Cloud Data Architect

Cloud Data Architect

Zen3 Infosolutions private limited
Bengaluru / Bangalore
10 - 15 Years
Not Specified

Job Description


Job Description
Technical Responsibilities:

  • Big data Engineer with 10 to 15 years of IT experience including 5 to 7 years in Big Data and Analytics field, developing E2E Data pipelines to perform batch and Real - Time/Stream analytics on structured and unstructured data on Azure.
  • Expertise in designing scalable Big Data solutions, data warehouse models on large-scale distributed data, performing wide range of analytics on Events Ingestion, Storage and processing on Azure.
  • Expertise in building solutions using Cosmos DB, Azure Data Lake, Azure Storage, Azure Databricks (Spark and Spark Streaming)
  • Experience in Big Data Analytics and design in Hadoop ecosystem using Spark/Spark Streaming, Kafka.
  • Solid understanding of data processing patterns, distributed computing and in building applications for real-time and batch analytics.
  • Strong programming skills in design and implementation using Python, Scala and PySpark
  • Hands on Data Ingress, Egress, Processing using Kafka, Azure Data Factory, Azure data Lake, Azure Databricks (Spark / Streaming).
  • Good knowledge on NoSQL Data bases such as HBase, Cassandra, MongoDB, Redis and using SPARK streaming for real time stream processing of data into the cluster.
  • Experience with multiple Hadoop file formats like Avro, Parquet, ORC, and JSON etc.
  • Developing, constructing, testing and maintaining architectures for data lakes, data pipeline, data warehouses and large-scale data processing systems on Azure.
  • Leading data platform team members or equivalent through technical design, and implementation of solutions.

  • Required Candidate profile
    Requirements (Qualifications):
  • BE/BTech/MCA with a sound industry experience of 10 to 15 years

  • Mandatory skills:
  • Spark, Scala, PySpark, Python, Java
  • Hands-on Azure experience - Azure Data Factory, Kafka, HBase, Cassandra, Mongo dB, Azure Databricks Azure Cosmos DB
  • Azure Kubernetes Service,
  • Azure Data Lake Storage, Azure DataBricks
    Salary: Not Disclosed by Recruiter
    Industry: /
    Functional Area:
    Employment Type: Full Time, Permanent

    Zen3 Info Solutions Private Limited. Zen3 is an AI first, data driven, product and cloud native company with over 1500+ employees. Offices in India, London, Seattle, Canada and Dubai. A leading software solution group with on-demand expertise in: Software Product Engineering, Testing, Support & Maintenance, Application Development, Machine learning, AI & Analytics. In India, we have large offshore delivery centres in Hyderabad as well as we have offices in Bangalore and Vizag. Our Managed Services group works with Fortune 500 companies to recruit and manage some of the best talent to deliver on mission-critical projects for our clients. To learn more about Zen3 visit us at www.zen3.com.

    People Also Considered

    Career Advice to Find Better