Senior Data Engineer/ Technical Lead

Senior Data Engineer/ Technical Lead

Disys India Private Limited
US
8-11 years
Not Specified

Job Description


Job Description :
Position Summary & Key Areas of Responsibility:
Positon entails the design of highly scalable data pipelines using new Spark, Kafka, Storm and BigQuery to induct data from various systems to provide efficient reporting and analytics capability. Translate complex business requirements into scalable technical solutions, and design dashboards or visualization using BI tools to perform data analysis and to support the business. Must be able to interface with multiple teams within an organization.
Basic Qualification:
  • 8+ years experience in designing and developing ETL data pipelines.
  • 8+ years experience in Java and/or Python
  • Strong understanding of data modeling, data structures and algorithms
  • 1+ year of experience with Google Cloud Platform (Pub Sub, Dataflow, BigQuery, BigTable)
  • Experience with all aspects of software development life cycle (source control, continuous integration, deployments, etc.)

Preferred Qualifications:
  • Any experience developing Big Data/Hadoop applications using java, Spark, Hive, Oozie, Kafka, and Map Reduce is a huge plus
  • Experience with or advance courses on data science and machine learning is ideal
  • Any experience with BI tools is a plus

Similar Jobs

People Also Considered

Data Not Available

Career Advice to Find Better

Simple body text this will replace with orginal content