AWS Data Engineer

AWS Data Engineer

Talent HR Networks Private Limited
5-7 years
Not Specified

Job Description

Job Description :
Position- AWS Data Engineer
Exp-5-7 years
  • Design and build large scale enterprise data solutions and applications using one or more of AWS data and analytics services using EMR, Lambda, Glue, DynamoDB, RedShift, Kinesis.
  • Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
  • Must have of experience in design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
  • MUST have HANDS-ON experience on Hadoop tools/technologies like Spark (Strong in Spark), Map Reduce, Hive, HDFS.
  • HANDS-ON expertise and excellent understanding of big data toolset such as Sqoop, Spark-streaming, Kafka, NiFi.
  • Good working knowledge in NoSQL DB (Mongo, HBase, Casandra).
  • Implemented complex projects dealing with the considerable data (TB/ PB) and with high complexity in the production environment.
  • Hortonworks (HDPCA/HDPCD/HDPCD-Spark) or Cloudera certification is an added advantage.
  • Bachelor's degree or higher in a quantitative /technical field (e.g., Computer Science, Statistics, Engineering) and software development experience with proven hands-on experience in Big Data technologies.
  • Experience in developing/architecting environments in the Hadoop ecosystem using HDP and HDF.
  • Demonstrated strength in data modelling, ETL development, and Data.
  • Experience in designing and implementing an enterprise data lake.
  • Experience in Big Data Management and Big Data Governance.
  • Some experience with Kubernetes, Docker containers etc.
Required Skills-
Kinesis Data Stream, Apache Spark, AWS, Lambda, Sqoop, EMR-PySpark, Amazon S3, Glue, Redshift, Data warehousing

Similar Jobs

People Also Considered

Career Advice to Find Better