Send me more jobs like this

Big Data Engineer

Keywords / Skills : Big Data, Hadoop, Data Analyst, NoSQL, Spark, Hive, ETL

8 - 10 years
Posted: 2019-11-27

IT/Computers - Software
Software Engineer/ Programmer
Posted On
27th Nov 2019
Job Description
Hi ,

Greetings from Magna Infotech!!!

Hiring for the below requirement.

Position: Data Engineer (Big Data Engineer)

Exp: 8+ yrs

Location: Gurgaon

Mode: C2H

Job Description
  • 5+ years Big-Data stack developer
  • Solid Big-Data Technologies hands on working experience
  • Strong hands-on experience of programming language like Python, Scala, Spark
  • Good command and working experience on Hadoop/MapReduce, HDFS, Hive, No-Sql Databases
  • Hands on working experience in analyzing source system data and data flows, working with structured and unstructured data
  • Hands on working experience of data processing at scale with event driven systems, message queues (Kafka/Flink/Spark Streaming)
  • Hands on working experience on any of the data engineering/analytics platform (Hortonworks/Cloudera/MapR/AWS), AWS preferred
  • Certification on Hortonworks/Cloudera or AWS would be a big plus
  • Experience building data pipelines for structured/unstructured, real-time/batch, events/synchronous/asynchronous using MQ, Kafka, Steam processing
  • Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
  • Hands on working Experience with AWS Services like EMR, Kinesis, S3, Cloudformation, Glue, API Gateway, Lake Foundation
  • Hands on working Experience with AWS Athena
  • Data Warehouse experience with Apache Kylin, Apache Nifi, Apache Airflow, and Kylo
  • Strong technical, analytical, and problem-solving skills
  • Strong preference for someone with Amazon Web Services (AWS) services
  • Strengthen the Data engineering team with Big Data solutions running on AWS
  • Experience in data warehouse design and best practices
  • Strong organizational skills, with the ability to work autonomously as well as in a team based environment
  • Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)
  • Feature Engineering/Data Processing to be used for Model development
  • Exposure to various ETL and Business Intelligence tools
  • Must be very strong in writing SQL queries

Primary Skills
  • Eight+ years of experience in delivering technology solutions
  • Five+ years of experience in leading design of Big Data solutions
  • Five+ years of experience with Hadoop, including HDFS, Spark, Hive, Athena
  • Five+ years of experience with NoSQL such as MongoDB, Elastic Search
  • Five+ years of working experience with Unix systems
  • Expertise with data lakes, data warehouse, data marts
  • Experience with Data Governance, Master Data Management 
  • Three years of experience designing and implementing Streaming and Batch solutions on Hadoop 
  • Ability to translate product objectives into an execution and delivery plan with milestones and resource needs 
  • Strong communication and presentation skills 
  • Experience with git and other source control systems 
  • Solid grounding in Agile methodologies 

Secondary Skills
  • Certification in Hadoop/Big Data – Hortonworks/Cloudera/AWS
  • Strong delivery background across the delivery of high-value, business-facing technical projects in major organizations
  • Strong client relationship management skills to identify and close suitable business development opportunities
  • Exceptional interpersonal skills - including presentation skills
  • Experience of managing client delivery teams, ideally coming from a Data Engineering / Data Science environment

  • 8+ years of experience in Data Engineering, Big-Data solutioning, cloud computing role and a passion for problem solving through data engineering.

  • Bachelors/Masters in Computer Science or related areas.

Below Details are Mandatory:

Full Name:

Alternate Number (Mobile or Land Line):

Current CTC:

Expected CTC:

Total work experience:

Relevant work experience:

Present Company:

Official mail id of present co. (MUST) not payroll co.:

Current location:

Notice period (Immediate to 15 days):

Reason for looking for job:

Any job offer you hold:

Highest Degree with Year of Passing:

Any Gaps in Education:

Date Of Birth:

Ready to work with Magna info Tech Payroll (C2h > 1 yr) position:

Willing to relocate:

Variable Pay:

Fixed Pay:


Highest qualification:

About Company
Similar Jobs
View All Similar Jobs
Walkin for you