Send me more jobs like this

Big Data Engineer

Keywords / Skills : Hadoop, Amazon EMR, Pig, Hive, Spark, Red-shift, SQL Programming, Big Data Engineer

4 - 8 years
Posted: 2019-10-01

Industry
IT/Computers - Software
Function
IT
Role
Software Engineer/ Programmer
Posted On
1st Oct 2019
Job Description
Job Description:
Responsibilities:

• Play a key developer role and be part of building Data Infrastructure components such as Tracking, Messaging Queues, and Real Time Streaming & Batch Data Pipelines.

• Deliver high quality data engineering components/services that are robust and scalable.

• Collaborate and communicate effectively with other team members to deliver strong results.

• Methodical approach to areas such as Data Modelling, Data Quality.

• Guide others in the team on architecture, design and quality engineering practices.

• Leverage these foundational Data Infrastructure.

• Integrate machine learning & statistical models into real time services and power the BI & Visualisation layers.

• Work closely with data scientists to assist on feature engineering, model training frameworks, and model deployments at scale.

• Integrate data from many sources, build ETL and data-flow pipelines, and support all parts of the data platform.

Requirements:

• Must have 4+ years of experience with Big Data technologies such as Hadoop, Amazon EMR, Pig, Hive, Spark, and Red-shift.

• Must have experience in building data platform, designing and building data model.

• Must have expert level SQL programming knowledge and experience.

• Expertise with at least one programming language - Python, Java or Scala.

• Experience in Web Services, API integration, Data exchanges with third parties is preferred.

• Data Analysis skill.

• Energetic, enthusiastic, detail-oriented, and passionate about producing high-quality analytics deliverables.

• Knowledge of basic statistical analysis and machine learning.

• MS/BS in Computer Science, MIS, Mathematics, Physics or other quantitative field or relevant work experience

About Company

Fanatics E-Commerce India LLP
Similar Jobs
View All Similar Jobs
Walkin for you