Send me more jobs like this

BIG Data Developer

Keywords / Skills : BIG Data , Hadoop Map Reduce, Pyspark, HIVE, SQOOP , Linux scripting, Kafka, Cloud Computing , AWS, EMR, Data Lakes , AZURE, Python, Scala, Shell Scripts, JSON, SQL, data processing pipeline, DB2, Oracle, Teradata.

5 - 7 years
Posted: 2019-06-24

Industry
IT/Computers - Software
Function
IT
Role
Software Engineer/ Programmer
Posted On
24th Jun 2019
Job Description
Title: BIG Data Developer
Work Location – Pune (Hinjewadi)
Total Exp. – 5 Yrs to 7 Yrs

Job Responsibilities: AWS /.Azure OR knows PySpark. 
  • Hands on experience in developing routines using Hadoop Map Reduce, Pyspark, HIVE, SQOOP and Linux scripting.
  • Expertise in: Hadoop, Hive, Spark (Pyspark), Spark Streaming with Kafka, Sqoop.
  • Demonstrated knowledge on Cloud Computing Fundamentals either on AWS(EC2, EMR, Data Lakes and Analytics on AWS) or Azure(HDInsight, Data Factory ..)
  • Create PySpark Jobs for data transformation and aggregation, Pyspark query tuning and performance optimization.
  • Demonstrated knowledge and use of the following languages: Python, Scala, Shell Scripts, JSON, SQL.
  • Demonstrated performance in all areas of the SDLC, specifically related to ETL solutions.
  • Design data processing pipelines.
  • Experience in implementing production data pipelines and creation of repeatable ingestion patterns.
  • Experience with various databases and platforms, including but not limited to: DB2, Oracle, Teradata.



About Company

Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences, enabling Enterprises, Associates and the Society to Rise™. We are a USD 4.7 billion company with 115,200+ professionals across 90 countries, helping over 903 global customers including Fortune 500 companies. Our convergent, digital, design experiences, innovation platforms and reusable assets connect across a number of technologies to deliver tangible business value and experiences to our stakeholders. Tech Mahindra is amongst the Fab 50 companies in Asia (Forbes 2016 list).

We are part of the USD 19 billion Mahindra Group that employs more than 200,000 people in over 100 countries. The Group operates in the key industries that drive economic growth, enjoying a leadership position in tractors, utility vehicles, after-market, information technology and vacation ownership
Similar Jobs
View All Similar Jobs
Walkin for you