Hadoop Developer

Hadoop Developer

2COMS Consulting Private Limited
Hyderabad / Secunderabad
4 - 9 Years
600000 - 1400000 INR

Job Description


Responsible for real-time aggregation of large amounts of data from various sources that includes streaming and batch data into a data lake.
Define data integration flows (ETL, ELT, stream processing, events/event processors, etc.)
Work alongside development team to build data management platforms using Amazon Redshift, Amazon Elastic Map Reduce (EMR), Amazon Athena, AWS Glue, AWS Lake Formation, Data pipeline, Glue and other related services.
Designing, implementing and supporting a platform that can provide ad-hoc access to large datasets
Strong Experience with data bases, including relational and non-relational.
Strong Experience with AWS Big data processing tools
Strong experience with scripting / programming languages such as: JavaScript, Java/Scala, .NET, PHP, Python and Node.JS).
Good to have DevOps experience with CI/CD pipelines, Configuration Management tools, Scripting
Must have exposure to search tools implementations(Elastic Search stack or similar)
Nice to have Cloudera, Hadoop development and admin experience
Good understanding of Windows, Unix/Linux operating systems and networking.
Collaborate with developers and operations teams to build and deploy custom solutions in AWS. Roles and Responsibilities
Desired Candidate Profile
Perks and Benefits

For a progressive organisation

Similar Jobs

People Also Considered

Career Advice to Find Better