Big Data Engineer/ETL

Big Data Engineer/ETL

Rakuten India Enterprises Private Limited
3-5 years
Not Specified

Job Description

Job Description :

- Develop, enhance and maintain data pipeline applications and data models on a rotational on-call basis in
a 24x7x365 environment.
- Trouble-shoot the causes of adhoc daily production failures and provide effective and documented
- Continuous improvement initiatives in data ingestion performance, ingestion models, data integrity and
data availability.
- Work with the business in analyzing and documenting new functionality requests and managing the
implementation of those within an Agile ownership model.
Mandatory Qualifications:
- B.S. in Computer Science or in related fields.
- More than 3 years experience with BI data driven development.
- Expert SQL capability in querying Big Data/ large data sets (Teradata, Hadoop, etc.) to extract BIinsights.
- Programming languages such as Python/Scala/PLSQL/Java.
- Development and operation of data pipeline leveraging big data technologies such as Spark, Map
Reduce, Hive, Kafka, Sqoop, NoSQL Databases as well as traditional DB and file based data integration
- Database development (eg TeraData, Oracle, MySQL, SQLServer, DB2..)
- Shell-scripting languages such as Bash.
- Formal analysis and documentation of BI solutions.
- Distributed version control system such as Git.
- Initiative and the ability to work independently and in a team. We are an Agile environment.
Desired Qualifications:
- Application development using workflow engines such as Airflow, Oozie, Rundeck.
- BI reporting tools, including administration, modeling, and report/dashboard development.
- BI Modelling of data marts using ER hybrid, Kimball, Data Vault methodologies.
- Experience in Google Big Query.
- Experience in AtScale and Presto.
- Operational experience in developing and supporting high availability applications / systems.
- Capability to self-manage and also manage small projects.

Job Details

Employment Types:




Similar Jobs

People Also Considered

Data Not Available

Career Advice to Find Better

Simple body text this will replace with orginal content