Big Data Engineer/ETL

Big Data Engineer/ETL

Rakuten India Enterprises Private Limited
3-5 years
Not Specified

Job Description


Job Description :

- Develop, enhance and maintain data pipeline applications and data models on a rotational on-call basis in
a 24x7x365 environment.
- Trouble-shoot the causes of adhoc daily production failures and provide effective and documented
solutions.
- Continuous improvement initiatives in data ingestion performance, ingestion models, data integrity and
data availability.
- Work with the business in analyzing and documenting new functionality requests and managing the
implementation of those within an Agile ownership model.
Mandatory Qualifications:
- B.S. in Computer Science or in related fields.
- More than 3 years experience with BI data driven development.
- Expert SQL capability in querying Big Data/ large data sets (Teradata, Hadoop, etc.) to extract BIinsights.
- Programming languages such as Python/Scala/PLSQL/Java.
- Development and operation of data pipeline leveraging big data technologies such as Spark, Map
Reduce, Hive, Kafka, Sqoop, NoSQL Databases as well as traditional DB and file based data integration
solutions.
- Database development (eg TeraData, Oracle, MySQL, SQLServer, DB2..)
- Shell-scripting languages such as Bash.
- Formal analysis and documentation of BI solutions.
- Distributed version control system such as Git.
- Initiative and the ability to work independently and in a team. We are an Agile environment.
Desired Qualifications:
- Application development using workflow engines such as Airflow, Oozie, Rundeck.
- BI reporting tools, including administration, modeling, and report/dashboard development.
- BI Modelling of data marts using ER hybrid, Kimball, Data Vault methodologies.
- Experience in Google Big Query.
- Experience in AtScale and Presto.
- Operational experience in developing and supporting high availability applications / systems.
- Capability to self-manage and also manage small projects.

Job Details

Employment Types:

Industry:

Function:

IT

Similar Jobs

People Also Considered

Data Not Available

Career Advice to Find Better

Simple body text this will replace with orginal content