Data Engineer Lead

Data Engineer Lead

Cerentral Consultants Private Limited
10-20 years
Not Specified

Job Description


Roles and Responsibilities
The Position (Key Responsibilities):
You will work with business leaders, their teams, and their various stakeholders to help discover, deliver, monitor and enhance various business goals and initiatives. This is done by leveraging AWS cloud based data analytics platform. The ideal candidate is a natural self-starter who is comfortable working within a cross functional environment, supporting multiple stakeholders and initiatives. You will have a true hands-on approach, strong analytical skills, including the ability to gain true insights from data, and be an effective communicator. Business acumen is a must have and will be most required for this position.
Other responsibilities include
Work with various stakeholders of Insight & Data Services throughout the organization to identify opportunities for leveraging company data to drive business solutions.
Responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
Experience in data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Manage and execute entire projects from start to finish including project management, data gathering and manipulation, estimation, synthesis and modeling, problem solving, and communication of insights and recommendations
Experience working in a fast-paced environment, comfortable navigating conflicting priorities and ambiguous problems
Coordinate with different functional teams to implement data models, architecture and monitor outcomes.
Evaluate and drive continuous improvements/ innovation in reporting/ advance analytics
  • Continuously focus on building competency in new/future technologies and solutions pertaining to data, reporting and analytics
  • Develop strong functional knowledge and business stakeholder relationship with every project

Background & Experience:
The ideal candidate:
10+ years of proven experience in data engineering for operational & managerial reporting/ analytics
3-4 years of advance & relevant experience in data engineering techniques (data querying, transformation, ingestion, cataloging, modelling & storage, etc.)
Experience querying databases and using statistical computer languages (Python, PySpark, Lambda function, Scala, SLQ, etc.) to manipulate data and draw insights from large data sets
Experience working with various source systems like SAP/ BW/ IoT/ Flat Files/ APIs integration using Theobald, AWS Kinesis, AWS Flat File Gateway, AWS Glue respectively
Experience working with multiple data ingestion patterns, (e.g. ETL, streaming, Change Data Capture (CDC), micro-batches, and self-service data preparation)
Familiarity with cloud-native approaches to data warehousing, including raw data storage, scalable data stores, elastic compute, and support for multiple marts. Data governance knowledge is plus
Experience working with AWS cloud services: AWS Glue, Lake Formation, S3, Redshift, EMR, EC2, Athena, is added advantage
Experience visualizing/presenting data for stakeholders using: PowerBI, Tableau, QuickSight
Familiarity with agile (e.g. scrum, Kanban) and DevOps practices
Certification on AWS cloud services / Big data technology is a big plus
Domain experience in finance/ human resource/ procurement/ manufacturing/ supply chain/ sales & marketing
Excellent interpersonal skills and the ability to successfully interact with stakeholders from senior management to junior staff
Proactively solves problems and seeks to own the resolution of issues throughout their lifecycle.
Takes critical feedback in stride, and adjusts approaches accordingly.
Digitally savvy, able to navigate easily in a virtual world
Is a team player and not afraid to challenge the status quo
Has excellent stakeholder management skills, can navigate matrix structures and foster collaborative working
MBA or Masters degree in Computer Science, Engineering, Finance, Math, Statistics or a related discipline

Technoscience was incorporated with one mission - Providing specialized manpower recruitment services. Our clientele includes global engineering companies, conglomerates and biotech companies. We deal with a variety of job roles from mid management to top level. The company focuses on niche hiring and technical recruitment.

Similar Jobs

People Also Considered

Career Advice to Find Better

Simple body text this will replace with orginal content