Tech Lead

Tech Lead

Virtusa Software Services Private Limited
Hyderabad / Secunderabad
5-7 years
Not Specified

Job Description


Job Description :
5-7 yearsý Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks and Apache Sparký Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).ý Microsoft Azure Big Data Architecture certification (preferred)ý Delivering and presenting proofs of concept to of key technology components to project stakeholders.ý Developing scalable and re-usable frameworks for ingesting of data setsý Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all timesý Working with event based / streaming technologies to ingest and process dataý Working with other members of the project team to support delivery of additional project components (API interfaces, Search)ý Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.ý Strong knowledge of Data Management principlesý Experience using geospatial frameworks on Apache Spark and associated design and development patternsý Hands on experience designing and delivering solutions using the Azure Data Analytics platform including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics

Job Details

Employment Types:

Industry:

Function:

IT

Skills:

Similar Jobs

Career Advice to Find Better