• 10+ years of experience in IT with7+ years in Big Data Ecosystem • Exp in development on Hadoop technologies like Python, Pyspark, HDFS, Hive, Pig, Flume, Sqoop, Zookeeper, Spark, MapReduce2, YARN, HBase, Kafka, and Storm.
• 1-2 Years’ Experience with functional programming • Experience with functional programming using Scala with Spark framework. • Strong understanding of Object-oriented programming, data structures and algorithms • Good experience in any of the cloud
Develop and deploy batch and streaming data pipelines in cloud ecosystem.Automation of manual processes and performance tuning of existing pipelines.Data loading and processing from multiple source locations into Data lake, Datamart
We are looking to hire a talented Big Data Engineer to develop and manage our company’s Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes.
Experience in BigData Development using Databricks, Spark and Scala Experience in ETL Development using Apache Spark & Scala using DataBricks Knowledge on JAVA and Scala Programming languages. knowledge on relational Database, Preferably MySql/MSSQL
'• Utilize statistical and analytical techniques to quantify KPI and metrics using systems of data • Understand complex data system by working closely with engineering and product teams • Perform data cleaning, integration, validation andanalysis
Strong platform administration skills with at least 2 years of experience in Hadoop administration. • Experience with DevOps methodologies and tools for automating and monitoring • Hands on experience in big data technologies including Scala or Spa