Posted On: a month agoTotal Applications : 8Job Id: 24420624
You will be collaberating with Platform teams and Solution Engineering teams
Define, Improve Data Governance Policiies
Create best practices around Data Security
Bachelor's degree in Computer Science, Engineering, Applied Mathematics or related field
8 – 15 years of data engineering experience
Minimum 3 Years of Java and Spring boot framework experience
Developed and deployed complex big data ingestion jobs bringing prototypes to production on Hadoop/NoSQL/MPP platforms
Minimum 4 years of hands on experience with MapReduce, Spark, Kafka etc. and automation of data flow using NiFi and Airflow/Oozie.
Minimum 3 years of experience in developing and building applications to process very large amounts of data (structured and unstructured), including streaming real-time data (Spark, R/Python, Scala, Kafka, Spark streaming or other such tools).
Minimum 2 years of experience in working with at least one NoSQL system (HBase, Cassandra, MongoDB)
Experience in Optimizing Solutions to scale on big data enviornments, tune for performance.
Must have experience establishing Data governance rules, data security standards
Writing Higly performing code
Demonstrated knowledge or aptitude of statistical, data mining or visualization tools
Demonstrated knowledge of data management
Demonstrated analytical skills, critical thinking and thought leadership
Experience in writing complex SQL statements
Experience in working with cloud-based deployments. Understanding of container and container orchestration (Swarm or Kubernetes)
Hands on experience with MapR or similar Hadoop distribution
Good understanding of branching, build, deployment, CI/CD methodologies such as Octopus and Bamboo
Experience working with in Agile Methodologies and Scrum Knowledge of software best practices, like Test-Driven Development (TDD)
Effective communication skills and succinct articulation