Software Development Manager - EMR, AWS EMR

Software Development Manager - EMR, AWS EMR

8-11 years
Not Specified

Job Description


Job summary
Do you enjoy building large-scale distributed systems Do you want to influence how the world interacts with and analyses large data sets across a number of industries and use cases Do you want to build and lead teams that are solving some of the most interesting challenges in the big data and distributed system domain AWS EMR (Elastic Map Reduce) in Bangalore is looking for leaders to build and lead teams working on our heavily used AWS Service.

We are doing innovative work on the open source data processing frameworks with the goal of making the EMR the best place to run big data workloads. We are looking for a passionate technology leader to join a world-class engineering team to take our platform to the next level.

Key job responsibilities
You will be responsible for directly interacting with customers, working closely with product management (PM) leads, managing implementation timelines, and shipping product functionality. You will also be heavily involved in the operational aspects of the software. This will include building and enhancing open source software, tracking and participating in broad big data industry trends, tackling security issues, and roadmap planning for big data frameworks in a way that satisfies the demands of the savviest customers in the business. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group.

A day in the life
What you'll be doing:
. Technical Leadership: - Drive high-level architectural decisions and designs based on business priorities and requirements.
. Ensure high technical standards by instituting processes (architecture reviews, testing) and culture (engineering excellence).
. Manage technical debt and long term technical architecture decisions to balance product roadmap.
People Management:
. Recruit a world-class, high -performance software engineering team. Hire/Coach top-notch staff+ level talent.
. Support engineers in their career development by providing clear feedback and develop engineering leaders.
Project Management:
. Work closely with engineering and product leadership and customers to build a long-term roadmap and prioritize initiatives to deliver the greatest value to the business..
. Coordinate execution and collaborate across teams to unblock cross-cutting projects.
. Effectively handle multiple initiatives and deliver releases on schedule with highest quality standards.

About the team
Amazon EMR is the industry leading cloud-native big data platform for processing vast amounts of data easily, quickly, and cost-effectively. Using open source frameworks such as Apache Spark, Apache Hive, Apache HBase, Apache Flink, and Presto, coupled with the dynamic scalability of Amazon EC2 and scalable storage of Amazon S3, EMR gives analytical teams the engines and elasticity to run Petabyte-scale analysis for a fraction of the cost of traditional on-premises clusters. We recently launched two new deployment options for EMR - EMR on EKS and EMR Serverless, as part of our ongoing efforts to further improve the overall experience of running big data workloads on the cloud.

. AWS EMR Serverless launch at re:Invent 2021:

. Bachelors degree in Computer Science or Engineering required, Masters/Ph.D. a plus
. Minimum 8 years of work experience
. Experience in leading technical teams working on distributed systems and databases, including coaching & mentoring individuals to grow in their career.
. Strong problem-solving skills are a must to earn the team's respect and to lead from the front. Expected to be capable of sitting down with engineers to constructively review designs and debug live production issues.
. Capable of handling ambiguous business requirements with excellent prioritization, time management abilities and focus on execution.
. Strong verbal/written communication skills.

. Masters or PhD in Computer Science or Engineering with a minimum of 8 years of relevant software development experience
. Hands-on experience in big data processing and infrastructure frameworks like Hadoop, Hive, Spark, Presto, Tez, HBase, HUDI, Iceberg, Docker, Kubernetes is a big plus
. Experience in distributed systems design, implementation and testing
. Experience in database internals such as query optimization or query execution
. Experience with AWS or any other Cloud Platform is a plus.
. Experience in delivering one or more version one products, ideally in a startup setting.

About Amazon strives to be Earth's most customer-centric company where people can find and discover virtually anything they want to buy online. By giving customers more of what they want - low prices, vast selection, and convenience - continues to grow and evolve as a world-class e-commerce platform. Amazon's evolution from Web site to e-commerce partner to development platform is driven by the spirit of innovation that is part of the company's DNA. The world's brightest technology minds come to to research and develop technology that improves the lives of shoppers and sellers around the world.

Job Source :

Similar Jobs

Career Advice to Find Better