Full Job Description
In this role, you will design and develop robust and scalable analytics processing applications. You will implement data integration pipelines that operate with maximum throughput and minimum latency. You’ll bring your knowledge of solving the big data analytics use cases and frameworks for managing high volume data processing and analytics. You will be passionate about exploring the use of innovative technologies and techniques and evaluating them for suitability in our environment.
Ideally you will be responsible for:
understanding the data patterns and solving the analytics use case
converting the solution to Spark and other big data tools based implementation
building data pipelines and ETL using heterogeneous sources to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc
tuning performance optimization of Spark data pipelines
managing the data pipelines and enhance to solve technical issues
automation of day to day tasks
providing technical support and guidance to business users.
We anticipate to excel in this role, you will ideally bring:
3+ years of experience working in Hadoop Ecosystem and big data technologies with 5-8 years of software development experience
reading and writing Spark transformation jobs using Java, Scala (Preferably in Java)
experience with Hadoop, Spark
good knowledge of the core AWS services (S3, IAM, EC2, ELB, CloudFormation)
good understanding of Linux and networking concepts
good understanding of data architecture principles, including data access patterns and data modelling
tertiary degree in IT or similar subject.
About the Corporate Operations Group
The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Market Operations, Human Resources, Business Services, Business Improvement & Strategy, and the Macquarie Group Foundation.
Our commitment to Diversity and Inclusion
The diversity of our people is one of our greatest strengths, and in combination with our inclusive environment, it enables us to deliver innovative and sustainable outcomes for our people, clients, shareholders and communities. From day one, you’ll be encouraged to be yourself and supported to perform at your best. If our purpose of ‘empowering people to innovate and invest for a better future’ is as inspiring to you as it is to us, please apply. With the right technology, support and resources, our people can work in a range of flexible ways.
We are committed to providing a working environment that embraces and values diversity and inclusion. We encourage candidates to speak with a member of our recruitment team if you require adjustments to our recruitment process to support you, and the type of working arrangements that would help you thrive.
We recognize that flexibility comes in a variety of forms. Talk to us about what flexibility you need.
About Macquarie
A career at Macquarie means you’ll have the opportunity to develop and utilise new skills, explore interesting fields and do challenging work that will impact the lives of people around the world—whether it’s accelerating the green energy transition, helping sustain global food supplies, financing social housing projects or investing in essential infrastructure. At Macquarie, we’re empowering people to innovate and invest for a better future.
Our size and international presence means your work can take you anywhere—across business groups, disciplines, sectors and borders. With 16,000+ employees and offices in 32 markets around the world, we’re a truly global organisation.
You’ll be supported by a diverse team where the unique perspectives, ideas and experiences that all of our people bring are valued. You’ll be empowered to address unmet needs in our communities whilst advising and investing alongside our clients and partners. Working with us, you’ll have the opportunity to make a difference.
Macquarie is a global financial group providing clients with asset management, retail and business banking, wealth management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory, capital raising and principal investment.
Job no: COG-956613
Work type: Permanent – Full time
Location: Gurugram
Category: Mid-senior, Corporate Banking
Group: Corporate Operations Group
Division: Technology
Recruiter: Sanchi Gupta
Opening Date: 25/10/2021