Microsoft Hiring for Data Engineer II at Bengaluru, Karnataka Full Time

If you are looking for the opportunity to build highly scalable services and rich data insights on Azure’s largest distributed platforms, then the Azure Data Governance team is the right place for you to come and take on your next challenge.

Our team owns a data pipeline that processes tens of terabytes of data per day and stores multiple petabytes of data. Our challenge is to do this efficiently, reliably, and with low latency. Our customers need to understand the data that they own and keep that data compliant with GDPR and other privacy regulations. Our job is to provide the infrastructure to do this, to produce meaningful insights about their level of compliance, and to create understandable actions that they can take to improve.

Privacy is one of the top challenges for our industry today. We are not satisfied with the status quo, and we are continually improving. Microsoft also keeps innovating, keeps growing its need for data governance, and so we will keep improving the capabilities of our system to meet the needs of all our partners.

Responsibilities

We are looking for engineers who have a track record of success, who deliver results, and who (preferably) have a background in large scale data processing systems. Everyone on the team owns significant areas of the system, directly contributes to the vision, direction, and implementation of new features, and are key to the success of our products. You will collaborate on your designs across our partner engineering teams and work closely with our PMs to design, build, and maintain a growing set of features that will serve the needs of our customers.

Qualifications

Basic Qualifications:
Bachelor’s / Master’s degree in Computer Science or Engineering or Mathematics or IT technical discipline

6+ years of programming experience in Analytics / Business Intelligence and Data Engineering

Experience in DW / DI tool like ADF, PowerCenter.

Experience in building reports / dashboards using Power BI

Experience in writing complex SQLs.

Experience in working with Data Lakes

Experience in cloud eco system like Azure / AWS

Basic programming experience using .NET, Java python is needed

Experience in Spark, Pyspark is added advantage

Preferred Qualifications:
Experience building and shipping production grade software or services.

Experience creating and shipping V1 products using modern development practices.

Experience using agile methodologies or test-driven development (TDD).

Great curiosity and willingness to question.

High enthusiasm, integrity, ingenuity, results-orientation, self-motivation, and resourcefulness in a fast-paced competitive environment.

Love the next problem, the next experiment, the next partner.

Have a deep desire to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes.

Get excited by the challenge of hard technical problems.

Solve problems by always leading with deep passion and empathy for customers.

Experience with Open-Source Big Data Stack such as Hadoop, HIVE, SPARK, HBASE etc is added advantage.

Understanding of data structures, algorithms, and distributed systems

AZDAT #ENGGJOBS

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.