NielsenIQ Hiring for Data Engineer -Consumer Insights at Mumbai, Maharashtra Full Time

Full Job DescriptionJob Description

ABOUT THIS JOB

Think about the billions of purchases that consumers make every single day around the world. Imagine trying to make sense of the trillions of data points that represent these purchases. From a family doing online shopping for household essentials to a quick run to the supermarket, NielsenIQ is measuring the entire consumer path to purchase. NielsenIQ is a multinational company working with the world’s largest brands across the world to inform them on where and how their best customers are shopping. The challenge is that this is a moving target and a complex problem. The commerce landscape is shifting today from brick and mortar to online shopping – and only NielsenIQ has the span of data to make sense of what drives a consumer to make their purchases.

We are looking for experienced and passionate people to join our team.

KEY RESPONSIBILITIES

Extracting data from various data sources
Building data and the data pipeline architecture, as well as optimizing data flow across the platform
Data sources include: Social media (Text, image, network), Web scraping, Web analytics and search data, Mobile usage data, Sales and enterprise data, Spatial/Location, Survey data
Data type – structured, unstructured, multilingual, network
Storage and retrieval of data from data warehouses/ data lake and different kind of databases
Transformation and integration of data to make it consumable for processing and analysis
Management of metadata
Ensuring quality and validation for the entire data flow
Setup, installation and management of various software/ platforms used in the data architecture
Enable automation of the various components of data flow
Managing vendors on various components for enabling the data flow
Document and present findings and recommendations on methodology in a structured way to various stakeholder or partnering teams.
Work closely with the other teams to convert those POC into fully scalable products.
Active and effective collaboration with other project team members (Commercial, delivery and product)
Work in a multi-disciplinary environment with specialists in machine learning, engineering and design

A LITTLE BIT ABOUT YOU

So where do you fit here? In NielsenIQ, we process over 250 terabytes of data every single day, manage it in the latest cloud technology, and build best-in-class analytical tools to add transparency and efficiency to the consumer goods market at a scale that no other company is able to achieve. We’re looking for passionate, analytical, innovative Data Engineers who want to figure out how to measure things in a complex world. If you have a passion for building top-notch, scalable products we’re looking for you to join us.

QUALIFICATIONS

4-5 yrs experience as data engineer

Managed data from various types of data sources:
1. Social media (Text, image, network),
2.Web scraping,
Good understanding of SQL
Exposure to working with multiple database/ storage types – SQL, No-SQL, File based, Graphdb
Exposure to working with Data Warehousing/Big Data stack: Snowflake, Hadoop and MapReduce, Hive and PIG, Apache Spark, Kafka, Elastic search
Understanding of data pipeline and workflow management tools: Azkaban, Luigi, Airflow
Exposure to data preparation, management for analytics especially for ML/ AI related work
Exposure to working with cloud services: Azure, AWS – EC2, EMR, RDS, Redshift
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

WE OFFER:
Being part of a new growing team with the ability to design best practises, ways of working etc.

Possibility of working with professionals in the multicultural environment.

Practical experience in the application of advanced analytics.

Additional Information

About NielsenIQ

NielsenIQ is a global measurement and data analytics company that provides the most complete and trusted view available of consumers and markets worldwide. We provide consumer packaged goods manufacturers/fast-moving consumer goods and retailers with accurate, actionable information and insights and a complete picture of the complex and changing marketplace that companies need to innovate and grow. Our approach marries proprietary NielsenIQ data with other data sources to help clients around the world understand what’s happening now, what’s happening next, and how to best act on this knowledge. We like to be in the middle of the action. That’s why you can find us at work in over 90 countries, covering more than 90% of the world’s population. For more information, visit www.niq.com.

NielsenIQ is committed to hiring and retaining a diverse workforce. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class.