Full Job Description
From 2 to 7 year(s) of experience
₹ Not Disclosed by Recruiter
Gurgaon/Gurugram, Bangalore/Bengaluru (WFH during Covid)
Job Description
.JOB DESCRIPTION:–
Job Profile – Data Engineer
Job Location – Gurgaon / Bangalor
Exp- Min 3yrs Max – 8yrs
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the design of data solutions using Hadoop based technologies along with Python & Spark programming.
Responsibilities:
Responsible to Ingest data from files, streams and databases. Process the data with Hive, Hadoop, Spark.
Develop programs in Scala, and Python as part of data cleaning and processing
Ability to solve ongoing issues with operating the cluster and optimize for efficiency
Understanding of prevalent cloud ecosystems and its associated services AWS, Azure, Google Cloud, IBM Cloud. Expertise in at least one.
Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
Experience with integration of data from multiple data sources
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Knowledge of various ETL techniques and frameworks, such as Flume
Experience with various messaging systems, such as Kafka or RabbitMQ
Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Functional Skills:
Selecting, integrating & supporting any Big Data tools and frameworks required to provide requested capabilities
Enhancing/optimizing & maintaining ETL process(s) across on-premise and cloud architectures
Monitoring performance and advising any necessary infrastructure changes
Communicating with confidence and ease
You will be a clear and confident communicator, able to deliver messages in a concise manner with strong and effective written and verbal communication
Desired Candidate Profile
Bachelor’s / Master’s degree in computer science engineering/technology
At least 2-7 years within the relevant domain of Data Engineering across industries and work experience providing analytics solutions in a commercial setting
Interested candidate can share their updated resume at [email protected]
Role:Data warehouse Developer / Engineer
Salary: Not Disclosed by Recruiter
Industry:IT Services & Consulting
Functional Area:Engineering – Software
Role Category:DBA / Data warehousing
Employment Type:Full Time, Permanent
Key Skills
PysparkAzureSpark
AirflowSoftware DevelopmentDockerShell ScriptingCIHadoopSCALASQL QueriesPython
Skills highlighted with ‘‘ are preferred keyskills
Education
UG:B.Tech/B.E. in Any Specialization
Company Profile
Mount Talent Consulting Private Limited
Gurgaon
Bangalore
Company Info
X
Contact Company:Mount Talent Consulting Private Limited