Full Job DescriptionJob Information
Industry
Other
Work Experience
3 years +
Salary
₹10L – ₹12L per annum
Remote Job
About us
We are a research lab working on the intersection use data, tech, design and social science to strengthen the course of civic engagements in India.
We work to harness the potential of open knowledge movements and better enable citizens to engage in matters of public reform.
We aim to grow data and tech literacy of governments, non-profits, think-tanks, media houses, universities, and more to enable data-driven decision making at scale.
Job Description
This is a remote position.
What We are looking for
A data engineer to support our various interventions through open data platforms and open-source tools, focusing on building robust data pipelines including data mining, data cleaning, wrangling and munging. We are looking for people who are strongly aligned with our values and have an innate sense of problem-solving, automating processes and adapt well to dynamic environments. They will work alongside data strategists, public policy researchers and other stakeholders to develop automated ETL (Extract, Transform and Load) data pipelines and know how to model, store and manage bulk datasets. This will help us co-create comprehensive data analytics tools and dashboards for our diverse stakeholders.
Our Commitment to diversity
We are committed to inclusive hiring and strongly encourage applicants from diverse and underrepresented gender identities and/or socio-cultural backgrounds to apply for this role.
Why work with us
We help you not just define your ‘impact’ but also work with you towards finding a path to learn, realise and quantify its effect on our ecosystem.
Our past work and experience of working with communities and civic tech, in general, has connected us as a branch to a network of civil society actors and organisations. You’ll have the opportunity to leverage this network, to work on pressing, yet thought-provoking issues, in sectors like Judiciary, Public Finance, Economics, Public Education and Urban Development.
We also feel that this is our biggest strength, what we can offer you are not a feature to work on but a passage to an infinitely long road of people, problems, ideas and opportunities that may help you find your place amidst the chaos.
How we work
At CivicDataLab, people work from their individual locations, being proactive in communication is the key. We use open-source tools and agile methodologies in organising our work. We meet once every quarter in some part of the country to reconvene, learn from each other and help the organisation grow.
Requirements
What You’ll Be Doing
Lead development of scalable data pipelines involving data mining, munging, storage and indexing.
Deploy and manage various SQL operations on data to slice it according to the analytics requirements..
Work on developing comprehensive data models and pipeline architecture, implementation and orchestration.
Build and monitor robust data APIs powering various data analytics tools and dashboards.
Develop robust log management and monitoring frameworks.
Bring new emerging technologies at CivicDataLab.
Publish and contribute our data pipelines as open and reusable resources.
Engage regularly with our diverse stakeholders and open source communities to co-create data and technology solutions.
Skills you should bring
Thorough knowledge of Python and SQL
Should have a thorough understanding of handling and manipulating data and querying mechanisms (SQL and alike) as well as data cleaning and manipulation.
Should have sound knowledge of best practices for indexing and querying, normalizing, working with distributed databases, caching methodologies and more.
Ability to actively engage with multiple stakeholders (like open-source communities, governments, civil society organizations, researchers, media and more) to plan and execute development sprints.
Good to have
Knowledge of open-source data scraping frameworks and tools such as Selenium and Scrapy.
Knowledge of Apache Airflow to automate processes.
Experience working with data pipelines that help standardisation of data.
Hands-on experience with CKAN
Prior experience in actively working and contributing to FOSS (Free and Open Source Software) communities.
Familiarity in working with Agile methodologies and Scrum processes.
Experience with scalable infrastructure practices such as microservice architecture, infrastructure as code, distributed systems, scaling methods, load balancing and more.
Engaging with government or social sector research-based organizations on past projects will be a big plus.
A good sense of humour.
Prior experience of working remotely.
Familiarity with maintaining large open-source projects.
Benefits
Perks of Working with Us
Home Office and Wellness Allowance
Since you work remotely, we want to make sure your home office is comfortable. You can use this perk to set up a home office. This includes internet services, other tech infrastructure, etc. If you’re interested in taking classes that enhance your overall physical or mental well-being you have an INR 60,000 annual stipend to do so. For some people that might mean a monthly massage. Some take photography lessons or learn a musical instrument or buy a gym membership. It’s up to you; the point is to learn something that you feel enriches you as a person.
Professional growth and development Allowance
At CivicDataLab, we encourage everyone to take up things that help one grow professionally and you get an annual kitty of INR 60,000 to do so. This includes attending or speaking at conferences and workshops, taking courses, acquiring hardware or software licences or even joining summer schools. We feel that learning a skill should never be a hurdle to solve important problems for the community.
Coworking Space Stipend
CivicDataLab encourages the usage of coworking spaces. Please make sure you’re using a true coworking space that’s meant solely for working, not a club or social space.