Junior Data Engineer
Citylitics, Canada
Job Description
About Citylitics
Citylitics delivers predictive intelligence on local utility amp; public infrastructure markets
What is Infrastructure? It is the roadways you rely on to safely get to Grandma's house, it's the potable water that comes out of your kitchen tap that you wash your family's food with and it's the energy that heats our homes and powers our digital lifestyles.
Every year, trillions of dollars are spent on all areas of infrastructure to maintain our quality life and move our economy forward. However, our infrastructure is no longer equipped to meet the needs of the future. We hear about infrastructure failures, whether bridge collapses, power blackouts, or water main breaks, every day in the news. Climate change and extreme weather events are disrupting the basic infrastructure we took for granted for years.
Citylitics is solving the hardest data problems in infrastructure while building the market amp; opportunity intelligence platform that enables a faster, more transparent, and more efficient infrastructure marketplace. We turn millions of unstructured documents into high value intelligence feeds and datasets that are available on an intuitive user experience. Our goal is to enable solution providers to connect with cities with relevant infrastructure needs in a faster and more digital way than historic market channels. As more companies adopt our platform, cities amp; utilities will be able to access solutions that deliver on the promise of moving towards a more resilient, sustainable, and equitable infrastructure future.
We are looking for a Junior Data Engineer with an ownership mindset who prides themselves on not only writing efficient code, but also in creating intuitive data flows with clear and easy to read documentation. As a Junior Data Engineer, you will play a crucial role in developing and maintaining our data pipelines, working primarily with Django and SQL. You will collaborate closely with cross-functional teams to ensure efficient data extraction, transformation, and loading (ETL) processes, enabling data accessibility and reliability for our organization.
- Design, develop, and maintain data pipelines using Django and SQL to support efficient ETL processes.
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Ensure data integrity, quality, and security throughout the ETL process.
- Assist in the optimization and performance tuning of database queries and processes.
- Support the integration of Airflow/Cloud Composer into existing data workflows.
- Contribute to the documentation of data pipelines, processes, and best practices.
- Stay updated with industry trends and best practices in data engineering and tools.
- Other duties as assigned
Technologies we use:
- Backend: Python, Django, Cloud SQL and Airflow/Cloud Composer as the main language, web framework, database and orchestration tool respectively
- Cloud Infrastructure: Google Cloud Platform
- Other Tools: Javascript, React as the main language and framework for our frontend
Requirements
- At least 1 year experience with Python and Django
- At least 1 year experience with database design and development
- Experience with Airflow/Cloud Composer is an asset
- Experience with Google Cloud Platform and Docker is an asset
Benefits
- This is a rare opportunity to influence positive change within one of the biggest societal challenges of our generation (infrastructure - from water to transport to energy and more).
- Be a part of a scale up company with no corporate bureaucracy here. You will accomplish more here in a few months than what you would in a few years at a large, entrenched technology company.
- Comprehensive health and dental benefits with an emphasis on mental health
- Annual Learning and Development Budget and Plans
- Flexible hours and work-from-wherever you are with the option to work in our downtown office if interested!
- Competitive salary and equity incentives to give you a stake in our future
- We work hard. We play hard. From virtual trivia to exploring the food scene around our office, we like to get together!