Staff Data Engineer - Databricks
Zenni Optical, Canada
Job Description
Company Overview:
Zenni Optical, the world's leading online eyewear retailer, pioneered the industry in 2003 with a mission to make prescription eyewear affordable and accessible to everyone. Based in the San Francisco Bay Area, Zenni offers adults and children the freedom to express their personal style through high-quality prescription and protective eyewear curated with a sense for fashion and incredible selection. With over 51 million frames sold worldwide, the company has brought massive price disruption to the traditional retail model. Zenni is proud to be the Official Eyewear of the San Francisco 49ers, Boston Celtics and Columbus Crew. Zenni has worked with designers and tastemakers on curations and collections, including Keke Palmer, Iris Apfel, Cynthia Rowley, David Ortiz and George and Claire Kittle. Zenni VR Prescription Lenses for Meta Quest 3 launched across the U.S., Canada, UK and Japan in October 2023.
For more information, please visit zennioptical.com/blog/press/.
Position Overview:
To support our rapid growth, we are seeking a talented Staff Data Engineer to lead our data engineering team in the implementation of a comprehensive data infrastructure on Databricks. In this role, you will establish and maintain a data pipeline, data security, data analytics platform, data verification, and governance protocols. Your expertise will guide the team in implementing best practices in data-centric projects on Databricks.
Team Overview:
You will work closely with cross-functional teams, including backend/frontend engineering, analytics, AI/ML, product, marketing, CRM, manufacturing, customer support, and leadership, to bring data-driven and business decision optimization to the company. Your goals will not be easy to achieve. You should inspire and motivate the team to think big. You will wear many hats and be surrounded by smart, dedicated, and nice people, who are proud of the company's mission and their product's impact.
What we want you to own in this role:
As a Databricks expert, you will be
- Spearheading the project to create a self-service data analytics platform by integrating with LakehouseIQ. This initiative aims to enhance data visibility and alleviate the data team's workload from ad hoc data requests.
- Leading the design and implementation of efficient data pipelines, ensuring they are robust, scalable, and optimized for performance.
- Providing expert guidance on data security measures, ensuring our infrastructure adheres to the highest standards and complies with relevant data protection regulations.
- Lead the development and execution of a data verification platform, aimed at identifying and addressing abnormal data or potential data discrepancies.
- Playing a key role in the development and execution of ML projects, leveraging the Databricks platform to its full potential.
- Developing and constructing scalable, efficient data models tailored to fulfill the specific data requirements of the business.
- Continuously exploring new technologies and methodologies to enhance our data infrastructure and maintain our competitive edge in data management and analytics.
Basic Qualifications:
- Bachelor’s degree in Computer Science or a related field
- At least 10 years experience in data engineering.
- Minimum of 5 years of extensive experience in Databricks.
- Extensive experience in Databricks tech stacks is must-have, e.g.: Workspace, Unity Catalog, Disaster Recovery, and CI/CD etc
- Experience in designing scalable and robust data pipelines by ETL or ELT.
- Strong programming skills in Python and SQL.
- Extensive experience in designing and implementing robust data security and governance platforms that adhered to industry compliance standards, including GDPR, and SOC2 Type 2
- Expertise in data modeling techniques and best practices for designing data warehouses and data lakes
- Experience with a velocity team.
- Strong experience with end-to-end project delivery including requirement gathering, communication with stakeholders, implementation, and QA process.
- Excellent written and verbal communication skills in English, with the ability to communicate complex ideas to both technical and non-technical audiences.
- Proven leadership and mentoring skills to guide and mentor team members.
Preferred Qualifications:
- dbt (data transformation) experience
- GCP experience
Benefits
- A highly competitive base salary
- A great career trajectory in a stable, successful growing company.
- Cutting-edge projects with opportunities for growth and professional development
- Excellent health benefits that the company pays for and 401k