Job Description
<h3>📋 Description</h3> • Data Pipeline Development & Ingestion: Design, build, and maintain efficient and resilient data pipelines to extract and load data into data warehouse from third-party APIs, databases (leveraging CDC), and various internal systems.
• Data Modeling & Transformation: Collaborate with teammates to implement and support dbt data models, ensuring raw data is effectively transformed for analytical use.
• Pipeline Orchestration & Monitoring: Assist in the orchestration, scheduling, and monitoring of data pipelines to ensure high availability, reliability, and timeliness of data.
• Data Quality & Testing: Implement data quality checks, validation rules, and test frameworks within the pipelines to ensure the accuracy and integrity of the data.
• Collaboration & Support: Act as the primary data provider for the DataOps team, ensuring clean, structured data needed for advanced modeling, analytics, and data application development.
• Documentation: Create and maintain comprehensive documentation for data pipelines, sources, and processes to support transparency and knowledge sharing. <h3>🎯 Requirements</h3> • 3+ years of hands-on experience in a Data Engineering role.
• A desire to build scalable, robust, and interesting platforms.
• Enjoys learning new technologies and approaches to problem-solving.
• Strong analytical and problem-solving skills, with a focus on building efficient systems.
• Detail-oriented with a passion for data quality, accuracy, and reliability.
• Excellent communication and cross-team collaboration skills.
Core Technical Skills Required:
• Strong proficiency in Python for data engineering tasks (e.g., scripting, data manipulation, API integration).
• Strong proficiency in SQL for complex querying and data modeling.
• Proven experience building and maintaining data pipelines, especially from sources like third-party APIs and databases using Change Data Capture (CDC).
• Hands-on experience with a cloud data warehouse (Snowflake strongly preferred).
• Experience with data transformation tools, preferably DBT.
• Experience with CI/CD tools (e.g., GitLab CI). <h3>🏖️ Benefits</h3> • We provide extensive medical coverage, including strong vision and dental plans, flexible spending accounts, and additional supplemental health options.
• 401K Plan to invest in your long-term retirement goals
• Generous Parental Leave
• Paid Flexible Time Off Policy
• Lifestyle Spending Account
• Commuter & Parking Benefits
• Mental Health Resources
• Monthly Phone Stipend
• Furry friends? We’ve got you covered with dog-friendly work environment & them with pet insurance options