Senior Data Engineer

<h3>📋 Description</h3> • As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines. • You will collaborate with cross-functional teams to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization. • Design, develop, and maintain robust ETL/ELT pipelines to process and transform large datasets efficiently. • Optimize data architecture and storage solutions to support analytics, machine learning, and business intelligence. • Work with cloud platforms (AWS) to implement scalable data solutions. • Ensure data quality, integrity, and security across all data pipelines. • Collaborate with data scientists, analysts, and software engineers to support data-driven initiatives. • Monitor and troubleshoot data workflows to ensure system performance and reliability. • Create APIs to provide analytical information to our clients. <h3>🎯 Requirements</h3> • 5+ years of experience in data engineering or a related field. • Strong proficiency in SQL and database technologies with (e.g., PostgreSQL, MySQL, Snowflake, BigQuery). • Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, Dagster). • Proficiency in programming languages such as Python and Scala. • Hands-on experience with AWS cloud data services. • Familiarity with big data processing frameworks like Apache Spark. • Knowledge of data modeling, warehousing concepts, and distributed computing. • Experience implementing CI/CD for data pipelines. • Real-time data processing and streaming architectures (RisingWave, Kafka, Flink). • Database performance tuning and query optimization. • Strong problem-solving skills and the ability to work independently and collaboratively. • ETL/ELT pipeline development and automation. • Cloud computing and infrastructure management on AWS (nice to have).