About the Role

Senior Data Engineer role at Amazon's WW FBA Central Analytics team, focusing on architecting scalable data infrastructure, migrating to a lakehouse model, and integrating LLM-powered solutions. Responsibilities include building data pipelines, implementing vector databases, and ensuring data quality and compliance.

Key Responsibilities

• Architect and implement a scalable S3-based Data Lakehouse
• Lead migration from Redshift to a lakehouse model
• Design and enforce standardized data ingestion patterns with quality controls
• Architect a centralized metrics repository as the source of truth
• Implement robust data quality frameworks with automated validation

Required Skills & Qualifications

Must Have:

• 7+ years of data engineering experience with distributed systems at scale
• Deep technical knowledge of AWS data services (Glue, Kinesis, Redshift, S3, Lambda) and infrastructure-as-code
• Proven experience designing enterprise Data Lakehouse architectures and metrics repositories
• Strong programming skills in Python and/or Scala with distributed data processing frameworks

Nice to Have:

• Experience architecting data platforms optimized for large-scale AI/ML workloads
• Hands-on experience with vector databases (Pinecone, Zilliz, Weaviate) at production scale
• Deep knowledge of LLM integration patterns, prompt engineering, and retrieval optimization techniques