Senior Data Engineer

Overview: Are you interested in working for one of the most exciting teams in Microsoft, that relentlessly focuses on customer needs and on advancing Microsoft's cloud first strategy? Are you interested in a start-up like environment, passionate about cloud computing technology and driving growth in one of Microsoft's core businesses?  Consumer Commerce Feeds and Risk team is focused on the success of Microsoft Cloud customers and partners.. Our analysis services and machine learning models answer key questions helping our customers and partners improve business models and services. Our team also provides key metrics about cloud adoption across Microsoft and inform internal business decisions. We do this with a team of people with diverse perspectives and backgrounds who continually identify points of engagement, measure outcomes, learn from our customers and partners, and improve business models and services. In this way we make data-driven insights actionable with changes to Microsoft Cloud products and services to make them easier to use, understand, and learn about. The institutional knowledge we build as a result amplifies our impact across Microsoft to help make customer and partner success our success.  The successful candidate should be able to demonstrate this broad set of attributes.

Qualifications: Qualifications Required BS in Computer Science, Computer Engineering, or equivalent degree 8+ years’ experience as a data engineer in a data-focused role for shipped software products or services. Professional software development experience using an applicable programming language (C#, Java, C++, Python or equivalent) and common data technologies (such as SQL, NoSQL, Spark, Scala Databricks, Azure Data factory etc). Preferred Experience delivering highly secure, reliable, and maintainable code. Ability to learn and grasp concepts quickly in a fast-paced environment is critical to success. Experience with Hadoop/HDFS/Apache Spark/Kafka, solid working knowledge of SQL and database design and experience writing performance-critical code. Familiarity with Containers and Kubernetes Ability to communicate ideas effectively.
Experience working in cloud platform is a plus.

Responsibilities: Design and build an efficient data pipeline that can test and deploy high quality data into production to run at scale. Develop and foster strong relationships with developers on multiple engineering teams within and outside the Azure division. Seek opportunities in our day-to-day workflow to improve quality and efficiency from ideation to deployment. Explore cutting edge technology stacks, platforms, and workflow tools to improve efficiency.

Benefits: Industry leading healthcare