Data Engineer II

Come join the Distribution & Delivery Data Insights Team! We are part of the Edge Device Services team, within the Windows Experiences and Devices organization.

We are looking for a passionate Data Engineer II who is self-driven, innovative, and motivated who can help us build the next generation federated Big Data service and modernize our platform. This job offers great growth opportunities for skilled and motivated engineers to work on big scale data and bring valuable insights, shaping our complex OTA (over the air) update domain.If you are passionate about processing billions of events, churning Petabytes of data daily, learning innovative public cloud technologies like Spark, Synapse, then EDS would love to apply your data expertise to some of the most exciting data problems in the industry.

As a Data Engineer in the team, you will work closely with our software engineers, program managers, and data scientists across different teams within Windows.You will also collaborate with a variety of internal partner teams across Azure and Microsoft.

You will build reliable, secure, compliant, highly scalable, performant and real-time data pipelines to enhance our publishing and updating platform.The value of your work will be reflected in improvements to the delivery and distribution pipeline of Windows Update platform, bringing efficiency/observability to our updating services, driving insights into our customers, including COGS reduction.You will have opportunities for mentorship, accelerating your career growth, learning new areas and working on truly high-business impact areas.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Requirements and Modeling: Collaborate with stakeholders, document data requirements, evaluates feasibility, negotiate data agreements, and proposes data metrics for project-relevant features.
• Data Model Design and Specification: Contribute to the data model design, draft design specification documents, improve data schemas, and balance analytical requirements and compute/storage consumption for data.
• Data Extraction and Validation: With guidance, implement code to extract raw data from upstream sources, perform code reviews, implement orchestration techniques, validate data quality and reliability, and record data source control and versioning.
• Data Transformation and Merging: Apply standard operations to transform raw data into compatible forms, use software and tools to wrangle and analyze data, and merge data into distributed systems or products.
• Data Tool Design and Maintenance: Design and maintain data tools/platforms that are used to transform, manage, and access data, write efficient code to test and validate data platforms, and implement sustainable design patterns.
• Data Monitoring and Troubleshooting: Follow performance monitoring protocols, build visualizations and aggregations to monitor data quality and pipeline/report health, troubleshoot and fix problems or anomalies, and document and share insights.
• Data Compliance and Governance: Follow data modeling and handling procedures to comply with laws and policies, tag and classify data, govern data accessibility and traceability, and contribute to the data glossary.
  
  

Qualifications

Required Qualifications

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, data modeling or data engineering work
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field
• OR equivalent experience.
  

Other Requirements

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: 
• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  

Preferred Qualifications

• Bachelor's Degree in Computer Science , Math, Software Engineering, Computer Engineering,
• OR related field AND 5+ years experience in business analytics, data science, software development, data modeling
• OR data engineering work
  

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.