Michael Page

Senior Data Engineer

Job description

  • Heavily investing in Data analytics|Working from Home flexibility


About Our Client

At the heart of every successful campaign is the customer analyses produced by our data analytics teams. Our Data team uses cutting-edge technologies to develop and deploy analytics solutions to turn data into effective marketing strategies.

Job Description

  • Lead the onshore and offshore teams for developing and maintaining an Enterprise Outpatient Reporting (EOR) data warehouse
  • This includes designing and building data ingestion and transformation pipelines using Azure Data engineering stack (Azure Data Factory, etc.), overseeing testing in lower environments (Development, Quality Assurance and Staging), coordinating steps for Production Deployments using a Change Approval Board process
  • Ensure best practices for both Data and Systems Engineering processes are followed
  • Responsible for coordinating production support between onshore and offshore teams, troubleshooting issues, prioritizing, scheduling and deploying fixes
  • Coordinate closely with DevOps to implement new cloud services or tools or to update configurations


The Successful Applicant

  • Bachelor's degree in computer science or a related field, or in lieu of degree related experience and education
  • 4+ years of experience building, running, and deploying systems in a production environment
  • Strong technical Data Engineering leadership experience with onshore and offshore teams
  • Strong SQL skills - Ability to profile data, verify data movement, validate data matches. Experience in working with large enterprise databases. Azure SQL managed instance experience is desired.
  • Strong proficiency with Azure Data Engineering tools and the Data Ingestion process:
  • Azure Data Factory (ADF) expert
  • Familiar with best practices for data flow patterns for data ingestion into Data warehouse including progression through Staging, ODS and Data Warehouse (Dims/Facts) schemas
  • Experienced handling Production data loads and designing error handling and alerting into all steps to best support
  • Experience with both event triggers and schedule triggers to trigger pipeline start
  • Experience ingesting from SQL and file-based sources, with Azure blob storage exp
  • Experience with git version control on projects with multiple developers
  • Experience with the Agile software methodology
  • Specialty Pharmacy and/or Healthcare experience preferred; aptitude for acquiring strong industry knowledge
  • Ability to work under pressure, organize and prioritize responsibilities
  • Ability to quickly grasp complex technical and business concepts and express them in clear language
  • Self-motivated with the ability to work independently as well as part of a team
  • Effective communication skills (both written and verbal) with internal and external clients


What's on Offer

We offer competitive remuneration package and comprehensive fringe benefits including medical and life insurance, excellent learning & development opportunities and flexibility to the right candidate.

Contact: Royce Chan

Quote job ref: JN-082024-6508375

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Procom
September 18, 2024

Senior Data Engineer

Kleinanzeigen
September 18, 2024

Senior Data Engineer

Wesfarmers Health
September 18, 2024

Senior Data Engineer