PasarPolis

Data Engineer

Job description

Responsibilities


  • Owns end to end responsibility of data engineering function within the analytics team.
  • Builds and maintains a scalable data lineage system to improve data infrastructure reliability.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and GCP big data' technologies.
  • Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Ensure the architecture will support all the business needs to drive actionable insights Data Pipeline ETLs & Monitoring.
  • Monitor and troubleshoot operational or data issues in the data source/lake for updated version.
  • Create and maintain optimal data pipelines architecture works very closely with all data engineers to build best practice pipelines.
  • Maintain and automate delivery of all data pipelines from different sources for all the functions to measure their respective KPIs in an automated way.
  • Monitor all schedule jobs to minimize errors to ensure 100% uptime of all reports share with different stakeholders.
  • Create data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader.
  • Provide inputs on cost reduction measures based on Machine Learning algorithms using historical data for prediction.
  • Streamline data pipelines using best industry practices to avoid redundancy in jobs running in analytics data warehouse.
  • Constantly develop and automate new reports and dashboards based on the business needs of the different countries/departments.
  • Assist in monitoring allocated budget to ensure compliance and highlight possible issues.
  • Performs ad-hoc analyses of data stored with bigquery analytics data warehouse and writes SQL scripts, stored procedures, functions, and views.
  • Prepare data for predictive and prescriptive modeling to predict our users next move and upload the propensity score for each user back in Google Marketing Platform for more optimised targeting in an automated way.
  • Use data to discover tasks that can be automated

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.