Job description
Data Engineer
Permanent employee, Full-time · Dublin, Abbey Street
Job Title: Data Engineer
Department : Business Intelligence
Reporting to Data Warehouse Manager
Basic Function and Purpose of this Role
The role of Data Engineer is a key role in the Business Intelligence team reporting to the Data Warehouse Manager. This role will oversee the design, development, implementation and support of data services, data warehousing and Business Intelligence solutions in National Lottery.
Responsibilities of the Job Holder
Implementing a programme of work and management of the delivery of BI solutions using latest Microsoft Azure platform technologies. Ensuring the accuracy of the collection and documentation of end-user requirements for large complex and some smaller ad-hoc projects and developing and maintaining strong relationships with key internal stakeholders to understand their systems and BI / Data related challenges.
Main Tasks
1. Maintain, design & create cloud-based BI using Microsoft Azure environments
2. Design, create and maintain optimized data models for business intelligence and reporting
3. Hands-on development using the following technologies:
- TSQL, SparkSQL
- Azure Data Factories, Synapse
- Python / Databricks
- Spark / Hadoop
- Jira
4. Data Warehouse day-to-day administration including reviewing ETL load jobs for consistency, quality,
and performance monitoring
5. Responsibility for implementation of best practices as they relate to Business Intelligence solution
design and data quality / governance strategies
6. Plan and analyse automated solutions and processes
7. Research data warehousing/business intelligence trends and technological innovations in order to
make appropriate development recommendations
8. Working closely with other development & technical staff
9. Provide support to business users and application developers
Qualifications and Desired Skills
Formal qualifications A degree in Computer Science or a related discipline with an Information
Technology focus.
Advanced Certificate/Qualification in Business Intelligence / Data Analytics
Experience 5+ years of IT experience within the Data Warehouse / Business Intelligence
domain
Knowledgeable in business processes and functions
Awareness of systems and application architecture
Experience of software development lifecycle
Exceptional analytical, conceptual, and problem-solving abilities
Strong understanding of relational database structures, data modelling, data
theories, principles and practices
Experience working in a team-oriented, collaborative environment
Experience in the gaming industry
Special Skills or Knowledge Exceptional analytical, conceptual, and problem-solving abilities
Effective communication and interpersonal skills
Knowledge of Machine Learning technologies & algorithms
Excellent organisational skills
Experience working in agile scrum, continuous integration, and delivery
Technical Skills Very strong SQL & Python development skills
Experience with Azure Data Factories, Synapse, Databricks, Python, PowerBI,
Hadoop & Azure Data Lake Gen 2
Comfortable with Azure DevOps, GitHub and GIT source control methodologies
Experience with PowerBI is desirable
Strong development and design skills
Agile or CI/CD development
Knowledge of data warehouse methodologies and medallion architecture
Working Relationships
Internal Head of Analytics, Data Warehouse Manager, BI Developers, Lead Testers, Test
Managers, Project Managers, Head of Programmes
External Suppliers, Service Providers, Contractors
Three sentences that describe the person who will be successful in the role:
- Effective team player - positive attitude, flexible and hard working
- Willingness to learn and embrace innovative technologies
- Technically astute specialising in SQL & Python
