Senior Data Engineer (Perm)
Are you passionate about shaping data-driven solutions and working at the forefront of cloud-based architectures? Join our client-an innovative organisation operating within the data and analytics industry-known for fostering a collaborative culture, embracing technological advancement, and supporting professional growth. This is an exciting opportunity to be part of a dynamic team that values expertise and impactful contributions.
Role Overview
Our Client is looking to add a highly skilled Senior Data Engineer to support its ongoing growth and strategic projects. This role is fundamental in enhancing the company’s data infrastructure, ensuring robust data processing, and delivering actionable insights through advanced analytics. If you thrive in a challenging environment and want to influence strategic decisions through your technical expertise, this role is perfect for you.
Key Responsibilities
- Develop and optimise complex SQL queries to manage large-scale data processing efficiently.
- Design, build, and maintain database objects such as tables, indexes, and views to support reporting and analytics.
- Employ advanced querying techniques, including joins and temporary tables, to transform and manipulate data.
- Fine-tune query performance and proactively troubleshoot bottlenecks to ensure optimal data retrieval.
- Architect, deploy, and maintain end-to-end data pipelines using Azure Data Factory.
- Configure linked services and datasets within ADF, ensuring seamless data ingestion via Copy Activity and API integrations.
- Orchestrate data workflows, set triggers, and monitor pipeline health, with proactive alerting for failures.
- Design, develop, and manage ETL processes leveraging SSIS to streamline data integration workflows.
- Optimize ETL packages for scalability and performance, handling debugging and error management.
- Create and maintain comprehensive reports and dashboards through SSRS and Power BI.
- Ensure visualisations are accurate, insightful, and support business decision-making.
- Support data quality, security, and compliance standards across all reporting and processing activities.
Essential Skills & Experience
- Demonstrable expertise in writing high-performance SQL queries, including indexing, joins, and performance tuning.
- Proven experience with Azure Data Factory for building scalable data pipelines.
- Hands-on skills with SSIS for developing efficient ETL workflows.
- Strong familiarity with reporting tools such as Power BI and SSRS.
- Sound understanding of cloud-based data architectures and best practices.
- Knowledge of Microsoft Fabric and semantic modelling principles.
- Solid experience in data modelling, including database object design and optimisation.
- Ability to troubleshoot and resolve complex performance issues effectively.
- Excellent organisational skills and attention to detail.
Desirable Skills & Experience
- Experience working within industries such as technology, financial services, or consultancy.
- Familiarity with API integrations and cloud service configurations.
- Knowledge of scripting languages such as PowerShell or Python.
- Awareness of data governance and security standards.
- Previous experience managing large data projects in fast-paced environments.
If you possess the qualifications and enthusiasm to excel in this influential role, we invite you to submit your CV today. This is your opportunity to work with a forward-thinking organisation committed to innovation and excellence in data management.
