Job Specifications
Pan Macmillan is looking for an experienced Data Engineer with the technical, analytical, and project skills to accelerate delivery of three key projects in data migration and expansion. This role is ideal for someone with a keen eye for detail who enjoys delivering innovative and appropriate data solutions.
Your Team
You’ll be joining a small but dynamic team, reporting to the Head of Analytics and working on projects alongside a Database Engineer and two Data Analysts. You’ll also collaborate with colleagues in the US and technology support teams.
The team provides accurate and timely data to drive decision-making across the business, managing a suite of Tableau reports and the underpinning Snowflake database. We are a project team working closely with stakeholders in the commercial, creative, business, and process areas to meet the evolving needs of the company and the publishing industry.
Your Role
You will be working on three key projects:
Completing migration from Microsoft SQL Server to Snowflake, using Matillion as the primary transformation tool.
Migrating Tableau dashboards to point at our newly structured data warehouse, including requirement gathering, data scoping, and building views and data marts
Expansion of commercial data sources, including scoping business requirements, pipeline development, and API integration.
You can expect project delivery to involve improving automation and data-flow reliability, leveraging APIs for data enrichment and integration, exploring AI-assisted solutions for data cleansing and categorisation, and creating Tableau dashboards to monitor data content and quality.
Adaptability and proactive problem-solving are essential in this fast-evolving environment, as is being a team player and a willingness to help deliver business as usual.
Your Key Responsibilities
Data warehouse migration & infrastructure
Collaborate with the Data Engineer to deliver the migration of the enterprise data warehouse from SQL Server to Snowflake.
Contribute to data mapping, modelling, shaping, and architecture design to support efficient and scalable data structures.
Handle data transfers and manage regular maintenance and updates of data pipelines.
Build and maintain ETL/ELT transformations using relevant tools.
Verify data, transformations, and packages to ensure completeness and accuracy.
Performance, quality & monitoring
Carry out query, data, and connection optimisation to improve pipeline performance.
Design and implement data quality assurance and monitoring processes.
Conduct troubleshooting and proactively resolve data-related issues, ensuring minimal disruption to data flows.
Integration & automation
Discover and integrate new data sources in line with business priorities.
Review and improve existing data-handling processes for automation, efficiency, and better leveraging of APIs.
Develop data-cleansing and categorisation solutions, including exploration of AI-assisted approaches.
Dashboards & migration
Review Tableau dashboards to define data requirements for migration to the restructured warehouse.
Maintain, improve, and contribute to our suite of Tableau dashboards and automated solutions.
Develop complex SQL queries, views, and marts to support Tableau dashboards and other outputs.
General Responsibilities
Participate in requirement gathering and specification activities for analytics projects.
Manage your workload using Asana to ensure timely delivery of tasks as part of a collaborative project team.
Support the Analytics team in delivering business-as-usual reporting and data support.
Share knowledge and provide support to team members, upskilling where relevant to meet new requirements.
Documentation of updates, decisions, and data solutions to support team knowledge and continuity.
Essential experience, abilities, and knowledge you’ll need to succeed:
Proven experience with SQL, including working knowledge of pipeline management, data architecture, and performance optimisation.
Working knowledge of cloud-based data warehousing and the following technologies: Python, AWS, APIs, DBT, with the ability to quickly upskill in Matillion.
Working knowledge of data visualisation / BI tools, with experience in creating or editing dashboards and reports.
Experience with handling commercial data and understanding the data use-cases of commercial teams.
Clear record of problem-solving capabilities, with strong analytical skills for data-driven decision-making.
Technical scoping expertise, especially:
Reviewing existing dashboards to recommend improvements to data sources and flows.
Assessing new data sources to deliver pipeline and data-handling recommendations.
Data cleansing, validation, and transformation skills.
Creating and maintaining clear and relevant technical documentation.
Ability to manage time effectively and meet deadlines under pressure.
Excellent attention to detail, with a focus on accuracy, relevancy, and quality.
Collaborative team player with a willingness to contribute ideas.
Ability to think both practically and strategically about data sources and applications, demonstrating initiative, creativity, and flexibility.
A minimum of three years of experience in a data-oriented role such as a Data Engineer, Database Administrator, ETL Developer, or a related field.
Undergraduate degree in a mathematically based subject (e.g., Information Systems, Economics, Psychology, Computer Sciences), or equivalent work experience.
Project experience, including working as part of a team and meeting deadlines, and some experience of leading project tasks or workstreams.
Desirable Skills We’d Love You To Have
An interest in, or experience with, publishing, reading, or the contemporary book market.
Experience with database migration and/or consultancy.
Experience with the following technologies would be advantageous: Tableau Desktop, Snowflake, Microsoft SQL Server, Matillion, Git or GitHub.
Practical experience working with social media data.
Strong communication skills, including stakeholder engagement and the ability to present and interpret data for non-data audiences.
Experience working in Agile or sprint-based delivery environments, particularly in data or analytics projects.
Proficiency with the Microsoft suite, especially Excel (including formulas, functions, pivots, and macros/VBA).
What You’ll Get In Return
In return we can offer you a range of great projects, a supportive and collaborative working environment as well as a competitive salary and benefits package.
Closing date: 21 April 2025
Salary start from: £42,000
Some Of The Benefits We Offer
28 days’ annual leave increasing with years of service + bank holidays
Generous pension scheme
Discounted private medical insurance
Group income protection scheme
Enhanced family pay and leave
Flexible working hours and summer hours (early finish on a Friday during summer months)
2 Volunteer Days per year
75% off all Pan Macmillan books and regular staff book ...