- Company Name
- Accenture UK & Ireland
- Job Title
- Data Engineer with AI Experience
- Job Description
-
Job Title: Data Engineer with AI Experience
Role Summary
Engineer and maintain scalable, automated ETL/ELT pipelines that integrate operational data with analytics and business intelligence systems. Design data models, manage data quality, and collaborate with cross‑functional teams in an Agile Scrum environment.
Expectations
- Deliver robust, repeatable data pipelines that support batch and streaming workloads.
- Ensure high data quality, integrity, and documentation across all assets.
- Maintain CI/CD pipelines, unit and integration tests, and adherence to software engineering best practices.
- Operate under BPSS/SC security clearance with 5 years UK address history and single citizenship.
Key Responsibilities
- Design, implement, and orchestrate ETL pipelines using batch and streaming technologies.
- Define, document, and iterate data mappings and models according to best practice.
- Re‑engineer existing pipelines for scalability, robustness, and automation.
- Explore, query, and analyze large‑scale datasets to support business decisions.
- Build and maintain metadata, dependency, and workload management processes.
- Identify, diagnose, and resolve data quality, mapping, and database issues.
- Integrate operational systems with data warehouses, lakes, and BI tools.
- Produce clean, maintainable code with comprehensive unit, feature, and integration tests.
- Participate in agile ceremonies (sprint planning, daily stand‑ups, retrospectives).
- Collaborate with stakeholders to refine requirements and triage technical issues.
Required Skills
- Proficiency in at least one programming language: Python, Java, or Scala.
- Hands‑on experience with cloud platforms: AWS, GCP, or Azure.
- Expertise in data warehousing and lakehouse architectures.
- Proven ability to build ETL/ELT pipelines for batch and streaming workloads.
- Strong SQL skills and experience with NoSQL databases.
- Familiarity with distributed computing frameworks (e.g., Spark, Kinesis, Flink).
- Solid understanding of software development practices: CI/CD, TDD, version control.
- Knowledge of data modelling, system architecture, and metadata management.
- Excellent analytical, troubleshooting, and problem‑solving abilities.
- Experience collaborating with external partners or clients in consulting or project‑based settings.
Required Education & Certifications
- Bachelor’s degree (or equivalent) in Computer Science, Data Engineering, Information Technology, or related technical field.
- Relevant cloud certifications are advantageous (e.g., AWS Certified Data Analytics, GCP Professional Data Engineer, Azure Data Engineer Associate).
- Mandatory BPSS/SC security clearance with UK residency and single citizenship status.