Job Specifications
Smartedge’s Client is looking for an individual to help with their Data Engineer
Job Details :
Role Name : Data Engineer
Role Location : Glasgow, Scotland, UK/Hybrid
Role Type : Contract
Job Description :
Data Engineer with strong experience to join our team to help a strategic banking client in various data transformation activities.
Key Responsibilities:
· Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.
· Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure.
· Demonstrate proficiency in coding skills, utilizing languages Python & SQL, to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations.
· Collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS, etc.
· Develop various components in Python of our unified data pipeline framework.
· Contribute towards the establishment of best practices for the optimal and efficient usage of data across various on-prem and cloud platforms.
· Assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling.
· Monitor the performance of queries and data loads and perform tuning as necessary.
· Provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.
· Develop SQL-based data validation, reporting, analysis, etc. as required Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
· Adhere to Agile practices throughout the solution development process.
· Design, build, and deploy databases and data stores to support organizational requirements.
Skills / Qualifications:
· Experience supporting Software Engineering, Data Engineering, or Data Analytics projects.
· Experience in data development and solutions in highly complex data environments with large data volumes.
· SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
· Experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
· Experience developing solutions in a hybrid data environment (on-Prem and Cloud) Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files, etc.) Experience with performance tuning SQL queries, Spark job, and stored procedures.
· An understanding of E-R data models (conceptual, logical, and physical).
· Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.
· Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
· Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
· Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.
If this sounds like a role you would be interested in or if you know someone in this field.
Connect with me or email me at mohit.r@smartedgesolutions.co.uk
Alternatively, you can call me on Tel: 44 2035002132
About the Company
Smartedge is a globally recognised Technology firm established in the year 2005.
We are headquartered in London with 15 offices globally, and offer a full range of IT Services and Professional Recruitment Services (PRS) across Europe.
Our reputation in the IT and Engineering domain coupled with an excellent consultant network across Europe, with an in-house authenticated database of 100,000+ consultants helps us to be truly SMART in our solutions.
Smartedge Brand Promise:
We are committed to transforming your organi...
Know more