Big Data Engineer

Skills

Job Specifications

Hello There,

My name is Himanshu Sharma, and I serve as the Recruitment Lead at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Big Data Engineer with our esteemed client. If you are interested then please share your updated resume at Himanshu01@kanakits.com .

Job Description

Position : Big Data Engineer

Location : Malvern, PA Hybrid

Duration : Initial 12 months + options to extend - Long term contract role

Responsibilities

Collaborate on the Smartstream cash reconciliation platform, known as TLM, to support data integration and transformation workflows.
Design and implement ETL processes using tools like AWS Glue, Spark, or Python to transform raw data into structured formats compatible with Smartstream's ingestion requirements.
Conduct data mapping exercises to align legacy data structures with modernized attributes stored in S3 buckets, ensuring consistency and accuracy across systems.
Ensure data quality and lineage through validation checks, anomaly detection, and documentation of data assumptions
Integrate data sources into cloud platforms such as AWS, leveraging services like S3, Glue, Lambda
Work closely with product owner and business to understand data requirements, translate them into technical specifications
Implement data governance principles, including version control, access management, and compliance with Vanguard and GIFS standards

Qualification: (8+ minimum experience)

AWS Skills - Glue Lambda S3 KMS Stepfunctions General Skills - Data Transformation Tools like Pandas and Pyspark Cloudformation Cloudblocks Python Bitbucket/Github Coder (optional) Java (optional) Golang (optional) Cobol/JBL (optional)

About the Company

Kanak Elite Services is a software development company based in the USA. The company was founded in [insert year] and has since been providing a wide range of software development services to clients across various industries. Kanak Elite Services specializes in the development of custom software solutions that are tailored to meet the specific needs of its clients. Its team of experienced software developers, project managers, and quality assurance specialists work together to deliver high-quality software products that mee... Know more