- Company Name
- Parafin
- Job Title
- Senior Software Engineer (Data Platform)
- Job Description
-
**Job Title**: Senior Software Engineer (Data Platform)
**Role Summary**: Lead the design, development, and maintenance of a scalable, secure, and developer-friendly data platform to support data-driven financial services for small businesses.
**Expectations**: Deliver high-quality data infrastructure solutions (pipelines, lakehouse, ML platforms) with expertise in cloud data stacks and distributed systems. Collaborate cross-functionally to ensure reliability, scalability, and performance.
**Key Responsibilities**:
- Design and build scalable data pipelines, lakehouse architecture, and self-service tools using PySpark, Databricks, Airflow, and AWS.
- Own end-to-end data platform infrastructure (Terraform, Databricks workspaces), ensuring high availability, security, and cost efficiency.
- Develop and optimize core data models, pipelines, and ML workflows powering dashboards, analytics, and customer-facing products.
- Partner with Data Science teams to design scalable solutions and resolve technical challenges.
- Improve data quality, lineage tracking, monitoring, and observability across backend systems.
- Mentor engineers and promote best practices in data infrastructure and distributed systems.
**Required Skills**:
- Advanced Python/SQL; Spark, Airflow, Databricks, AWS (S3, RDS), and lakehouse architecture (Delta Lake/Iceberg).
- Distributed systems experience: Hadoop, Hive, Kafka, Trino/Presto.
- Problem-solving, cross-team collaboration, and ownership of technical debt.
- Data ingestion frameworks, data versioning, and partitioning strategies.
**Required Education & Certifications**: Bachelor’s degree in Computer Science, Engineering, or related field. 4+ years of software engineering experience in data infrastructure, pipelines, or distributed systems.
San francisco, United states
On site
Senior
08-10-2025