Senior Python Data Engineer (Financial Automation & AI)

Job Description

We are hiring a Senior Python Data Engineer to lead the development of high-performance financial reconciliation and AI-driven automation systems. This role focuses on building scalable, fault-tolerant platforms that process large financial datasets with precision and speed.

Key Responsibilities

Design and optimize reconciliation engines (Bank GL, Card, Custom workflows)

Build AI-powered automation using Agentic systems and RAG architectures

Develop scalable backend systems using Python, Celery, Docker, PostgreSQL

Create robust data pipelines for ingestion, validation, and reporting

Implement strong testing strategies, including synthetic data simulation

Collaborate with global stakeholders to convert business needs into production systems

Technical Requirements

Core Skills

Expert in Python, Pandas, NumPy (large-scale data handling & performance tuning)

Strong experience with Celery (async processing) and Docker (containerization)

Advanced knowledge of PostgreSQL (query optimization, indexing, performance tuning)

AI & Automation

Experience with LangChain / CrewAI / MCP frameworks

Hands-on with RAG + Vector Databases

Exposure to deploying LLMs (Llama / Qwen or similar)

Architecture

Experience building fault-tolerant, high-availability systems

Strong debugging, logging, and performance optimization skills

Familiarity with DPDPA, GDPR, PCI DSS is a plus

Experience

5+ years in Python/Data Engineering

Preferably from Banking / Payments

domain

Experience mentoring or leading developers is a plus

Important: This is a screening-based hiring process. Only candidates who complete the task below will be considered.

Screening Task (Mandatory)

Build a Mini Reconciliation Engine:

Input:

Two datasets (Bank vs Internal transactions)

https://www.kaggle.com/datasets/ealaxi/paysim1 or any other relevant data

Output:

• Fully matched
• Partially matched
• Unmatched

Requirements:

• Efficient handling of large datasets (optimize using Pandas)
• Proper logging & error handling
• Clean, modular code

Bonus:

• Add anomaly detection logic OR simple AI-based insights

How to Apply

Send the following to [Confidential Information]:

• Updated resume
• GitHub / code submission of the task
• Brief explanation of your approach (max 200 words)
• Subject Line: Senior Python Data Engineer Application – [Your Name]

We're specifically looking for engineers who can build scalable, production-grade systems—not just write code.