I build systems.
Data is just what flows through them.
Drawn to problems where structure matters — how things connect, how data moves, and how systems behave as they grow.
I care about how systems evolve: where bottlenecks form, and how design choices ripple into scale, cost, and clarity. Currently building data infrastructure and platform engineering — databases, streaming pipelines, observability — and extending that foundation into agentic AI and tool-augmented systems.
Developer by foundation
Systems-first by instinct
Data-driven by nature
Tooling
- PostgreSQL
- Kafka
- Python
- Databricks
- Docker
- LangChain
What I Do
Five capabilities, one throughline — systems where data moves with intent.
- SVC-01
System & Data Architecture
Designing systems where data flows cleanly across boundaries — from sources to services to analytics — with clear structure and well-defined ownership.
ContextPostgres migration (SQL Server → PostgreSQL) via pgloader, with Kafka-based reverse-sync through Debezium CDC for zero-downtime rollback safety.
PostgreSQL Kafka Debezium - SVC-02
Data Pipelines & Platforms
Building ingestion, transformation, and storage layers that are reliable, observable, and cost-aware.
ContextIngestion pipelines on Databricks — API-based and file-based (SDP) — with cost and resource-usage dashboards for platform observability.
Databricks Python - SVC-03
Backend & Service Development
Backend services and APIs that integrate cleanly with data systems and scale with growing complexity.
ContextCustom Python consumers for Kafka streams, bridging CDC events to downstream systems with idempotent, at-least-once processing.
Python Kafka FastAPI - SVC-04
Integration & Extensibility
Systems that take on new tools, data sources, and alternatives without major rewrites.
ContextHeterogeneous sources — relational databases, object stores, streaming platforms — unified into a single lakehouse query surface.
PostgreSQL Databricks Docker - SVC-05
Optimization & Reliability
Performance, cost efficiency, and failure handling grounded in how systems behave under load and change.
ContextDual-write rollback strategies via Kafka CDC to cut migration risk; custom dashboards for Databricks spend and resource utilization.
Kafka Databricks Python
I'm drawn to open-source data infrastructure and developer tooling — the parts everyone builds on and few get to shape. I value open design and community-driven software, and I'm working toward contributing back as I grow.
How I Think
ADR-001…005 · v1 · ACCEPTEDprinciples that govern how I design data systems
- 01ADR-01
Systems Before Solutions
Structure before tooling. A schema, a contract, or a boundary drawn early is worth a hundred fixes later. I pick the tool only after the system's shape is visible — a Kafka topic chosen before the bounded context is a load-bearing decision made blind.
- 02ADR-02
Design for Extension, Not Correction
Change should read like an addition, not a patch. If integrating the next source means rewriting the core, the core was never the core — it was a coincidence that happened to work.
- 03ADR-03
Leave Space at the Edges
Boundaries are where systems stay adaptable. I push irreversible decisions inward and keep the perimeter reversible: schema, contracts, ownership. The edge is where the next unknown system will arrive.
- 04ADR-04
Complexity Must Be Earned
I start with the boring pipeline and the obvious table. Complexity is justified by load, by cost, or by a failure I can name — never by resume appeal, and never before the simpler version has been measured.
- 05ADR-05
Data You Can Reason About
Moved data is a liability; understood data is an asset. A pipeline is only done when it ends in a question someone can actually ask of it — and an answer they can trust.
Closing RuleBuild for the system you understand. Leave room for the one you will meet next.
Technical Domains
Six areas of practice, mapped by depth rather than breadth.
- DOM-01
Data Systems
5/5Designing how data moves, transforms, and settles across systems — from raw ingestion to analytics-ready outputs — with attention to structure, observability, and evolution.
Pipelines, storage layers, batch and stream patterns, data modeling.
PostgreSQLKafkaDebeziumDatabricksdbtAirflow - DOM-02
Backend & Services
4/5Building backend services that expose, consume, and coordinate data through well-defined interfaces, with a focus on correctness, scalability, and clean integration.
APIs, service boundaries, background workers, internal tooling.
PythonFastAPIGoRESTPostgreSQLevent-driven patterns - DOM-03
Distributed & Infrastructure-Aware Systems
3/5Working with systems that run across multiple components — understanding deployment constraints and operational trade-offs. Not infrastructure for its own sake, but enough context to design responsibly and avoid fragile systems.
Enough context to design responsibly and avoid fragile systems.
DockerLinuxCDC patternsinfrastructure as code - DOM-04
Developer Tooling & Automation
3/5Creating internal tools, scripts, and workflows that reduce friction, improve visibility, and make systems easier to operate and extend.
A developer-first approach to system design and operability.
PythonAirflowdbtdashboardspipeline monitoring - DOM-05
Data Reasoning & Analysis
4/5Reasoning about data correctness, quality, and behavior — validating assumptions, tracing issues, and ensuring outputs are trustworthy.
Analytics is an outcome, not the primary goal.
SQLcost analyticsdata quality validationdbt - DOM-06
Agentic AI & Tool-Augmented Systems
2/5Applying systems-thinking to AI agent architectures — orchestrating tools, skills, memory, and data flows through well-defined interfaces. Agentic systems are, at their core, integration and orchestration problems.
Systems-level perspective on agent design — composition, tool discovery, and state/context flow across interactions.
LangChainLLM APIsagent orchestrationtool-augmented reasoning
If you're working on systems that need to grow without losing clarity, I'd like to talk.
I design data platforms built to evolve under load — where system design, infrastructure, and long-term clarity meet. Currently looking for the next system worth signing my name to.
- GitHub — Experiments, infra tooling, and notes-in-progress
- LinkedIn — Brief history and current focus
Leave room for what doesn't exist yet.
— Amirthanathan R.