01About
Real products, not demos.
I’m a computer-science student in Visakhapatnam who would rather ship a working system than a slide about one. Over the last year that has meant end-to-end data pipelines — change-data-capture from PostgreSQL through Debezium and Kafka into Spark Structured Streaming, batch ETL into star-schema warehouses with SCD Type 2 history, data-quality gates, Airflow orchestration and idempotent, observable jobs.
It has also meant products: authentication, REST APIs, relational data models and polished front-ends — increasingly with AI at the core, from a LangGraph multi-agent operations layer with a human-in-the-loop safety gate to KYC and document forensics that run entirely on-device with ONNX and WASM.
Ask me about Spark internals (lazy evaluation, shuffles, broadcast joins, foreachBatch, checkpoints), Kafka and CDC semantics, dimensional modelling, data-quality strategy, SQL window functions, Next.js and React architecture, or shipping LLM features to production — RAG, agents, evals.
Currently exploring Databricks & Delta Lake, Snowflake, Hadoop / Hive, Kafka Streams and Data contracts. Fundamentals I keep sharp: data structures and algorithms, OOP, DBMS, operating systems, computer networks and system design.
- Name
- D L Narayana
- Based in
- Visakhapatnam, India
- Education
- B.Tech Computer Science & Engineering · GITAM · Class of 2027
- Roles
- Data engineer · Full-stack developer · AI product engineer
- Exploring
- Databricks & Delta Lake · Snowflake · Hadoop / Hive · Kafka Streams · Data contracts
- CGPA
- 7.97 / 10
- Résumé
- One page, printable →
- linkedin.com/in/dlnarayana ↗
Now — what the work is about
- 01
Streaming lakehouses
CDC from PostgreSQL through Debezium and Kafka into Spark Structured Streaming; SCD2, quarantine and backfills that share one transform set.
- 02
Agents with brakes
LangGraph supervisors whose high-risk actions stop at a policy gate and a human approval — traced, evaluated, tested offline.
- 03
ML in the browser tab
ONNX Runtime Web and WASM pipelines for KYC and document forensics that never upload the document.
- 04
Reading & running locally
Databricks & Delta Lake, Snowflake, Hadoop/Hive, Kafka Streams and data contracts — not yet shipped, so not yet claimed.
Working principles
- 01
Idempotent pipelines
Replaying the same offsets or re-running a backfill yields identical tables. Retries are safe by construction, not by hope.
- 02
Explicit schemas
Every source is read with a declared StructType. Inference is only used to detect drift and log it before it becomes nulls.
- 03
Tests for every transform
One set of transforms powers both the stream and the batch path, so a single pytest suite covers both.
- 04
Metrics for every run
JSON structured logs, per-stage timers, quarantine breakdowns and run metrics files — observable by default.
02Stack
Tools chosen for failure modes, not logos.
The ledger below is computed from every project’s declared stack — each filled cell is a repository you can open. “Exploring” means reading and running locally, not yet shipping.
| Technology | LakeFlow | Retail ETL | AeroSentry | VeriLens | StayNest | CityHelp | VeriDoc | DocuForge | Nova | ResumeForge | Stillpoint | GitHubLens | CodeRunner | AlgoViz | CryptoLab | Spectra | Typeflow | Σ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Tailwind CSS (Web) | 9 | |||||||||||||||||
| TypeScript (Web) | 8 | |||||||||||||||||
| Motion (Web) | 6 | |||||||||||||||||
| Next.js (Web) | 5 | |||||||||||||||||
| React (Web) | 5 | |||||||||||||||||
| Vite (Web) | 5 | |||||||||||||||||
| JavaScript (Web) | 4 | |||||||||||||||||
| Python (Data) | 3 | |||||||||||||||||
| Airflow (Data) | 2 | |||||||||||||||||
| Docker (Data) | 2 | |||||||||||||||||
| ONNX Runtime Web (AI) | 2 | |||||||||||||||||
| Parquet (Data) | 2 | |||||||||||||||||
| Playwright (Tooling) | 2 | |||||||||||||||||
| PostgreSQL (Data) | 2 | |||||||||||||||||
| PySpark (Data) | 2 | |||||||||||||||||
| pytest (Data) | 2 | |||||||||||||||||
| PyTorch (AI) | 2 | |||||||||||||||||
| Recharts (Web) | 2 |
- Tailwind CSS9 projects
- StayNestNovaStillpointGitHubLensCodeRunnerAlgoVizCryptoLabSpectraTypeflow
- TypeScript8 projects
- StayNestCityHelpNovaStillpointGitHubLensCodeRunnerSpectraTypeflow
- Motion6 projects
- StayNestStillpointGitHubLensCodeRunnerAlgoVizCryptoLab
- Next.js5 projects
- StayNestCityHelpNovaGitHubLensCodeRunner
- React5 projects
- StillpointAlgoVizCryptoLabSpectraTypeflow
- Vite5 projects
- StillpointAlgoVizCryptoLabSpectraTypeflow
- JavaScript4 projects
- VeriLensVeriDocDocuForgeResumeForge
- Python3 projects
- Retail ETLAeroSentryVeriLens
- Airflow2 projects
- LakeFlowRetail ETL
- Docker2 projects
- LakeFlowAeroSentry
- Parquet2 projects
- LakeFlowRetail ETL
- PySpark2 projects
- LakeFlowRetail ETL
- pytest2 projects
- LakeFlowRetail ETL
- Recharts2 projects
- CityHelpGitHubLens
Data
- Apache Spark
- PySpark
- Spark SQL
- Structured Streaming
- Apache Kafka
- Debezium CDC
- Apache Airflow
- Parquet lakehouse
- Star schema · SCD2
- Data-quality gates
- PostgreSQL
- MongoDB
- Docker Compose
- pytest
Web
- TypeScript
- React
- Next.js
- Node.js
- Python
- Java
- SQL
- Prisma
- Tailwind CSS
- Motion
- Supabase
AI
- LLM integration
- RAG pipelines
- Embeddings & vector search
- AI agents (LangGraph)
- Evals & guardrails
- ONNX Runtime Web
- PyTorch
Fundamentals
- Data structures & algorithms
- OOP
- DBMS
- Operating systems
- Computer networks
- System design
Exploring
- Databricks & Delta Lake
- Snowflake
- Hadoop / Hive
- Kafka Streams
- Data contracts
03Timeline
A short record, densely written.
Dates come from repository creation and push timestamps, not memory.
Sep 2026
Data engineering, in public
Published LakeFlow (real-time CDC lakehouse) and Retail Lakehouse ETL (PySpark batch warehouse), plus AeroSentry — a multi-agent operations layer with a human-in-the-loop safety gate.
Aug 2026
ResumeForge
A privacy-first career toolkit with a real-time ATS engine — pure HTML/CSS/JS, zero runtime dependencies, 36 commits over five days.
Jul 2026
On-device verification trio
VeriLens, VeriDoc Studio and DocuForge: KYC, Indian document verification and forgery forensics running entirely in the browser on ONNX/WASM.
Jun 2026
Ten products in one month
CityHelp, StayNest, AlgoViz, CryptoLab, GitHubLens, CodeRunner, Stillpoint, Typeflow, Spectra and Nova — each deployed live on Vercel.
Dec 2025
github.com/D-L-Narayana ↗
Account created; the public record starts here.
Class of 2027
B.Tech CSE, GITAM
Computer Science & Engineering, Class of 2027, Visakhapatnam. CGPA 7.97/10.