01About

Real products, not demos.

I’m a computer-science student in Visakhapatnam who would rather ship a working system than a slide about one. Over the last year that has meant end-to-end data pipelines — change-data-capture from PostgreSQL through Debezium and Kafka into Spark Structured Streaming, batch ETL into star-schema warehouses with SCD Type 2 history, data-quality gates, Airflow orchestration and idempotent, observable jobs.

It has also meant products: authentication, REST APIs, relational data models and polished front-ends — increasingly with AI at the core, from a LangGraph multi-agent operations layer with a human-in-the-loop safety gate to KYC and document forensics that run entirely on-device with ONNX and WASM.

Ask me about Spark internals (lazy evaluation, shuffles, broadcast joins, foreachBatch, checkpoints), Kafka and CDC semantics, dimensional modelling, data-quality strategy, SQL window functions, Next.js and React architecture, or shipping LLM features to production — RAG, agents, evals.

Currently exploring Databricks & Delta Lake, Snowflake, Hadoop / Hive, Kafka Streams and Data contracts. Fundamentals I keep sharp: data structures and algorithms, OOP, DBMS, operating systems, computer networks and system design.

Name
D L Narayana
Based in
Visakhapatnam, India
Education
B.Tech Computer Science & Engineering · GITAM · Class of 2027
Roles
Data engineer · Full-stack developer · AI product engineer
Exploring
Databricks & Delta Lake · Snowflake · Hadoop / Hive · Kafka Streams · Data contracts
CGPA
7.97 / 10

Now — what the work is about

  • 01

    Streaming lakehouses

    CDC from PostgreSQL through Debezium and Kafka into Spark Structured Streaming; SCD2, quarantine and backfills that share one transform set.

  • 02

    Agents with brakes

    LangGraph supervisors whose high-risk actions stop at a policy gate and a human approval — traced, evaluated, tested offline.

  • 03

    ML in the browser tab

    ONNX Runtime Web and WASM pipelines for KYC and document forensics that never upload the document.

  • 04

    Reading & running locally

    Databricks & Delta Lake, Snowflake, Hadoop/Hive, Kafka Streams and data contracts — not yet shipped, so not yet claimed.

Working principles

  1. 01

    Idempotent pipelines

    Replaying the same offsets or re-running a backfill yields identical tables. Retries are safe by construction, not by hope.

  2. 02

    Explicit schemas

    Every source is read with a declared StructType. Inference is only used to detect drift and log it before it becomes nulls.

  3. 03

    Tests for every transform

    One set of transforms powers both the stream and the batch path, so a single pytest suite covers both.

  4. 04

    Metrics for every run

    JSON structured logs, per-stage timers, quarantine breakdowns and run metrics files — observable by default.

02Stack

Tools chosen for failure modes, not logos.

The ledger below is computed from every project’s declared stack — each filled cell is a repository you can open. “Exploring” means reading and running locally, not yet shipping.

Airflow2 projects
LakeFlowRetail ETL
Docker2 projects
LakeFlowAeroSentry
ONNX Runtime Web2 projects
VeriLensVeriDoc
Parquet2 projects
LakeFlowRetail ETL
Playwright2 projects
VeriLensDocuForge
PostgreSQL2 projects
LakeFlowCityHelp
PySpark2 projects
LakeFlowRetail ETL
pytest2 projects
LakeFlowRetail ETL
PyTorch2 projects
VeriDocDocuForge
Recharts2 projects
CityHelpGitHubLens

Data

  • Apache Spark
  • PySpark
  • Spark SQL
  • Structured Streaming
  • Apache Kafka
  • Debezium CDC
  • Apache Airflow
  • Parquet lakehouse
  • Star schema · SCD2
  • Data-quality gates
  • PostgreSQL
  • MongoDB
  • Docker Compose
  • pytest

Web

  • TypeScript
  • React
  • Next.js
  • Node.js
  • Python
  • Java
  • SQL
  • Prisma
  • Tailwind CSS
  • Motion
  • Supabase

AI

  • LLM integration
  • RAG pipelines
  • Embeddings & vector search
  • AI agents (LangGraph)
  • Evals & guardrails
  • ONNX Runtime Web
  • PyTorch

Fundamentals

  • Data structures & algorithms
  • OOP
  • DBMS
  • Operating systems
  • Computer networks
  • System design

Exploring

  • Databricks & Delta Lake
  • Snowflake
  • Hadoop / Hive
  • Kafka Streams
  • Data contracts

03Timeline

A short record, densely written.

Dates come from repository creation and push timestamps, not memory.

  1. Sep 2026

    Data engineering, in public

    Published LakeFlow (real-time CDC lakehouse) and Retail Lakehouse ETL (PySpark batch warehouse), plus AeroSentry — a multi-agent operations layer with a human-in-the-loop safety gate.

  2. Aug 2026

    ResumeForge

    A privacy-first career toolkit with a real-time ATS engine — pure HTML/CSS/JS, zero runtime dependencies, 36 commits over five days.

  3. Jul 2026

    On-device verification trio

    VeriLens, VeriDoc Studio and DocuForge: KYC, Indian document verification and forgery forensics running entirely in the browser on ONNX/WASM.

  4. Jun 2026

    Ten products in one month

    CityHelp, StayNest, AlgoViz, CryptoLab, GitHubLens, CodeRunner, Stillpoint, Typeflow, Spectra and Nova — each deployed live on Vercel.

  5. Dec 2025

    github.com/D-L-Narayana

    Account created; the public record starts here.

  6. Class of 2027

    B.Tech CSE, GITAM

    Computer Science & Engineering, Class of 2027, Visakhapatnam. CGPA 7.97/10.