DATA & AI ENGINEER

Building agent workflows and the data platform underneath them.

I'm Duyet — a Senior Data & AI Engineer. I focus on the foundational systems that make software work: data pipelines that scale, platforms that stay reliable, and AI agents that are actually useful. I build systems that are simple to operate and transparent about what they do — and I open-source most of what I build.

01Selected work

Things I've shipped

An autonomous agent skill designed to help build, run, and scale downstream AI agent systems.

AI Skill

Codex and Claude Code plugins for AI-powered development workflows.

AI

One API for every AI model. Route traffic across providers with fallback, observability, and BYOK from a single OpenAI-compatible endpoint built on Cloudflare's edge.

AI Infra

ClickHouse monitoring with AI agent support for finding insights, monitoring clusters, and triaging activity

Data

State store for AI agents — persistent memory and state management for agent workflows.

AI

Model Context Protocol tools and integrations

AI

Query an LLM directly via DNS TXT records — `dig @llm.duyet.net 'explain quantum computing' TXT +short`

AI Infra

Import Claude Code usage data (ccusage) into ClickHouse for long-term analytics.

Data

Analyze your Claude Code usage with DuckDB — query session stats, token costs, and model breakdown.

Data

Rust programming language documentation in Vietnamese

Rust

URL shortener with analytics and custom domains

Tool

Collection of useful Helm Charts, well-tested with KinD and Kubeconform.

Infra
02Writing

From the blog

03Discipline

Areas of Expertise

Data Engineering

8yr

End-to-end pipelines from raw event streams to analytics-ready tables. ClickHouse as the primary OLAP layer — petabyte-scale ingestion, columnar query optimization, and materialized view patterns. Airflow for orchestration; Spark for heavy batch transforms.

312projects

ClickHouseClickHouse
Apache SparkApache Spark
Apache AirflowAirflow
BigQuery
Apache KafkaKafka
dbt
Python

AI Agent Engineering

4yr

Agent frameworks, model routing, and evaluation infrastructure. AnyRouter for multi-provider fallback and BYOK routing. LangGraph and LlamaIndex for workflow orchestration. Usage analytics baked in from day one.

87projects

ClaudeClaude API
LangGraphLangGraph
LlamaIndexLlamaIndex
AI SDK
TypeScript

Cloud Infrastructure

6yr

Kubernetes clusters on AWS and GCP, Helm chart authoring, Terraform for IaC. Cloudflare Workers for edge compute — zero cold-start, global, cheap.

145projects

Kubernetes
Terraform
AWSAWS
GCP
Cloudflare

Backend & APIs

7yr

REST and GraphQL services in Python, Rust, and TypeScript. Cloudflare D1 + KV for edge-native persistence. Durable Objects for stateful agent sessions.

204projects

Rust
Python
TypeScript
Cloudflare Workers
D1

Frontend & UI

5yr

React and TanStack Start with SSG. shadcn/ui + Tailwind as the component layer across 8 sibling apps. Performance-first: sub-second LCP, no hydration overhead for static routes.

178projects

React
TanStack Start
shadcn/ui
Tailwind CSS

DevOps & Observability

5yr

GitHub Actions CI/CD with Turborepo caching. Structured logging into ClickHouse; MotherDuck for ad-hoc querying. OpenTelemetry traces for agent workflows.

93projects

GitHub ActionsGitHub Actions
Turborepo
OpenTelemetryOpenTelemetry
Grafana

Open Source

8yr

Public libraries, dashboards, and reference implementations. rust-tieng-viet, ClickHouse Monitor, ShareHTML, LLM Timeline — built and maintained openly.

54projects

Rust
TypeScript
OSS
GitHub