# Omar Elcircevi > Omar Elcircevi (omarcevi) is a machine learning engineer based in Istanbul, Turkey, who builds production ML inference systems: model serving with vLLM and NVIDIA Triton, GPU sharing with MIG, and Kubernetes on cloud and on-prem, increasingly for AI agents in production. He is a Google Developer Expert in Cloud AI, co-organizes GDG Istanbul, and speaks at DevFest, Build with AI and Google developer events in Turkish and English. Türkçe özet: Omar Elcircevi, İstanbul'da yaşayan bir makine öğrenmesi (ML) mühendisidir. Üretimde çalışan ML çıkarım (inference) sistemleri kurar: vLLM ve NVIDIA Triton ile model sunumu, MIG ile GPU paylaşımı, bulut ve on-prem Kubernetes ve üretimde yapay zeka ajanları. Google Developer Expert (Cloud AI) ve GDG Istanbul organizatörüdür. ## Experience - Trendyol (Istanbul), Machine Learning Engineer, Inference Platform, March 2024 – September 2026: ran model serving for 40M+ across 35 different countries users at over 1M requests per minute with Triton and vLLM on GKE and on-prem Kubernetes; reconfigured H100 GPUs with MIG for about 1.75x more serving capacity; designed the platform's deployment client, auth, active zone switching and pipeline event notifications; built TensorRT conversion pipelines; benchmarked AMD MI325X against NVIDIA H200 for LLM and ranking workloads. - Turkcell (Istanbul), AI & Analytical Solutions, 2022 – 2024. ## Focus areas - ML inference and model serving: vLLM, NVIDIA Triton Inference Server, TensorRT, dynamic batching, p99 latency, GPU utilization, NVIDIA MIG - ML platform engineering on Kubernetes (GKE and on-prem) - AI agents in production: Google Agent Development Kit (ADK), MCP, A2A, Vertex AI, Agent Runtime ## Projects - [tensorhane.com](https://tensorhane.com): a Turkish platform for learning machine learning by writing and running Python code, with interactive demos of gradient descent, BPE tokenization, attention and the KV cache. - [sdlc-agent-pipeline](https://github.com/omarcevi/sdlc-agent-pipeline): planner, coder and reviewer agents in a Google ADK graph that turn a GitHub issue into a tested pull request, with sandboxed tools, cost caps and human approval. [Recorded runs](https://omarcevi.dev/sdlc-agent-pipeline/) - [vllm-metal-bench](https://github.com/omarcevi/vllm-metal-bench): load testing vllm-metal on an Apple M1 Pro with AIPerf; bursty traffic made time-to-first-token about 5x worse than steady traffic at the same average rate. - [triton-beginner-demo](https://github.com/omarcevi/triton-beginner-demo): first model on NVIDIA Triton Inference Server, with dynamic batching, perf_analyzer and GKE deployment. - [augury](https://github.com/omarcevi/augury): a terminal-native AI research digest built with Google ADK. - [claude-caps](https://github.com/omarcevi/claude-caps): a Claude Code plugin with Turkish meme reactions. ## Talks and workshops - Retrieval Is All You Need (Almost) — DevFest İzmir 2026, 5 December 2026 · İzmir, Tepekule Congress Center, Bayraklı · [tickets](https://kommunity.com/gdg-izmir/events/devfest-izmir-2026-16cae32b) - Finansal Verilerle Yapay Zekâyı Buluşturmak (workshop) — Işık IEEE Computer Society, 18 November 2026 · Istanbul, Işık University Şile Campus (DMF-214) · [guide](https://omarcevi.dev/workshops/pytorch-finance-workshop/) · [repo](https://github.com/omarcevi/pytorch-finance-workshop) - Build Your Coding Agent with Google ADK (workshop) — DevFest Kocaeli 2026, 14 November 2026 · Kocaeli, Emexotel · [guide](https://omarcevi.dev/workshops/coding-agent-workshop/) · [repo](https://github.com/omarcevi/coding_agent_workshop) - Building Trabzonspor's AI Analysis Room (workshop) — DevFest Trabzon 2026, 31 October 2026 · Trabzon, Prof. Dr. Osman Turan Congress Center, KTÜ · [guide](https://omarcevi.dev/workshops/match-day-agents/) · [repo](https://github.com/omarcevi/trabzonspor_analyst) - Deploying your agents on Google Cloud Agent Platform (workshop) — Google Cloud Day Türkiye – Builder Connect, 27 October 2026 · Istanbul, Wyndham Grand Levent · [guide](https://omarcevi.dev/workshops/cloud-agents-workshop/) · [repo](https://github.com/omarcevi/cloud-agents-workshop) - Deploy your first AI agent to Google Cloud (workshop) — DevFest Samsun 2026, 24 October 2026 · Samsun, Colombia Coffee Ömürevleri · [guide](https://omarcevi.dev/workshops/devfest-samsun-agent/) · [repo](https://github.com/omarcevi/devfest-samsun-assistant) - Architecting Multi-Agent Systems with Google ADK (workshop) — Google Developer Day Istanbul, 9 October 2026 · [guide](https://omarcevi.dev/workshops/adk-multi-agent-workshop/) · [repo](https://github.com/omarcevi/adk-multi-agent-workshop) - Managing Agentic Systems on Google Cloud: From Deployment to Monitoring — Google Developer Day Istanbul, September 2026 - Gemma Train-the-Trainer: Running AI Models (workshop) — Google Developer Experts, August 2026 - Agentverse: Multi-Agent Systems with ADK, MCP and A2A (workshop) — May 2026 - Build with AI: Google Antigravity (workshop) — 42 Türkiye, 25 April 2026 - Build with AI: Vertex AI Studio (workshop) — 42 Türkiye, 18 April 2026 - Build with AI: Build a Gemini-Powered YouTube Summarizer with the GenAI SDK (workshop) — 42 Türkiye, 11 April 2026 - Vapurda Tech Talk 2025 — GDSC Marmara, 2025 · [photos](https://www.instagram.com/p/DSJzQRmDYa2/) - Architecture of High Performance ML Solutions — GDG Baku, 22 November 2025 - How AI Agents Can Save You: Google Agent Development Kit Demo — GDG Istanbul – Build with AI Extended, 17 May 2025 · Istanbul, Trendyol Campus - Supercharging AI Agents with Gemini 2.0 (workshop) — GDG Istanbul – Build with AI, 27 February 2025 · Istanbul, Google Istanbul Office - Vapurda Tech Talk 2024 — GDSC Marmara, 2024 · [photos](https://www.instagram.com/p/DDM_0NWgiXV/) - The Dark Side of ML: Exploring Vulnerabilities in ML Systems — DevFest Trabzon 2023, 2023 · [photos](https://www.instagram.com/p/CzMdVHatqDF/) - MLOps in the Age of GenAI — DevFest Izmir 2023, December 2023 · [photos](https://www.instagram.com/p/CzEh2MAMk6B/) - Machine Learning Event — GDSC Sabancı, November 2023 · [photos](https://www.instagram.com/p/CzT_LVKt2Vp/) - MLOps in the Age of GenAI — DevFest Istanbul 2023, 26 November 2023 · Istanbul, UNIQ Istanbul · [video](https://www.youtube.com/watch?v=PKqyohMo4I8&t=928s) - MLOps in the Age of GenAI — DevFest Kocaeli 2023, 4 November 2023 · Kocaeli, Kocaeli Kongre Merkezi · [photos](https://www.instagram.com/p/CzJqZuHN2bi/) - TensorFlow Applications — GDG Samsun – Talk About ML, 20 August 2023 · [video](https://www.youtube.com/live/7eqp89f7GiA) - TensorFlow Workshop: Cloud Computer Vision (workshop) — GDSC Marmara, 20 May 2023 · [video](https://www.youtube.com/live/Q5DB-fs1lkU) - Beyond ML Notebook — GDG Istanbul, 18 March 2023 · Istanbul, Zemin İstanbul - TensorFlow Workshop 2: Computer Vision and CNNs (workshop) — GDSC Bilkent, 31 December 2022 · [video](https://www.youtube.com/live/MzlWHu2D1z4) - TensorFlow Workshop 1: Intro to TensorFlow (workshop) — GDSC Bilkent, December 2022 · [video](https://youtu.be/TPJp42fF12I) - But What Is TensorFlow? — GDSC Üsküdar & GDSC 29 Mayıs, 30 December 2022 · [video](https://www.youtube.com/live/5llTde9TLdA) ## Writing - [Your Model Works in a Notebook. Now What? A Friendly Intro to NVIDIA Triton Inference Server](https://levelup.gitconnected.com/your-model-works-in-a-notebook-now-what-a-friendly-intro-to-nvidia-triton-inference-server-6a3887b0dd2b) - [One H100, Many Models: What I Learned Sharing GPUs on Kubernetes](https://omarcevi.medium.com/one-h100-many-models-what-i-learned-sharing-gpus-on-kubernetes-9eb635db2311) - [All posts on Medium](https://omarcevi.medium.com) ## Open source - [google/adk-python #3037](https://github.com/google/adk-python/pull/3037): fix for third-party CrewAI tool integration - [google/adk-web #272](https://github.com/google/adk-web/pull/272): light theme for the ADK web UI ## Availability - Open to new roles: senior or staff-level ML inference, model serving or ML platform engineering, including AI agents in production. Remote (global) or Istanbul. - Open to collaborations: conference talks and workshops (Turkish or English), open-source work, and advising teams on serving models and AI agents in production. - Yeni rollere ve iş birliklerine açık: ML inference / ML platform mühendisliği (uzaktan veya İstanbul), konuşmalar, atölyeler ve açık kaynak. - Best way to reach him: hello@omarcevi.dev - Book a call: https://calendar.google.com/calendar/appointments/schedules/AcZssZ0eb5WUAIpBMx4QPBcHLYvEkpsTizdL89jBUa6UXEfyqFAB_blGgZgBPyEFoXzoag5z6xWIRzHT?gv=true ## Contact - Website: https://omarcevi.dev/ - Email: hello@omarcevi.dev - LinkedIn: https://www.linkedin.com/in/omarcevi/ - GitHub: https://github.com/omarcevi - Medium: https://omarcevi.medium.com