A decade of experience in DevOps, microservices and container orchestration. These days I spend most of my time on Amazon EKS β making clusters cheaper to run, easier to upgrade, and capable of hosting GPU and generative AI workloads without the operations team paying for it later.
- ποΈ Container Architect & GenAI Practitioner at Amazon Web Services
- π¬ Working on multi-tenant GPU platforms, agentic AI on Kubernetes, and EKS day-2 operations
- βοΈ Published on the AWS Containers Blog and AWS Builder Center
- π± Open source contributor β AWS EKS Workshop, app modernization blueprints, Istio on EKS
- π Based in the New York metro area
Clouds β AWS (primary), GCP, Azure
Container & Orchestration: Amazon EKS, EKS Auto Mode,EKS capabilities, Karpenter,Helm, Argo CD,Flux
Networking: VPC CNI ,Cilium, Gateway API, kgateway, CoreDNS
Provisioning & Platform Delivery β Terraform (+ pre-commit-terraform, tflint, Checkov), Crossplane & Upbound reference platforms, AWS CDK, CloudFormation, Ansible Β· internal developer platforms and self-service APIs
Observability: OpenTelemetry,Prometheus, Grafana, AMP/AMG + ADOT, Langfuse, Hubble
GitOps & Pipelines β Argo CD, Argo Rollouts, Argo Workflows, Flux Β· multi-cluster GitOps topologies Β· GitHub Actions, Jenkins, AWS CodePipeline / CodeBuild
Traffic, Mesh & Connectivity β Istio, Envoy (external processing filters) Β· Gateway API, AWS Load Balancer Controller, ALB/NLB Β· VPC CNI, CoreDNS, ExternalDNS, cert-manager,Route 53, CloudFront, PrivateLink, Transit Gateway
Accelerated Compute & Training β NVIDIA GPU Operator, device plugin, DCGM exporter, MIG partitioning Β· Karpenter GPU provisioning, Spot capacity, EFA networking Β· multi-tenant scheduling, quotas and cost attribution on EKS
AI/ML Inference, Serving & Gateway: vLLM,NeMo Framework, AWS Neuron / Trainium2 / Inferential2, Ray Serve, NVIDIA Triton, Amazon Bedrock AgentCore,kgateway + agentgateway, Bifrost, LiteLLM
AI Agents Frameworks : Strands Kagent, MCP, LangGraph, CrewAI, langchain
Security, Identity & Compliance: IRSA, EKS Pod Identity,External Secrets Operator, AWS Secrets Manager, Prowler, Kyverno, OPA Gatekeeper, Trivy Β· GuardDuty, Inspector, Security Hub, Keycloak, OAuth2-Proxy (OIDC)
MLOps: MLflow, Kubeflow, KServe
Vector DB & Evaluation: Milvus, RAGAS, LLM-as-a-Judge, Langfuse Custom Evaluators
Languages: β Go, Python, Bash
NVIDIA Stack: GPU Operator, Network Operator, k8s-device-plugin, DCGM / DCGM Exporter Β· MIG partitioning, time-slicing, KAI Scheduler (Run:ai) Β· CUDA, cuDNN, NCCL, NVLink / NVSwitch, GPUDirect RDMA Β· TensorRT, TensorRT-LLM, Triton Inference Server, NIM microservices, NeMo Framework & Guardrails, Dynamo Β· DGX / HGX (H100, H200, GB200), BlueField DPU & DOCA Β· NGC catalog, AI Enterprise, Nsight profiling
Migration Strategy β 7 Rs assessment (rehost, replatform, repurchase, refactor, retire, retain, relocate) Β· portfolio discovery and wave planning Β· Migration Acceleration Program (MAP) engagements Β· TCO and Migration Evaluator business cases
Kubernetes & Container Migrations β self-managed Kubernetes β Amazon EKS Β· ECS β EKS Β· OpenShift β ROSA Β· on-prem β EKS Anywhere and Hybrid Nodes Β· Velero backup/restore and cluster relocation Β· in-place EKS version upgrades with eksup Β· CNI swaps (VPC CNI β Cilium), Ingress β Gateway API, Cluster Autoscaler β Karpenter
Application Modernization β monolith decomposition and strangler-fig migrations Β· containerization and 12-factor refactoring Β· serverless with Lambda, Fargate and Step Functions Β· event-driven architecture with EventBridge, SQS/SNS and MSK Β· API-first with API Gateway and gRPC
- Full request and response compliance logging on Amazon EKS Β· AWS Containers Blog
- Better Together: Amazon EKS Auto Mode and Istio Ambient Mesh Β· AWS Containers Blog
- Enabling swap memory on EKS with Karpenter Β· AWS Builder Center
- Optimizing IP usage with subnet selection in EKS Auto Mode Β· AWS Builder Center
- Automating Kubernetes version monitoring and upgrades Β· AWS Builder Center
More on AWS Builder Center