Skip to content
Almaz-KGPublic

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

Data engineer moving into ML infrastructure
╔══════════════════════════════════════════════════╗
║  almaz@amsterdam:~$ whoami                       ║
║                                                  ║
║  Senior data engineer, transitioning to MLOps    ║
║  and ML infrastructure engineering.              ║
║                                                  ║
║  status: training | measuring | writing it down  ║
╚══════════════════════════════════════════════════╝

What I'm building

focus = {
    "now":     ["pretraining", "MFU and FLOP accounting", "distributed PyTorch"],
    "next":    ["inference as a storage hierarchy", "KV cache tiering"],
    "day job": ["CICD", "Databricks", "dbt", "Terraform", "GCP"],
}
Python, PyTorch, Rust, TypeScript, React, FastAPI, Docker, Kubernetes, Linux, Git, GitHub Actions; GCP, BigQuery, dbt, Airflow, Spark, Databricks, Kafka, Terraform, Postgres

Elsewhere

  • almaz.murzabekov.net - notes on what broke, with the numbers behind it.
  • nookat - a lightweight container manager in Tauri, Rust and React.

If you are working on the same seam between data engineering and ML infrastructure, open an issue on any of these repos.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages