Conf42: Incident Management 2023

Leveraging SRE and Observability Techniques for the Wild World of Building on LLMs

Building on LLMs is magical—but maintaining LLM-backed code is tricky: how do you ensure perf/correctness for something probabilistic? It's like building on any black box (eg APIs/DBs). We'll cover instrumentation techniques, uses for observability best practices, and even using SLOs early in dev.