Evaluating AI applications, not just models.
Evals.cz is a Prague-based meetup for people who build or explore AI-powered products. Model benchmarks on leaderboards are interesting, but how do you evaluate a specific RAG pipeline in production?
Next meetup: January 14 at Filevine — agenda and registration coming soon
Subscribe to the event calendar on LumaEvaluating retrieval quality and end-to-end RAG pipelines in production
How to detect and fix issues in deployed AI systems
Evaluation approaches combining human expertise with automation
Integrating evaluations into development and CI/CD pipelines
You deploy and monitor models in production
You integrate LLMs or RAG into existing products
You measure and improve AI system performance
You need to understand AI feature quality
You study AI reliability and safety
Practical interest and curiosity are welcome
"What broke in production and how we fixed it" — no sales pitches
Two-hour online session on evaluation fundamentals. Concepts, live demo and Q&A.