Explainable developer assessment platform with multi-path evaluation, evidence-based scoring, and growth-focused feedback. Helps candidates understand their strengths and areas for improvement. Built with Python, FastAPI, and Docker.

A Streamlit web app that uses a Groq-powered LLM (Llama 3) to act as an impartial judge for evaluating and comparing two model outputs. Supports custom criteria, presets like creativity and brand tone, and returns structured scores, explanations, and a winner. Built end-to-end with Python, Groq API, and Streamlit.

Artha is a code evaluation system developed with Django and Django REST Framework that uses Judge0 as the code execution engine.

An open-source Python library for code encryption, decryption, and safe evaluation using Python's built-in AST module, complete with allowed functions, variables, built-in imports, timeouts, and blocked access to attributes.

SocratiQ AI uses socratic method of teaching to guide users through learning, asking questions that prompt critical thinking and problem-solving rather than providing direct answers.

Gowlin: Open-source Secure autograder for LLM agent development and evaluation

Python toolkit for automated evaluation and benchmarking of code efficiency, performance, and resource usage. Easily analyze, compare, and score scripts or code snippets in a fast, modular CLI workflow.

Industrial-level evaluation benchmarks for Coding LLMs in the full life-cycle of AI native software developing.企业级代码大模型评测体系,持续开放中

Pip compatible CodeBLEU metric implementation available for linux/macos/win

The SF Code Evaluator

Backend for automated evaluation of programming tasks in higher education

Python library to interact synchronously and asynchronously with tio.run