Enhancing Information Retrieval with AI-Augmented Annotation
Quick Start | Explore the Paper | Cite AIANO
Streamline your dataset creation with intelligent AI assistance and intuitive human-in-the-loop workflows.
AIANO is an AI-native annotation platform designed to streamline the creation of high-quality datasets for information retrieval tasks, such as RAG evaluation and machine learning model training. Built entirely with open-source technologies, it combines intelligent AI assistance with intuitive manual annotation workflows to make dataset creation faster, more consistent, and more efficient.
The fastest way to get AIANO running is using Docker Compose.
# Clone the repository
git clone https://github.com/TIO-IKIM/AIANO.git
cd AIANO
# Initialize environment files
cp api/.env.example api/.env
cp ui/.env.example ui/.env
# Build and start all services
docker compose up --build -dAccess the platform at:
- Frontend: http://localhost:3000
- Backend API: http://localhost:8000/docs
- π€ Native AI Integration β Works with any OpenAI-compatible API provider (Local or Cloud).
- π Multi-Document Management β Seamlessly manage multiple documents within a single project.
- π Advanced Search β Quickly locate and filter content for precise annotations.
- β‘ Smart Annotations β High-speed highlighting with customizable relevancy levels.
- π§© AIANO Blocks β A modular paradigm for humanβAI collaborative annotation.
AIANO Blocks support flexible annotation workflows across three distinct modes:
| Mode | Description |
|---|---|
| Plain Mode | Traditional manual annotation without AI assistance. |
| Solo AI Mode | Tasks are pre-filled with AI-generated suggestions for human review. |
| HumanβAI Mode | Collaborative mode where AI and human inputs are combined. |
If you prefer to run the components manually outside of Docker:
cd api
uv sync
uv run alembic upgrade head
uv run uvicorn src.main:app --reloadcd ui
yarn install
yarn devaiano/
βββ api/ # Python Backend (FastAPI + SQLAlchemy)
β βββ src/ # Core application logic & routes
β βββ alembic/ # Database migration history
βββ ui/ # React Frontend (TypeScript + Vite)
β βββ src/ # Components, containers, and services
βββ docs/ # Project documentation & assets
- Frontend: React 19, TanStack Router, Zustand, Tailwind CSS.
- Backend: FastAPI, SQLAlchemy, Alembic, Pydantic.
- Database: PostgreSQL.
- Infrastructure: Docker, Docker Compose.
Encountering issues? Check our Troubleshooting & Debugging Guide for solutions to common database, migration, and build problems.
If you use AIANO in your research, please cite our work:
@misc{khattab2026aianoenhancinginformationretrieval,
title={AIANO: Enhancing Information Retrieval with AI-Augmented Annotation},
author={Sameh Khattab and Marie Bauer and Lukas Heine and Till Rostalski and Jens Kleesiek and Julian Friedrich},
year={2026},
eprint={2602.04579},
archivePrefix={arXiv},
primaryClass={cs.IR},
url={https://arxiv.org/abs/2602.04579},
}AIANO is released under the Apache License 2.0. See the LICENSE file for more details.