Skip to content
View breuert's full-sized avatar

Organizations

@irgroup @osirrc

Block or report breuert

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
breuert/README.md

Python packages

  • scrydb: Lexical, dense and hybrid search with SQLite. Documents, embeddings and the lexical index are stored in a single SQLite file, and the library works with Sentence Transformers or precomputed embeddings. [scrydb-eval], [Hugging Face], [arXiv].

Browser tools

  • trec-eval-web: trec_eval in the browser. Load qrels and up to eight TREC runs to get trec_eval's measures as tables, cutoff plots, per-topic views and trec_eval's own text output, all in one offline HTML file. [Live page].

  • repro-eval-web: A browser dashboard for repro_eval. Load TREC runs and qrels to get reproducibility and replicability measures (KTU, RBO, RMSE, ER, ΔRI, t-tests) as tables, plots and exports, without data leaving your machine. [Live page].

  • rbo: An interactive explainer for rank-biased overlap (RBO) that shows how the persistence parameter p decides which ranks a score depends on. [Live page].

Teaching resources

  • Data Integration: Resources of the BSc Data Integration course running at TH Köln - University of Applied Sciences. The course teaches the basics of working with data-driven questions. [Live page].

Pinned Loading

  1. irgroup/repro_eval irgroup/repro_eval Public

    A Python Interface to Reproducibility Measures of System-Oriented IR Experiments

    Python 11 2

  2. usnistgov/trec-browser usnistgov/trec-browser Public

    Metadata browser of TREC

    Jupyter Notebook 12 3

  3. sigirap24 sigirap24 Public

    Data Fusion of Synthetic Query Variants With Generative Large Language Models

    Jupyter Notebook 6

  4. acmrep24 acmrep24 Public

    Toward Evaluating the Reproducibility of Information Retrieval Systems with Simulated Users

    Jupyter Notebook

  5. irgroup/ecir2022-uqv-sim irgroup/ecir2022-uqv-sim Public

    Validating Simulations of User Query Variants

    Python 4 1

  6. centre19 centre19 Public

    Replicability and Reproducibility of Automatic Routing Runs

    Python