基于PowerCenter的数据质量监控系统

Ergebnisse der Datenanalyse vom Feinstaub Hackathon 2018 der Stuttgarter Zeitung

TellMeQuality is a tool for measuring Data Quality according to ISO/IEC 25024.

GEM light DQM code

R code for the discovery of COVID-19 subgroups by symptoms and comorbidities.

To describe age-gender unbiased COVID-19 subphenotypes regarding severity patterns through a two-stage clustering approach using patient phenotypes and demographic features. Additional source and temporal variability assessments are included as part of data quality analyses.

LEILA - Librería de calidad de datos

FIMUS imputes numerical and categorical missing values by using a data set’s existing patterns including co-appearances of attribute values, correlations among the attributes and similarity of values belonging to an attribute.

This GitHub repository provides a comprehensive set of tools and algorithms for detecting fraud anomalies in various data sources. Fraudulent activities can have severe consequences, impacting businesses and individuals alike. With this repository, we aim to empower researchers with effective techniques to identify and prevent fraudulent behavior.

A comprehensive repository housing a collection of insightful blog posts, in-depth documentation, and resources exploring various facets of data engineering. From ETL processes and database management to orchestration tools, data quality, monitoring, and deployment strategies

Metrics Observability & Troubleshooting

Collection of R scripts to test packages in conducting data quality assessments

re_data - fix data issues before your users & CEO would discover them 😊

R package for delineating temporal dataset shifts in Eletronic Health Records

Data file examples and user guides for VerityPy and VerityDotNet libraries

Comprehensive data governance pipeline for SSH honeypot logs—covering data profiling, cleansing, quality assurance, encryption, classification, and GDPR/CCPA/HIPAA compliance. Built with Pandas, Pandera, YData Profiling, and cryptography, with simulated Caesar cipher attacks to demonstrate practical data-security techniques.

Detecting errors and anomalies in structured data using automation

A web application for displaying automation test reports.