π₯ Self-updating domain tracker for Anna's Archive and shadow libraries β with real-time verification and permanent IPFS publishing. Never lose access again.
Current CID: QmYebyxQ7PV6cBMN7SXW2yVBsqb2qkiyUZ93e28KT887vT
| Gateway | Link |
|---|---|
| ipfs.io | Open report |
| dweb.link | Open report |
| Pinata | Open report |
The CID is updated automatically every 12 hours. Older CIDs remain permanently accessible.
| Domain | Status |
|---|---|
| annas-archive.gl | β Active |
| annas-archive.pk | β Active |
| annas-archive.gd | β Active |
| libgen.bz | β Active |
| libgen.gl | β Active |
| libgen.la | β Active |
| libgen.vg | β Active |
| z-library.bz | β Active |
| z-library.se | β Active |
| welib.org | β Active |
β οΈ Some domains (z-lib.gl, go-to-library.sk, etc.) require opening in a browser due to Cloudflare protection.
NEVER follow a "captcha" or "human verification" page that asks you to open PowerShell, CMD, Terminal, or the Run dialog (Win + R) and paste or execute a command.
No legitimate captcha ever requires interacting with your terminal. These pages silently copy a malicious command to your clipboard and trick you into running it β infecting your machine with malware.
If any mirror or link shows this kind of "verification": close the tab immediately and do not paste anything.
open-slum.org βββ
Reddit / X βββΌβββΊ candidates βββΊ HTTP verify βββΊ active βββΊ IPFS βββΊ QR / USB
Telegram βββ
Mastodon βββ
| Feature | Description |
|---|---|
| π·οΈ Multi-source crawler | open-slum.org + Reddit + X/Twitter + Telegram + Mastodon |
| β Smart verification | curl_cffi with Chrome impersonation to bypass blocks |
| π« Spam filtering | Blocks fake domains and spam Telegram channels |
| π¦ IPFS publishing | Immutable report pinned to Pinata β no server needed |
| π³οΈ Voting system | |
| β±οΈ Auto-scheduled | Runs unattended via cron every 12 hours |
Requirements: Python 3.12+, Git
git clone https://github.com/D4vRAM369/annas-archive-hub
cd annas-archive-hub
# Create and activate virtual environment
python -m venv venv
source venv/bin/activate # Linux / macOS
# venv\Scripts\activate # Windows
pip install -r requirements.txt
cp .env.example .env # optional β see Configuration belowThere are two ways to use this tool:
For manual control. Run it, pick an option, see results on screen.
python main.pyββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β ANNA'S ARCHIVES HUB β
β Self-updating domain tracker + IPFS immortality β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
1. Test static domains β checks the hardcoded domain list
2. Test all domains β static + community-voted domains
3. Add a domain manually β propose a new domain for testing
4. Vote for a domain β upvote a candidate domain
5. View pending domains β domains waiting for votes
6. Publish report to IPFS β pin results to Pinata / local node
7. Show latest IPFS hash β display current CID + public URLs
8. Crawl open-slum.org β discover new domains from open-slum
9. Crawl social sources β Reddit, X/Twitter, Telegram, Mastodon
0. Exit
β οΈ Note: The voting system (options 3β5) is currently not functional. New domains are discovered exclusively through the automated crawlers (options 8β9).
Runs everything unattended in sequence: crawl β verify β publish β log. Designed for cron. No interaction needed.
python run.py[1/5] Crawling open-slum.org... β finds candidate domains
[2/5] Crawling social sources... β Reddit, X, Telegram, Mastodon
[3/5] Testing N domains... β verifies each one is alive
[4/5] Publishing to IPFS... β pins report, prints CID
[5/5] Saving log... β appends to logs/update.log
β
Done
crontab -eAdd this line (replace the path with your actual clone location):
0 */12 * * * cd /home/youruser/annas-archive-hub && source venv/bin/activate && python run.py >> logs/cron.log 2>&1
Copy .env.example to .env and fill in your Pinata credentials for permanent IPFS pinning (free plan: 1 GB):
PINATA_API_KEY=your_key_here
PINATA_API_SECRET=your_secret_hereWithout Pinata: reports publish to your local IPFS node (requires the IPFS daemon running). The tool works without any credentials β IPFS publishing is optional.
anna-archive-hub/
βββ main.py # Interactive menu (9 options)
βββ run.py # Automated pipeline (for cron)
βββ config/
β βββ settings.py # Central configuration
βββ core/
β βββ domain_tester.py # Domain verification with curl_cffi
β βββ domain_extractor.py # Regex domain extraction from free text
β βββ open_slum_crawler.py # open-slum.org crawler
β βββ social_crawler.py # Reddit, X, Telegram, Mastodon sources
β βββ ipfs_publisher.py # IPFS / Pinata publishing
β βββ voter.py # Community voting system
βββ data/
β βββ current_report.json # Latest generated report
β βββ ipfs_hash.txt # Latest published CID
βββ .env.example # Credentials template
βββ requirements.txt
See CONTRIBUTING.md.
MIT β Free for all. Keep knowledge alive.