Skip to content

Repository files navigation

Anna's Archive Hub

Gemini_Generated_Image

πŸ”₯ Self-updating domain tracker for Anna's Archive and shadow libraries β€” with real-time verification and permanent IPFS publishing. Never lose access again.

License: MIT Python 3.12+ IPFS Ask DeepWiki

πŸ‡ͺπŸ‡Έ VersiΓ³n en espaΓ±ol


πŸ“‘ Latest Report (IPFS β€” Immutable)

Current CID: QmYebyxQ7PV6cBMN7SXW2yVBsqb2qkiyUZ93e28KT887vT

Gateway Link
ipfs.io Open report
dweb.link Open report
Pinata Open report

The CID is updated automatically every 12 hours. Older CIDs remain permanently accessible.


βœ… Active Domains (Last Verified)

Domain Status
annas-archive.gl βœ… Active
annas-archive.pk βœ… Active
annas-archive.gd βœ… Active
libgen.bz βœ… Active
libgen.gl βœ… Active
libgen.la βœ… Active
libgen.vg βœ… Active
z-library.bz βœ… Active
z-library.se βœ… Active
welib.org βœ… Active

⚠️ Some domains (z-lib.gl, go-to-library.sk, etc.) require opening in a browser due to Cloudflare protection.


πŸ›‘ Security Warning β€” Fake CAPTCHA Scams ("ClickFix")

NEVER follow a "captcha" or "human verification" page that asks you to open PowerShell, CMD, Terminal, or the Run dialog (Win + R) and paste or execute a command.

No legitimate captcha ever requires interacting with your terminal. These pages silently copy a malicious command to your clipboard and trick you into running it β€” infecting your machine with malware.

If any mirror or link shows this kind of "verification": close the tab immediately and do not paste anything.


πŸš€ How It Works

open-slum.org ──┐
Reddit / X    ──┼──► candidates ──► HTTP verify ──► active ──► IPFS ──► QR / USB
Telegram      β”€β”€β”˜
Mastodon      β”€β”€β”˜
Feature Description
πŸ•·οΈ Multi-source crawler open-slum.org + Reddit + X/Twitter + Telegram + Mastodon
βœ… Smart verification curl_cffi with Chrome impersonation to bypass blocks
🚫 Spam filtering Blocks fake domains and spam Telegram channels
πŸ“¦ IPFS publishing Immutable report pinned to Pinata β€” no server needed
πŸ—³οΈ Voting system ⚠️ Currently unavailable β€” domains are discovered via the crawlers only
⏱️ Auto-scheduled Runs unattended via cron every 12 hours

πŸ› οΈ Installation

Requirements: Python 3.12+, Git

git clone https://github.com/D4vRAM369/annas-archive-hub
cd annas-archive-hub

# Create and activate virtual environment
python -m venv venv
source venv/bin/activate        # Linux / macOS
# venv\Scripts\activate         # Windows

pip install -r requirements.txt
cp .env.example .env            # optional β€” see Configuration below

πŸ–₯️ Usage

There are two ways to use this tool:

Option A β€” Interactive menu (main.py)

For manual control. Run it, pick an option, see results on screen.

python main.py
╔════════════════════════════════════════════════════════════════════════════╗
β•‘                        ANNA'S ARCHIVES HUB                                β•‘
β•‘             Self-updating domain tracker + IPFS immortality                β•‘
β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•

  1. Test static domains          β†’ checks the hardcoded domain list
  2. Test all domains             β†’ static + community-voted domains
  3. Add a domain manually        β†’ propose a new domain for testing
  4. Vote for a domain            β†’ upvote a candidate domain
  5. View pending domains         β†’ domains waiting for votes
  6. Publish report to IPFS       β†’ pin results to Pinata / local node
  7. Show latest IPFS hash        β†’ display current CID + public URLs
  8. Crawl open-slum.org          β†’ discover new domains from open-slum
  9. Crawl social sources         β†’ Reddit, X/Twitter, Telegram, Mastodon
  0. Exit

⚠️ Note: The voting system (options 3–5) is currently not functional. New domains are discovered exclusively through the automated crawlers (options 8–9).

Option B β€” Automated pipeline (run.py)

Runs everything unattended in sequence: crawl β†’ verify β†’ publish β†’ log. Designed for cron. No interaction needed.

python run.py
[1/5] Crawling open-slum.org...     β†’ finds candidate domains
[2/5] Crawling social sources...    β†’ Reddit, X, Telegram, Mastodon
[3/5] Testing N domains...          β†’ verifies each one is alive
[4/5] Publishing to IPFS...         β†’ pins report, prints CID
[5/5] Saving log...                 β†’ appends to logs/update.log
βœ… Done

Automate with cron (every 12 hours)

crontab -e

Add this line (replace the path with your actual clone location):

0 */12 * * * cd /home/youruser/annas-archive-hub && source venv/bin/activate && python run.py >> logs/cron.log 2>&1

βš™οΈ Configuration

Copy .env.example to .env and fill in your Pinata credentials for permanent IPFS pinning (free plan: 1 GB):

PINATA_API_KEY=your_key_here
PINATA_API_SECRET=your_secret_here

Without Pinata: reports publish to your local IPFS node (requires the IPFS daemon running). The tool works without any credentials β€” IPFS publishing is optional.


πŸ“ Project Structure

anna-archive-hub/
β”œβ”€β”€ main.py                    # Interactive menu (9 options)
β”œβ”€β”€ run.py                     # Automated pipeline (for cron)
β”œβ”€β”€ config/
β”‚   └── settings.py            # Central configuration
β”œβ”€β”€ core/
β”‚   β”œβ”€β”€ domain_tester.py       # Domain verification with curl_cffi
β”‚   β”œβ”€β”€ domain_extractor.py    # Regex domain extraction from free text
β”‚   β”œβ”€β”€ open_slum_crawler.py   # open-slum.org crawler
β”‚   β”œβ”€β”€ social_crawler.py      # Reddit, X, Telegram, Mastodon sources
β”‚   β”œβ”€β”€ ipfs_publisher.py      # IPFS / Pinata publishing
β”‚   └── voter.py               # Community voting system
β”œβ”€β”€ data/
β”‚   β”œβ”€β”€ current_report.json    # Latest generated report
β”‚   └── ipfs_hash.txt          # Latest published CID
β”œβ”€β”€ .env.example               # Credentials template
└── requirements.txt

🀝 Contributing

See CONTRIBUTING.md.

πŸ“„ License

MIT β€” Free for all. Keep knowledge alive.

About

Self-updating domain tracker for Anna's Archive with real-time verification and IPFS publishing. Never lose access again.

Topics

Resources

Contributing

Stars

6 stars

Watchers

0 watching

Forks

Packages

Contributors

Languages