Lib.rs

› Keywords #xml #seo #web-crawler #cache #web #static-site-generator #parser #sws

#sitemap

  1. hauchiwa

    Flexible static website generator library with incremental rebuilds and cached image optimization

    v0.18.0 #static-site-generator #static-website-generator #sitemap #ssg

  2. urx

    Extracts URLs from OSINT Archives for Security Insights

    v0.8.0 750 #api-key #archive #sitemap #rate-limiting #domain #osint #robots-txt #wayback-machine #key-rotation #json-format

  3. sitemap-writer

    lightweight Rust library for generating XML sitemaps

    v1.0.1 #sitemap #writer #xml #seo #web

  4. siteprobe

    CLI tool to fetch URLs from sitemap.xml, check their existence, and generate performance reports

    v1.3.0 #sitemap #web-crawler #performance #url-checker #http-monitoring

  5. sitewriter

    A sitemap writing library

    v1.0.5 1.6K #sitemap #xml #parser #sitemapindex

  6. heater

    sitemap-based cache-warming with header variations

    v0.3.3 750 #sitemap #cdn #cache #warm #warming

  7. sitemap2urllist

    Read a sitemap and output a list of URLs

    v0.1.6 #sitemap #cache #urllist

  8. sitemap

    parser (reader) and writer

    v0.4.1 20K #reader-writer #parser #parse

  9. yagami

    A concurrent sitemap crawler that validates web links and exports results to CSV

    v0.1.0 #sitemap #web-crawler #link-checker #seo

  10. robots_txt

    A lightweight parser and generator for robots.txt

    v0.7.0 1.5K #parser-generator #sitemap #web

  11. sitemap_generator

    A high-performance Rust library for generating XML sitemaps (standard, image, video, and sitemap index)

    v0.1.1 #sitemap #generator #seo #xml #web

  12. argus-parser

    HTML and sitemap parsing utilities for web crawling

    v0.1.0 #web-crawler #sitemap #html-parser

  13. mythic-core

    Core config, content discovery, build pipeline, and caching for the Mythic static site generator

    v0.3.4 #static-site-generator #content-discovery #pipeline #cache #sitemap #plugin-system #rhai #incremental-build #internationalization #accessibility

  14. webmaster

    Unified CLI for search engine webmaster tools — sitemap submission, search analytics, URL inspection across Google, Bing, and Yandex

    v0.1.2 #sitemap #webmasters #bing #search-console #seo

  15. rjango-contrib-sitemaps

    Rjango sitemaps contrib app

    v0.1.1 #sitemap #contrib #rjango

  16. hab-rs-api-client

    Bindings for openHAB REST API

    v0.3.0 130 #uninstall #ui-component #rules #plugin #namespaces #uuid #delete-service #service-configuration #sitemap #firmware

  17. sitemapo

    Sitemap.xml (or URL inclusion) protocol with the support of txt & xml formats, and video, image, news extensions

    v0.2.0 #sitemap #crawler

  18. sitemaps

    Read and write files in the Sitemaps XML format

    v0.2.0 750 #sitemap #xml-format #xml

    19. Try searching with DuckDuckGo.

  19. llamap

    CLI tool to build llms.txt from sitemap.xml

    v0.1.0 #sitemap #converter #llms-txt #summary #cli

  20. mdbook-sitemap-generator

    generate a sitemap.xml file for an mdbook project

    v0.2.0 #xml #sitemap #mdbook #generate #utility

  21. actix-sitemaps-rs

    Add a static sitemap to your actix-web app

    v0.1.0 #actix-web #sitemap #seo

  22. sitemaps-cli

    CLI for working with Sitemaps as data

    v0.2.0 #sitemap #xml #data #cli

  23. sido

    Execute commands for every URL in a sitemap

    v0.1.0 #sitemap #xml #parallel #cli-command

  24. wls

    Easily crawl multiple sitemaps and list URLs

    v0.1.0 #sitemap #web-crawler #url

  25. sitemap-xml-writer

    writing sitemap.xml

    v0.1.0 #sitemap #date-time #writer

  26. sws-tree

    Slotmap-backed ID-tree

    v1.0.0 #id-tree #sws #web-scraping #sitemap #reference #slot-map #csv

  27. xml_collected

    fetch and parse XML sitemaps, discover sub-sitemaps, and save extracted URLs to a file

    v0.1.0 #sitemap #xml

  28. sitemapper

    CLI tool for generating sitemaps

    v0.0.4 #sitemap #generator #web-page #command-line-tool #link

  29. sws-crawler

    Web crawler with plugable scraping logic

    v0.1.0 #web-crawler #web-scraping-logic #sws #sitemap #seed #plugable #scrap #web-page

  30. auto_sitemap

    Sitemaps with automatically updated lastmods

    v0.2.1 #sitemap #automatic #xml

  31. sitemap-iter

    Sitemap iterator adhering to the sitemap protocol, as used by WordPress

    v0.1.0 #sitemap #wordpress #sitemap-protocol

  32. sws-lua

    Scraper scriptable in Lua

    v0.1.0 #web-scraping #scriptable #sitemap #sws #lua #csv #lua-script #scrap #css-selectors

  33. sws-scraper

    HTML parsing and querying with CSS selectors

    v0.2.4 #web-scraping #css-selectors #sws #sitemap #html-parser #querying-with-css-selectors #web-page #parsing-and-querying

  34. john

    Fetch all pages from the sitemap

    v0.2.0 #sitemap #fetch #page