Skip to content

Scrapy

PyPI Version Supported Python Versions Tests Coverage report Conda Version Ask DeepWiki

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.

About

Scrapy, a fast high-level web crawling & scraping framework for Python.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

64.0k stars

Watchers

1.8k watching

Forks

Releases

Packages

Used by

Contributors

Languages