This is a Crawler written in pure python.

It can Crawl all categories and link of the all article in the specific category

Also it can crawl all article in Zoomit.ir Website with these details:

• Title
• Body
• Author
• Posted DateTime

##Installation instructions:

python3 -m venv venv

pip install -r requirements.txt

CREATE DATABASE dbname;

GRANT ALL PRIVILEGES ON DATABASE database_name TO username;

SQL_USERNAME = ""
SQL_PASSWORD = ""
SQL_HOST = ""
SQL_PORT = 0

python config.py category_name

Step1
python start.py find_links
Step2
python start.py save_data