A lightweight Python bot that scrapes any website URL and returns the most frequently used keywords found in the page's visible content. Ideal for basic SEO analysis, keyword research, or content auditing.

✅ Extracts visible text from any given URL
✅ Automatically filters out HTML, JavaScript, and CSS content
✅ Removes common English stopwords (using NLTK)
✅ Displays the top N most-used keywords
✅ Fully terminal-based, no complex setup needed

• Python 3.7+
• pip (Python package manager)

• requests – for fetching the web page
• beautifulsoup4 – for parsing and cleaning HTML
• nltk – for stopword filtering and text processing

1. Clone or extract the project
2. Navigate to the folder in terminal/command prompt
3. Install the dependencies:

pip install -r requirements.txt
python scraper.py


Sample Output:
**yaml
Copy
Edit
Top keywords:
development: 18
web: 14
design: 12
seo: 10
services: 9**