Skip to content
Silverknight87Public

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

10 Commits

Folders and files

Repository files navigation

Scraper for Amazon price tracking. Uses BeautifulSoup4 library.

  1. The nodered flow is to invoke the py script (using pythonshell node) in a layman friendly manner and provide the amazon URL as input.

  2. Requirements need to be installed separately. Installed in venv (See tutorials in youtube) and venv path specified in pythonshell node. /data is the nodered root directly in my case.

pip install Beautifulsoup4
pip install requests

  1. Once the script is executed and the product price details are output by the script, the next node filter and convert to json. Frequent polling returns a none several times and is filtered.

  2. The function node formats the product and price to send the price to influxdb for visualization.

  3. The price compare node compares price against a price set by you for the product and if the price is below the set price, the product details along with price are set to a telegram bot which is part of a telegram group so that users receive the price alert immediately.

  4. Users can click the url and purchase the product if they like the price.

  5. The trigger frequency for the script can be set in the inject node along with the product url. Amazon can identify scripts polling their websites and block IP's of user that poll too often, so better to maintain a 20-30 min frequency.

  6. The same flow can be replicated to track multiple products. need to change url in inject node. Measurement name in influxdb and price in compare node. All alerts will reach the same telegram group on your mobile. The telegram group members should be the bot and yourself.

  7. Follow google instructions to know how to create a free telegram bot and also on how to get the chat id for the group.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages