Skip to content

Latest commit

 

History

21 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scraping-app

A small express.js app to scrap contents from infogreffe.fr and societe.com and rendeer it in a handsontable view and easily copy and paste it to your favorite spreadsheet software (Excel, Google Sheets, Open/LibreOffice Calc, ...)

Requirements

Preview

You can try the app online at this address : http://scrap.bdevaux.com/

How do I use it ?

Simply paste the URL of the company which you want to get information (both from societe.com and infogreffe.fr) and click "Scrap !".

After processing all the available information will appear in a Handsontable view, allowing you to select the relevant information and copy it to any other program (likely to be Excel, Google Sheet or Open/LibreOffice Calc)

How does it work ?

The interface (index.html) contains javascript code making AJAX call to the server side.

The server is an express.js app that retrieves the two URLs from the front-end client, and uses request, jsdom and jQuery to load the pages and scrap the relevant content.

It then sends it back to the interface which displays it in a Handsontable view.

Install locally

  • Download and install Node.js

  • Install Bower :

$ npm install -g bower
  • Clone the repository :
$ git clone git@github.com:devauxbr/scraping-app.git
$ cd scraping-app
  • Install Node.js and Bower dependencies :
$ npm install
$ bower install
  • Run the local server :
$ node app.js

Open http://localhost:3000 in your brother.

If you want to keep the server running, install forever :

$ npm install -g forever

Then instead of node app.js, run :

$ forever start app.js

About

A small express.js app to scrap contents from infogreffe.fr and societe.com and rendeer it in a handsontable view

Resources

Stars

4 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages