Skip to content

Wanderoooo/Scrappy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scrappy - Data Extraction & Visualization

A personal project involving data collection & analysis of frontend dev jobs across Canada. Conducted immediately prior to my first Co-op job search to help conduct my job search :).

Scrappy landing page image

Data Extraction

Data extraction was done through analysis of a website’s DOM with Python scripting

  • filtering valid data points (frontend job skills) with Python
  • employing CSS selectors and XPATH for data retrieval
  • leveraging Pandas library for data serialization
  • using targeted SQL queries to cleanse data in MySQL

image

Data Visualization

Data Visualization was done in Tableau with data imported from MySQL

  • categorized by province across Canada

data sub-categories include:

  • job location
  • job commitment type
  • education requirement
  • demanded tech skills

About

A personal project involving data collection & analysis of frontend dev jobs across Canada. Conducted immediately prior to my first Co-op job search to help conduct my job search :).

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors