go run generate.go
go run transform.go
go run run.go

generate.go - training phase
transform.go - extracts links and html elements - main logic of our crawler
run.go - testing phase
first two commands execute in folder rl
the last one exectue in folder rl2