go-spider

What is the go-spider?

go-spider is a lightweight, extensible, and configurable web crawler.

dependency:

go 1.6

see TODO.

Please contact [Aleda](mailto: aledalee@foxmail.com) or aleda.cn

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
README.md		README.md
TODO		TODO
action.go		action.go
assert_test.go		assert_test.go
cache.go		cache.go
cache_test.go		cache_test.go
crawler.go		crawler.go
crawler_test.go		crawler_test.go
errors.go		errors.go
logger.go		logger.go
logger_test.go		logger_test.go
lrucache.go		lrucache.go
lrucache_test.go		lrucache_test.go
saver.go		saver.go
saver_test.go		saver_test.go
type.go		type.go
urlcontext.go		urlcontext.go
utils.go		utils.go
utils_test.go		utils_test.go
worker.go		worker.go
worker_test.go		worker_test.go