aboutsummaryrefslogtreecommitdiffstats
path: root/crawler/crawler.go
Commit message (Collapse)AuthorAgeFilesLines
* close results channelAdam Mathes2018-07-071-0/+1
|
* add \n to stored item loggingAdam Mathes2018-07-041-1/+1
|
* spellingAdam Mathes2018-07-041-1/+1
|
* set limit to number of simultaneous crawl jobsAdam Mathes2018-04-301-6/+28
|
* opml exportAdam Mathes2018-04-071-0/+1
|
* remove extra printing in crawlerAdam Mathes2018-03-021-2/+0
|
* custom user-agent for crawlerAdam Mathes2018-02-201-1/+48
|
* turn off full content crawlerAdam Mathes2018-02-191-2/+3
|
* enable full_text and header_imageAdam Mathes2017-11-191-8/+9
|
* silent by default, verbose option added. -feeds cmd line option addedAdam Mathes2017-02-251-7/+8
|
* crawler fixAdam Mathes2017-02-171-2/+1
|
* oops, timestamps againAdam Mathes2017-02-161-2/+4
|
* trying again with date fmtAdam Mathes2017-02-161-3/+5
|
* well that date stuff didnt work right at all whoopsAdam Mathes2017-02-161-3/+3
|
* change to personal namespaceAdam Mathes2017-02-071-2/+2
|
* fix typoAdam Mathes2017-02-021-1/+1
|
* fix crash on import related to unparsed datesAdam Mathes2017-02-021-2/+3
|
* import pathsAdam Mathes2017-02-021-1/+1
|
* fix includesAdam Mathes2017-02-021-1/+1
|
* slightly better handling of datesAdam Mathes2017-02-021-3/+2
|
* switch rss parsers, properly support content:encodedAdam Mathes2017-02-011-5/+24
|
* print item creation errors during crawlAdam Mathes2017-01-241-1/+4
|
* neko v2 initial commitAdam Mathes2017-01-231-0/+63