Class: Scheduler Private
Defined in: | src/kermit/Crawler.coffee |
Inherits: | Mixin |
Overview
The scheduler acts as a buffer for submitted URLs, which it will feed to the crawler according to the crawlers load. It receives URLs from clients and applies all configured filters (blacklist/whitelist) as well as duplicate prevention. The scheduler is an internal class controlled by the Crawler and should not be interacted with directly. It is exposed indirectly through the CrawlerContext.
Class Method Summary
Instance Method Summary
- # (void) stop() Bound
Class Method Details
.
(void)
defaultOptions()
Instance Method Details
#
(void)
stop()
Bound