summaryrefslogtreecommitdiff
path: root/crocoite/controller.py
AgeCommit message (Expand)AuthorFilesLines
2018-12-21Parse URLs by defaultLars-Dominik Braun1-5/+4
2018-12-08controller: Reraise queue processing errors earlyLars-Dominik Braun1-1/+7
2018-12-08tools: Add version info to merged WARCsLars-Dominik Braun1-11/+4
2018-12-02controller: Add only enabled behavior scripts to warcinfoLars-Dominik Braun1-5/+5
2018-12-02controller: Remove unused argumentLars-Dominik Braun1-4/+3
2018-11-25single: Graceful ^CLars-Dominik Braun1-1/+8
2018-11-24behavior: Fix scrollingLars-Dominik Braun1-2/+2
2018-11-22controller: Improve idle waitingLars-Dominik Braun1-16/+27
2018-11-19controller: Add parameters to warcinfoLars-Dominik Braun1-0/+7
2018-11-19Coding styleLars-Dominik Braun1-20/+16
2018-11-14Async chrome process startupLars-Dominik Braun1-66/+66
2018-11-06Switch single mode to asyncioLars-Dominik Braun1-103/+75
2018-10-30recursive: Actually stop the grab when canceledLars-Dominik Braun1-1/+3
2018-10-30Reduce idle wait time after stopping pageLars-Dominik Braun1-4/+4
2018-10-23single: Set and recursive: check exit statusLars-Dominik Braun1-7/+14
2018-10-14irc: Add PoC dashboardLars-Dominik Braun1-6/+12
2018-10-11recursive: Gracefully shut down on SIGINT/TERMLars-Dominik Braun1-3/+14
2018-10-03controller: Depth limit does not work with i>1Lars-Dominik Braun1-1/+3
2018-09-29Add documentationLars-Dominik Braun1-2/+3
2018-09-25Prevent recursing into arbitrary schemesLars-Dominik Braun1-1/+9
2018-09-25Parallelize recursive grabsLars-Dominik Braun1-4/+14
2018-09-25Add recursive controllerLars-Dominik Braun1-1/+129
2018-09-25Log extracted linksLars-Dominik Braun1-0/+23
2018-08-21Remove celery and recursionLars-Dominik Braun1-118/+3
2018-08-04Add package information to warcinfoLars-Dominik Braun1-6/+16
2018-08-04Reintroduce WARC loggingLars-Dominik Braun1-23/+33
2018-06-25warc: Save DOM-/image screenshot as WARC conversionLars-Dominik Braun1-7/+1
2018-06-20Add __slots__ to classesLars-Dominik Braun1-0/+22
2018-06-20Synchronous SiteLoader event handlingLars-Dominik Braun1-99/+161
2018-05-05Extract only visible and clickable linksLars-Dominik Braun1-1/+1
2018-05-04Add distributed recursive crawlsLars-Dominik Braun1-5/+17
2018-05-04Add support for recursive crawlsLars-Dominik Braun1-0/+100
2018-05-04behavior: Add link extraction scriptLars-Dominik Braun1-1/+11
2018-05-04Move page archiving logic to SinglePageControllerLars-Dominik Braun1-0/+103
generated by cgit v1.2.3 (git 2.39.1) at 2024-12-26 07:51:12 +0000