Age | Commit message (Collapse) | Author | Files | Lines | |
---|---|---|---|---|---|
2017-12-19 | Serialize WARC writing | Lars-Dominik Braun | 1 | -0/+35 | |
Logger and SiteWriter both access .write_record() concurrently, which can corrupt WARC files. Move the writer to its own thread and decouple it with a queue. Since we’re probably I/O-bound this may speed up writeback as well. | |||||
2017-12-17 | Don’t fetch redirected request body | Lars-Dominik Braun | 1 | -8/+12 | |
We can’t do that safely due to a race-condition. | |||||
2017-11-29 | Use Chrome’s timestamps as WARC-Date | Lars-Dominik Braun | 1 | -0/+6 | |
2017-11-29 | Refactoring | Lars-Dominik Braun | 1 | -0/+174 | |
Reusable browser communication and WARC writing. |