summaryrefslogtreecommitdiff
path: root/crocoite/test_tools.py
AgeCommit message (Collapse)AuthorFilesLines
2019-07-28Fix wrong Content-Type header parameterLars-Dominik Braun1-1/+1
In line with HTTP “encoding” parameter should be called “charset”. Fixable errata item created. Fixes issue #19.
2019-07-02Stabilize WARC headersLars-Dominik Braun1-2/+3
In preparation for 1.0 release: - Correct mime types - Add X-Crocoite-Type, so logs, scripts, dom-snapshots and screenshots can be identified easily - Remove random WARC headers like X-Chrome-Initiator. We don’t want to maintain those. - Remove non-standard urn-based package URLs. Can’t use them without a urn-registration
2018-12-24Use f-strings where possibleLars-Dominik Braun1-1/+1
Replaces str.format, which is less readable due to its separation of format and arguments.
2018-12-17Add simple errata toolLars-Dominik Braun1-1/+27
Fixes #9.
2018-12-08tools: Add version info to merged WARCsLars-Dominik Braun1-4/+14
In preparation for #9. I was hoping to reuse one of schema.org’s microdata schema’s, but neither Action (archival action) nor SoftwareApplication (version information) seem to be suitable.
2018-11-17tools: Add original HTTP header to revisit recordLars-Dominik Braun1-10/+9
The payloads may be the same, but the headers are usually not.
2018-11-10tools: Fix WARC mergingLars-Dominik Braun1-0/+188
WARC-Target-URI was taken from the previous record, even if the URI was different. This essentially removes the revisited URL from the archive. Also add a few tests. And boy, warcio is a mess.