Timmy Welch
4b91c400b5
Add more metrics
...
ids: ID Count
consistent_ids: ID Count == A Hash Count
consistent_hashes: A Hash Count == D Hash Count == P Hash Count
2026-11-05 16:29:43 -08:00
Timmy Welch
55de1f70bf
Update commands for non-blocking logging
2026-11-05 16:29:43 -08:00
Timmy Welch
7bc53e8408
Add CHDB compaction
...
Compact the bolt database on shutdown to reclaim the space freed
by deleted entries
2026-11-05 16:29:43 -08:00
Timmy Welch
978f19b1f6
Add a hash conversion command
...
Add cmd/convert to convert legacy V2 hash files to the V3 format
2026-11-05 16:29:43 -08:00
Timmy Welch
5206c6d57c
Add and update tests for V3 hashes
2026-11-05 16:29:43 -08:00
Timmy Welch
c98784ea1d
Update storage for V3 hashes
...
Backends use the V3 hashes and ids loaded in place instead of
building a separate runtime IDMap
2026-11-05 16:29:43 -08:00
Timmy Welch
b1aa8d5bd3
Serve hashes as x-image-hash-db+gzip
2026-11-05 16:29:43 -08:00
Timmy Welch
3bc88f961f
Full re-scrape of comicvine
2026-11-05 16:29:43 -08:00
Timmy Welch
04c06b072a
Implement the V3 binary saved hashes format
...
Load hash files in place instead of decoding msgpack or json
Drop the --save-format flag since there is only one format
2026-11-05 16:29:10 -08:00
Timmy Welch
1519a0adcb
Define the SavedHashesV3 types
...
V3 uses fixed-size records so a saved file can be loaded in place
and used directly instead of being decoded into new structures
2026-11-05 16:29:08 -08:00
Timmy Welch
13e9858d92
Remove the NewIDs type
2026-11-05 16:29:06 -08:00
Timmy Welch
b85659a845
Remove IDList
...
Use a slice instead
2026-11-05 16:29:01 -08:00
Timmy Welch
1129ff6f7a
Rename SavedHashes to SavedHashesV2
2026-11-05 16:28:57 -08:00
Timmy Welch
c21f55dac7
Improve error handling in matchCoverHash
2026-11-05 16:28:55 -08:00
Timmy Welch
d720d02911
Use a bounded context for graceful shutdown
2026-11-05 16:28:53 -08:00
Timmy Welch
37d7532706
Rework the channel pipeline for hashing images
2026-11-05 16:28:51 -08:00
Timmy Welch
ffc0261ace
Fix HashServer
...
Use appropriate digest header caches
Name fixups
Encode hashes with pgzip and a buffered writer
Add --use-all-checksums for faster default exports
Only create the hash server when hash saving is enabled
2026-11-05 16:28:49 -08:00
Timmy Welch
e374614124
Move hashing code into ch/ and comic-hasher to the repo root
...
So `go install gitea.narnian.us/lordwelch/comic-hasher@latest` works
2026-11-05 16:28:41 -08:00
Timmy Welch