21 Commits
Author SHA1 Message Date
timmy acafe20bda Add metrics 2026-09-03 03:32:11 -07:00
timmy f7e42f3171 Fix ID's not getting added to basicmap 2026-09-02 18:42:56 -07:00
timmy 412b0e07bd Implement downloading and automatically saving the current hashes.gz 2026-05-17 18:28:39 -07:00
timmy 197574ac67 Format bool arguments better 2026-02-25 16:21:26 -08:00
timmy 211bd2b5e9 Reduce copies 2026-02-25 00:56:53 -08:00
timmy 543d94c2d4 Further reduce allocations 2026-02-24 22:50:53 -08:00
timmy ab961da4de Try to decode strings more efficiently 2026-02-24 22:33:43 -08:00
timmy 5a8f7deac5 Fix saving hashes 2026-02-24 22:00:01 -08:00
timmy 2ed5daa67b Cleanup 2026-02-22 13:49:03 -08:00
timmy d240bd953b Remove references to loaded json object 2025-05-31 17:59:19 -07:00
timmy bb64d8449c Improve memory efficiency 2025-05-31 15:00:05 -07:00
timmy b0a4c2939c Map to slice 2025-05-27 22:31:11 -07:00
timmy d7c42f5c1d Fix issues with loading saved hashes 2025-04-24 12:46:04 -07:00
timmy 0fd431f6f7 Update result type 2025-04-19 15:41:04 -07:00
timmy 130b7dec4a Update internal hash storage 2025-02-22 13:45:41 -08:00
timmy a65cadf106 Add CV cover downloader 2024-10-18 10:50:35 -07:00
timmy da54b3a454 Fix decoding hashes 2024-10-14 02:02:26 -07:00
timmy 87c1a69b49 Remove unused Path attribute 2024-10-13 22:16:37 -07:00
timmy 0928ed6ccf Optimize memory usage
Add a basic map storage that does manual searches to conserve memory
Change saved hashes format to allow multiple hashes for a given ID
Add a vptree storage

Maps in Go take up a huge amount of space changing IDList to []ID took
  memory from over 1GB down to 200MB (note this was on aarch64 MacOS
  which for some reason uses less memory than aarch64 Linux).
  Exhaustive searches using slices took about 30 ms search now takes
  50-60 ms as it takes longer to iterate a map. Partial hashes will
  speed up searches to 8 ms at the cost of 700MB initial memory usage
  and 400MB idle (though this is on MacOS, which for some reason uses
  less memory that aarch64 Linux so probably more like
  900MB initial -> 600 MB idle on an RPI running Linux)
2024-09-07 14:51:18 -07:00
timmy 0069ffd5cb Make runtime hash storage modular 2024-09-01 18:13:47 -07:00
timmy d730de8fe1 Finish POC
Make a pip installable package for quick-tag
Save and load hashes from msgpack/json
Embed hashes of all thumb_urls from ComicVine
Allow associating new IDs to old IDs
Support multiple domains
Support hashing local covers
Support simple list of ids and distance and results including the hash
2024-08-11 20:46:41 -07:00