• downloaders:
• extended url classes to support 'next gallery page' generation--a fallback that predicts next gallery page url if the parser cannot provide it (as is often the case with APIs and unreliable next-page-url galleries such as gelbooru)
• integrated this new next page generation into new gallery processing pipeline
• updated gelbooru, tumblr api and artstation gallery api url classes to support the new next gallery page business
• fixed the url class for xbooru, which wasn't recognising gallery urls correctly
• wrote new gallery parsers for rule34.paheal and mishimmie (which are both shimmie but have slightly different gallery layout). this should finally solve the 'one paheal gallery url is being parsed into the file list per page' problem
• 'fixed' the tumblr parser to fetch the 1280px url (tumblr killed the raw url trick this past week)
• misc text/status fixes
• wrote a gallery parser for tumblr that fetches the actual tumblr post urls and hence uses the new tumblr post parser naturally! (tumblr post urls are now more neatly associated as 'known urls' on files!)
• note that as the tumblr downloader now produces different kinds of urls, your tumblr subs will hit your periodic limits the next time they run. they will also re-download any 1280px files that are different to the previously fetched raws due to the above raw change (protip: keep your subscription periodic file limits low)
• cut the 'periodic limit' subscription warning popup down to a much simpler statement and moved the accompanying help to a new help button on the edit sub panel
• multi-gallery pages now have an 'added' column like multi-watchers
• the new 'pause' ⏸ and 'stop' ⏹ characters shown in the multi-downloader pages are now customisable under options->downloading (some users had trouble with the unicode)
• the watcher now shows the 'stop character' if checking is 404/DEAD
• fixed an issue where the new gallery imports on the same multi-page were all sharing the same identifier for their ephemeral 'downloader instance' bandwidth tracker, which meant they were all sharing the same '100rqs per 5mins' etc... rules
• the page and subscription downloader 'gallery page delay' is now program-wide (since both these things can run in mass parallel). let's see how it goes, maybe we'll move it to per-site
• subscription queries now auto-compact on sync! this means that surplus old urls will be removed from their caches, keeping the whole object lean and quick to load/save
• gallery logs now also compact! they will remove anything older than twice the current death velocity, but always keep the newest 25 regardless of age
• .
• misc:
• the top-right hover window will now always appear--previously, it would only pop up if the client had some ratings services, but this window now handles urls
• harmonised 'known urls' view/copy menu to a single code location and added sorted url class labels to entries (which should reduce direct-file-url misclicks)
• greatly sped up manage tags dialogs initial calculation of possible actions on a tag alteration event, particularly when the dialog holds 10k+ tags
• greatly sped up the second half of this process, when the action choice is applied to the manage tag dialog's current media list
• the buttons on the manage tags dialog action popup dialog will now only show a max of 25 rows on their tooltips
• some larger->smaller selection events on large pages with many tags should be significantly faster
• subscription popups should now 'blank' their network job controls when not working (rather than leaving them on the old job, and without flickery-ly removing the job control completely)
• the file cache and gallery log summary controls now have ... ellipsized texts to reduce their max width
• fixed an issue where larger 'overriding bandwidth' status wait times would sometimes show instead of legit regular smaller bandwidth wait times
• removed a now-superfluous layer of buffering in the thumbnail grid drawing pipeline--it seems to have removed some slight lag/flicker
• I may have fixed the issue where a handful of thumbs will sometimes remain undrawn after several fast scrolling events
• gave the some-linux-flavours infinitely-expanding popup message problem another pass. there should be an explicit reasonable max width on the thing now
• added a 'html5lib not found!' notification to the network->downloaders menu if this library is missing (mostly for users running from source)
• help->about now states if lz4 is present
• gave 'running from source' help page another pass, including info on running a virtual environment
• in file lookup scripts, the full file content now supports string transformations--if this is set to occur, the file will be sent as an addition POST parameter and the content-type set to 'application/x-www-form-urlencoded'. this is a temp fix to see if we can get whatanime.ga working, and may see some more work
• if the free space on the db dir partition is < 500MB, the program will not boot
• if the free space on the db dir partition is < 1GB, the client will not sync repositories
• on boot the client can now attempt to auto-heal a missing local_hashes table. it will give an appropriate error message
• misc post-importing-cleanup refactoring