• gallery:
• gallery url classes can now be linked to parsers!
• if parsers are linked, gallery pagewalk can now work on the new parsing system. gallery import pipeline has been significantly updated to reflect this
• gallery import objects are now 'multiple' gallery imports, much like the multi-watcher, with each separate query having its own entry in a list (they also run in parallel!)
• the multi-gallery list will show file/gallery pause status in slender columns, and will show a 'stop' character when gallery parsing is done
• wrote a 'gallery selector' button and added it to the new multi-gallery page, so you can spawn queries for different sites on the same import page! it always defaults to 'deviant art' for now, but when the next 'searcher' overhaul step is done, this will be customisable
• the new page selector and related 'pages' menu is now simpler--with the new selector, you just select 'gallery'
• added 'new_gallery_downloader_page' shortcut action to the 'main gui' set to allow quick opening of this new page type
• wrote a 'gallery import panel', which reviews a single gallery import stream, and added it to the multi-gallery page to show the current highlighted query
• as all gallery imports now run in parallel and work on the new system, the now almost-useless 'cancel' gallery pagewalk button is now removed
• with the wider availability of the new gallery log for file count and error reports, shifted around and smoothed out some gallery status text presentation
• improved the auto url_class->parser linking 'try to fill in gaps' logic to work with gallery urls (this was surprisingly complicated)
• fixed a misc stupid waste of time in auto url_class->parser linking
• many misc updates to gallery pipeline
• .
• subscriptions:
• wrote a new gallery pagewalk pipeline for subscriptions, which still does oldest-to-newest url addition and obeys file limits and so on
• numerous subscription pipeline and error handling tweaks and improvements, particularly in regards to the new code
• subscriptions now have max initial and periodic file limits of 1000. existing subs with >1000 or infinite will be cut to 1000. there is a help button on the edit sub panel to explain why you should do large syncs with the manual downloader and not subs
• the ugly and dangerous-if-you-scroll-in-the-wrong-place gallery selector mismash control in the edit subscription panel is now replaced with the new gallery selector button
• fixed an issue where the edit subs panels could sometimes say '48 years ago' (i.e. displaying a literal time delta since 0, 1970) on initial timestamps
• juggled some 'periodic limit' reporting logic to skip an unusual false positive that affect hentai foundry subs for now and more in future
• .
• urls:
• the url downloader now accepts gallery urls and will receive drag-and-dropped gallery urls. at the moment, it only parses the one page (i.e. it doesn't start a new 'searching' pagewalk) and sends the parsed links to its file queue
• .
• watcher:
• finished 'watcher panel', which reviews a watcher, and added it to the multi-watcher page to show the current highlighted watcher
• the single watcher page is completely removed--it is only the multiple watcher now. all singles will be converted to multiples on update
• some single-watcher options (like watchers naming their own page tabs and the [404]-style page name prefixes) are removed
• multiple watcher panel now lists file/checking pause status and has separate buttons to control these paused statuses
• fixed some misc watcher highlight code--highlighted watchers should correctly publish to the page from the start of session load now
• improved some 'repage' logic in how highlighted threads get removed
• .
• misc:
• discovered a scroll-setup parameter that stops janky scroll-to-click-focus behaviour on all the new scrolling panels, thank the LORD
• improved some 'can't parse' error handling for post url parsing
• reworked how all importers present their network jobs to the ui, including fast response if the switch happens during a job
• in prep for searcher switchover where all downloader sources will be harmonised into one system, booru identifiers now present in several ui locations as 'name', not 'booru: name'
• updated the danbooru parser to deal with the new 'next page' markup they use
• wrote a gelbooru gallery parser that works with 0.2.0 and 0.2.5 gelb sites--an ancillary issue where gelb-related downloaders could sometimes not accurately figure out the magic '42' next-page offset is hence now fixed
• wrote an e621 gallery page parser
• these sites hence now support single-page gallery drag-and-drop
• added url classes for artstation gallery url and its api counterpart, but didn't go further yet--we aren't quite there with api pagewalking just yet
• updated deviant art gallery url classes
• added an e621 'search initialisation' gallery url class to improve some future drag-and-drop stuff
• url normalisation no longer cuts off 'www.'-style prefixes
• url comparison is more careful to test 'www.'-style prefixes, so a file import cache should recognise that 'http://www.blah.com/blah' is the same as 'https://blah.com/blah'
• did a bunch of refactoring to further split up the bloated ClientImporting.py
• fixed some misc downloader layout that may have been hiding some texts previously
• some multi-watcher and multi-gallery events like add/pause query should be a bit snappier
• in the parsing ui, url and title priorities are now 50 by default
• prepped a little subscription unit test code for when searcher object is done
• misc downloader layout improvements
• misc listctrl refactoring