v1.10.0

Warning

• Prior to version 1.10.0 all cache files were created world readable (mode 644)
  leading to possible sensitive information disclosure on multi-user systems
• It is recommended to restrict access permissions of already existing files
  (/tmp/.gallery-dl.cache) with chmod 600
• Windows users should not be affected

Additions

• Support for
  • vsco - https://vsco.co/ (#331)
  • imgbb - https://imgbb.com/ (#361)
  • adultempire - https://www.adultempire.com/ (#340)
• restrict-filenames option to create Windows-compatible filenames on any platform (#348)
• forward-cookies option to control cookie forwarding to youtube-dl (#352)

Changes

• The default cache file location on non-Windows systems is now
  • $XDG_CACHE_HOME/gallery-dl/cache.sqlite3 or
  • ~/.cache/gallery-dl/cache.sqlite3
• New cache files are created with mode 600
• exhentai extractors will always use e-hentai.org as domain

Fixes

• Logging into exhentai now collects more cookies than just ipb_member_id and ipb_pass_hash
• Better handling of exhentai image limits and errors (#356, #360)
• Try to prevent ZIP file corruption (#355)
• Miscellaneous fixes for behance, ngomik

v1.9.0

Additions

• Support for
  • erolord - http://erolord.com/ (#326)
• Add login support for instagram (#195)
• Add --no-download and extractor.*.download disable file downloads (#220)
• Add -A/--abort to specify the number of consecutive download skips before aborting
• Interpret -1 as infinite retries (#300)
• Implement custom log message formats per log-level (#304)
• Implement an mtime post-processor that sets file modification times according to metadata fields (#332)
• Implement a twitter.content option to enable tweet text extraction (#333, #338)
• Enable date-min/-max/-format options for tumblr (#337)

Changes

• Set file modification times according to their Last-Modified header when downloading (#236, #277)
  • Use --no-mtime or downloader.*.mtime to disable this behavior
• Duplicate download URLs are no longer silently ignored (controllable with extractor.*.image-unique)
• Deprecate --abort-on-skip

Fixes

• Retry downloads on OpenSSL exceptions (#324)
• Ignore unavailable pins on sexcom instead of raising an exception (#325)
• Use Firefox's SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#342)
• Improve folder name matching on deviantart (#343)
• Forward cookies to youtube-dl to allow downloading private videos
• Miscellaneous fixes for 35photo, 500px, newgrounds, simplyhentai

v1.8.7

Additions

• Support for
  • vanillarock - https://vanilla-rock.com/ (#254)
  • nsfwalbum - https://nsfwalbum.com/ (#287)
• artist and tags metadata for hentaicafe (#238)
• description metadata for instagram (#310)
• Format string option to replace a substring with another - R<old>/<new>/ (#318)

Changes

• Delete empty archives created by the zip post-processor (#316)

Fixes

• Handle hitomi Game CG galleries correctly (#321)
• Miscellaneous fixes for deviantart, hitomi, pururin, kissmanga, keenspot, mangoxo, imagefap

v1.8.6

Additions

• Support for
  • slickpic - https://www.slickpic.com/ (#249)
  • xhamster - https://xhamster.com/ (#281)
  • pornhub - https://www.pornhub.com/ (#282)
  • 8muses - https://www.8muses.com/ (#305)
• extra option for deviantart to download Sta.sh content linked in description texts (#302)

Changes

• Detect directlink URLs with upper case filename extensions (#296)

Fixes

• Improved error handling for tumblr API calls (#297)
• Fixed extraction of livedoor blogs (#301)
• Fixed extraction of special deviantart Sta.sh items (#307)
• Fixed pagination for specific keenspot comics

v1.8.5

Additions

• Support for
  • keenspot - http://keenspot.com/ (#223)
  • sankakucomplex - https://www.sankakucomplex.com (#258)
• folders option for deviantart to add a list of containing folders to each file's metadata (#276)
• captcha option for kissmanga and readcomiconline to control CAPTCHA handling (#279)
• filename metadata for files downloaded with youtube-dl (#291)

Changes

• Adjust wallhaven extractors to new page layout:
  • use API and add api-key option
  • removed traditional login support
• Provide original filenames for patreon downloads (#268)
• Use e-hentai.org or exhentai.org depending on input URL (#278)

Fixes

• Fix pagination over sankaku popular listings (#265)
• Fix folder and collection extraction on deviantart (#271)
• Detect "AreYouHuman" redirects on readcomiconline (#279)
• Miscellaneous fixes for hentainexus, livedoor, ngomik

v1.8.4

Additions

• Support for
  • patreon - https://www.patreon.com/ (#226)
  • hentainexus - https://hentainexus.com/ (#256)
• date metadata fields for pixiv (#248), instagram (#250), exhentai, and newgrounds

Changes

• Improved flickr metadata and video extraction (#246)

Fixes

• Download original GIF animations from deviantart (#242)
• Ignore missing edge_media_to_comment fields on instagram (#250)
• Fix serialization of datetime objects for --write-metadata (#251, #252)
• Allow multiple post-processor command-line options at once (#253)
• Prevent crash on booru sites when no tags are available (#259)
• Fix extraction on instagram after rhx_gis field removal (#266)
• Avoid Cloudflare CAPTCHAs for Python interpreters built against OpenSSL < 1.1.1
• Miscellaneous fixes for luscious

v1.8.3

Additions

• Support for
  • plurk - https://www.plurk.com/ (#212)
  • sexcom - https://www.sex.com/ (#147)
• --clear-cache
• date metadata fields for deviantart, twitter, and tumblr (#224, #232)

Changes

• Standalone executables are now built using PyInstaller:
  • uses the latest CPython interpreter (Python 3.7.3)
  • available on several platforms (Windows, Linux, macOS)
  • includes the certifi CA bundle, youtube-dl, and pyOpenSSL on Windows

Fixes

• Patch urllib3's default list of SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#227)
  • Windows users need to install pyOpenSSL for this to take effect
• Provide fallback URLs for twitter images (#237)
• Send Referer headers when downloading from hitomi (#239)
• Updated login procedure on mangoxo

v1.8.2

Additions

• Support for
  • pixnet - https://www.pixnet.net/ (#177)
  • wikiart - https://www.wikiart.org/ (#179)
  • mangoxo - https://www.mangoxo.com/ (#184)
  • yaplog - https://yaplog.jp/ (#190)
  • livedoor - http://blog.livedoor.jp/ (#190)
• Login support for mangoxo (#184) and twitter (#214)

Changes

• Increased required Requests version to 2.11.0

Fixes

• Improved image quality on reactor sites (#210)
• Support imagebam galleries with more than 100 images (#219)
• Updated Cloudflare bypass code

v1.8.1

Additions

• Support for:
  • 35photo - https://35photo.pro/ (#162)
  • 500px - https://500px.com/ (#185)
• instagram extractor for hashtags (#202)
• Option to get more metadata on deviantart (#189)
• Man pages and bash completion (#150)
• Snap improvements (#197, #199, #207)

Changes

• Better FFmpeg arguments for --ugoira-conv
• Adjusted metadata for luscious albums

Fixes

• Proper handling of instagram multi-image posts (#178, #201)
• Fixed tumblr avatar URLs when not using OAuth1.0 (#193)
• Miscellaneous fixes for exhentai, komikcast

v1.8.0

Additions

• Support for:
  • weibo - https://www.weibo.com/
  • pururin - https://pururin.io/ (#174)
  • fashionnova - https://www.fashionnova.com/ (#175)
  • shopify sites in general (#175)
• Snap packaging (#169, #170, #187, #188)
• Automatic Cloudflare DDoS protection bypass
• Extractor and Job information for logging format strings
• dynastyscans image and search extractors (#163)
• deviantart scraps extractor (#168)
• artstation extractor for artwork listings (#172)
• smugmug video support and improved image format selection (#183)

Changes

• More metadata for nhentai galleries
• Combined myportfolio extractors into one
• Renamed name metadata field to filename and removed the original filename field
• Simplified and improved internal data structures
• Optimized creation of child extractors

Fixes

• Filter empty tumblr URLs (#165)
• Filter ads and improve connection speed on hentaifoundry
• Show proper error messages if luscious galleries are unavailable
• Miscellaneous issues on mangahere, ngomik, simplyhentai, imgspice

Removals

• seaotterscans