Changelog ========= v0.0.0 ------ - Initial release. v0.0.1 ------ - Added polls v0.0.2 ------ - Add `is_conversation_scraped` field to Tweets - Add some new tombstone types: "tweet violated twitter rules", "account no longer exists" - No longer re-download media content (tweet content, user profile / banner images) if not needed - Download video thumbnail images as part of video downloading v0.0.3 ------ - Add video `duration` and `view_count` fields - Add `--version` command line option - Improve user image scraping for rando users (download less eagerly) to speed up browsing and save disk space: - Download tiny versions of profile images (48x48 pixels) - Don't download banner images at all v0.0.4 ------ - Escape HTML entities in tweet text - Add support for banned users - Improve tombstone recognition (quote-tweets) - Fix spacing issue around tiny profile images v0.0.5 ------ - BUGFIX: fix parsing of tweet URLs with query params ('?s=20', etc) - BUGFIX: fix bug in scraping users with "600x200" banner images that caused them not to be saved correctly v0.1.0 ------ - Add support for new GraphQL twitter API (dubbed "APIv2" in code). User feed scraping now uses this API - Embedded links (URLs) now have their short versions saved in the DB. v0.1.1 ------ - BUGFIX: fix selection of primary "TimelineAddEntries" field in APIv2 following breaking API change - Add `-h, --help` command line flags to display help message and gracefully exit