73 Commits

Author SHA1 Message Date
5d6c40246c Move checking for parsing errors up a bit 2023-10-14 18:49:54 -03:00
63ddaaeafb Scraper now handles implicit tombstones like '"quoted_status_result": {}' 2023-10-14 18:02:31 -03:00
392e836689 Update URL parser to handle 'x.com' links 2023-10-09 19:40:34 -07:00
4c81846d15 BUGFIX: fix embedded links not being clickable
- also improve the display to show the domain name when other info is missing
2023-09-13 23:52:04 -07:00
34d3e16439 Update tombstone texts that will be parsed from the Twitter response to say Post instead of Tweet 2023-09-09 19:35:22 -03:00
14b9143f76 Compound db queries now fetch whether the tweet is liked by the current logged-in user 2023-09-04 13:11:58 -03:00
0b0f1a09f2 Make GetUserLikes respect the -n flag 2023-09-01 22:32:32 -03:00
b2df94f041 Show tombstones 2023-08-29 12:27:53 -03:00
8aca7d4ebe Add manual re-scrape for user feeds and quote-tweets stat on tweets 2023-08-27 22:55:40 -03:00
655a47ec21 Remove debugging panic 2023-08-27 22:00:58 -03:00
8349ca4ae3 Add background scraping of the logged-in user's home timeline 2023-08-27 21:05:09 -03:00
eaa01a2360 Fix fetching users and search
- Add is_deleted field on Users
- Fix fetching of tombstoned users including deleted users
- Fix "verified" bluechecks not being scraped anymore
- Fix search to use new graphql endpoint (old one got taken down)
2023-08-22 20:07:32 -03:00
e09c97a85e Fix crashing on failing to parse the 'messageprompt' entry telling you to subscribe to twitter blue 2023-08-22 19:52:04 -03:00
e1b2968332 Add subcommand to fetch home timelines (both regular and 'for you') 2023-08-20 20:45:03 -03:00
466000f152 Add 'for you' option for HomeTimeline 2023-08-20 18:47:30 -03:00
4c91977e38 Add parsing of HomeTimeline (not For You) 2023-08-20 18:29:55 -03:00
7a750877f6 Fix spaces timestamps to remove the factor of 1000x 2023-08-19 22:36:50 -03:00
a12dcae4e4 Add helper function to format Space duration 2023-08-18 18:59:15 -03:00
57b72549c5 Add helper functions for rendering polls 2023-08-18 14:52:54 -03:00
fd0c625de5 Optimize Timeline query by splitting it into sub-queries so it can use indexes 2023-08-17 18:21:26 -03:00
107d21b7e6 Add retweet indicator on tweets 2023-08-13 15:57:58 -03:00
2c8ef0b476 Fix user profile images 2023-08-13 15:55:04 -03:00
a061decd0f REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
- also restructure project to use a 'pkg' directory for reusable packages
2023-07-30 14:20:07 -03:00