369616aeec
Implement parsing of whole inbox state
2023-11-07 15:04:47 -04:00
9dbdbdb067
Add the sample response files for DM tests
2023-11-07 15:04:47 -04:00
a061decd0f
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
...
- also restructure project to use a 'pkg' directory for reusable packages
2023-07-30 14:20:07 -03:00
79a4b87f3a
Add parsing of Likes feed
2023-06-26 12:16:38 -03:00
a58ebc6988
Add new type of TimelineTimelineModule, the 'profile-conversation'
2023-06-22 17:21:54 -03:00
d8b8aaea15
Fix a bug where replies to deleted accounts can fail to do proper reply-joining
2023-06-21 15:38:18 -03:00
e06e7164cc
Avoid crashing on tombstones in tweet detail replies
2023-06-20 13:48:06 -03:00
459fbb4f2f
Add recognition of other types of cursors on Tweet Detail page
2023-06-19 23:27:30 -03:00
64bb8233f0
Avoid crashing on inline labels like 'More Replies'
2023-06-19 22:18:19 -03:00
0a40dbe908
Avoid crashing on user-feed tombstone entries
2023-06-19 21:37:30 -03:00
c0f2624009
Add test file for previous commit
2023-06-17 15:22:39 -03:00
1226e3947e
Add parsing of tombstones in immediate parent replies in Tweet Detail views for APIv2
2023-06-17 15:15:22 -03:00
21581b325a
Add support for parsing Tweet Detail in APIv2, including its unusual cursor format and conversation threads
2023-06-08 23:19:50 -03:00
6192c37999
FIXUP: add test file for previous commit
2023-06-08 18:53:50 -03:00
eb566c0612
FIXUP: add test file for previous commit
2023-06-08 18:10:55 -03:00
6830be3c87
Fix error where retweets were not parsing properly sometimes
2022-11-25 15:51:21 -05:00
a81d0e80fe
Add test file
2022-11-24 19:02:50 -05:00
2a45818468
Add parsing of Space object
2022-11-13 13:40:58 -05:00
6de2d670e8
Fix lint error
2022-10-15 12:47:41 -04:00
d647307097
Support multiple videos / videos+images
2022-10-15 12:40:40 -04:00
e932dd33d5
Add parsing Spaces for API v2
2022-05-14 17:36:47 -07:00
54857f40cd
Add parsing of tweets with Space links in them
2022-05-14 15:02:58 -07:00
565b7eaf1e
Add Spaces type
2022-05-14 14:35:49 -07:00
7edc8ad5d3
Some whitespace changes :V
2022-03-06 17:07:05 -08:00
872fc4addf
Add test file for previous commit
2022-03-02 14:37:37 -08:00
aa961b9ff4
Fix handling of empty entries in the feed
...
- e.g., retweets where the author then deleted the original tweet
- I think this is a bug in the Twitter API (it doesn't make sense to return this data) but we have to handle it anyway
2022-03-01 11:51:34 -08:00
3c2aee5016
Add test file for previous commit
2022-02-28 13:50:19 -08:00
52370a4f9d
Recognized deleted users when scraping, create a user with a fake ID
2022-02-27 23:06:06 -08:00
2773214855
Add test file for previous commit
2022-02-04 17:34:15 -08:00
8d406e1b11
Minify that test file
2022-02-02 15:21:42 -08:00
359c166363
Add test file for previous commit
2022-02-02 14:53:10 -08:00
3ca67418e0
Add test file for previous commit
2022-02-02 12:26:02 -08:00
c00ff06b3f
URLs need to have a TweetID lol
2022-02-01 18:21:48 -08:00
9eb3e42539
Add link parsing for APIv2
2022-02-01 16:56:37 -08:00
1bc6aec3b5
Incorporate the new parsing structure into the actual program
2022-02-01 16:04:52 -08:00
12be70f541
Add test files
2022-01-30 17:58:03 -08:00
68a8549f34
Rename api V2 test responses directory
2022-01-30 15:06:07 -08:00
8c79a39c2e
API V2: parse User result
2022-01-30 14:40:17 -08:00
fb421215df
Add parsing of new GraphQL twitter api for user feeds
2022-01-24 20:13:17 -08:00
1a9ba75355
Add checking for banned users
2022-01-06 14:39:31 -05:00
bf2dbede94
Escape HTML entities in tweet text
2022-01-05 21:04:40 -05:00
c15ac9d751
Add persistence for polls
2021-12-12 16:42:32 -08:00
d0cb857acb
Fix embedded link parsing for youtube links with no thumbnails
2021-11-22 14:52:18 -08:00
658f3c338f
Add parsing of twitter polls
2021-11-07 21:10:24 -08:00
c0ae23b4fd
Add 'unavailable' tombstone category
2021-11-01 15:47:52 -07:00
b37bc4bc60
Add test data for tombstones
2021-11-01 14:13:22 -07:00
159084006d
Fix handling of reply-mentions and tweet text normalization
2021-09-27 18:12:28 -07:00
9ae6213025
Clean up the tests some more
2021-09-27 18:08:14 -07:00
89179f2447
Tidy up the scraper tests a bit
2021-09-27 15:30:05 -07:00
0bb9ff6c6b
Add handling for URL cards with no link preview thumbnail image
2021-09-17 20:50:28 -07:00
