Alessio
1e09477a5e
If a scraped tweet has tombstone type 'suspended', then the user should be marked as banned during reply-joining
2025-02-17 18:05:49 -08:00
Alessio
cd02110021
BUGFIX: fix a scraping error on encountering a 'composer' entry in a tweet thread
2025-02-02 17:28:18 -08:00
Alessio
bd0e353771
REFACTOR: move a bunch of stuff around in the scraper to consolidate
...
- delete type-specific test files and put them in api_types_test
- remove an unneeded test file
2024-12-23 19:06:29 -08:00
Alessio
a4285c2db1
Add test file for previous commit
2024-11-03 20:11:41 -08:00
Alessio
90f453c207
Fix crashing on non-timeline-module composer button entries
2024-10-26 22:11:23 -07:00
018df0d6a4
Rename 'for you' timeline to 'following only' to match Twitter's upstream changes
...
- Also add 'get_user_likes_all' cmd subcommand to get all users likes
2024-02-18 14:47:12 -08:00
12a2dc9744
Fix crashing on user's own tweet threads because of the composer button
2023-11-17 20:03:59 -08:00
62f14856d6
Add parsing of edited tweets
2023-10-14 19:34:45 -03:00
9b85d81b89
Fix new video format and new user suspended format
2023-10-14 18:59:10 -03:00
63ddaaeafb
Scraper now handles implicit tombstones like '"quoted_status_result": {}'
2023-10-14 18:02:31 -03:00
eaa01a2360
Fix fetching users and search
...
- Add is_deleted field on Users
- Fix fetching of tombstoned users including deleted users
- Fix "verified" bluechecks not being scraped anymore
- Fix search to use new graphql endpoint (old one got taken down)
2023-08-22 20:07:32 -03:00
466000f152
Add 'for you' option for HomeTimeline
2023-08-20 18:47:30 -03:00
4c91977e38
Add parsing of HomeTimeline (not For You)
2023-08-20 18:29:55 -03:00
a061decd0f
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
...
- also restructure project to use a 'pkg' directory for reusable packages
2023-07-30 14:20:07 -03:00
