Alessio
381e9e0706
'fetch_user' and 'fetch_user_by_id' subcommands now check for conflicting user handle errors and rescrape if needed
2024-09-22 22:11:08 -07:00
Alessio
79033cfc79
Make user handles only unique among active users
2024-09-17 18:33:58 -07:00
Alessio
8c390444d6
Temporarily remove the follow/unfollow integration tests
2024-09-17 18:25:25 -07:00
Alessio
51eaa2a0c4
Remove some useless functions ('list_followed', superceded by Lists; 'UserExists')
2024-09-17 18:13:54 -07:00
Alessio
4ea15f10af
Add scraper function to get user by ID
2024-09-15 22:56:59 -07:00
Alessio
210328bcc9
Kick CI
2024-09-15 19:26:14 -07:00
Alessio
a418fc99bf
Kick CI
2024-09-15 19:20:02 -07:00
Alessio
9c0f9504f6
"ConvertToAPIUser() now returns an error indicating a "not-found" response, which propagates through "GetUser" API calls
2024-09-15 17:59:25 -07:00
Alessio
a13f47e508
Make the data directory if needed
2024-09-15 15:22:07 -07:00
Alessio
67f2852ac7
Put pkg/persistence and cmd/data in tmpfs
2024-09-15 15:18:54 -07:00
Alessio
b9e025589e
Update CHANGELOG.txt for v0.6.16
2024-09-03 18:36:23 -07:00
Alessio
9c7174a84a
Add way to scrape unread count; add db query to count unread notifs since a given sort index
2024-09-02 15:02:27 -07:00
Alessio
0c620621a6
Add scraping notiication detail
2024-08-28 19:22:09 -07:00
Alessio
0a1cdc17af
Fix integration test (link thumbnail image went down again)
2024-08-26 12:21:46 -07:00
Alessio
2c7c35e23f
Add pagination to notifications
...
- handle notifications end-of-feed
- add support for "quoted" and "mentioned" notifications
2024-08-26 00:07:10 -07:00
Alessio
04991ad554
Add 'get_notifications' subcommand
2024-08-25 22:57:40 -07:00
Alessio
9a985539c5
Add some debug info to the integration test
2024-08-23 13:24:11 -07:00
Alessio
3f7a357b17
Fix lint error
2024-08-19 18:23:46 -07:00
Alessio
c45b8e7ad8
Add --delay flag to force a delay between requests in a large paginated scrape
2024-08-19 18:20:12 -07:00
Alessio
9c8c7cdf65
'webserver' subcommand now respects the '--session' flag
2024-08-19 17:49:36 -07:00
Alessio
e2ca9a975a
Remove scraper singleton pattern entirely
2024-08-19 17:27:54 -07:00
Alessio
08e5a726a8
Remove most uses of the singleton pattern in 'scraper' package
2024-08-19 16:45:32 -07:00
Alessio
f8988abef1
Enable optionally using a stored session file in integration test, bypassing login
2024-08-19 14:15:57 -07:00
Alessio
8321d65f17
Fix broken integration test (link thumbnail disappeared, as usual)
2024-08-18 15:50:04 -07:00
Alessio
24129c4852
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
...
- ensure all scraper functions have a `api.XYZ` version and a package-level convenience function
- isolate `the_api` to top-level convenience functions, in preparation for removal
- move a bunch of scraper functions around to be nearby their related functions
- new ErrLoginRequired
- remove obsolete APIv1 stuff (Feed, TweetDetail)
- rename scraper function GetUserFeedGraphqlFor => GetUserFeed
- fix go.mod Go version incorrectly claiming it's compatible with Go 1.16 (should be Go 1.17)
2024-08-09 19:48:50 -07:00
Alessio
bbee9b1a1d
Fix integration test
2024-07-28 17:53:49 -07:00
Alessio
b4384f9cc4
Enable sending emoji reactions in DMs
2024-07-28 14:09:41 -07:00
Alessio
98015ddf0c
REFACTOR: remove DMTrove type, merge it into TweetTrove
2024-07-28 08:01:58 -07:00
Alessio
3c4507dafa
Update CHANGELOG.txt for v0.6.13
2024-07-14 14:21:34 -07:00
Alessio
ef15e8a306
Handle guest token / session initialization when not connected to internet
2024-07-14 13:20:44 -07:00
Alessio
0fd17f1af0
Fix getting tweets from deleted accounts
2024-07-14 12:52:07 -07:00
Alessio
fb95d024cb
Fix broken integration test
2024-07-14 12:49:03 -07:00
Alessio
bbe6c6fef1
Fix lint error
2024-07-13 23:05:31 -07:00
Alessio
d2045028a7
Improve closing message when a scrape ends due to rate-limiting
2024-06-11 12:32:58 -07:00
Alessio
80f8ed0a5d
Update command line output when you get rate limited
2024-06-10 20:37:43 -07:00
Alessio
a1faacaf6b
Don't throw away all previous results if you get rate-limited, just save them
2024-06-10 19:59:08 -07:00
Alessio
b23a6a7e05
Change integration test for search again due to upstream stupidity
2024-06-10 18:33:59 -07:00
Alessio
cf6443518a
Add integration test for another type of deleted tweet
2024-06-10 17:55:19 -07:00
Alessio
81c39e0c4c
Fix deleted tweet in integration test
2024-06-10 17:14:44 -07:00
Alessio
4dbe8b1558
Make the CI actually not use static linking of libc
2024-06-09 14:33:25 -07:00
Alessio
03c082ab4b
Disable pagination in the 'twitter search' integration test because it's been disabled upstream
2024-05-30 00:03:54 -07:00
Alessio
971bef06e5
Don't use static compilation for non-release builds (it makes the CI really slow)
2024-05-29 22:21:20 -07:00
Alessio
14a7f88cdb
Add scraping and saving of bookmarks
2024-05-28 21:55:42 -07:00
Alessio
fc08fb0be4
Statically link libc (musl) so the binaries are fully portable
2024-05-27 14:50:57 -07:00
2e1c851e04
Add help message info for 'get_followers' and 'get_followees'
2024-03-22 21:34:38 -07:00
50e2edc2b9
Re-enable the retweets test
2024-03-16 18:30:28 -07:00
77cd9905d5
Disable retweet test temporarily
2024-03-11 13:49:32 -07:00
f3b71a2633
Move --addr flag under webserver subcommand
2024-03-10 19:14:19 -07:00
7000c1d8f2
Fix integration tests (back from the commit where default_profile.png was added to profile setup step)
2024-03-02 15:56:52 -08:00
73ffb90f63
Move API login flow to its own file; add support for secondary verification challenges
2024-03-02 15:43:02 -08:00
