68 Commits

Author SHA1 Message Date
Alessio
d2045028a7 Improve closing message when a scrape ends due to rate-limiting 2024-06-11 12:32:58 -07:00
Alessio
80f8ed0a5d Update command line output when you get rate limited 2024-06-10 20:37:43 -07:00
Alessio
a1faacaf6b Don't throw away all previous results if you get rate-limited, just save them 2024-06-10 19:59:08 -07:00
Alessio
14a7f88cdb Add scraping and saving of bookmarks 2024-05-28 21:55:42 -07:00
f3b71a2633 Move --addr flag under webserver subcommand 2024-03-10 19:14:19 -07:00
73ffb90f63 Move API login flow to its own file; add support for secondary verification challenges 2024-03-02 15:43:02 -08:00
a29c54c068 Fix lint errors 2024-02-21 19:55:47 -08:00
a5f1e8396e Add --default-profile command-line flag which will create the profile if necessary and then use it 2024-02-21 19:53:12 -08:00
90b9df15e5 Several visual improvements
- make spacing around a tweet's reply-mentions container grow and shrink more appropriately
- fix double HTMX-spinner when a tweet has a quoted tweet
- add favicon
2024-02-18 15:07:56 -08:00
018df0d6a4 Rename 'for you' timeline to 'following only' to match Twitter's upstream changes
- Also add 'get_user_likes_all' cmd subcommand to get all users likes
2024-02-18 14:47:12 -08:00
df8093bbd9 Add follows 2023-12-26 19:52:37 -06:00
4b6686cde6 Fix lint errors 2023-12-26 14:09:03 -06:00
795b7250ed Add flag to auto-open page in web browser 2023-12-26 12:20:58 -06:00
fee47205ec Move content downloading to the background when scraping 2023-11-26 22:13:47 -08:00
903483e305 Add function to send DMs 2023-11-26 21:25:04 -08:00
ae01208cde Add 'fetch_dm' subcommand 2023-11-19 10:43:35 -08:00
a4c4dba5e0 Fix typo 2023-11-18 16:39:37 -08:00
520b9e366a Make fetch_inbox command respect the -n flag 2023-11-18 16:26:03 -08:00
ef72de76e0 Rebase DMs, updating for rename of 'scraper' to 'pkg/scraper' 2023-11-07 15:04:47 -04:00
57500b0d30 Add command to fetch a user's DM inbox and hook it up 2023-11-07 15:04:47 -04:00
4c81846d15 BUGFIX: fix embedded links not being clickable
- also improve the display to show the domain name when other info is missing
2023-09-13 23:52:04 -07:00
3e9bc9f4f3 Update main function to use the -n flag for GetUserLikes 2023-09-01 22:33:47 -03:00
e1b2968332 Add subcommand to fetch home timelines (both regular and 'for you') 2023-08-20 20:45:03 -03:00
930af3455f Fix gray connector line showing up on quoted tweets 2023-08-19 22:36:50 -03:00
9d3eacc256 Add a subcommand 'twitter webserver' to start the server 2023-08-03 13:15:39 -03:00
a061decd0f REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
- also restructure project to use a 'pkg' directory for reusable packages
2023-07-30 14:20:07 -03:00
ffaec2799d When POSTing a 'like' to the API, save it as a Like in the db as well 2023-06-26 14:59:41 -03:00
d06a42e2fc Add integration test for fetching Likes 2023-06-26 13:39:51 -03:00
cc632e0654 Add commands to like and unlike tweets 2023-06-25 22:18:00 -03:00
a44323c5de Switch over Tweet Detail fetching to use APIv2 2023-06-21 14:05:49 -03:00
af93f44ed2 Two bug fixes
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
2023-06-03 07:38:17 -03:00
a724f32470 Allow specifying session files with .session extension at command line 2023-03-16 17:53:14 -03:00
c09b77f497 Add ability to use saved sessions 2023-02-17 13:07:12 -05:00
933ee9a7f9 Fix lint errors 2023-02-05 23:40:22 -05:00
Jaeger Aquila
28ca0ac4eb added cmdline login functionality 2023-02-05 20:29:57 -05:00
f41d072573 Improve error handling some more 2022-03-06 20:31:04 -08:00
7edc8ad5d3 Some whitespace changes :V 2022-03-06 17:07:05 -08:00
508670248e Add list_followed subcommand 2022-02-28 16:06:58 -08:00
728aaf251f Fix linting error 2022-02-26 22:18:41 -08:00
41586bf0f8 Add follow and unfollow sub-commands 2022-02-26 16:22:00 -08:00
9cd7f4171a Add proper logging module, set logging level to 'info' by default (hide very verbose debug results) 2022-02-14 14:31:26 -08:00
f9a8841c07 REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go 2022-02-14 13:39:59 -08:00
3d489a8e95 REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions 2022-02-14 13:10:12 -08:00
f1a33bab48 Fix cmd help output when entering an invalid command-line flag 2022-02-14 13:00:32 -08:00
e0f05cbeea Refactor all scraper areas to use TweetTroves where applicable 2022-02-12 20:39:30 -08:00
13170c84b2 Add '-h, --help' flag to print help message then exit 2022-02-12 15:41:03 -08:00
04a4974ffb Add '-n' / '--number' flags, and update help message for executable 2022-02-02 15:09:50 -08:00
b261f095ad Change main application to use new API for user feeds 2022-01-24 20:19:08 -08:00
e06b0bff30 Add --version flag to the executable 2022-01-04 12:57:43 -05:00
692d3de564 Don't double-download tweet contents 2021-12-21 21:57:00 -05:00