me/offline-twitter
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
932 Commits 1 Branch 0 Tags
Commit Graph

932 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Alessio
4abbb93c63 Update link preview image integration test (old one broke again) 2025-02-14 14:46:56 -08:00
Alessio
c03e1f6317 REFACTOR: Not sure why this was missed in previous commit 2025-02-10 13:38:26 -08:00
Alessio
bbe098d6df REFACTOR: replace imports of the 'persistence' package in 'persistence_test' with dot-imports 2025-02-10 13:30:01 -08:00
Alessio
4132eb4bca REFACTOR: SaveTweetTrove no longer calls scraper.GetUserByID, removing another scraper dependency from persistence package 
- it was calling it to handle conflicting user handles
- now user handle conflicts are handled by the callee
- Add a utility function in `main` and `webserver` packages to rescrape the conflicting users
 2025-02-10 12:53:31 -08:00
Alessio
fc66d1d8a6 Update 2 integration tests that got out-of-date 2025-02-10 12:31:46 -08:00
Alessio
b2f697a8a6 REFACTOR: make Session file storage functions more generic (not hardcoded for scraper.API) 2025-02-04 14:46:13 -08:00
Alessio
cb0b478c08 REFACTOR: apply dependency injection change (whole API object -> just the downloader function) to 'SaveTweetTrove' method 2025-02-03 21:58:53 -08:00
Alessio
0c1d853f55 REFACTOR: change media downloader dependency injection to take just the download function rather than a whole API object 2025-02-03 21:24:53 -08:00
Alessio
ac763a97a6 REFACTOR: in persistence package, import scraper as '.' 2025-02-03 16:25:34 -08:00
Alessio
95a52906ba Tidy up logging in API do_http methods 2025-02-03 10:58:41 -08:00
Alessio
e0ce1f205a REFACTOR: convert tweet trove methods that make API calls to API methods instead that take a TweetTrove 2025-02-03 08:03:13 -08:00
Alessio
368209a1cc Add handling for 'Twitterversary' account anniversary notification 2025-02-02 20:50:35 -08:00
Alessio
efe453dbe3 Fix lint errors 2025-02-02 20:38:43 -08:00
Alessio
5f62d91b44 Update CHANGELOG.txt for v0.6.22 2025-02-02 20:35:46 -08:00
Alessio
f7b0c4a427 Add background scraping jobs for Bookmarks and logged-in user's User Feed 2025-02-02 20:23:55 -08:00
Alessio
eec02fef00 On manually rescraping a user feed, update the user and download their content too 2025-02-02 20:02:26 -08:00
Alessio
cd02110021 BUGFIX: fix a scraping error on encountering a 'composer' entry in a tweet thread 2025-02-02 17:28:18 -08:00
Alessio
a3ddfa72b7 Fix a typo in the windows build script 2025-01-18 21:44:42 -08:00
Alessio
af21249e67 Fix a broken integration test 2025-01-18 20:38:32 -08:00
Alessio
7a056c7494 Fix whitespace issue (kick pipeline) 2025-01-17 15:02:14 -08:00
Alessio
06ea9b890b Update CHANGELOG.txt for v0.6.21 2025-01-17 14:54:15 -08:00
Alessio
5f1e917819 Try re-downloading chat images 5x with 0.5s delay before giving up 2025-01-17 14:48:31 -08:00
Alessio
23f023837b Try to add an icon to the compiled application on Windows 2025-01-12 20:26:48 -08:00
Alessio
355e1cec3b BUGFIX: fix several issues with the Windows installer 
- fix Start Menu shortcut putting `--default-profile` flag in the wrong position, causing it to print the help message and exit instead of starting
- fix "current user only" installation trying to install a desktop shortcut on the Public desktop instead of the user's
 2025-01-12 20:07:51 -08:00
Alessio
d7a8ee6013 I forgot to include this in the previous commit 2024-12-23 19:40:32 -08:00
Alessio
37993af341 Fix more lint errors of the same kind 2024-12-23 19:38:25 -08:00
Alessio
f9fdfe04df Fix new lint error activated by updating Go version (remove 'rand.Seed(time.Now)' calls, as they are redundant; as of 1.20, the generator is seeded randomly at startup) 2024-12-23 19:35:00 -08:00
Alessio
574be89062 Bump go toolchain version to 1.21 to support slices (not 1.18 as incorrectly tried in the previous commit) 2024-12-23 19:28:17 -08:00
Alessio
c428c95a4c Switch order of test and lint in CI build 2024-12-23 19:16:48 -08:00
Alessio
4e2dfef3cb Update go.mod go version to 1.18, to use slices package 2024-12-23 19:12:43 -08:00
Alessio
bd0e353771 REFACTOR: move a bunch of stuff around in the scraper to consolidate 
- delete type-specific test files and put them in api_types_test
- remove an unneeded test file
 2024-12-23 19:06:29 -08:00
Alessio
32531a3bd9 Move User Detail query, structures, parsing and tests to new 'api_types_user' file 2024-12-23 18:43:45 -08:00
Alessio
14024f550d REFACTOR: Get rid of SortableXYZ types, use slices.SortFunc instead 2024-12-23 12:53:58 -08:00
Alessio
81e6dc50be REFACTOR: rename some stuff in scraper apiv1 
- rename TweetResponse -> APIv1Response
- rename Entry -> APIv1Entry
- rename APIv1Response.GetCursor -> GetCursorBottom
 2024-12-23 12:37:28 -08:00
Alessio
eaa9f4c404 Update the init_data script to be compatible with putting the sample data profile in a tmpfs 2024-12-23 12:16:02 -08:00
Alessio
938a725f39 Fix bug introduced by BackgroundTask refactor 2024-12-22 08:38:54 -08:00
Alessio
29666bd51b Fix lint error 2024-12-22 08:08:47 -08:00
Alessio
8d29e25823 Don't bother sending a RemoteUrl for DM images if they're not downloaded yet, since they can't be loaded without an authentication token anyway 2024-12-22 08:07:26 -08:00
Alessio
5c79decd7b Remove unused (apparently redundant?) BottomTimestamp function from the Feed object 2024-12-22 08:05:23 -08:00
Alessio
7102530661 Update integration test for user feed to use a user who retweets stuff more often 2024-12-22 08:04:18 -08:00
Alessio
ff638bd543 REFACTOR: create a BackgroundTask abstraction 2024-12-22 08:03:12 -08:00
Alessio
e27cd12cdc REFACTOR: change 'fetch_tweet_only' to use the regular fetch-tweet scraper function, and extract the main tweet in the 'main' package instead of having a scraper function for it 2024-12-21 09:21:23 -08:00
Alessio
850662c3cb REFACTOR: move as much API code out of the types files and into api_types_... files as possible 
- also remove a few useless functions
 2024-12-21 09:15:02 -08:00
Alessio
1f44fb0961 REFACTOR: SQL should use single-quotes; octal literals should start with '0o' 2024-12-21 07:53:31 -08:00
Alessio
9f31037ad7 Update the other command in the build with the same change as previous commits 2024-12-11 11:17:04 -08:00
Alessio
eb6afa63a0 BUGFIX: Fix what must have been a very old bug, where the version bump test used 'offline-twitter-engine' instead of 'offline-twitter' as the 'old' version, effectively pinning it at v0.6.2 2024-12-11 11:07:35 -08:00
Alessio
0f7b7d74e2 Update build file to use authenticated session to fetch a user (change from last release) 2024-12-09 18:34:39 -08:00
Alessio
b5df0f3b5e Update integration test to account for @Offline_Twatter unfollowing @POTUS 2024-12-09 15:03:48 -08:00
Alessio
5b7713bb05 Handle 'X Premium' native ads in notifications 2024-12-09 14:56:17 -08:00
Alessio
1b290d9b5c Update CHANGELOG.txt for v0.6.20 2024-12-09 14:07:37 -08:00