Alessio
4132eb4bca
REFACTOR: SaveTweetTrove no longer calls scraper.GetUserByID, removing another scraper dependency from persistence package
...
- it was calling it to handle conflicting user handles
- now user handle conflicts are handled by the callee
- Add a utility function in `main` and `webserver` packages to rescrape the conflicting users
2025-02-10 12:53:31 -08:00
Alessio
cb0b478c08
REFACTOR: apply dependency injection change (whole API object -> just the downloader function) to 'SaveTweetTrove' method
2025-02-03 21:58:53 -08:00
Alessio
0c1d853f55
REFACTOR: change media downloader dependency injection to take just the download function rather than a whole API object
2025-02-03 21:24:53 -08:00
Alessio
ac763a97a6
REFACTOR: in persistence package, import scraper as '.'
2025-02-03 16:25:34 -08:00
Alessio
c7a6b5b321
Add back in the GetUserByID unauthenticated operation since apparently it does actually work
2024-11-06 18:58:18 -08:00
Alessio
2b7a636720
Remove the unauthenticated GetUser requests as they no longer work
2024-11-06 18:36:06 -08:00
Alessio
3539d9418d
SaveTweetTrove now re-fetches users with conflicting handles as well
2024-09-23 00:23:07 -07:00
Alessio
b77612c66f
Add SQL queries for notifications
2024-08-25 22:54:18 -07:00
Alessio
e2ca9a975a
Remove scraper singleton pattern entirely
2024-08-19 17:27:54 -07:00
Alessio
c52960759e
Fix bug caused by DMTrove refactor
2024-07-28 13:23:10 -07:00
Alessio
8aca12695b
Handle media download 404s gracefully
2024-07-28 12:50:00 -07:00
Alessio
14a7f88cdb
Add scraping and saving of bookmarks
2024-05-28 21:55:42 -07:00
cf51c065d0
Fix lint error
2024-03-18 20:49:25 -07:00
69e0a35e57
Handle HTTP request timeouts
2024-03-16 19:55:05 -07:00
fee47205ec
Move content downloading to the background when scraping
2023-11-26 22:13:47 -08:00
604d5b9ce2
REFACTOR: convert function comments to proper godoc
...
- also fix indentation in versions.go file
2023-08-03 00:47:43 -03:00
a061decd0f
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
...
- also restructure project to use a 'pkg' directory for reusable packages
2023-07-30 14:20:07 -03:00
