Alessio
1b3c5d0ed3
Add timeout error handling for scraper requests to the request body download as well (rather than just headers)
2024-04-13 16:10:23 -07:00
158710df8d
Update User Feed graphql endpoint so it can get long tweets
2024-03-22 21:39:13 -07:00
750ad3031a
Fix lint error
2024-03-18 22:32:30 -07:00
898ad163ae
Add parsing of pinned tweets on scraped user feeds
2024-03-18 22:20:36 -07:00
ca7cf613f9
Remove unnecessary import
2024-03-18 21:16:38 -07:00
3967367eed
Fix more lint errors
2024-03-18 21:15:27 -07:00
69e0a35e57
Handle HTTP request timeouts
2024-03-16 19:55:05 -07:00
73c5803a47
Add downloading of DM embedded images, videos and links
2024-03-11 21:12:38 -07:00
0ad3cf8fb8
Fix lint errors
2024-03-11 14:08:07 -07:00
aa05708e20
Move media downloader from persistence to scraper package; add 429 Rate Limited error type
2024-03-11 12:57:58 -07:00
1ba4f91463
REFACTOR: replace 'log.Debug(fmt.Sprintf(...))' with 'log.Debugf(...)' and remove 'scraper.' prefix in utils_test.go
2024-03-10 19:14:27 -07:00
07233a7153
Fix parsing of other media items in DMs as 'urls'
2024-03-09 15:11:33 -08:00
f18a2e529c
Add test files for previous commit
2024-03-08 17:30:27 -08:00
0d12166966
Add parsing of DM images, videos and URLs
2024-03-08 17:22:52 -08:00
2d14621cc0
FIXUP: Add test file for previous commit
2024-03-03 14:58:41 -08:00
b076f4d2f2
Scraper: handle videos being geo-blocked, which was panicking the downloader
2024-03-03 14:56:36 -08:00
f39ad6b7cb
Fix lint error
2024-03-02 15:45:17 -08:00
73ffb90f63
Move API login flow to its own file; add support for secondary verification challenges
2024-03-02 15:43:02 -08:00
e0266667d6
Fix previous commit
2024-02-25 17:02:39 -08:00
5b6894eee2
Add List queries
2024-02-24 16:45:08 -08:00
a7ce15ebd2
Don't clobber interaction stats when fetching a deleted tweet
2024-02-18 14:52:28 -08:00
018df0d6a4
Rename 'for you' timeline to 'following only' to match Twitter's upstream changes
...
- Also add 'get_user_likes_all' cmd subcommand to get all users likes
2024-02-18 14:47:12 -08:00
84ff6c12b7
Change all timestamps to use milliseconds instead of seconds
2024-01-07 15:15:43 -06:00
dd68ee1fce
Add scraper funcs for previous commit
2023-12-26 19:54:08 -06:00
df8093bbd9
Add follows
2023-12-26 19:52:37 -06:00
92b166a4eb
REFACTOR: create 'GetPaginatedQuery' function to encapsulate queries with cursors
2023-12-26 15:54:41 -06:00
f3f2550d85
REFACTOR: create 'GetMore' function for paginated queries with cursors
2023-12-26 11:42:02 -06:00
e1bc6bba98
Enable sending DM messages
2023-12-24 14:21:57 -06:00
903483e305
Add function to send DMs
2023-11-26 21:25:04 -08:00
aaab11b1d0
Add DM message replying-to indicators/previews and render embedded tweets
2023-11-25 14:21:09 -08:00
dcab3de773
Add test file for previous commit
2023-11-19 23:41:05 -08:00
e5b00c334d
Add embedded tweet recognition to DMs
2023-11-19 23:33:04 -08:00
b73ee1f5d2
Add support for group DMs; also make UI highlight which chat is currently active
2023-11-19 20:37:22 -08:00
c6d0bbce65
Add polling for DM updates while webserver is running
2023-11-19 13:51:16 -08:00
ae01208cde
Add 'fetch_dm' subcommand
2023-11-19 10:43:35 -08:00
6fd06c8c51
Add integration test for fetch_inbox
2023-11-18 16:35:59 -08:00
520b9e366a
Make fetch_inbox command respect the -n flag
2023-11-18 16:26:03 -08:00
12a2dc9744
Fix crashing on user's own tweet threads because of the composer button
2023-11-17 20:03:59 -08:00
99f6de9d45
Add UI queries for DMs
2023-11-12 13:04:02 -08:00
186cea5f1c
REFACTOR: a bunch of miscellaneous spacing and formatting improvements
2023-11-12 12:53:56 -08:00
ef72de76e0
Rebase DMs, updating for rename of 'scraper' to 'pkg/scraper'
2023-11-07 15:04:47 -04:00
f0fcef68e0
Fix lint error
2023-11-07 15:04:47 -04:00
57500b0d30
Add command to fetch a user's DM inbox and hook it up
2023-11-07 15:04:47 -04:00
369616aeec
Implement parsing of whole inbox state
2023-11-07 15:04:47 -04:00
7c25648cbf
Add DB queries for DM chat messages and reactions
...
- also change reactions to be a map instead of a slice
2023-11-07 15:04:47 -04:00
1538605e23
Change DMChatRoom#Participants to a map instead of a slice
2023-11-07 15:04:47 -04:00
3f1fcf6bcd
Tweak field names, add more 'db:...' tags to struct field names
2023-11-07 15:04:47 -04:00
616ff30a12
Add DM API response structures and parsing of DM objects
2023-11-07 15:04:47 -04:00
~holmus-hiddyn
945923e226
Adds shell for DMs, reactions, and conversation
2023-11-07 15:04:47 -04:00
694a8e0bc5
Change "scrape" from a URL param to a query param
...
- create generic "refresh" button for User Feed that refreshes whichever tab you're on
- refactor TweetDetail view into multiple pieces for easier maintenance
- on "Already liked this tweet" error, save the Like instead of discarding it
2023-11-05 15:27:40 -04:00
