235 Commits

Author SHA1 Message Date
a58ebc6988 Add new type of TimelineTimelineModule, the 'profile-conversation' 2023-06-22 17:21:54 -03:00
f6692fa535 Fix some lint errors 2023-06-21 15:42:43 -03:00
d8b8aaea15 Fix a bug where replies to deleted accounts can fail to do proper reply-joining 2023-06-21 15:38:18 -03:00
a44323c5de Switch over Tweet Detail fetching to use APIv2 2023-06-21 14:05:49 -03:00
eae3ebe3e7 When doing reply-joining of tombstones, ignore cursors and labels 2023-06-21 14:05:49 -03:00
3dc9889725 Fetch tombstoned users that are partially re-assembled using reply-joining 2023-06-21 14:05:49 -03:00
94e581cc0b Improve error messages in parsing of single tweets 2023-06-21 13:23:50 -03:00
5899732fa5 Do tombstoned user fetching for apiv2 2023-06-21 12:25:42 -03:00
e06e7164cc Avoid crashing on tombstones in tweet detail replies 2023-06-20 13:48:06 -03:00
459fbb4f2f Add recognition of other types of cursors on Tweet Detail page 2023-06-19 23:27:30 -03:00
64bb8233f0 Avoid crashing on inline labels like 'More Replies' 2023-06-19 22:18:19 -03:00
0a40dbe908 Avoid crashing on user-feed tombstone entries 2023-06-19 21:37:30 -03:00
3340fc3da3 Create fake users for tombstones whose users can't be inferred 2023-06-19 21:26:09 -03:00
0dd759ce54 Add joining of tombstone threads by in_reply_to_id 2023-06-18 12:04:11 -03:00
0cc132c156 Create helper function to parse an APIV2Entry's ID field into a tweet ID and entry type 2023-06-17 23:24:32 -03:00
ad9e599ef9 Clean up a few tests to use assert and require instead of 'if ... { t.Errorf...' 2023-06-17 23:22:28 -03:00
c0f2624009 Add test file for previous commit 2023-06-17 15:22:39 -03:00
1226e3947e Add parsing of tombstones in immediate parent replies in Tweet Detail views for APIv2 2023-06-17 15:15:22 -03:00
21581b325a Add support for parsing Tweet Detail in APIv2, including its unusual cursor format and conversation threads 2023-06-08 23:19:50 -03:00
693831704d BUGFIX: spaces ended_at should be updated on saving now 2023-06-08 21:52:22 -03:00
d78f9c004d REFACTOR: use a switch statement to add clarity for parsing non-tweet timeline entries 2023-06-08 20:43:07 -03:00
6192c37999 FIXUP: add test file for previous commit 2023-06-08 18:53:50 -03:00
0868d8d6d8 Implement expandable ("Show more...") tweets 2023-06-08 18:51:50 -03:00
eb566c0612 FIXUP: add test file for previous commit 2023-06-08 18:10:55 -03:00
e4e05008d5 Add parsing of home-conversation entry types (mini-threads that show up in a feed) 2023-06-08 18:08:23 -03:00
9a1ef814ef Add debug logging of requested URLs 2023-06-08 16:04:24 -03:00
5c70d2cf49 Remove incorrect/redundant API type field 2023-06-08 14:22:04 -03:00
b36e7410c5 FIXUP: forgot this in the previous commit 2023-06-08 13:10:15 -03:00
a464aa8a98 REFACTOR: rename 'ParseTweetResponse' to 'ToTweetTrove' and put it in the api_types file 2023-06-08 13:08:46 -03:00
f7d383adf3 REFACTOR: move API types, requests and tests to their own 'api_types_spaces' files 2023-06-07 17:18:26 -03:00
b37977145a Expand debug logging to make debugging scraping errors easier
- Print HTTP headers to the debug log on every request
- If parsing a APIV2 tweet panics, print the full JSON of that tweet entry to the debug log
2023-06-07 15:17:38 -03:00
2a74941707 Fix lint error 2023-06-05 18:10:02 -03:00
6df313558d Fix lint errors 2023-06-03 09:17:12 -03:00
815a8180da BUGFIX: don't clobber num_likes, num_retweets etc. if tweet is a stub
- Convert Tweet queries to sqlx, including new CommaSeparatedList type to convert Hashtags, Mentions and ReplyMentions
2023-06-03 08:30:49 -03:00
dea37c7556 Fix cursor bug in authenticated sessions 2023-06-03 07:51:39 -03:00
af93f44ed2 Two bug fixes
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
2023-06-03 07:38:17 -03:00
1384aa73e9 BUGFIX: fix CSRF tokens getting out of sync on requests that load multiple pages of results 2023-03-09 22:49:55 -05:00
ee4b863d38 Remove integration test masquerading as a unit test 2023-02-17 13:22:09 -05:00
c09b77f497 Add ability to use saved sessions 2023-02-17 13:07:12 -05:00
Jaeger Aquila
28ca0ac4eb added cmdline login functionality 2023-02-05 20:29:57 -05:00
390c831541 Add marshaling and unmarshaling of API objects so state can be persisted between runs 2023-01-01 21:57:08 -05:00
c3494cfe19 Add handle of the logged-in user to API 2023-01-01 21:45:58 -05:00
00a73836f5 Fix some lint errors 2023-01-01 20:14:26 -05:00
8a1b2fc801 Fix lint error 2022-12-30 21:23:45 -05:00
04842f8c72 REFACTOR: make login flow less verbose 2022-12-30 21:23:45 -05:00
1087809d63 Add fetching likes API request 2022-12-30 21:23:45 -05:00
c0366a0978 Add cookies and CSRF to authentication flow 2022-12-30 21:23:45 -05:00
Jaeger Aquila
2cf64db93e some refactoring and tests 2022-12-30 21:23:45 -05:00
Jaeger Aquila
140024e903 initial login code 2022-12-30 21:23:45 -05:00
58f4026e88 Rename login script 2022-12-30 21:23:45 -05:00