371 Commits

Author SHA1 Message Date
d78f9c004d REFACTOR: use a switch statement to add clarity for parsing non-tweet timeline entries 2023-06-08 20:43:07 -03:00
6192c37999 FIXUP: add test file for previous commit 2023-06-08 18:53:50 -03:00
0868d8d6d8 Implement expandable ("Show more...") tweets 2023-06-08 18:51:50 -03:00
eb566c0612 FIXUP: add test file for previous commit 2023-06-08 18:10:55 -03:00
e4e05008d5 Add parsing of home-conversation entry types (mini-threads that show up in a feed) 2023-06-08 18:08:23 -03:00
9a1ef814ef Add debug logging of requested URLs 2023-06-08 16:04:24 -03:00
5c70d2cf49 Remove incorrect/redundant API type field 2023-06-08 14:22:04 -03:00
b36e7410c5 FIXUP: forgot this in the previous commit 2023-06-08 13:10:15 -03:00
a464aa8a98 REFACTOR: rename 'ParseTweetResponse' to 'ToTweetTrove' and put it in the api_types file 2023-06-08 13:08:46 -03:00
f7d383adf3 REFACTOR: move API types, requests and tests to their own 'api_types_spaces' files 2023-06-07 17:18:26 -03:00
f07da7880c Correct a mistake in the CHANGELOG for v0.2.1 2023-06-07 16:06:31 -03:00
d93033352e Update CHANGELOG.txt for v0.2.1 2023-06-07 15:44:25 -03:00
b37977145a Expand debug logging to make debugging scraping errors easier
- Print HTTP headers to the debug log on every request
- If parsing a APIV2 tweet panics, print the full JSON of that tweet entry to the debug log
2023-06-07 15:17:38 -03:00
cba6631a72 Add integration test for no-clobbering of tombstone stats 2023-06-07 13:23:57 -03:00
2a74941707 Fix lint error 2023-06-05 18:10:02 -03:00
c01c927a92 Use the built image for the main pipeline 2023-06-05 18:06:50 -03:00
04eb65aef3 Mount the docker socket 2023-06-05 15:42:11 -03:00
599ba042b8 Create separate build file for the docker image 2023-06-03 10:56:01 -03:00
6df313558d Fix lint errors 2023-06-03 09:17:12 -03:00
815a8180da BUGFIX: don't clobber num_likes, num_retweets etc. if tweet is a stub
- Convert Tweet queries to sqlx, including new CommaSeparatedList type to convert Hashtags, Mentions and ReplyMentions
2023-06-03 08:30:49 -03:00
dea37c7556 Fix cursor bug in authenticated sessions 2023-06-03 07:51:39 -03:00
af93f44ed2 Two bug fixes
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
2023-06-03 07:38:17 -03:00
a724f32470 Allow specifying session files with .session extension at command line 2023-03-16 17:53:14 -03:00
6f2ef8953b Update CHANGELOG.txt for v0.2.0 2023-03-09 22:55:02 -05:00
1384aa73e9 BUGFIX: fix CSRF tokens getting out of sync on requests that load multiple pages of results 2023-03-09 22:49:55 -05:00
ae9a9c3a47 Remove password from login.py as well 2023-02-17 13:51:31 -05:00
f988d57e1c Remove password from test script 2023-02-17 13:46:42 -05:00
ee4b863d38 Remove integration test masquerading as a unit test 2023-02-17 13:22:09 -05:00
c09b77f497 Add ability to use saved sessions 2023-02-17 13:07:12 -05:00
933ee9a7f9 Fix lint errors 2023-02-05 23:40:22 -05:00
alex
3a44f39e9f Add a check 2023-02-05 23:33:36 -05:00
Jaeger Aquila
28ca0ac4eb added cmdline login functionality 2023-02-05 20:29:57 -05:00
Jaeger Aquila
68867718af Fixed linter errors 2023-01-14 17:56:02 -05:00
Jaeger Aquila
a8b1241898 removing extra TODO 2023-01-14 17:51:54 -05:00
Jaeger Aquila
4ee69f1ed5 implemented saving cookies and user session to a file 2023-01-14 17:40:03 -05:00
ab9e67bbb1 Add skeleton for saving and loading sessions 2023-01-08 15:40:17 -05:00
390c831541 Add marshaling and unmarshaling of API objects so state can be persisted between runs 2023-01-01 21:57:08 -05:00
c3494cfe19 Add handle of the logged-in user to API 2023-01-01 21:45:58 -05:00
6302b3d5ab Fix integration test (pompilivs deleted his account) 2023-01-01 20:27:35 -05:00
00a73836f5 Fix some lint errors 2023-01-01 20:14:26 -05:00
8a1b2fc801 Fix lint error 2022-12-30 21:23:45 -05:00
04842f8c72 REFACTOR: make login flow less verbose 2022-12-30 21:23:45 -05:00
1087809d63 Add fetching likes API request 2022-12-30 21:23:45 -05:00
c0366a0978 Add cookies and CSRF to authentication flow 2022-12-30 21:23:45 -05:00
3feaf9caa6 Fix cookies in login python script 2022-12-30 21:23:45 -05:00
Jaeger Aquila
2cf64db93e some refactoring and tests 2022-12-30 21:23:45 -05:00
Jaeger Aquila
140024e903 initial login code 2022-12-30 21:23:45 -05:00
58f4026e88 Rename login script 2022-12-30 21:23:45 -05:00
62c499e95c Tidy up login script, add request to fetch 'likes' (auth-guarded endpoint) 2022-12-30 21:23:45 -05:00
James Raleigh
55b25f4fbf initial login test script in py 2022-12-30 21:23:45 -05:00