|
|
94e581cc0b
|
Improve error messages in parsing of single tweets
|
2023-06-21 13:23:50 -03:00 |
|
|
|
56d150d4ae
|
Fix an integration test which broke because twitter removed a link thumbnail image
|
2023-06-21 13:10:59 -03:00 |
|
|
|
5899732fa5
|
Do tombstoned user fetching for apiv2
|
2023-06-21 12:25:42 -03:00 |
|
|
|
e06e7164cc
|
Avoid crashing on tombstones in tweet detail replies
|
2023-06-20 13:48:06 -03:00 |
|
|
|
459fbb4f2f
|
Add recognition of other types of cursors on Tweet Detail page
|
2023-06-19 23:27:30 -03:00 |
|
|
|
64bb8233f0
|
Avoid crashing on inline labels like 'More Replies'
|
2023-06-19 22:18:19 -03:00 |
|
|
|
0a40dbe908
|
Avoid crashing on user-feed tombstone entries
|
2023-06-19 21:37:30 -03:00 |
|
|
|
3340fc3da3
|
Create fake users for tombstones whose users can't be inferred
|
2023-06-19 21:26:09 -03:00 |
|
|
|
0dd759ce54
|
Add joining of tombstone threads by in_reply_to_id
|
2023-06-18 12:04:11 -03:00 |
|
|
|
0cc132c156
|
Create helper function to parse an APIV2Entry's ID field into a tweet ID and entry type
|
2023-06-17 23:24:32 -03:00 |
|
|
|
ad9e599ef9
|
Clean up a few tests to use assert and require instead of 'if ... { t.Errorf...'
|
2023-06-17 23:22:28 -03:00 |
|
|
|
c0f2624009
|
Add test file for previous commit
|
2023-06-17 15:22:39 -03:00 |
|
|
|
1226e3947e
|
Add parsing of tombstones in immediate parent replies in Tweet Detail views for APIv2
|
2023-06-17 15:15:22 -03:00 |
|
|
|
21581b325a
|
Add support for parsing Tweet Detail in APIv2, including its unusual cursor format and conversation threads
|
2023-06-08 23:19:50 -03:00 |
|
|
|
693831704d
|
BUGFIX: spaces ended_at should be updated on saving now
|
2023-06-08 21:52:22 -03:00 |
|
|
|
b692d9f2fa
|
Update CHANGELOG.txt for version 0.2.2
|
2023-06-08 20:48:30 -03:00 |
|
|
|
d78f9c004d
|
REFACTOR: use a switch statement to add clarity for parsing non-tweet timeline entries
|
2023-06-08 20:43:07 -03:00 |
|
|
|
6192c37999
|
FIXUP: add test file for previous commit
|
2023-06-08 18:53:50 -03:00 |
|
|
|
0868d8d6d8
|
Implement expandable ("Show more...") tweets
|
2023-06-08 18:51:50 -03:00 |
|
|
|
eb566c0612
|
FIXUP: add test file for previous commit
|
2023-06-08 18:10:55 -03:00 |
|
|
|
e4e05008d5
|
Add parsing of home-conversation entry types (mini-threads that show up in a feed)
|
2023-06-08 18:08:23 -03:00 |
|
|
|
9a1ef814ef
|
Add debug logging of requested URLs
|
2023-06-08 16:04:24 -03:00 |
|
|
|
5c70d2cf49
|
Remove incorrect/redundant API type field
|
2023-06-08 14:22:04 -03:00 |
|
|
|
b36e7410c5
|
FIXUP: forgot this in the previous commit
|
2023-06-08 13:10:15 -03:00 |
|
|
|
a464aa8a98
|
REFACTOR: rename 'ParseTweetResponse' to 'ToTweetTrove' and put it in the api_types file
|
2023-06-08 13:08:46 -03:00 |
|
|
|
f7d383adf3
|
REFACTOR: move API types, requests and tests to their own 'api_types_spaces' files
|
2023-06-07 17:18:26 -03:00 |
|
|
|
f07da7880c
|
Correct a mistake in the CHANGELOG for v0.2.1
|
2023-06-07 16:06:31 -03:00 |
|
|
|
d93033352e
|
Update CHANGELOG.txt for v0.2.1
|
2023-06-07 15:44:25 -03:00 |
|
|
|
b37977145a
|
Expand debug logging to make debugging scraping errors easier
- Print HTTP headers to the debug log on every request
- If parsing a APIV2 tweet panics, print the full JSON of that tweet entry to the debug log
|
2023-06-07 15:17:38 -03:00 |
|
|
|
cba6631a72
|
Add integration test for no-clobbering of tombstone stats
|
2023-06-07 13:23:57 -03:00 |
|
|
|
2a74941707
|
Fix lint error
|
2023-06-05 18:10:02 -03:00 |
|
|
|
c01c927a92
|
Use the built image for the main pipeline
|
2023-06-05 18:06:50 -03:00 |
|
|
|
04eb65aef3
|
Mount the docker socket
|
2023-06-05 15:42:11 -03:00 |
|
|
|
599ba042b8
|
Create separate build file for the docker image
|
2023-06-03 10:56:01 -03:00 |
|
|
|
6df313558d
|
Fix lint errors
|
2023-06-03 09:17:12 -03:00 |
|
|
|
815a8180da
|
BUGFIX: don't clobber num_likes, num_retweets etc. if tweet is a stub
- Convert Tweet queries to sqlx, including new CommaSeparatedList type to convert Hashtags, Mentions and ReplyMentions
|
2023-06-03 08:30:49 -03:00 |
|
|
|
dea37c7556
|
Fix cursor bug in authenticated sessions
|
2023-06-03 07:51:39 -03:00 |
|
|
|
af93f44ed2
|
Two bug fixes
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
|
2023-06-03 07:38:17 -03:00 |
|
|
|
a724f32470
|
Allow specifying session files with .session extension at command line
|
2023-03-16 17:53:14 -03:00 |
|
|
|
6f2ef8953b
|
Update CHANGELOG.txt for v0.2.0
|
2023-03-09 22:55:02 -05:00 |
|
|
|
1384aa73e9
|
BUGFIX: fix CSRF tokens getting out of sync on requests that load multiple pages of results
|
2023-03-09 22:49:55 -05:00 |
|
|
|
ae9a9c3a47
|
Remove password from login.py as well
|
2023-02-17 13:51:31 -05:00 |
|
|
|
f988d57e1c
|
Remove password from test script
|
2023-02-17 13:46:42 -05:00 |
|
|
|
ee4b863d38
|
Remove integration test masquerading as a unit test
|
2023-02-17 13:22:09 -05:00 |
|
|
|
c09b77f497
|
Add ability to use saved sessions
|
2023-02-17 13:07:12 -05:00 |
|
|
|
933ee9a7f9
|
Fix lint errors
|
2023-02-05 23:40:22 -05:00 |
|
alex
|
3a44f39e9f
|
Add a check
|
2023-02-05 23:33:36 -05:00 |
|
Jaeger Aquila
|
28ca0ac4eb
|
added cmdline login functionality
|
2023-02-05 20:29:57 -05:00 |
|
Jaeger Aquila
|
68867718af
|
Fixed linter errors
|
2023-01-14 17:56:02 -05:00 |
|
Jaeger Aquila
|
a8b1241898
|
removing extra TODO
|
2023-01-14 17:51:54 -05:00 |
|
