|
|
d85259a014
|
REFACTOR: delete 'get_xyz_url' helper functions and put them inline in the respective functions
|
2023-06-24 13:59:00 -03:00 |
|
|
|
cce8cc1f7f
|
Create structures for GraphQL request variables and features
|
2023-06-24 13:39:08 -03:00 |
|
|
|
bb53ab4730
|
Update CHANGELOG.txt for v0.3.1
|
2023-06-22 17:26:20 -03:00 |
|
|
|
a58ebc6988
|
Add new type of TimelineTimelineModule, the 'profile-conversation'
|
2023-06-22 17:21:54 -03:00 |
|
|
|
5c6e171ea3
|
Update CHANGELOG.txt for version 0.3.0
|
2023-06-21 16:02:08 -03:00 |
|
|
|
f6692fa535
|
Fix some lint errors
|
2023-06-21 15:42:43 -03:00 |
|
|
|
d8b8aaea15
|
Fix a bug where replies to deleted accounts can fail to do proper reply-joining
|
2023-06-21 15:38:18 -03:00 |
|
|
|
a44323c5de
|
Switch over Tweet Detail fetching to use APIv2
|
2023-06-21 14:05:49 -03:00 |
|
|
|
eae3ebe3e7
|
When doing reply-joining of tombstones, ignore cursors and labels
|
2023-06-21 14:05:49 -03:00 |
|
|
|
3dc9889725
|
Fetch tombstoned users that are partially re-assembled using reply-joining
|
2023-06-21 14:05:49 -03:00 |
|
|
|
94e581cc0b
|
Improve error messages in parsing of single tweets
|
2023-06-21 13:23:50 -03:00 |
|
|
|
56d150d4ae
|
Fix an integration test which broke because twitter removed a link thumbnail image
|
2023-06-21 13:10:59 -03:00 |
|
|
|
5899732fa5
|
Do tombstoned user fetching for apiv2
|
2023-06-21 12:25:42 -03:00 |
|
|
|
e06e7164cc
|
Avoid crashing on tombstones in tweet detail replies
|
2023-06-20 13:48:06 -03:00 |
|
|
|
459fbb4f2f
|
Add recognition of other types of cursors on Tweet Detail page
|
2023-06-19 23:27:30 -03:00 |
|
|
|
64bb8233f0
|
Avoid crashing on inline labels like 'More Replies'
|
2023-06-19 22:18:19 -03:00 |
|
|
|
0a40dbe908
|
Avoid crashing on user-feed tombstone entries
|
2023-06-19 21:37:30 -03:00 |
|
|
|
3340fc3da3
|
Create fake users for tombstones whose users can't be inferred
|
2023-06-19 21:26:09 -03:00 |
|
|
|
0dd759ce54
|
Add joining of tombstone threads by in_reply_to_id
|
2023-06-18 12:04:11 -03:00 |
|
|
|
0cc132c156
|
Create helper function to parse an APIV2Entry's ID field into a tweet ID and entry type
|
2023-06-17 23:24:32 -03:00 |
|
|
|
ad9e599ef9
|
Clean up a few tests to use assert and require instead of 'if ... { t.Errorf...'
|
2023-06-17 23:22:28 -03:00 |
|
|
|
c0f2624009
|
Add test file for previous commit
|
2023-06-17 15:22:39 -03:00 |
|
|
|
1226e3947e
|
Add parsing of tombstones in immediate parent replies in Tweet Detail views for APIv2
|
2023-06-17 15:15:22 -03:00 |
|
|
|
21581b325a
|
Add support for parsing Tweet Detail in APIv2, including its unusual cursor format and conversation threads
|
2023-06-08 23:19:50 -03:00 |
|
|
|
693831704d
|
BUGFIX: spaces ended_at should be updated on saving now
|
2023-06-08 21:52:22 -03:00 |
|
|
|
b692d9f2fa
|
Update CHANGELOG.txt for version 0.2.2
|
2023-06-08 20:48:30 -03:00 |
|
|
|
d78f9c004d
|
REFACTOR: use a switch statement to add clarity for parsing non-tweet timeline entries
|
2023-06-08 20:43:07 -03:00 |
|
|
|
6192c37999
|
FIXUP: add test file for previous commit
|
2023-06-08 18:53:50 -03:00 |
|
|
|
0868d8d6d8
|
Implement expandable ("Show more...") tweets
|
2023-06-08 18:51:50 -03:00 |
|
|
|
eb566c0612
|
FIXUP: add test file for previous commit
|
2023-06-08 18:10:55 -03:00 |
|
|
|
e4e05008d5
|
Add parsing of home-conversation entry types (mini-threads that show up in a feed)
|
2023-06-08 18:08:23 -03:00 |
|
|
|
9a1ef814ef
|
Add debug logging of requested URLs
|
2023-06-08 16:04:24 -03:00 |
|
|
|
5c70d2cf49
|
Remove incorrect/redundant API type field
|
2023-06-08 14:22:04 -03:00 |
|
|
|
b36e7410c5
|
FIXUP: forgot this in the previous commit
|
2023-06-08 13:10:15 -03:00 |
|
|
|
a464aa8a98
|
REFACTOR: rename 'ParseTweetResponse' to 'ToTweetTrove' and put it in the api_types file
|
2023-06-08 13:08:46 -03:00 |
|
|
|
f7d383adf3
|
REFACTOR: move API types, requests and tests to their own 'api_types_spaces' files
|
2023-06-07 17:18:26 -03:00 |
|
|
|
f07da7880c
|
Correct a mistake in the CHANGELOG for v0.2.1
|
2023-06-07 16:06:31 -03:00 |
|
|
|
d93033352e
|
Update CHANGELOG.txt for v0.2.1
|
2023-06-07 15:44:25 -03:00 |
|
|
|
b37977145a
|
Expand debug logging to make debugging scraping errors easier
- Print HTTP headers to the debug log on every request
- If parsing a APIV2 tweet panics, print the full JSON of that tweet entry to the debug log
|
2023-06-07 15:17:38 -03:00 |
|
|
|
cba6631a72
|
Add integration test for no-clobbering of tombstone stats
|
2023-06-07 13:23:57 -03:00 |
|
|
|
2a74941707
|
Fix lint error
|
2023-06-05 18:10:02 -03:00 |
|
|
|
c01c927a92
|
Use the built image for the main pipeline
|
2023-06-05 18:06:50 -03:00 |
|
|
|
04eb65aef3
|
Mount the docker socket
|
2023-06-05 15:42:11 -03:00 |
|
|
|
599ba042b8
|
Create separate build file for the docker image
|
2023-06-03 10:56:01 -03:00 |
|
|
|
6df313558d
|
Fix lint errors
|
2023-06-03 09:17:12 -03:00 |
|
|
|
815a8180da
|
BUGFIX: don't clobber num_likes, num_retweets etc. if tweet is a stub
- Convert Tweet queries to sqlx, including new CommaSeparatedList type to convert Hashtags, Mentions and ReplyMentions
|
2023-06-03 08:30:49 -03:00 |
|
|
|
dea37c7556
|
Fix cursor bug in authenticated sessions
|
2023-06-03 07:51:39 -03:00 |
|
|
|
af93f44ed2
|
Two bug fixes
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
|
2023-06-03 07:38:17 -03:00 |
|
|
|
a724f32470
|
Allow specifying session files with .session extension at command line
|
2023-03-16 17:53:14 -03:00 |
|
|
|
6f2ef8953b
|
Update CHANGELOG.txt for v0.2.0
|
2023-03-09 22:55:02 -05:00 |
|
