7bad18e9b1
Tidy up the formatting
2022-12-03 13:47:34 -05:00
James Raleigh
972fd50c5b
Fixed tests for DMCAed videos and other fixes
2022-12-02 20:38:57 -05:00
b78cef34ce
Update tests to change account that got banned
2022-11-13 11:29:47 -05:00
5877063748
Add some tests for multiple videos / videos+images
2022-10-15 15:50:25 -04:00
069ddcd976
Put videos, images, and video-thumbnails into subdirectories
2022-10-15 15:06:06 -04:00
b8b3b56c8e
Add woodpecker config, update tests due to an account getting banned
2022-10-14 23:32:14 -04:00
c97ee8a645
Add integration test for scraping a Space
2022-05-14 17:00:56 -07:00
3b4b3fceb9
Improve tombstone handling significantly
...
- Tombstone type can now be updated
- If a tombstoned tweet becomes available, now updates the text and removes the tombstone
- Non-stub tweets can now have tombstones attached to them without clobbering the tweet content
2022-05-07 16:50:07 -07:00
7e33cc1a9f
Update test script because previously deleted account un-deleted itself somehow
2022-03-22 13:28:42 -07:00
8c2fb965aa
Fix integration test (failing because user Denlesks was marked as "sensitive")
2022-03-13 14:46:44 -07:00
3cb3c14e77
Change failing integration test to use different tweet with link preview image (previous one had bad karma anyway)
2022-03-02 15:34:38 -08:00
508670248e
Add list_followed subcommand
2022-02-28 16:06:58 -08:00
5f3013a49b
Update tweet UserIDs in a tweet trove with Unknown Users in it (i.e., deleted users(?))
2022-02-27 23:14:30 -08:00
52370a4f9d
Recognized deleted users when scraping, create a user with a fake ID
2022-02-27 23:06:06 -08:00
41586bf0f8
Add follow and unfollow sub-commands
2022-02-26 16:22:00 -08:00
13170c84b2
Add '-h, --help' flag to print help message then exit
2022-02-12 15:41:03 -08:00
f264aff265
Update test data since the previous private-user unprivated
2022-01-30 15:16:04 -08:00
56870173e9
Fix bug with users with 600x200 banner images
...
When downloading these users' content, they weren't getting saved afterward (to update 'is_content_downloaded').
2022-01-18 17:48:56 -08:00
e71e32228c
Get rid of tiny default profile images (default image is small enough, doesn't need a tiny version)
2022-01-07 17:33:26 -05:00
12f1cc6728
Fix some problems associated with banned users
2022-01-07 16:23:02 -05:00
d95f183e45
Add parsing of tombstoned quoted-tweets
2022-01-07 13:42:00 -05:00
6eac56183d
Allow fetching of banned users
2022-01-07 13:40:22 -05:00
f25f1ae024
Change profile image downloading to use tiny profile image if appropriate
2022-01-05 12:37:11 -05:00
e06b0bff30
Add --version flag to the executable
2022-01-04 12:57:43 -05:00
fbbb6834de
Add video thumbnails
2021-12-23 15:12:01 -05:00
8e13e30ac5
Scraping now updates last_scraped_at and sets is_conversation_scraped
2021-12-20 15:27:59 -05:00
28e44897b5
Add poll updating
2021-12-12 18:42:27 -08:00
ddb16c9e64
Remove integration test for tombstones because the guy un-privated for some reason
2021-12-12 16:14:11 -08:00
6d7d940df4
Add search
2021-11-06 14:50:39 -07:00
470dce1d27
Persist tombstone data
2021-11-06 13:37:46 -07:00
e5b4b43358
Temporarily remove integration tests user who got banned ('suspended' handling doesn't work yet)
2021-11-01 16:04:53 -07:00
c219652dcc
Make fetching very aggressive by default
2021-10-10 15:13:32 -07:00
66daacec34
Fix the constantly-breaking thumbnail url test
2021-10-10 15:06:39 -07:00
1c2f356ee9
Fix re-downloading making users get marked as content-not-downloaded
2021-10-09 18:58:52 -07:00
b117cbec7b
Update some of the integration tests
2021-10-07 14:58:59 -07:00
100fe6c718
Fix gifs
2021-10-04 21:06:53 -07:00
6aa14c32e2
Add persistence for reply-mentions
2021-09-27 18:29:55 -07:00
b17e0821bb
Make command line accept either URL or just ID to find a tweet
2021-09-27 13:49:17 -07:00
1dd02ff390
Fetching a user now downloads its content automatically
2021-09-27 12:54:18 -07:00
0bb9ff6c6b
Add handling for URL cards with no link preview thumbnail image
2021-09-17 20:50:28 -07:00
f9ddc0f102
Add downloading for link previews
2021-09-17 20:11:36 -07:00
05c3f2289b
Add persistence for new Url type
2021-09-17 18:04:57 -07:00
e2ff9436fa
Add player type of URL card
2021-09-17 17:35:55 -07:00
ef9a98b79c
Fix integration test (sample user got banned)
2021-09-17 15:03:23 -07:00
a2554e9293
Enable 'fetch_tweet' full scrape
2021-08-22 17:55:21 -07:00
9eee64cca1
Catch random API 403 errors
2021-08-22 16:41:59 -07:00
08d703a26f
Add command to get a user feed
2021-08-19 12:54:08 -07:00
2b23fcbc53
twitter command now uses current directory as the profile dir by default
2021-08-11 06:56:42 -07:00
917c3fc7a7
Add integration test for downloading user contents
2021-08-10 22:06:03 -07:00
3de47f6bde
Add twitter command download_tweet_content
2021-08-07 17:06:39 -07:00
