|
|
8261087103
|
REFACTOR: make helper function use the scraper tweet-url parsing method
|
2022-03-13 14:50:08 -07:00 |
|
|
|
8c2fb965aa
|
Fix integration test (failing because user Denlesks was marked as "sensitive")
|
2022-03-13 14:46:44 -07:00 |
|
|
|
f41d072573
|
Improve error handling some more
|
2022-03-06 20:31:04 -08:00 |
|
|
|
7edc8ad5d3
|
Some whitespace changes :V
|
2022-03-06 17:07:05 -08:00 |
|
|
|
18c9f79429
|
REFACTOR: LINT: add .golangci.yaml lint config file
- Add linting for line lengths
- Fix some linting errors
|
2022-03-06 15:06:06 -08:00 |
|
|
|
3cb3c14e77
|
Change failing integration test to use different tweet with link preview image (previous one had bad karma anyway)
|
2022-03-02 15:34:38 -08:00 |
|
|
|
508670248e
|
Add list_followed subcommand
|
2022-02-28 16:06:58 -08:00 |
|
|
|
5f3013a49b
|
Update tweet UserIDs in a tweet trove with Unknown Users in it (i.e., deleted users(?))
|
2022-02-27 23:14:30 -08:00 |
|
|
|
52370a4f9d
|
Recognized deleted users when scraping, create a user with a fake ID
|
2022-02-27 23:06:06 -08:00 |
|
|
|
728aaf251f
|
Fix linting error
|
2022-02-26 22:18:41 -08:00 |
|
|
|
41586bf0f8
|
Add follow and unfollow sub-commands
|
2022-02-26 16:22:00 -08:00 |
|
|
|
9cd7f4171a
|
Add proper logging module, set logging level to 'info' by default (hide very verbose debug results)
|
2022-02-14 14:31:26 -08:00 |
|
|
|
f9a8841c07
|
REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go
|
2022-02-14 13:39:59 -08:00 |
|
|
|
3d489a8e95
|
REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions
|
2022-02-14 13:10:12 -08:00 |
|
|
|
f1a33bab48
|
Fix cmd help output when entering an invalid command-line flag
|
2022-02-14 13:00:32 -08:00 |
|
|
|
e0f05cbeea
|
Refactor all scraper areas to use TweetTroves where applicable
|
2022-02-12 20:39:30 -08:00 |
|
|
|
c53d8ae24c
|
Remove old, unneeded debugging files
|
2022-02-12 20:25:18 -08:00 |
|
|
|
13170c84b2
|
Add '-h, --help' flag to print help message then exit
|
2022-02-12 15:41:03 -08:00 |
|
|
|
04a4974ffb
|
Add '-n' / '--number' flags, and update help message for executable
|
2022-02-02 15:09:50 -08:00 |
|
|
|
f264aff265
|
Update test data since the previous private-user unprivated
|
2022-01-30 15:16:04 -08:00 |
|
|
|
b261f095ad
|
Change main application to use new API for user feeds
|
2022-01-24 20:19:08 -08:00 |
|
|
|
56870173e9
|
Fix bug with users with 600x200 banner images
When downloading these users' content, they weren't getting saved afterward (to update 'is_content_downloaded').
|
2022-01-18 17:48:56 -08:00 |
|
|
|
e71e32228c
|
Get rid of tiny default profile images (default image is small enough, doesn't need a tiny version)
|
2022-01-07 17:33:26 -05:00 |
|
|
|
12f1cc6728
|
Fix some problems associated with banned users
|
2022-01-07 16:23:02 -05:00 |
|
|
|
d95f183e45
|
Add parsing of tombstoned quoted-tweets
|
2022-01-07 13:42:00 -05:00 |
|
|
|
6eac56183d
|
Allow fetching of banned users
|
2022-01-07 13:40:22 -05:00 |
|
|
|
f25f1ae024
|
Change profile image downloading to use tiny profile image if appropriate
|
2022-01-05 12:37:11 -05:00 |
|
|
|
e06b0bff30
|
Add --version flag to the executable
|
2022-01-04 12:57:43 -05:00 |
|
|
|
fbbb6834de
|
Add video thumbnails
|
2021-12-23 15:12:01 -05:00 |
|
|
|
692d3de564
|
Don't double-download tweet contents
|
2021-12-21 21:57:00 -05:00 |
|
|
|
469d846db4
|
Add another section of avoiding double-downloading user content
|
2021-12-21 21:37:04 -05:00 |
|
|
|
5a4da58572
|
Add conditional downloading for user content
|
2021-12-21 21:29:27 -05:00 |
|
|
|
8e13e30ac5
|
Scraping now updates last_scraped_at and sets is_conversation_scraped
|
2021-12-20 15:27:59 -05:00 |
|
|
|
28e44897b5
|
Add poll updating
|
2021-12-12 18:42:27 -08:00 |
|
|
|
ddb16c9e64
|
Remove integration test for tombstones because the guy un-privated for some reason
|
2021-12-12 16:14:11 -08:00 |
|
|
|
abbc525df9
|
Create first release attempt
|
2021-11-29 15:23:16 -08:00 |
|
|
|
6d7d940df4
|
Add search
|
2021-11-06 14:50:39 -07:00 |
|
|
|
470dce1d27
|
Persist tombstone data
|
2021-11-06 13:37:46 -07:00 |
|
|
|
e5b4b43358
|
Temporarily remove integration tests user who got banned ('suspended' handling doesn't work yet)
|
2021-11-01 16:04:53 -07:00 |
|
|
|
c219652dcc
|
Make fetching very aggressive by default
|
2021-10-10 15:13:32 -07:00 |
|
|
|
66daacec34
|
Fix the constantly-breaking thumbnail url test
|
2021-10-10 15:06:39 -07:00 |
|
|
|
1c2f356ee9
|
Fix re-downloading making users get marked as content-not-downloaded
|
2021-10-09 18:58:52 -07:00 |
|
|
|
b117cbec7b
|
Update some of the integration tests
|
2021-10-07 14:58:59 -07:00 |
|
|
|
100fe6c718
|
Fix gifs
|
2021-10-04 21:06:53 -07:00 |
|
|
|
6aa14c32e2
|
Add persistence for reply-mentions
|
2021-09-27 18:29:55 -07:00 |
|
|
|
f278010201
|
Fix linting error
|
2021-09-27 13:52:51 -07:00 |
|
|
|
b17e0821bb
|
Make command line accept either URL or just ID to find a tweet
|
2021-09-27 13:49:17 -07:00 |
|
|
|
1dd02ff390
|
Fetching a user now downloads its content automatically
|
2021-09-27 12:54:18 -07:00 |
|
|
|
0bb9ff6c6b
|
Add handling for URL cards with no link preview thumbnail image
|
2021-09-17 20:50:28 -07:00 |
|
|
|
f9ddc0f102
|
Add downloading for link previews
|
2021-09-17 20:11:36 -07:00 |
|
