56d150d4ae
Fix an integration test which broke because twitter removed a link thumbnail image
2023-06-21 13:10:59 -03:00
cba6631a72
Add integration test for no-clobbering of tombstone stats
2023-06-07 13:23:57 -03:00
dea37c7556
Fix cursor bug in authenticated sessions
2023-06-03 07:51:39 -03:00
af93f44ed2
Two bug fixes
...
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
2023-06-03 07:38:17 -03:00
a724f32470
Allow specifying session files with .session extension at command line
2023-03-16 17:53:14 -03:00
6f2ef8953b
Update CHANGELOG.txt for v0.2.0
2023-03-09 22:55:02 -05:00
ae9a9c3a47
Remove password from login.py as well
2023-02-17 13:51:31 -05:00
f988d57e1c
Remove password from test script
2023-02-17 13:46:42 -05:00
c09b77f497
Add ability to use saved sessions
2023-02-17 13:07:12 -05:00
933ee9a7f9
Fix lint errors
2023-02-05 23:40:22 -05:00
alex
3a44f39e9f
Add a check
2023-02-05 23:33:36 -05:00
Jaeger Aquila
28ca0ac4eb
added cmdline login functionality
2023-02-05 20:29:57 -05:00
6302b3d5ab
Fix integration test (pompilivs deleted his account)
2023-01-01 20:27:35 -05:00
f2af4b2403
Fix search
2022-12-09 23:02:12 -05:00
7bad18e9b1
Tidy up the formatting
2022-12-03 13:47:34 -05:00
James Raleigh
972fd50c5b
Fixed tests for DMCAed videos and other fixes
2022-12-02 20:38:57 -05:00
b78cef34ce
Update tests to change account that got banned
2022-11-13 11:29:47 -05:00
5877063748
Add some tests for multiple videos / videos+images
2022-10-15 15:50:25 -04:00
069ddcd976
Put videos, images, and video-thumbnails into subdirectories
2022-10-15 15:06:06 -04:00
b8b3b56c8e
Add woodpecker config, update tests due to an account getting banned
2022-10-14 23:32:14 -04:00
94b8b551f8
Update CHANGELOG.txt for v0.1.6
2022-05-14 18:28:33 -07:00
5d54a46aaf
Move cmd help message to a plain text file and embed it using go:embed
2022-05-14 18:18:05 -07:00
c97ee8a645
Add integration test for scraping a Space
2022-05-14 17:00:56 -07:00
3b4b3fceb9
Improve tombstone handling significantly
...
- Tombstone type can now be updated
- If a tombstoned tweet becomes available, now updates the text and removes the tombstone
- Non-stub tweets can now have tombstones attached to them without clobbering the tweet content
2022-05-07 16:50:07 -07:00
7e33cc1a9f
Update test script because previously deleted account un-deleted itself somehow
2022-03-22 13:28:42 -07:00
8261087103
REFACTOR: make helper function use the scraper tweet-url parsing method
2022-03-13 14:50:08 -07:00
8c2fb965aa
Fix integration test (failing because user Denlesks was marked as "sensitive")
2022-03-13 14:46:44 -07:00
f41d072573
Improve error handling some more
2022-03-06 20:31:04 -08:00
7edc8ad5d3
Some whitespace changes :V
2022-03-06 17:07:05 -08:00
18c9f79429
REFACTOR: LINT: add .golangci.yaml lint config file
...
- Add linting for line lengths
- Fix some linting errors
2022-03-06 15:06:06 -08:00
3cb3c14e77
Change failing integration test to use different tweet with link preview image (previous one had bad karma anyway)
2022-03-02 15:34:38 -08:00
508670248e
Add list_followed subcommand
2022-02-28 16:06:58 -08:00
5f3013a49b
Update tweet UserIDs in a tweet trove with Unknown Users in it (i.e., deleted users(?))
2022-02-27 23:14:30 -08:00
52370a4f9d
Recognized deleted users when scraping, create a user with a fake ID
2022-02-27 23:06:06 -08:00
728aaf251f
Fix linting error
2022-02-26 22:18:41 -08:00
41586bf0f8
Add follow and unfollow sub-commands
2022-02-26 16:22:00 -08:00
9cd7f4171a
Add proper logging module, set logging level to 'info' by default (hide very verbose debug results)
2022-02-14 14:31:26 -08:00
f9a8841c07
REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go
2022-02-14 13:39:59 -08:00
3d489a8e95
REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions
2022-02-14 13:10:12 -08:00
f1a33bab48
Fix cmd help output when entering an invalid command-line flag
2022-02-14 13:00:32 -08:00
e0f05cbeea
Refactor all scraper areas to use TweetTroves where applicable
2022-02-12 20:39:30 -08:00
c53d8ae24c
Remove old, unneeded debugging files
2022-02-12 20:25:18 -08:00
13170c84b2
Add '-h, --help' flag to print help message then exit
2022-02-12 15:41:03 -08:00
04a4974ffb
Add '-n' / '--number' flags, and update help message for executable
2022-02-02 15:09:50 -08:00
f264aff265
Update test data since the previous private-user unprivated
2022-01-30 15:16:04 -08:00
b261f095ad
Change main application to use new API for user feeds
2022-01-24 20:19:08 -08:00
56870173e9
Fix bug with users with 600x200 banner images
...
When downloading these users' content, they weren't getting saved afterward (to update 'is_content_downloaded').
2022-01-18 17:48:56 -08:00
e71e32228c
Get rid of tiny default profile images (default image is small enough, doesn't need a tiny version)
2022-01-07 17:33:26 -05:00
12f1cc6728
Fix some problems associated with banned users
2022-01-07 16:23:02 -05:00
d95f183e45
Add parsing of tombstoned quoted-tweets
2022-01-07 13:42:00 -05:00
