|
|
52370a4f9d
|
Recognized deleted users when scraping, create a user with a fake ID
|
2022-02-27 23:06:06 -08:00 |
|
|
|
728aaf251f
|
Fix linting error
|
2022-02-26 22:18:41 -08:00 |
|
|
|
772fa247f7
|
Add creation of unknown users with known handles (i.e., deleted accounts)
|
2022-02-26 22:09:27 -08:00 |
|
|
|
41586bf0f8
|
Add follow and unfollow sub-commands
|
2022-02-26 16:22:00 -08:00 |
|
|
|
857b9c5255
|
Fix linting error
|
2022-02-26 16:06:51 -08:00 |
|
|
|
373b9ce16e
|
Add IsFollowed field on Users
|
2022-02-26 15:58:30 -08:00 |
|
|
|
f9eb986aed
|
Update CHANGELOG.txt for v0.1.2
|
2022-02-16 09:29:11 -08:00 |
|
|
|
19c4b14704
|
Use a more lint-approved case-insensitive comparator
|
2022-02-14 18:06:04 -08:00 |
|
|
|
82f5721ac2
|
Make user handle matching case-insensitive in tweet trove
|
2022-02-14 17:58:10 -08:00 |
|
|
|
8a70f55e1b
|
Update some more stuff to match API changes
- set X-Twitter-Client-Language header to "en"
- Add a new tombstone type (age-restricted)
|
2022-02-14 17:18:23 -08:00 |
|
|
|
9cd7f4171a
|
Add proper logging module, set logging level to 'info' by default (hide very verbose debug results)
|
2022-02-14 14:31:26 -08:00 |
|
|
|
f9a8841c07
|
REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go
|
2022-02-14 13:39:59 -08:00 |
|
|
|
3d489a8e95
|
REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions
|
2022-02-14 13:10:12 -08:00 |
|
|
|
f1a33bab48
|
Fix cmd help output when entering an invalid command-line flag
|
2022-02-14 13:00:32 -08:00 |
|
|
|
e0f05cbeea
|
Refactor all scraper areas to use TweetTroves where applicable
|
2022-02-12 20:39:30 -08:00 |
|
|
|
c53d8ae24c
|
Remove old, unneeded debugging files
|
2022-02-12 20:25:18 -08:00 |
|
|
|
a204d66a44
|
Update CHANGELOG.txt for v0.1.1
|
2022-02-12 16:04:54 -08:00 |
|
|
|
4b2df1c628
|
Fix wrong 'Instruction' item being chosen following new API update :V
|
2022-02-12 15:51:55 -08:00 |
|
|
|
13170c84b2
|
Add '-h, --help' flag to print help message then exit
|
2022-02-12 15:41:03 -08:00 |
|
|
|
2773214855
|
Add test file for previous commit
|
2022-02-04 17:34:15 -08:00 |
|
|
|
09b8685f19
|
Add polls for APIv2
|
2022-02-04 17:05:27 -08:00 |
|
|
|
5e446f73a6
|
Update CHANGELOG.txt for v0.1.0
|
2022-02-02 15:30:01 -08:00 |
|
|
|
8d406e1b11
|
Minify that test file
|
2022-02-02 15:21:42 -08:00 |
|
|
|
04a4974ffb
|
Add '-n' / '--number' flags, and update help message for executable
|
2022-02-02 15:09:50 -08:00 |
|
|
|
359c166363
|
Add test file for previous commit
|
2022-02-02 14:53:10 -08:00 |
|
|
|
8892785aad
|
Add fetching of tombstoned users for APIv2
|
2022-02-02 14:49:46 -08:00 |
|
|
|
1e1e97b5ca
|
Add TweetTrove#FillMissingUserIDs helper method
|
2022-02-02 14:43:17 -08:00 |
|
|
|
3ca67418e0
|
Add test file for previous commit
|
2022-02-02 12:26:02 -08:00 |
|
|
|
df1a7d2388
|
Add recognizing bottom of feed
|
2022-02-02 12:10:24 -08:00 |
|
|
|
c00ff06b3f
|
URLs need to have a TweetID lol
|
2022-02-01 18:21:48 -08:00 |
|
|
|
32e1558800
|
Fix link parsing for retweets
|
2022-02-01 17:36:23 -08:00 |
|
|
|
9eb3e42539
|
Add link parsing for APIv2
|
2022-02-01 16:56:37 -08:00 |
|
|
|
1bc6aec3b5
|
Incorporate the new parsing structure into the actual program
|
2022-02-01 16:04:52 -08:00 |
|
|
|
b2199e9b59
|
Add Url#ShortText field
|
2022-02-01 15:48:43 -08:00 |
|
|
|
069ab83fba
|
Refactor scraper tests
- use Stretchr assert package for assertions
- use "dot imports" to remove "scraper.XYZ" from everything
|
2022-01-31 19:14:14 -08:00 |
|
|
|
babbdecf6c
|
Fix linting error
|
2022-01-30 18:03:09 -08:00 |
|
|
|
12be70f541
|
Add test files
|
2022-01-30 17:58:03 -08:00 |
|
|
|
c085a579d9
|
Add TombstoneUsers to TweetTrove
|
2022-01-30 17:55:18 -08:00 |
|
|
|
4708ffc3c9
|
Intermediate results for refactoring :V
|
2022-01-30 17:48:03 -08:00 |
|
|
|
f0b1acd595
|
Fix an error
|
2022-01-30 15:44:26 -08:00 |
|
|
|
3046dd56f4
|
Add TweetTrove#MergeWith method
|
2022-01-30 15:31:06 -08:00 |
|
|
|
f264aff265
|
Update test data since the previous private-user unprivated
|
2022-01-30 15:16:04 -08:00 |
|
|
|
68a8549f34
|
Rename api V2 test responses directory
|
2022-01-30 15:06:07 -08:00 |
|
|
|
4ccd6795d5
|
Fix import error
|
2022-01-30 14:51:14 -08:00 |
|
|
|
7532c3ba81
|
Add testify dependency
|
2022-01-30 14:48:16 -08:00 |
|
|
|
8c79a39c2e
|
API V2: parse User result
|
2022-01-30 14:40:17 -08:00 |
|
|
|
b261f095ad
|
Change main application to use new API for user feeds
|
2022-01-24 20:19:08 -08:00 |
|
|
|
fb421215df
|
Add parsing of new GraphQL twitter api for user feeds
|
2022-01-24 20:13:17 -08:00 |
|
|
|
8250725d2c
|
Update CHANGELOG.txt for v0.0.5
|
2022-01-19 17:20:52 -08:00 |
|
|
|
56870173e9
|
Fix bug with users with 600x200 banner images
When downloading these users' content, they weren't getting saved afterward (to update 'is_content_downloaded').
|
2022-01-18 17:48:56 -08:00 |
|
