|
|
9cd7f4171a
|
Add proper logging module, set logging level to 'info' by default (hide very verbose debug results)
|
2022-02-14 14:31:26 -08:00 |
|
|
|
f9a8841c07
|
REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go
|
2022-02-14 13:39:59 -08:00 |
|
|
|
3d489a8e95
|
REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions
|
2022-02-14 13:10:12 -08:00 |
|
|
|
f1a33bab48
|
Fix cmd help output when entering an invalid command-line flag
|
2022-02-14 13:00:32 -08:00 |
|
|
|
e0f05cbeea
|
Refactor all scraper areas to use TweetTroves where applicable
|
2022-02-12 20:39:30 -08:00 |
|
|
|
13170c84b2
|
Add '-h, --help' flag to print help message then exit
|
2022-02-12 15:41:03 -08:00 |
|
|
|
04a4974ffb
|
Add '-n' / '--number' flags, and update help message for executable
|
2022-02-02 15:09:50 -08:00 |
|
|
|
b261f095ad
|
Change main application to use new API for user feeds
|
2022-01-24 20:19:08 -08:00 |
|
|
|
e06b0bff30
|
Add --version flag to the executable
|
2022-01-04 12:57:43 -05:00 |
|
|
|
692d3de564
|
Don't double-download tweet contents
|
2021-12-21 21:57:00 -05:00 |
|
|
|
469d846db4
|
Add another section of avoiding double-downloading user content
|
2021-12-21 21:37:04 -05:00 |
|
|
|
5a4da58572
|
Add conditional downloading for user content
|
2021-12-21 21:29:27 -05:00 |
|
|
|
28e44897b5
|
Add poll updating
|
2021-12-12 18:42:27 -08:00 |
|
|
|
6d7d940df4
|
Add search
|
2021-11-06 14:50:39 -07:00 |
|
|
|
c219652dcc
|
Make fetching very aggressive by default
|
2021-10-10 15:13:32 -07:00 |
|
|
|
f278010201
|
Fix linting error
|
2021-09-27 13:52:51 -07:00 |
|
|
|
b17e0821bb
|
Make command line accept either URL or just ID to find a tweet
|
2021-09-27 13:49:17 -07:00 |
|
|
|
1dd02ff390
|
Fetching a user now downloads its content automatically
|
2021-09-27 12:54:18 -07:00 |
|
|
|
06831dfb52
|
Update help message
|
2021-08-22 18:43:33 -07:00 |
|
|
|
1f5ebf9f8d
|
Enable fetching tweets to the limit of scrollback
|
2021-08-22 18:22:06 -07:00 |
|
|
|
9c944cdc5e
|
Remove useless transaction block
|
2021-08-22 18:20:42 -07:00 |
|
|
|
a2554e9293
|
Enable 'fetch_tweet' full scrape
|
2021-08-22 17:55:21 -07:00 |
|
|
|
9eee64cca1
|
Catch random API 403 errors
|
2021-08-22 16:41:59 -07:00 |
|
|
|
08d703a26f
|
Add command to get a user feed
|
2021-08-19 12:54:08 -07:00 |
|
|
|
2b23fcbc53
|
twitter command now uses current directory as the profile dir by default
|
2021-08-11 06:56:42 -07:00 |
|
|
|
917c3fc7a7
|
Add integration test for downloading user contents
|
2021-08-10 22:06:03 -07:00 |
|
|
|
0a1fa92cdd
|
Add to database: LocalPath version of BannerImage and ProfileImage on Users
|
2021-08-10 20:51:42 -07:00 |
|
|
|
3de47f6bde
|
Add twitter command download_tweet_content
|
2021-08-07 17:06:39 -07:00 |
|
|
|
c803794a0f
|
Change TweetID to be an int64 instead of a string
|
2021-08-04 14:49:20 -07:00 |
|
|
|
c4c2ef8979
|
Fix a test
|
2021-08-02 14:55:59 -07:00 |
|
|
|
18a63cd2eb
|
Create twitter main package
|
2021-08-02 14:47:32 -07:00 |
|
