50 Commits

Author SHA1 Message Date
a061decd0f REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
- also restructure project to use a 'pkg' directory for reusable packages
2023-07-30 14:20:07 -03:00
ffaec2799d When POSTing a 'like' to the API, save it as a Like in the db as well 2023-06-26 14:59:41 -03:00
d06a42e2fc Add integration test for fetching Likes 2023-06-26 13:39:51 -03:00
cc632e0654 Add commands to like and unlike tweets 2023-06-25 22:18:00 -03:00
a44323c5de Switch over Tweet Detail fetching to use APIv2 2023-06-21 14:05:49 -03:00
af93f44ed2 Two bug fixes
- Search is now authenticated only
- `fetch_tweet` and `search` subcommands now respect the `-n [number]` flag
2023-06-03 07:38:17 -03:00
a724f32470 Allow specifying session files with .session extension at command line 2023-03-16 17:53:14 -03:00
c09b77f497 Add ability to use saved sessions 2023-02-17 13:07:12 -05:00
933ee9a7f9 Fix lint errors 2023-02-05 23:40:22 -05:00
Jaeger Aquila
28ca0ac4eb added cmdline login functionality 2023-02-05 20:29:57 -05:00
94b8b551f8 Update CHANGELOG.txt for v0.1.6 2022-05-14 18:28:33 -07:00
5d54a46aaf Move cmd help message to a plain text file and embed it using go:embed 2022-05-14 18:18:05 -07:00
8261087103 REFACTOR: make helper function use the scraper tweet-url parsing method 2022-03-13 14:50:08 -07:00
f41d072573 Improve error handling some more 2022-03-06 20:31:04 -08:00
7edc8ad5d3 Some whitespace changes :V 2022-03-06 17:07:05 -08:00
18c9f79429 REFACTOR: LINT: add .golangci.yaml lint config file
- Add linting for line lengths
- Fix some linting errors
2022-03-06 15:06:06 -08:00
508670248e Add list_followed subcommand 2022-02-28 16:06:58 -08:00
728aaf251f Fix linting error 2022-02-26 22:18:41 -08:00
41586bf0f8 Add follow and unfollow sub-commands 2022-02-26 16:22:00 -08:00
9cd7f4171a Add proper logging module, set logging level to 'info' by default (hide very verbose debug results) 2022-02-14 14:31:26 -08:00
f9a8841c07 REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go 2022-02-14 13:39:59 -08:00
3d489a8e95 REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions 2022-02-14 13:10:12 -08:00
f1a33bab48 Fix cmd help output when entering an invalid command-line flag 2022-02-14 13:00:32 -08:00
e0f05cbeea Refactor all scraper areas to use TweetTroves where applicable 2022-02-12 20:39:30 -08:00
13170c84b2 Add '-h, --help' flag to print help message then exit 2022-02-12 15:41:03 -08:00
04a4974ffb Add '-n' / '--number' flags, and update help message for executable 2022-02-02 15:09:50 -08:00
b261f095ad Change main application to use new API for user feeds 2022-01-24 20:19:08 -08:00
e06b0bff30 Add --version flag to the executable 2022-01-04 12:57:43 -05:00
692d3de564 Don't double-download tweet contents 2021-12-21 21:57:00 -05:00
469d846db4 Add another section of avoiding double-downloading user content 2021-12-21 21:37:04 -05:00
5a4da58572 Add conditional downloading for user content 2021-12-21 21:29:27 -05:00
28e44897b5 Add poll updating 2021-12-12 18:42:27 -08:00
6d7d940df4 Add search 2021-11-06 14:50:39 -07:00
c219652dcc Make fetching very aggressive by default 2021-10-10 15:13:32 -07:00
f278010201 Fix linting error 2021-09-27 13:52:51 -07:00
b17e0821bb Make command line accept either URL or just ID to find a tweet 2021-09-27 13:49:17 -07:00
1dd02ff390 Fetching a user now downloads its content automatically 2021-09-27 12:54:18 -07:00
06831dfb52 Update help message 2021-08-22 18:43:33 -07:00
1f5ebf9f8d Enable fetching tweets to the limit of scrollback 2021-08-22 18:22:06 -07:00
9c944cdc5e Remove useless transaction block 2021-08-22 18:20:42 -07:00
a2554e9293 Enable 'fetch_tweet' full scrape 2021-08-22 17:55:21 -07:00
9eee64cca1 Catch random API 403 errors 2021-08-22 16:41:59 -07:00
08d703a26f Add command to get a user feed 2021-08-19 12:54:08 -07:00
2b23fcbc53 twitter command now uses current directory as the profile dir by default 2021-08-11 06:56:42 -07:00
917c3fc7a7 Add integration test for downloading user contents 2021-08-10 22:06:03 -07:00
0a1fa92cdd Add to database: LocalPath version of BannerImage and ProfileImage on Users 2021-08-10 20:51:42 -07:00
3de47f6bde Add twitter command download_tweet_content 2021-08-07 17:06:39 -07:00
c803794a0f Change TweetID to be an int64 instead of a string 2021-08-04 14:49:20 -07:00
c4c2ef8979 Fix a test 2021-08-02 14:55:59 -07:00
18a63cd2eb Create twitter main package 2021-08-02 14:47:32 -07:00