26 Commits

Author SHA1 Message Date
7bad18e9b1 Tidy up the formatting 2022-12-03 13:47:34 -05:00
James Raleigh
972fd50c5b Fixed tests for DMCAed videos and other fixes 2022-12-02 20:38:57 -05:00
James Raleigh
bacfd519cc fix for dmca video downloads 2022-11-27 18:10:25 -05:00
4b5b098b9e Fix error in Curl function where parent directory already exists 2022-10-15 15:17:15 -04:00
069ddcd976 Put videos, images, and video-thumbnails into subdirectories 2022-10-15 15:06:06 -04:00
8775f5337d Add test to ensure proper user images are being downloaded 2022-05-07 18:44:03 -07:00
6498a97816 Change IsFollowing method to use id field instead of handle 2022-05-07 14:21:59 -07:00
223734d001 Remove all references to deprecated 'ioutil' package 2022-03-13 16:33:17 -07:00
f08da27cc2 Enable 'wrapcheck' linter 2022-03-13 16:13:16 -07:00
f41d072573 Improve error handling some more 2022-03-06 20:31:04 -08:00
7edc8ad5d3 Some whitespace changes :V 2022-03-06 17:07:05 -08:00
18c9f79429 REFACTOR: LINT: add .golangci.yaml lint config file
- Add linting for line lengths
- Fix some linting errors
2022-03-06 15:06:06 -08:00
772fa247f7 Add creation of unknown users with known handles (i.e., deleted accounts) 2022-02-26 22:09:27 -08:00
3d489a8e95 REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions 2022-02-14 13:10:12 -08:00
56870173e9 Fix bug with users with 600x200 banner images
When downloading these users' content, they weren't getting saved afterward (to update 'is_content_downloaded').
2022-01-18 17:48:56 -08:00
6eac56183d Allow fetching of banned users 2022-01-07 13:40:22 -05:00
f25f1ae024 Change profile image downloading to use tiny profile image if appropriate 2022-01-05 12:37:11 -05:00
2210b61b3c Create a 'Follow' type 2022-01-04 14:40:51 -05:00
fbbb6834de Add video thumbnails 2021-12-23 15:12:01 -05:00
692d3de564 Don't double-download tweet contents 2021-12-21 21:57:00 -05:00
5a4da58572 Add conditional downloading for user content 2021-12-21 21:29:27 -05:00
c219652dcc Make fetching very aggressive by default 2021-10-10 15:13:32 -07:00
0bb9ff6c6b Add handling for URL cards with no link preview thumbnail image 2021-09-17 20:50:28 -07:00
f9ddc0f102 Add downloading for link previews 2021-09-17 20:11:36 -07:00
294917124a Add downloading of User banner image and profile image 2021-08-10 21:35:27 -07:00
9734c09426 Add downloading for media in tweets 2021-08-07 16:51:38 -07:00