123 Commits

Author SHA1 Message Date
476f00856c Add indexes for in_reply_to_id, and fetching urls/polls/images/videos by tweet_id 2022-12-24 13:47:43 -05:00
dac10fa13c Tighten up no-worsening of spaces, add saving ShortUrl when scraping from feed 2022-12-23 00:00:46 -05:00
7bad18e9b1 Tidy up the formatting 2022-12-03 13:47:34 -05:00
James Raleigh
972fd50c5b Fixed tests for DMCAed videos and other fixes 2022-12-02 20:38:57 -05:00
James Raleigh
bacfd519cc fix for dmca video downloads 2022-11-27 18:10:25 -05:00
6830be3c87 Fix error where retweets were not parsing properly sometimes 2022-11-25 15:51:21 -05:00
37525e58c0 Fix title no-worsening for spaces 2022-11-25 13:32:22 -05:00
412574e46f Fix parsing of spaces in APIv2; improve no-worsening of Spaces 2022-11-25 13:22:20 -05:00
58c19df11a Add Space persistence queries for Space details 2022-11-24 19:08:00 -05:00
d54e77b169 Some housekeeping 2022-11-13 12:07:36 -05:00
4b5b098b9e Fix error in Curl function where parent directory already exists 2022-10-15 15:17:15 -04:00
069ddcd976 Put videos, images, and video-thumbnails into subdirectories 2022-10-15 15:06:06 -04:00
94b8b551f8 Update CHANGELOG.txt for v0.1.6 2022-05-14 18:28:33 -07:00
99ad0f4a2c Fix lint errors 2022-05-14 16:43:39 -07:00
cf7608eaa9 Save links to Spaces in a Tweet 2022-05-14 16:36:03 -07:00
3b6c970b74 Make Space test fixture semi-stable based on given ID 2022-05-14 16:31:53 -07:00
1b675e8200 Add db operations for Spaces 2022-05-14 16:04:09 -07:00
a39fab14b3 Fix another lint error 2022-05-07 19:02:02 -07:00
876f617876 Fix lint errors 2022-05-07 18:50:28 -07:00
3d289ed5f0 Profile images are now downloaded based on whether the local file path exists, not just what the DB says 2022-05-07 18:46:07 -07:00
8775f5337d Add test to ensure proper user images are being downloaded 2022-05-07 18:44:03 -07:00
3b4b3fceb9 Improve tombstone handling significantly
- Tombstone type can now be updated
- If a tombstoned tweet becomes available, now updates the text and removes the tombstone
- Non-stub tweets can now have tombstones attached to them without clobbering the tweet content
2022-05-07 16:50:07 -07:00
780577d724 Enable updating user handles 2022-05-07 15:23:37 -07:00
cb3fc469b2 Fix lint error 2022-05-07 14:38:21 -07:00
36e537b1cd Handle IsFollowing calls for users that aren't saved yet 2022-05-07 14:36:59 -07:00
6498a97816 Change IsFollowing method to use id field instead of handle 2022-05-07 14:21:59 -07:00
d1d80a91cd Add 'gofmt' linter 2022-03-13 17:13:40 -07:00
223734d001 Remove all references to deprecated 'ioutil' package 2022-03-13 16:33:17 -07:00
f08da27cc2 Enable 'wrapcheck' linter 2022-03-13 16:13:16 -07:00
f41d072573 Improve error handling some more 2022-03-06 20:31:04 -08:00
d77c55ec1c Fix lint errors 2022-03-06 19:29:48 -08:00
2f784c779c REFACTOR: Add sqlx dependency 2022-03-06 19:17:43 -08:00
78a5ffbf92 Fix another over-eager commit 2022-03-06 18:14:06 -08:00
26ab9ec937 Create new Timestamp helper type 2022-03-06 18:09:43 -08:00
7edc8ad5d3 Some whitespace changes :V 2022-03-06 17:07:05 -08:00
1d990e8a40 Remove users.yaml file 2022-03-06 16:11:45 -08:00
1582dfe44e Fix some lint problems 2022-03-06 15:36:07 -08:00
06167eef18 Fix over-enthusiastic commit 2022-03-06 15:26:27 -08:00
18c9f79429 REFACTOR: LINT: add .golangci.yaml lint config file
- Add linting for line lengths
- Fix some linting errors
2022-03-06 15:06:06 -08:00
524060a79a Fix a manual git-editing typo 2022-03-06 13:45:24 -08:00
5fb6a4aa9a REFACTOR: update persistence tests to use assert and require 2022-03-06 13:30:17 -08:00
68d4062820 Add a data migration to remove URLs that just link to a quoted tweet 2022-03-02 16:09:41 -08:00
508670248e Add list_followed subcommand 2022-02-28 16:06:58 -08:00
5f3013a49b Update tweet UserIDs in a tweet trove with Unknown Users in it (i.e., deleted users(?)) 2022-02-27 23:14:30 -08:00
772fa247f7 Add creation of unknown users with known handles (i.e., deleted accounts) 2022-02-26 22:09:27 -08:00
857b9c5255 Fix linting error 2022-02-26 16:06:51 -08:00
373b9ce16e Add IsFollowed field on Users 2022-02-26 15:58:30 -08:00
8a70f55e1b Update some more stuff to match API changes
- set X-Twitter-Client-Language header to "en"
- Add a new tombstone type (age-restricted)
2022-02-14 17:18:23 -08:00
f9a8841c07 REFACTOR: create SaveTweetTrove convenience method to reduce code in main.go 2022-02-14 13:39:59 -08:00
3d489a8e95 REFACTOR: eliminate 'download-if-needed' functions, add the 'if-needed' check to the regular downloading functions 2022-02-14 13:10:12 -08:00