|
|
b36e7410c5
|
FIXUP: forgot this in the previous commit
|
2023-06-08 13:10:15 -03:00 |
|
|
|
a464aa8a98
|
REFACTOR: rename 'ParseTweetResponse' to 'ToTweetTrove' and put it in the api_types file
|
2023-06-08 13:08:46 -03:00 |
|
|
|
815a8180da
|
BUGFIX: don't clobber num_likes, num_retweets etc. if tweet is a stub
- Convert Tweet queries to sqlx, including new CommaSeparatedList type to convert Hashtags, Mentions and ReplyMentions
|
2023-06-03 08:30:49 -03:00 |
|
|
|
2a45818468
|
Add parsing of Space object
|
2022-11-13 13:40:58 -05:00 |
|
|
|
d54e77b169
|
Some housekeeping
|
2022-11-13 12:07:36 -05:00 |
|
|
|
5877063748
|
Add some tests for multiple videos / videos+images
|
2022-10-15 15:50:25 -04:00 |
|
|
|
d647307097
|
Support multiple videos / videos+images
|
2022-10-15 12:40:40 -04:00 |
|
|
|
54857f40cd
|
Add parsing of tweets with Space links in them
|
2022-05-14 15:02:58 -07:00 |
|
|
|
d1d80a91cd
|
Add 'gofmt' linter
|
2022-03-13 17:13:40 -07:00 |
|
|
|
223734d001
|
Remove all references to deprecated 'ioutil' package
|
2022-03-13 16:33:17 -07:00 |
|
|
|
18c9f79429
|
REFACTOR: LINT: add .golangci.yaml lint config file
- Add linting for line lengths
- Fix some linting errors
|
2022-03-06 15:06:06 -08:00 |
|
|
|
f22f15f3d9
|
Prevent quoted-tweet URLs from being added as URLs (they should just be quote-tweets)
|
2022-03-02 14:34:42 -08:00 |
|
|
|
e0f05cbeea
|
Refactor all scraper areas to use TweetTroves where applicable
|
2022-02-12 20:39:30 -08:00 |
|
|
|
b2199e9b59
|
Add Url#ShortText field
|
2022-02-01 15:48:43 -08:00 |
|
|
|
069ab83fba
|
Refactor scraper tests
- use Stretchr assert package for assertions
- use "dot imports" to remove "scraper.XYZ" from everything
|
2022-01-31 19:14:14 -08:00 |
|
|
|
c15ac9d751
|
Add persistence for polls
|
2021-12-12 16:42:32 -08:00 |
|
|
|
0de9b25dfe
|
Change 'in_reply_to' and 'quoted_tweet' ID fields to say '_id' (hungarian notation)
|
2021-11-22 14:56:57 -08:00 |
|
|
|
470dce1d27
|
Persist tombstone data
|
2021-11-06 13:37:46 -07:00 |
|
|
|
3b56973355
|
Remove reply-mentions for threads
|
2021-10-10 15:22:48 -07:00 |
|
|
|
100fe6c718
|
Fix gifs
|
2021-10-04 21:06:53 -07:00 |
|
|
|
18722a6b1b
|
Refactor tweet_test: make a tweet loader helper function
|
2021-09-27 18:43:24 -07:00 |
|
|
|
159084006d
|
Fix handling of reply-mentions and tweet text normalization
|
2021-09-27 18:12:28 -07:00 |
|
|
|
9ae6213025
|
Clean up the tests some more
|
2021-09-27 18:08:14 -07:00 |
|
|
|
89179f2447
|
Tidy up the scraper tests a bit
|
2021-09-27 15:30:05 -07:00 |
|
|
|
c865df8aca
|
Add support for tweets with multiple URLs
|
2021-09-17 19:45:31 -07:00 |
|
|
|
05c3f2289b
|
Add persistence for new Url type
|
2021-09-17 18:04:57 -07:00 |
|
|
|
9c9100d874
|
Add RemoteURL and LocalFilename fields to Video, remove Filename
|
2021-08-05 14:10:46 -07:00 |
|
|
|
c803794a0f
|
Change TweetID to be an int64 instead of a string
|
2021-08-04 14:49:20 -07:00 |
|
|
|
d81fae0013
|
Make UserID an alias for int64 rather than string
|
2021-08-04 02:00:58 -07:00 |
|
|
|
81392996bb
|
Add video and image types
- in addition to `Filename` (string), includes IsDownloaded (bool)
|
2021-07-26 17:26:39 -07:00 |
|
|
|
0c87428c44
|
Make videos their own table; store as a slice on Tweet rather than text field
|
2021-07-25 15:42:43 -07:00 |
|
|
|
647dd8aa6b
|
Add scraping of videos from tweets
|
2021-07-25 14:51:17 -07:00 |
|
|
|
90e5fdb8b1
|
Add parser for a TweetResponse
|
2021-06-15 15:18:09 -07:00 |
|
|
|
02a2a0be33
|
Add parsing for user API type
|
2021-06-13 14:34:20 -07:00 |
|
|
|
e5337ef0d0
|
Change mentions to track usernames rather than user ids
|
2021-05-24 13:17:08 -04:00 |
|
|
|
2c8fe25e78
|
Add tweet parsing
|
2021-05-22 18:20:18 -04:00 |
|
