21 Commits

Author SHA1 Message Date
159084006d Fix handling of reply-mentions and tweet text normalization 2021-09-27 18:12:28 -07:00
9ae6213025 Clean up the tests some more 2021-09-27 18:08:14 -07:00
89179f2447 Tidy up the scraper tests a bit 2021-09-27 15:30:05 -07:00
0bb9ff6c6b Add handling for URL cards with no link preview thumbnail image 2021-09-17 20:50:28 -07:00
9d10fd5942 Fix scraper test file to be minified 2021-09-17 20:12:51 -07:00
497a62050b Add test file for previous commit 2021-09-17 20:02:33 -07:00
690dd99b8f Clean up the michael malice feed test file 2021-09-17 18:08:16 -07:00
05c3f2289b Add persistence for new Url type 2021-09-17 18:04:57 -07:00
355ed7ccf5 Add test file for the previous commit 2021-09-17 17:36:35 -07:00
3f9c807efa Add Url type 2021-09-17 13:41:43 -07:00
5a0b8b5e36 Check for end-of-feed 2021-08-22 15:01:46 -07:00
8462365d70 Add tests for API video parsing 2021-08-04 23:49:45 -07:00
c803794a0f Change TweetID to be an int64 instead of a string 2021-08-04 14:49:20 -07:00
494ca25dc4 Change method of scraping images
- break `Filename` field on Image into `RemoteURL` and `LocalFilename`
- new parsing function for an APIMedia item
2021-08-03 17:34:44 -07:00
647dd8aa6b Add scraping of videos from tweets 2021-07-25 14:51:17 -07:00
6c111ab976 BUGFIX: fix incorrect text normalization on tweet with multiple images 2021-07-23 19:14:16 -07:00
f28d600024 Add user feed test data file 2021-06-16 13:15:53 -07:00
5b7d3dcdc4 Add Retweet type 2021-06-14 12:14:51 -07:00
73510288af Add test file for user profile 2021-06-13 12:48:14 -07:00
0738f77b55 Add helper methods to API types to help pre-process them 2021-05-23 20:58:31 -04:00
2c8fe25e78 Add tweet parsing 2021-05-22 18:20:18 -04:00