|
|
3ca67418e0
|
Add test file for previous commit
|
2022-02-02 12:26:02 -08:00 |
|
|
|
c00ff06b3f
|
URLs need to have a TweetID lol
|
2022-02-01 18:21:48 -08:00 |
|
|
|
9eb3e42539
|
Add link parsing for APIv2
|
2022-02-01 16:56:37 -08:00 |
|
|
|
1bc6aec3b5
|
Incorporate the new parsing structure into the actual program
|
2022-02-01 16:04:52 -08:00 |
|
|
|
12be70f541
|
Add test files
|
2022-01-30 17:58:03 -08:00 |
|
|
|
68a8549f34
|
Rename api V2 test responses directory
|
2022-01-30 15:06:07 -08:00 |
|
|
|
8c79a39c2e
|
API V2: parse User result
|
2022-01-30 14:40:17 -08:00 |
|
|
|
fb421215df
|
Add parsing of new GraphQL twitter api for user feeds
|
2022-01-24 20:13:17 -08:00 |
|
|
|
1a9ba75355
|
Add checking for banned users
|
2022-01-06 14:39:31 -05:00 |
|
|
|
bf2dbede94
|
Escape HTML entities in tweet text
|
2022-01-05 21:04:40 -05:00 |
|
|
|
c15ac9d751
|
Add persistence for polls
|
2021-12-12 16:42:32 -08:00 |
|
|
|
d0cb857acb
|
Fix embedded link parsing for youtube links with no thumbnails
|
2021-11-22 14:52:18 -08:00 |
|
|
|
658f3c338f
|
Add parsing of twitter polls
|
2021-11-07 21:10:24 -08:00 |
|
|
|
c0ae23b4fd
|
Add 'unavailable' tombstone category
|
2021-11-01 15:47:52 -07:00 |
|
|
|
b37bc4bc60
|
Add test data for tombstones
|
2021-11-01 14:13:22 -07:00 |
|
|
|
159084006d
|
Fix handling of reply-mentions and tweet text normalization
|
2021-09-27 18:12:28 -07:00 |
|
|
|
9ae6213025
|
Clean up the tests some more
|
2021-09-27 18:08:14 -07:00 |
|
|
|
89179f2447
|
Tidy up the scraper tests a bit
|
2021-09-27 15:30:05 -07:00 |
|
|
|
0bb9ff6c6b
|
Add handling for URL cards with no link preview thumbnail image
|
2021-09-17 20:50:28 -07:00 |
|
|
|
9d10fd5942
|
Fix scraper test file to be minified
|
2021-09-17 20:12:51 -07:00 |
|
|
|
497a62050b
|
Add test file for previous commit
|
2021-09-17 20:02:33 -07:00 |
|
|
|
690dd99b8f
|
Clean up the michael malice feed test file
|
2021-09-17 18:08:16 -07:00 |
|
|
|
05c3f2289b
|
Add persistence for new Url type
|
2021-09-17 18:04:57 -07:00 |
|
|
|
355ed7ccf5
|
Add test file for the previous commit
|
2021-09-17 17:36:35 -07:00 |
|
|
|
3f9c807efa
|
Add Url type
|
2021-09-17 13:41:43 -07:00 |
|
|
|
5a0b8b5e36
|
Check for end-of-feed
|
2021-08-22 15:01:46 -07:00 |
|
|
|
8462365d70
|
Add tests for API video parsing
|
2021-08-04 23:49:45 -07:00 |
|
|
|
c803794a0f
|
Change TweetID to be an int64 instead of a string
|
2021-08-04 14:49:20 -07:00 |
|
|
|
494ca25dc4
|
Change method of scraping images
- break `Filename` field on Image into `RemoteURL` and `LocalFilename`
- new parsing function for an APIMedia item
|
2021-08-03 17:34:44 -07:00 |
|
|
|
647dd8aa6b
|
Add scraping of videos from tweets
|
2021-07-25 14:51:17 -07:00 |
|
|
|
6c111ab976
|
BUGFIX: fix incorrect text normalization on tweet with multiple images
|
2021-07-23 19:14:16 -07:00 |
|
|
|
f28d600024
|
Add user feed test data file
|
2021-06-16 13:15:53 -07:00 |
|
|
|
5b7d3dcdc4
|
Add Retweet type
|
2021-06-14 12:14:51 -07:00 |
|
|
|
73510288af
|
Add test file for user profile
|
2021-06-13 12:48:14 -07:00 |
|
|
|
0738f77b55
|
Add helper methods to API types to help pre-process them
|
2021-05-23 20:58:31 -04:00 |
|
|
|
2c8fe25e78
|
Add tweet parsing
|
2021-05-22 18:20:18 -04:00 |
|
