|
|
4ccd6795d5
|
Fix import error
|
2022-01-30 14:51:14 -08:00 |
|
|
|
8c79a39c2e
|
API V2: parse User result
|
2022-01-30 14:40:17 -08:00 |
|
|
|
b261f095ad
|
Change main application to use new API for user feeds
|
2022-01-24 20:19:08 -08:00 |
|
|
|
fb421215df
|
Add parsing of new GraphQL twitter api for user feeds
|
2022-01-24 20:13:17 -08:00 |
|
|
|
dc24ce5ad4
|
Fix tweet URL parsing for urls with the stupid '?s=20' etc
|
2022-01-10 11:41:03 -05:00 |
|
|
|
d9f9c9de83
|
Integrate url expander into Tweet URL parser
|
2022-01-08 18:36:23 -05:00 |
|
|
|
043a7fd66f
|
Add link expander
|
2022-01-08 18:25:26 -05:00 |
|
|
|
e71e32228c
|
Get rid of tiny default profile images (default image is small enough, doesn't need a tiny version)
|
2022-01-07 17:33:26 -05:00 |
|
|
|
12f1cc6728
|
Fix some problems associated with banned users
|
2022-01-07 16:23:02 -05:00 |
|
|
|
c253486580
|
Fix lint error
|
2022-01-07 13:52:33 -05:00 |
|
|
|
d95f183e45
|
Add parsing of tombstoned quoted-tweets
|
2022-01-07 13:42:00 -05:00 |
|
|
|
6eac56183d
|
Allow fetching of banned users
|
2022-01-07 13:40:22 -05:00 |
|
|
|
1ea97e669a
|
Update tiny profile image logic for users with no profile image (including banned users)
|
2022-01-06 15:21:27 -05:00 |
|
|
|
1a9ba75355
|
Add checking for banned users
|
2022-01-06 14:39:31 -05:00 |
|
|
|
b1c7db6540
|
Add helper method to parse tweet URLs
|
2022-01-06 13:43:22 -05:00 |
|
|
|
bf2dbede94
|
Escape HTML entities in tweet text
|
2022-01-05 21:04:40 -05:00 |
|
|
|
f25f1ae024
|
Change profile image downloading to use tiny profile image if appropriate
|
2022-01-05 12:37:11 -05:00 |
|
|
|
80f6787aa0
|
Add getter for User tiny-profile-image URL
|
2022-01-04 13:15:47 -05:00 |
|
|
|
a23d3b98e7
|
Remove unneeded 'reflect' import
|
2021-12-24 16:40:50 -05:00 |
|
|
|
28e139a3e4
|
Add video durations and view counts
|
2021-12-24 16:26:34 -05:00 |
|
|
|
fbbb6834de
|
Add video thumbnails
|
2021-12-23 15:12:01 -05:00 |
|
|
|
13299233c0
|
Add 'suspended' tombstone text; add 'violated twitter rules' and 'account no longer exists' tombstone types
|
2021-12-21 16:05:51 -05:00 |
|
|
|
d91e76f664
|
Remove print statements
|
2021-12-20 18:17:39 -05:00 |
|
|
|
8e13e30ac5
|
Scraping now updates last_scraped_at and sets is_conversation_scraped
|
2021-12-20 15:27:59 -05:00 |
|
|
|
c1bcd54a11
|
Add Tweet#last_scraped_at and Tweet#is_conversation_scraped fields
|
2021-12-20 14:07:20 -05:00 |
|
|
|
28e44897b5
|
Add poll updating
|
2021-12-12 18:42:27 -08:00 |
|
|
|
c15ac9d751
|
Add persistence for polls
|
2021-12-12 16:42:32 -08:00 |
|
|
|
ab89d53cc6
|
Add Poll#LastUpdatedAt processing
|
2021-12-12 16:39:01 -08:00 |
|
|
|
ddb16c9e64
|
Remove integration test for tombstones because the guy un-privated for some reason
|
2021-12-12 16:14:11 -08:00 |
|
|
|
0de9b25dfe
|
Change 'in_reply_to' and 'quoted_tweet' ID fields to say '_id' (hungarian notation)
|
2021-11-22 14:56:57 -08:00 |
|
|
|
d0cb857acb
|
Fix embedded link parsing for youtube links with no thumbnails
|
2021-11-22 14:52:18 -08:00 |
|
|
|
658f3c338f
|
Add parsing of twitter polls
|
2021-11-07 21:10:24 -08:00 |
|
|
|
681cd59e64
|
Add the actual search file
|
2021-11-06 14:55:15 -07:00 |
|
|
|
6d7d940df4
|
Add search
|
2021-11-06 14:50:39 -07:00 |
|
|
|
470dce1d27
|
Persist tombstone data
|
2021-11-06 13:37:46 -07:00 |
|
|
|
c0ae23b4fd
|
Add 'unavailable' tombstone category
|
2021-11-01 15:47:52 -07:00 |
|
|
|
b37bc4bc60
|
Add test data for tombstones
|
2021-11-01 14:13:22 -07:00 |
|
|
|
bb2ae81dfa
|
Fix the previous commit by actually adding the relevant code
|
2021-11-01 14:10:20 -07:00 |
|
|
|
e8a9c10c89
|
Add parsing of tombstones from api
|
2021-11-01 14:06:15 -07:00 |
|
|
|
4fa30e246d
|
Add dimension info to media content
|
2021-10-10 16:06:47 -07:00 |
|
|
|
dd22b25831
|
Fix lint error
|
2021-10-10 15:28:49 -07:00 |
|
|
|
3b56973355
|
Remove reply-mentions for threads
|
2021-10-10 15:22:48 -07:00 |
|
|
|
100fe6c718
|
Fix gifs
|
2021-10-04 21:06:53 -07:00 |
|
|
|
18722a6b1b
|
Refactor tweet_test: make a tweet loader helper function
|
2021-09-27 18:43:24 -07:00 |
|
|
|
159084006d
|
Fix handling of reply-mentions and tweet text normalization
|
2021-09-27 18:12:28 -07:00 |
|
|
|
9ae6213025
|
Clean up the tests some more
|
2021-09-27 18:08:14 -07:00 |
|
|
|
89179f2447
|
Tidy up the scraper tests a bit
|
2021-09-27 15:30:05 -07:00 |
|
|
|
0bb9ff6c6b
|
Add handling for URL cards with no link preview thumbnail image
|
2021-09-17 20:50:28 -07:00 |
|
|
|
9d10fd5942
|
Fix scraper test file to be minified
|
2021-09-17 20:12:51 -07:00 |
|
|
|
497a62050b
|
Add test file for previous commit
|
2021-09-17 20:02:33 -07:00 |
|
