242 Commits

Author SHA1 Message Date
13299233c0 Add 'suspended' tombstone text; add 'violated twitter rules' and 'account no longer exists' tombstone types 2021-12-21 16:05:51 -05:00
d91e76f664 Remove print statements 2021-12-20 18:17:39 -05:00
8e13e30ac5 Scraping now updates last_scraped_at and sets is_conversation_scraped 2021-12-20 15:27:59 -05:00
c1bcd54a11 Add Tweet#last_scraped_at and Tweet#is_conversation_scraped fields 2021-12-20 14:07:20 -05:00
c95ed6c918 Fix directory error in version bump test task 2021-12-12 20:17:05 -08:00
1e9f60db25 Fix permission error with version bump test task in CI build 2021-12-12 20:10:38 -08:00
81a361d87e Add color to version upgrading messages 2021-12-12 20:10:08 -08:00
713c91ee61 Screen for being on a release branch before doing the version bump test in CI build 2021-12-12 19:43:35 -08:00
9357974a29 Make preparations for first upgrade release
- Create `CHANGELOG.txt` file
- Bump ENGINE_DATABASE_VERSION
- Add an upgrade-testing step to the CI build
2021-12-12 19:38:28 -08:00
28e44897b5 Add poll updating 2021-12-12 18:42:27 -08:00
c15ac9d751 Add persistence for polls 2021-12-12 16:42:32 -08:00
ab89d53cc6 Add Poll#LastUpdatedAt processing 2021-12-12 16:39:01 -08:00
ddb16c9e64 Remove integration test for tombstones because the guy un-privated for some reason 2021-12-12 16:14:11 -08:00
2475f3d3e9 Fix build file for non-release branches 2021-12-12 15:16:01 -08:00
0f4c501779 Merge two dpkg tasks into one 2021-11-29 15:43:41 -08:00
b167742f24 Add known hosts for the apt server 2021-11-29 15:38:27 -08:00
30c8553470 Fix the version checking 2021-11-29 15:31:10 -08:00
abbc525df9 Create first release attempt 2021-11-29 15:23:16 -08:00
ce6851a198 Fix errors in build file 2021-11-29 14:32:49 -08:00
dad63a0ad4 Test commit for new branch 2021-11-29 14:18:20 -08:00
7f02d6acec Fix linting error 2021-11-22 17:03:57 -08:00
5f97014bdc Add database versioning 2021-11-22 16:55:27 -08:00
0de9b25dfe Change 'in_reply_to' and 'quoted_tweet' ID fields to say '_id' (hungarian notation) 2021-11-22 14:56:57 -08:00
d0cb857acb Fix embedded link parsing for youtube links with no thumbnails 2021-11-22 14:52:18 -08:00
658f3c338f Add parsing of twitter polls 2021-11-07 21:10:24 -08:00
4793cf8a4d Change users text file into a yaml file 2021-11-07 12:37:21 -08:00
681cd59e64 Add the actual search file 2021-11-06 14:55:15 -07:00
6d7d940df4 Add search 2021-11-06 14:50:39 -07:00
470dce1d27 Persist tombstone data 2021-11-06 13:37:46 -07:00
e5b4b43358 Temporarily remove integration tests user who got banned ('suspended' handling doesn't work yet) 2021-11-01 16:04:53 -07:00
c0ae23b4fd Add 'unavailable' tombstone category 2021-11-01 15:47:52 -07:00
b37bc4bc60 Add test data for tombstones 2021-11-01 14:13:22 -07:00
bb2ae81dfa Fix the previous commit by actually adding the relevant code 2021-11-01 14:10:20 -07:00
e8a9c10c89 Add parsing of tombstones from api 2021-11-01 14:06:15 -07:00
4fa30e246d Add dimension info to media content 2021-10-10 16:06:47 -07:00
dd22b25831 Fix lint error 2021-10-10 15:28:49 -07:00
3b56973355 Remove reply-mentions for threads 2021-10-10 15:22:48 -07:00
c219652dcc Make fetching very aggressive by default 2021-10-10 15:13:32 -07:00
66daacec34 Fix the constantly-breaking thumbnail url test 2021-10-10 15:06:39 -07:00
1c2f356ee9 Fix re-downloading making users get marked as content-not-downloaded 2021-10-09 18:58:52 -07:00
b117cbec7b Update some of the integration tests 2021-10-07 14:58:59 -07:00
100fe6c718 Fix gifs 2021-10-04 21:06:53 -07:00
18722a6b1b Refactor tweet_test: make a tweet loader helper function 2021-09-27 18:43:24 -07:00
6aa14c32e2 Add persistence for reply-mentions 2021-09-27 18:29:55 -07:00
159084006d Fix handling of reply-mentions and tweet text normalization 2021-09-27 18:12:28 -07:00
9ae6213025 Clean up the tests some more 2021-09-27 18:08:14 -07:00
89179f2447 Tidy up the scraper tests a bit 2021-09-27 15:30:05 -07:00
f278010201 Fix linting error 2021-09-27 13:52:51 -07:00
b17e0821bb Make command line accept either URL or just ID to find a tweet 2021-09-27 13:49:17 -07:00
1dd02ff390 Fetching a user now downloads its content automatically 2021-09-27 12:54:18 -07:00