326 Commits

Author SHA1 Message Date
Jaeger Aquila
2cf64db93e some refactoring and tests 2022-12-30 21:23:45 -05:00
Jaeger Aquila
140024e903 initial login code 2022-12-30 21:23:45 -05:00
58f4026e88 Rename login script 2022-12-30 21:23:45 -05:00
62c499e95c Tidy up login script, add request to fetch 'likes' (auth-guarded endpoint) 2022-12-30 21:23:45 -05:00
James Raleigh
55b25f4fbf initial login test script in py 2022-12-30 21:23:45 -05:00
1558c321b6 Add index on tweets user_id column to accelerate building user feed 2022-12-26 13:08:25 -05:00
83a6edb257 Fix migrations to not have nulls 2022-12-26 12:56:05 -05:00
1570075443 Add new spaces columns to the migrations 2022-12-25 13:08:46 -05:00
7f9cc62667 Update CHANGELOG.txt for v0.1.8 2022-12-24 14:39:04 -05:00
476f00856c Add indexes for in_reply_to_id, and fetching urls/polls/images/videos by tweet_id 2022-12-24 13:47:43 -05:00
dac10fa13c Tighten up no-worsening of spaces, add saving ShortUrl when scraping from feed 2022-12-23 00:00:46 -05:00
1a9a2cb745 Fix Spaces created-by-id not being scraped 2022-12-22 23:29:11 -05:00
Jaeger Aquila
ce11a70bf9 Finished refactoring 2022-12-10 13:30:16 -05:00
ec6ecb39cb Remove UpdateQueryCursor helper function as it was inlined 2022-12-10 12:18:52 -05:00
fe57763568 Change entrypoint functions to use NewGuestSession constructor for API 2022-12-10 10:58:32 -05:00
3c9ed97c64 Fix lint error 2022-12-10 10:55:55 -05:00
6c5f8b8356 Update API call functions to use do_http
- move query-string modifications to individual API call functions:
"referrer=tweet", tweet "include_XYZ" params
- tidy up implementation of retries in `API.GetUser`
- fix out-param of `do_http` being a pointer to an interface when it should just be an interface
2022-12-10 10:49:25 -05:00
Jaeger Aquila
e44a83edae fixed trailing whitespace 2022-12-09 23:03:22 -05:00
Jaeger Aquila
6816dcbe2f generic http implem and fixing package errors 2022-12-09 23:03:22 -05:00
77e338b4f7 Add skeleton for API refactoring 2022-12-09 23:03:22 -05:00
f2af4b2403 Fix search 2022-12-09 23:02:12 -05:00
7bad18e9b1 Tidy up the formatting 2022-12-03 13:47:34 -05:00
James Raleigh
972fd50c5b Fixed tests for DMCAed videos and other fixes 2022-12-02 20:38:57 -05:00
Jaeger Aquila
a05d97dd71 Updated todo text 2022-11-27 23:20:25 +00:00
James Raleigh
bacfd519cc fix for dmca video downloads 2022-11-27 18:10:25 -05:00
6830be3c87 Fix error where retweets were not parsing properly sometimes 2022-11-25 15:51:21 -05:00
37525e58c0 Fix title no-worsening for spaces 2022-11-25 13:32:22 -05:00
412574e46f Fix parsing of spaces in APIv2; improve no-worsening of Spaces 2022-11-25 13:22:20 -05:00
433dd5e0bb Enable fetching of Space details 2022-11-24 19:15:21 -05:00
58c19df11a Add Space persistence queries for Space details 2022-11-24 19:08:00 -05:00
a81d0e80fe Add test file 2022-11-24 19:02:50 -05:00
55c4db32de Fix lint 2022-11-24 19:01:30 -05:00
0293f11b9b Fix parsing of empty Space responses 2022-11-24 18:57:42 -05:00
05cacb1490 Add blank line 2022-11-13 13:47:56 -05:00
2a45818468 Add parsing of Space object 2022-11-13 13:40:58 -05:00
d54e77b169 Some housekeeping 2022-11-13 12:07:36 -05:00
b78cef34ce Update tests to change account that got banned 2022-11-13 11:29:47 -05:00
877cdd316b Skip building the binary an extra time when building the dpkg 2022-10-15 16:57:18 -04:00
0bf73d4bc5 Update CHANGELOG.txt for version 0.1.7 2022-10-15 16:52:45 -04:00
fe305ec2ab Fix typo 2022-10-15 16:38:07 -04:00
8ccb55ef79 Add version bump test to woodpecker build 2022-10-15 16:35:14 -04:00
5877063748 Add some tests for multiple videos / videos+images 2022-10-15 15:50:25 -04:00
4b5b098b9e Fix error in Curl function where parent directory already exists 2022-10-15 15:17:15 -04:00
069ddcd976 Put videos, images, and video-thumbnails into subdirectories 2022-10-15 15:06:06 -04:00
6de2d670e8 Fix lint error 2022-10-15 12:47:41 -04:00
d647307097 Support multiple videos / videos+images 2022-10-15 12:40:40 -04:00
b8b3b56c8e Add woodpecker config, update tests due to an account getting banned 2022-10-14 23:32:14 -04:00
94b8b551f8 Update CHANGELOG.txt for v0.1.6 2022-05-14 18:28:33 -07:00
5d54a46aaf Move cmd help message to a plain text file and embed it using go:embed 2022-05-14 18:18:05 -07:00
e932dd33d5 Add parsing Spaces for API v2 2022-05-14 17:36:47 -07:00