dea37c7556
Fix cursor bug in authenticated sessions
2023-06-03 07:51:39 -03:00
1384aa73e9
BUGFIX: fix CSRF tokens getting out of sync on requests that load multiple pages of results
2023-03-09 22:49:55 -05:00
c09b77f497
Add ability to use saved sessions
2023-02-17 13:07:12 -05:00
390c831541
Add marshaling and unmarshaling of API objects so state can be persisted between runs
2023-01-01 21:57:08 -05:00
c3494cfe19
Add handle of the logged-in user to API
2023-01-01 21:45:58 -05:00
00a73836f5
Fix some lint errors
2023-01-01 20:14:26 -05:00
8a1b2fc801
Fix lint error
2022-12-30 21:23:45 -05:00
04842f8c72
REFACTOR: make login flow less verbose
2022-12-30 21:23:45 -05:00
c0366a0978
Add cookies and CSRF to authentication flow
2022-12-30 21:23:45 -05:00
Jaeger Aquila
2cf64db93e
some refactoring and tests
2022-12-30 21:23:45 -05:00
Jaeger Aquila
140024e903
initial login code
2022-12-30 21:23:45 -05:00
Jaeger Aquila
ce11a70bf9
Finished refactoring
2022-12-10 13:30:16 -05:00
ec6ecb39cb
Remove UpdateQueryCursor helper function as it was inlined
2022-12-10 12:18:52 -05:00
3c9ed97c64
Fix lint error
2022-12-10 10:55:55 -05:00
6c5f8b8356
Update API call functions to use do_http
...
- move query-string modifications to individual API call functions:
"referrer=tweet", tweet "include_XYZ" params
- tidy up implementation of retries in `API.GetUser`
- fix out-param of `do_http` being a pointer to an interface when it should just be an interface
2022-12-10 10:49:25 -05:00
Jaeger Aquila
e44a83edae
fixed trailing whitespace
2022-12-09 23:03:22 -05:00
Jaeger Aquila
6816dcbe2f
generic http implem and fixing package errors
2022-12-09 23:03:22 -05:00
77e338b4f7
Add skeleton for API refactoring
2022-12-09 23:03:22 -05:00
f2af4b2403
Fix search
2022-12-09 23:02:12 -05:00
433dd5e0bb
Enable fetching of Space details
2022-11-24 19:15:21 -05:00
d54e77b169
Some housekeeping
2022-11-13 12:07:36 -05:00
223734d001
Remove all references to deprecated 'ioutil' package
2022-03-13 16:33:17 -07:00
f08da27cc2
Enable 'wrapcheck' linter
2022-03-13 16:13:16 -07:00
15d7cd77a1
Do slightly more proper error handling
2022-03-06 19:27:30 -08:00
1582dfe44e
Fix some lint problems
2022-03-06 15:36:07 -08:00
18c9f79429
REFACTOR: LINT: add .golangci.yaml lint config file
...
- Add linting for line lengths
- Fix some linting errors
2022-03-06 15:06:06 -08:00
508670248e
Add list_followed subcommand
2022-02-28 16:06:58 -08:00
648098352b
Fix scraper treating NotFoundError as a bug requiring retries
2022-02-27 23:35:44 -08:00
8a70f55e1b
Update some more stuff to match API changes
...
- set X-Twitter-Client-Language header to "en"
- Add a new tombstone type (age-restricted)
2022-02-14 17:18:23 -08:00
9cd7f4171a
Add proper logging module, set logging level to 'info' by default (hide very verbose debug results)
2022-02-14 14:31:26 -08:00
6eac56183d
Allow fetching of banned users
2022-01-07 13:40:22 -05:00
6d7d940df4
Add search
2021-11-06 14:50:39 -07:00
1f5ebf9f8d
Enable fetching tweets to the limit of scrollback
2021-08-22 18:22:06 -07:00
9eee64cca1
Catch random API 403 errors
2021-08-22 16:41:59 -07:00
4a3c12b04a
Update some docstrings, rename a few methods
2021-08-16 20:35:15 -07:00
c803794a0f
Change TweetID to be an int64 instead of a string
2021-08-04 14:49:20 -07:00
529c181397
Fix build errors
2021-08-04 02:14:06 -07:00
d81fae0013
Make UserID an alias for int64 rather than string
2021-08-04 02:00:58 -07:00
b5c33c2ad0
Fix some types to be more clear
2021-07-22 14:16:40 -07:00
28b11548bf
Add actual scraping
2021-06-16 19:34:06 -07:00
