me/offline-twitter
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
offline-twitter/pkg/scraper
History
Alessio 24129c4852 REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper 
- ensure all scraper functions have a `api.XYZ` version and a package-level convenience function
	- isolate `the_api` to top-level convenience functions, in preparation for removal
- move a bunch of scraper functions around to be nearby their related functions
- new ErrLoginRequired
- remove obsolete APIv1 stuff (Feed, TweetDetail)
- rename scraper function GetUserFeedGraphqlFor => GetUserFeed
- fix go.mod Go version incorrectly claiming it's compatible with Go 1.16 (should be Go 1.17)
2024-08-09 19:48:50 -07:00
..
test_responses
Add test files for previous commit
2024-03-08 17:30:27 -08:00
api_errors.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_graphql_utils.go
Add scraping and saving of bookmarks
2024-05-28 21:55:42 -07:00
api_login.go
Fix lint error
2024-03-02 15:45:17 -08:00
api_obsolete_requests.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_request_utils.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types_dms_test.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types_dms.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types_lists_test.go
Add scraper funcs for previous commit
2023-12-26 19:54:08 -06:00
api_types_lists.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types_notifications.go
Adds shell for DMs, reactions, and conversation
2023-11-07 15:04:47 -04:00
api_types_posting.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types_spaces_test.go
Fix spaces timestamps to remove the factor of 1000x
2023-08-19 22:36:50 -03:00
api_types_spaces.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types_test.go
Fix fetching users and search
2023-08-22 20:07:32 -03:00
api_types_v2_test.go
Save tweets with unknown user as <UNKNOWN USER> instead of UserID 0, which causes foreign key errors
2024-06-10 15:47:13 -07:00
api_types_v2.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
api_types.go
Improve closing message when a scrape ends due to rate-limiting
2024-06-11 12:32:58 -07:00
authentication_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
bookmark.go
Add scraping and saving of bookmarks
2024-05-28 21:55:42 -07:00
constants.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
conversation.go
Adds shell for DMs, reactions, and conversation
2023-11-07 15:04:47 -04:00
dm_chat_room.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
dm_message.go
Fix parsing of other media items in DMs as 'urls'
2024-03-09 15:11:33 -08:00
dm_trove.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
guest_token_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
guest_token.go
Handle guest token / session initialization when not connected to internet
2024-07-14 13:20:44 -07:00
image_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
image.go
Add parsing of DM images, videos and URLs
2024-03-08 17:22:52 -08:00
like.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
link_expander_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
link_expander.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
list.go
Fix previous commit
2024-02-25 17:02:39 -08:00
poll_test.go
Add helper functions for rendering polls
2023-08-18 14:52:54 -03:00
poll.go
Add helper functions for rendering polls
2023-08-18 14:52:54 -03:00
retweet_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
retweet.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
space_test.go
Fix spaces timestamps to remove the factor of 1000x
2023-08-19 22:36:50 -03:00
space.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
timestamp_type.go
Change all timestamps to use milliseconds instead of seconds
2024-01-07 15:15:43 -06:00
tweet_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
tweet_trove_test.go
REFACTOR: Rename go module to 'gitlab.com/offline-twitter/twitter_offline_engine' in accordance with 'go get' conventions
2023-07-30 14:20:07 -03:00
tweet_trove.go
REFACTOR: remove DMTrove type, merge it into TweetTrove
2024-07-28 08:01:58 -07:00
tweet.go
REFACTOR: reduce technical debt, particularly that caused by singleton pattern in pkg/scraper
2024-08-09 19:48:50 -07:00
url_test.go
Update URL parser to handle 'x.com' links
2023-10-09 19:40:34 -07:00
url.go
Handle media download 404s gracefully
2024-07-28 12:50:00 -07:00
user_test.go
Fix fetching users and search
2023-08-22 20:07:32 -03:00
user.go
Handle guest token / session initialization when not connected to internet
2024-07-14 13:20:44 -07:00
video_test.go
Add parsing of DM images, videos and URLs
2024-03-08 17:22:52 -08:00
video.go
Add parsing of DM images, videos and URLs
2024-03-08 17:22:52 -08:00