|
|
294917124a
|
Add downloading of User banner image and profile image
|
2021-08-10 21:35:27 -07:00 |
|
|
|
0a1fa92cdd
|
Add to database: LocalPath version of BannerImage and ProfileImage on Users
|
2021-08-10 20:51:42 -07:00 |
|
|
|
655c968614
|
Add LocalPath fields for BannerImage and ProfileImage on a User
|
2021-08-10 19:51:56 -07:00 |
|
|
|
3de47f6bde
|
Add twitter command download_tweet_content
|
2021-08-07 17:06:39 -07:00 |
|
|
|
9734c09426
|
Add downloading for media in tweets
|
2021-08-07 16:51:38 -07:00 |
|
|
|
d1ba8b48f3
|
Add RemoteURL and LocalFilename to Images, remove Filename
|
2021-08-05 14:22:16 -07:00 |
|
|
|
9c9100d874
|
Add RemoteURL and LocalFilename fields to Video, remove Filename
|
2021-08-05 14:10:46 -07:00 |
|
|
|
8462365d70
|
Add tests for API video parsing
|
2021-08-04 23:49:45 -07:00 |
|
|
|
3aa03a3903
|
Make build work
|
2021-08-04 23:46:28 -07:00 |
|
|
|
58dc223f84
|
Use VideoID given by the Twitter API instead of a rowid
|
2021-08-04 23:41:58 -07:00 |
|
|
|
e06bb4dc9a
|
Remove unused fmt import
|
2021-08-04 21:54:40 -07:00 |
|
|
|
c803794a0f
|
Change TweetID to be an int64 instead of a string
|
2021-08-04 14:49:20 -07:00 |
|
|
|
529c181397
|
Fix build errors
|
2021-08-04 02:14:06 -07:00 |
|
|
|
d81fae0013
|
Make UserID an alias for int64 rather than string
|
2021-08-04 02:00:58 -07:00 |
|
|
|
5e32f0605d
|
Remove extra params temporarily (make build work)
|
2021-08-04 01:42:29 -07:00 |
|
|
|
5503743e35
|
Add Image id column to the database schema
|
2021-08-04 01:27:14 -07:00 |
|
|
|
7a81b71cd3
|
Use ImageID from the API rather than rowid
|
2021-08-04 01:23:55 -07:00 |
|
|
|
494ca25dc4
|
Change method of scraping images
- break `Filename` field on Image into `RemoteURL` and `LocalFilename`
- new parsing function for an APIMedia item
|
2021-08-03 17:34:44 -07:00 |
|
|
|
2663387f29
|
Add filename helper utils to video and image types
|
2021-08-03 15:38:19 -07:00 |
|
|
|
3893dda640
|
this should have been in previous commit
|
2021-08-02 17:18:28 -07:00 |
|
|
|
d8d04c5acc
|
Fix some more build errors
|
2021-08-02 17:08:43 -07:00 |
|
|
|
c4c2ef8979
|
Fix a test
|
2021-08-02 14:55:59 -07:00 |
|
|
|
18a63cd2eb
|
Create twitter main package
|
2021-08-02 14:47:32 -07:00 |
|
|
|
f4636a25be
|
Make build work
|
2021-08-01 15:58:06 -07:00 |
|
|
|
083f5f72e0
|
Add media queries
|
2021-08-01 15:52:04 -07:00 |
|
|
|
35cf1f1296
|
Create test fixtures (stable test objects)
|
2021-07-30 19:38:25 -07:00 |
|
|
|
7f286d0596
|
Make the build work
|
2021-07-28 16:02:25 -07:00 |
|
|
|
222e681836
|
Create DB queries for media attachments, refactor this out of the tweet query into separate functions
|
2021-07-28 15:56:47 -07:00 |
|
|
|
81392996bb
|
Add video and image types
- in addition to `Filename` (string), includes IsDownloaded (bool)
|
2021-07-26 17:26:39 -07:00 |
|
|
|
0c87428c44
|
Make videos their own table; store as a slice on Tweet rather than text field
|
2021-07-25 15:42:43 -07:00 |
|
|
|
647dd8aa6b
|
Add scraping of videos from tweets
|
2021-07-25 14:51:17 -07:00 |
|
|
|
15241f4f43
|
Add tweet queries
|
2021-07-25 14:37:32 -07:00 |
|
|
|
2086a5e983
|
FIXUP: rename Video field in Tweet
|
2021-07-24 21:52:39 -07:00 |
|
|
|
7db981398c
|
Create test utils file for fixtures and helper functions
|
2021-07-24 21:48:01 -07:00 |
|
|
|
bac66d767c
|
Add go dependencies (???)
|
2021-07-24 12:36:39 -07:00 |
|
|
|
5f003c48e9
|
Add custom Error type
|
2021-07-24 12:28:30 -07:00 |
|
|
|
11e3a74b22
|
Add User queries
|
2021-07-24 12:24:57 -07:00 |
|
|
|
d386ba2cb4
|
Make String() methods more useful for terminal output
|
2021-07-24 10:55:44 -07:00 |
|
|
|
6568259d63
|
Fix some other IDs that I missed
|
2021-07-24 10:29:35 -07:00 |
|
|
|
0221cbe865
|
Fix some unnecessary typecasting
|
2021-07-24 10:23:40 -07:00 |
|
|
|
96e2edfb8a
|
ID fields are now Hungarian-notated
- tweet.User is now a pointer to a User object; tweet.UserID holds the user id
|
2021-07-24 10:19:05 -07:00 |
|
|
|
741c508017
|
Change profile creation to only target paths that don't exist yet
- Will fail if passed an existing path (file or directory)
|
2021-07-24 10:01:33 -07:00 |
|
|
|
1fa6e50b7e
|
Add some terminal utils
|
2021-07-23 19:59:33 -07:00 |
|
|
|
6c111ab976
|
BUGFIX: fix incorrect text normalization on tweet with multiple images
|
2021-07-23 19:14:16 -07:00 |
|
|
|
700e3e0412
|
Lint at top level, instead of each package individually
|
2021-07-23 16:02:47 -07:00 |
|
|
|
b5c33c2ad0
|
Fix some types to be more clear
|
2021-07-22 14:16:40 -07:00 |
|
|
|
8ef1156d76
|
Add go get to build
|
2021-06-27 13:46:18 -07:00 |
|
|
|
545346e635
|
Add persistence module
|
2021-06-27 13:31:30 -07:00 |
|
|
|
12b1aeaccd
|
Remove redundant copies of cmd files
|
2021-06-16 19:36:03 -07:00 |
|
|
|
28b11548bf
|
Add actual scraping
|
2021-06-16 19:34:06 -07:00 |
|
