io
94949289f0
normalize Pleroman posts without cws ( fix #3 )
2021-09-27 11:17:56 +00:00
io
4492f6685c
remove repeated call to extract_post_content ( #2 )
...
fortunately, extract_post_content returns the same thing when called repeatedly,
so this wasn't a big deal anyway
2021-09-27 11:17:56 +00:00
ioistired
3d393c7577
Merge pull request #2 from TinfoilSubmarine/create-posts-on-first-run
...
Commit on DB object creation to ensure table posts is created
2021-09-27 05:42:46 -05:00
io
2bea936cf2
fix fetching from masto instances
2021-09-21 13:58:20 +00:00
Joel Beckmeyer
6f0a389050
create table posts if it does not exist
2021-09-17 14:07:32 -04:00
io
da961a0e35
add TODO comment
2021-09-17 06:37:39 +00:00
io
788f8550c7
handle rate limits
2021-09-17 06:35:54 +00:00
io
b906abe2b1
add basic migration support
2021-09-17 06:35:35 +00:00
io
191214dbd6
save some memory by using account handles instead of objects
2021-08-19 10:40:57 +00:00
io
97a2f5de00
a few changes
...
- better error reporting
- fix the program hanging at the end if any of the accounts failed to fetch
- remove trailing semicolon from user agent string
2021-08-13 09:40:20 +00:00
io
9b60540d07
move db_path default to load_config
2021-07-26 06:47:43 +00:00
io
a3348602c1
fetch_posts: add KeyboardInterrupt handling
2021-07-26 06:17:01 +00:00
io
4ba3bb1662
fetch_posts.py: use argparse
2021-07-26 06:04:32 +00:00
io
b8e727cfd4
fetch_posts.py: remove unused import
2021-07-26 06:04:14 +00:00
io
330fdc2809
rewrite fetch_posts.py from scratch
...
now it should be properly async by fetching posts in a separate task and sending them across
a queue to a task that inserts to the DB
2021-07-26 04:59:04 +00:00
io
944e2fc3a5
use json5 instead lol
...
toml sucks add null when
2021-06-18 10:38:58 +00:00
io
5f9959fff8
rename main.py to fetch_posts.py
2021-06-16 04:26:22 +00:00