io
93095f62f3
relicense
2021-06-16 01:29:53 +00:00
io
04178b37d7
fix scraping posts
...
saves the cursors provided in the first page to the db so that we can reuse it next time we fetch,
instead of assuming the format of the cursor URL manually using min_id
2021-06-14 21:39:17 +00:00
io
fe1474ffd0
call raise_for_status() on all GET requests
2021-06-14 20:34:33 +00:00
io
71dbf59796
add ability to ignore CWs
2021-06-11 21:29:51 +00:00
Agatha Rose
a904587b32
Clean up formatting and help linter calm down
2021-06-05 00:38:36 +03:00
Agatha Rose
dd78364f2d
Expose overlap ratio and length limit to config
2021-06-05 00:14:56 +03:00
otrapersona
be8227c70a
Changed group of trigger
...
I think there's a tiny chance that two posts on diff instances have the same id, problem solved by using the uri.
2021-03-13 13:54:32 -06:00
otrapersona
9f80c2746f
Add trigger
...
Fixes symptom but not cause 🤷♀️
2021-03-13 13:46:18 -06:00
Lynnesbian
5534f99fc7
fixed a pleroma bug that's been around for ages but apparently nobody noticed whoops
2020-03-10 17:12:23 +10:00
Lynnesbian
c3b9d91ce7
fix another dumb mistake that broke pleroma
2020-03-10 16:59:29 +10:00
Lynnesbian
ac411e15a9
print warning after printing cfg file location
2020-03-10 16:54:00 +10:00
Lynnesbian
8db84a5656
check to see whether site starts with http(s)://
2020-03-10 16:53:30 +10:00
Lynne
dbd74ed6fe
handle case with a single json page better
2020-03-10 14:35:12 +10:00
Lynne
eea48dda1c
fixed an error causing pleroma to always fail
2020-03-10 14:33:26 +10:00
Lynnesbian
fbde3cb911
only use pleroma mode if 'prev' key exists, handle final page better
2020-03-08 19:57:06 +10:00
Lynnesbian
7d718bbe3a
minor code cleanup
2020-03-08 19:46:07 +10:00
Lynne
910829d946
don't insert duplicate posts
2019-08-16 13:50:47 +10:00
Lynne
e5f91f6c0b
fixed wrong db name
2019-08-16 02:02:06 +10:00
Lynne
8eb2750d86
okay this is a big one. fixes #27 .
...
- fixed: compatibility with snowflake IDs
- fixed: no longer assume userids will be unique across instances
- fixed: don't use post ID for sorting
- fixed: we now store userid and id as VARCHAR instead of INT
- new: print friendly message if access token is invalid
- lynne: relieved to be done with this
i tested this with a bot that follows mastodon users. if any of the people your ebooks bot is following (and therefore learning from) use pleroma, you need to delete toots.db.
2019-08-15 11:56:27 +10:00
Lynne
6ae8586500
add sort id to keep track of latest posts rather than post id
2019-08-14 15:17:38 +10:00
Lynne
c8d7e391a0
add sort id if it doesn't exist
2019-08-14 15:10:53 +10:00
Lynne
02ca3d3a50
create config if it doesn't exist
2019-08-14 15:00:35 +10:00
Lynne
1261af29c3
fix silly mistake
2019-08-07 13:48:45 +10:00
Lynne
1fbaf17e3e
allow users to specify custom config.json location
2019-08-07 13:46:57 +10:00
Lynne
023056b5d5
fix potential keyerror
2019-07-10 10:43:56 +10:00
Lynne
a19d429841
added documentation and default value for as of yet unimplemented paired punctuation stripping functionality ( #25 )
2019-07-01 17:19:52 +10:00
Lynne
91d4d7303a
removed legacy code
2019-07-01 17:05:08 +10:00
Lynne
42b23091d9
blacklist knzk.me (rip)
2019-07-01 11:21:08 +10:00
Lynne
575c473301
Merge pull request #24 from notagoat/pin-branch
...
Add un/pin to the bot
2019-05-19 23:09:11 +10:00
Lynne
354ea46dcb
code cleanup, fixes #23
2019-05-19 23:06:31 +10:00
Lynne
5fcefd12b0
remove obsolete update code
2019-05-19 22:45:55 +10:00
notagoat
011ec2c9a8
Added the ability to pin and unpin toots with the pin and unpin command. Would like to clean up code as well as possibly toot confirmation and error messages
2019-05-19 13:31:42 +01:00
Lynne
8fe30f0c88
fix a keyerror
2019-05-07 03:14:30 +10:00
Lynne
ae75212eba
less rude comment
2019-05-07 03:05:02 +10:00
Lynne
a8ac5869d0
added specific error for rate limit exceeded
2019-05-07 03:02:42 +10:00
Lynne Lawson
90e3cfc64c
don't create infinite loop threads, finally fixes #17
2019-05-04 16:44:57 +10:00
Lynne
3f998c018e
mention_handling defaults to 1
2019-04-29 14:24:52 +10:00
Lynne
99d1d13fbf
handle cfg defaults better
2019-04-29 13:59:37 +10:00
Lukas Fülling
c0cf42a41a
add config option to filter for language
2019-02-25 19:44:58 +01:00
Lynne
b00af91305
fixed CW stuff
2019-02-25 11:28:05 +10:00
Lynne
7a337e0fc6
removed unecessary break
2019-02-25 11:22:01 +10:00
Lynne
46792f699f
remove webfingering wikipedia link
2019-02-25 11:18:38 +10:00
Lynne
2cecfd42a5
added support for learning from CW'd posts
2019-02-25 11:17:06 +10:00
Lynne
64b49da4eb
Merge branch 'master' into master
2019-02-23 10:25:15 +10:00
Lynne
0e01d5d8ec
Merge pull request #12 from SneakyBastardSword/master
...
precompile regexes
2019-02-23 10:23:23 +10:00
Lynne
4438d797e7
use config.sample.json if config.json doesn't exist
2019-02-21 13:37:45 +10:00
Lucina Wilton
20c3df5393
fixed tabs i think hopefully
2019-02-07 10:45:44 -05:00
Lucina Wilton
f71c4af0e6
precompiled regexes used inside of loop
2019-02-07 10:27:52 -05:00
Lynne
0d162b067b
webfinger is NOT a joke.
2019-02-07 10:58:27 +10:00
Lynne
5d62b17310
removed hacky solution, added misskey support
2019-02-07 10:53:23 +10:00