Commit Graph

76 Commits

Author SHA1 Message Date
io 93095f62f3 relicense 2021-06-16 01:29:53 +00:00
io 04178b37d7 fix scraping posts
saves the cursors provided in the first page to the db so that we can reuse it next time we fetch,
instead of assuming the format of the cursor URL manually using min_id
2021-06-14 21:39:17 +00:00
io fe1474ffd0 call raise_for_status() on all GET requests 2021-06-14 20:34:33 +00:00
io 71dbf59796 add ability to ignore CWs 2021-06-11 21:29:51 +00:00
Agatha Rose a904587b32
Clean up formatting and help linter calm down 2021-06-05 00:38:36 +03:00
Agatha Rose dd78364f2d
Expose overlap ratio and length limit to config 2021-06-05 00:14:56 +03:00
otrapersona be8227c70a Changed group of trigger
I think there's a tiny chance that two posts on diff instances have the same id, problem solved by using the uri.
2021-03-13 13:54:32 -06:00
otrapersona 9f80c2746f Add trigger
Fixes symptom but not cause 🤷‍♀️
2021-03-13 13:46:18 -06:00
Lynnesbian 5534f99fc7
fixed a pleroma bug that's been around for ages but apparently nobody noticed whoops 2020-03-10 17:12:23 +10:00
Lynnesbian c3b9d91ce7
fix another dumb mistake that broke pleroma 2020-03-10 16:59:29 +10:00
Lynnesbian ac411e15a9
print warning after printing cfg file location 2020-03-10 16:54:00 +10:00
Lynnesbian 8db84a5656
check to see whether site starts with http(s):// 2020-03-10 16:53:30 +10:00
Lynne dbd74ed6fe
handle case with a single json page better 2020-03-10 14:35:12 +10:00
Lynne eea48dda1c
fixed an error causing pleroma to always fail 2020-03-10 14:33:26 +10:00
Lynnesbian fbde3cb911
only use pleroma mode if 'prev' key exists, handle final page better 2020-03-08 19:57:06 +10:00
Lynnesbian 7d718bbe3a
minor code cleanup 2020-03-08 19:46:07 +10:00
Lynne 910829d946 don't insert duplicate posts 2019-08-16 13:50:47 +10:00
Lynne e5f91f6c0b fixed wrong db name 2019-08-16 02:02:06 +10:00
Lynne 8eb2750d86 okay this is a big one. fixes #27.
- fixed: compatibility with snowflake IDs
- fixed: no longer assume userids will be unique across instances
- fixed: don't use post ID for sorting
- fixed: we now store userid and id as VARCHAR instead of INT
- new: print friendly message if access token is invalid
- lynne: relieved to be done with this

i tested this with a bot that follows mastodon users. if any of the people your ebooks bot is following (and therefore learning from) use pleroma, you need to delete toots.db.
2019-08-15 11:56:27 +10:00
Lynne 6ae8586500 add sort id to keep track of latest posts rather than post id 2019-08-14 15:17:38 +10:00
Lynne c8d7e391a0 add sort id if it doesn't exist 2019-08-14 15:10:53 +10:00
Lynne 02ca3d3a50 create config if it doesn't exist 2019-08-14 15:00:35 +10:00
Lynne 1261af29c3 fix silly mistake 2019-08-07 13:48:45 +10:00
Lynne 1fbaf17e3e allow users to specify custom config.json location 2019-08-07 13:46:57 +10:00
Lynne 023056b5d5 fix potential keyerror 2019-07-10 10:43:56 +10:00
Lynne a19d429841 added documentation and default value for as of yet unimplemented paired punctuation stripping functionality (#25) 2019-07-01 17:19:52 +10:00
Lynne 91d4d7303a removed legacy code 2019-07-01 17:05:08 +10:00
Lynne 42b23091d9 blacklist knzk.me (rip) 2019-07-01 11:21:08 +10:00
Lynne 575c473301
Merge pull request #24 from notagoat/pin-branch
Add un/pin to the bot
2019-05-19 23:09:11 +10:00
Lynne 354ea46dcb
code cleanup, fixes #23 2019-05-19 23:06:31 +10:00
Lynne 5fcefd12b0
remove obsolete update code 2019-05-19 22:45:55 +10:00
notagoat 011ec2c9a8 Added the ability to pin and unpin toots with the pin and unpin command. Would like to clean up code as well as possibly toot confirmation and error messages 2019-05-19 13:31:42 +01:00
Lynne 8fe30f0c88 fix a keyerror 2019-05-07 03:14:30 +10:00
Lynne ae75212eba less rude comment 2019-05-07 03:05:02 +10:00
Lynne a8ac5869d0 added specific error for rate limit exceeded 2019-05-07 03:02:42 +10:00
Lynne Lawson 90e3cfc64c don't create infinite loop threads, finally fixes #17 2019-05-04 16:44:57 +10:00
Lynne 3f998c018e
mention_handling defaults to 1 2019-04-29 14:24:52 +10:00
Lynne 99d1d13fbf
handle cfg defaults better 2019-04-29 13:59:37 +10:00
Lukas Fülling c0cf42a41a add config option to filter for language 2019-02-25 19:44:58 +01:00
Lynne b00af91305
fixed CW stuff 2019-02-25 11:28:05 +10:00
Lynne 7a337e0fc6
removed unecessary break 2019-02-25 11:22:01 +10:00
Lynne 46792f699f
remove webfingering wikipedia link 2019-02-25 11:18:38 +10:00
Lynne 2cecfd42a5
added support for learning from CW'd posts 2019-02-25 11:17:06 +10:00
Lynne 64b49da4eb
Merge branch 'master' into master 2019-02-23 10:25:15 +10:00
Lynne 0e01d5d8ec
Merge pull request #12 from SneakyBastardSword/master
precompile regexes
2019-02-23 10:23:23 +10:00
Lynne 4438d797e7
use config.sample.json if config.json doesn't exist 2019-02-21 13:37:45 +10:00
Lucina Wilton 20c3df5393 fixed tabs i think hopefully 2019-02-07 10:45:44 -05:00
Lucina Wilton f71c4af0e6 precompiled regexes used inside of loop 2019-02-07 10:27:52 -05:00
Lynne 0d162b067b
webfinger is NOT a joke. 2019-02-07 10:58:27 +10:00
Lynne 5d62b17310
removed hacky solution, added misskey support 2019-02-07 10:53:23 +10:00