Iceblade
Iceblade
This probably shouldn't be enabled in the default view, as deletion of spam could leave behind a whole lot of "comment deleted by moderator" notices, which themselves could become a...
Oh, hang on, I managed to get in a previous WIP file, there should only be the "openrouter_handler" and "openrouter/class.py", "openrouter.py" needs to be removed
There, should be updated now.
Alright, I've done somewhat more thorough testing this time around, and it seems to be behaving properly now, at least on my end.
I've reworked the handler class in /modeling/inference_models to be more generic, and as a proof-of-concept added support for another API! Adding support for Neuro.Mancer took roughly an hour.
Moved GooseAI over to the new API handler.
Currently, api_handler translates all calls to core_generate, raw_generate & _raw_generate into a call to the abstract function _raw_api_generate (unique to each specific endpoint handler), decoding the prompt if it has...
NOTE: I keep triggering the following error when tabbing into the web client, and sometimes when switching between tabs in the left menu.  I don't know if it is...
Repetition penalty is now properly tied to the setting inside the KAI front end. Removing presence penalty & frequency penalty would require adding them as new items in gensettings.py (and...
Added them and it seems to work. Easy to undo if we want,