AGS Plugin Development (AI)

[JackTyme]

Hello, is there a plugin for AGS that can connect the live game to either GPT API, or even better a plugin that can connect to a locally hosted model like llama or kobold.

I am asking because I want to implement this technology into my game, NPC dialog and actions will be powered by these AI models. I want the dialog to be AI generated, for both user interactions and NPC to NPC(s) interactions (NPCs conversing with each other).

Anything like this for AGS yet?

[Kastchey]

That's an interesting idea, but I don't think anything like that has been developed already. I suppose there would be some charges involved, too, if only to host the API somewhere.

[eri0o]

If you are making a plugin for your own game you don't have to have the flexibility of neither LangChain or Semantic Kernel, you can do with a very simple API of send string, get string and hardcode everything else - the process isn't instantaneous, so you may need some API to either poll (is the answer here yet?) or some event (but it won't work when something else is blocking).

Now there is a bunch of things like llama.cpp that I think should be ok to use as a dependency and you build on top of it.

The issue though is even the smallest models I could find that aren't terrible (like the ones Google recently released, Gemma) are still more than a GB. I don't feel like downloading many GB to run something. And using APIs from the web is also something that I wasn't comfortable.

So the opinion I got after playing toying with this idea, is until there's some model that is not terrible and manages to be small, it's not worth it.