Dedicated AI town server is up !

Help push this to over a 1k town folks

Want to run AI town models at scale, without a crazy openAI bill?

Now you can - just by pointing to our dedicated AI town servers at

https://aitown-demo-api.recursal.ai

Without quotes or ending backslashes in the settings.

This API currently supports, the following openAI format

• chat completion endpoint (with aitown 3B model)

• completion endpoint

• embedding endpoint (passthrough to openAI, using your openAI key)

You will still need an OPENAI_API_KEY for the embeddings. AI town models at scales beyond 100+++

Alternatively to run locally, you can use the github repo here:

https://github.com/recursal/ai-town-rwkv-proxy

We intend to keep this server up, to the public, with some sensible anti-abuse / rate limits - throughout the year, as we explore means of optimizing our inference infrastructure at scale under load, for our commercial cloud platform.

Dedicated RWKV inference cloud service will be out soon.

Disclaimer: This API service is provided as it is, without any warranties or guarantees.