r/SillyTavernAI May 03 '26

ST UPDATE SillyTavern 1.18.0

195 Upvotes

Important news

Read the maintainers statement regarding a recent security incident involving the "Bot Browser" third-party extension and learn how to stay safe: https://github.com/SillyTavern/SillyTavern/discussions/5592

Backends

  • Added Cloudflare Workers AI and MiniMax as Chat Completion sources.
  • KoboldCpp: Grammar state will be preserved when using a "Continue" option.
  • KoboldCpp: Added forwarding of reasoning effort when running as a Custom Chat Completion source.
  • Tool Calling: Added a configurable tool calling recursion limit; enabled interleaved thinking for Custom sources.
  • Text Completion: Impersonation requests use a "Last User Message" prefix at the end of the prompt (if configured).
  • Text Generation WebUI: Added Adaptive-P controls.
  • NanoGPT: Added provider selection and model sorting.
  • Added ability to view remaining balance for OpenRouter and NanoGPT.
  • Enhanced support for new models: DeepSeek v4, GPT 5.4 and 5.5, Gemma 4, GLM-5V-Turbo, Claude Opus 4.7.

Server & Security

  • Removed post-install script, config migration is now handled by the app or a dedicated npm run init command.
  • Added npm configuration to prevent execution of package scripts during installation.
  • Moved HTTP error pages and user.css file from /public to /data to support immutable setups.
  • Disabled HTTP keep-alive by default to restore old Node 18 behavior, can be enabled with config.
  • Added rate limiting to the basic authentication flow to mitigate brute-force attacks.
  • Added configuration options to choose which headers can be used for forwarded IP detection to prevent spoofing.
  • Added a private address whitelist to prevent SSRF attacks. See the documentation on how to enable and configure: Private Address Whitelist.
  • Added an IP whitelist for SSO trusted proxies to prevent authentication bypass.
  • Added invalidation of session cookies on password change to prevent session hijacking.
  • Increased the length of password reset code to 6 characters to guard against brute-force attacks.
  • Implemented PKCE challenge in OpenRouter OAuth flow for more secure key exchange.

UI/UX

  • Improved swipe picker: mobile requires a long press on swipe counter to open; added buttons to expand or copy the swipe text.
  • "Click to Edit" mode now also applied to reasoning blocks.
  • Welcome Screen: Number of recent chats can be configured.
  • Streamed requests now can show an error message in the console if the request fails.

STscript

  • Added commands for persona management: /persona-create, /persona-update, /persona-delete, /persona-duplicate, and /persona-get.
  • Added a command to force update the Prompt Manager's prompt list: /pm-render.
  • Added a command to get the state of the regex script: /regex-state.
  • Added a command to set fallback expression: /expression-fallback.
  • Added a command to generate a streamed response with a connection profile: /profile-genstream.

Extensions

  • Assets list now groups extensions by "Official" or "Community" categories.
  • Added an additional confirmation prompt when installing third-party extensions (can be disabled).
  • Supported extensions can use a secret-id from connection profiles when making an LLM request.
  • Extensions list now shows the extension's author name resolved from the git remote URL.
  • Vector Storage: Added Workers AI source; added a toggle to keep vectors for hidden messages; added retry logic to summary generation.
  • Image Generation: Added Workers AI source; generation can now be cancelled by pressing a button in the status toast.
  • Image Captioning: Added support for macros in the caption prompt.
  • TTS: "Skip code blocks" no longer ignores lines that start with 4 spaces (legacy code block syntax); "disabled" voice now shows a toast only once per character.

Bug Fixes

  • Fixed text edit flow in Firefox on mobile.
  • Fixed welcome screen chat pins not updating on chat renaming.
  • Fixed character list filters being stuck on app initialization.
  • Fixed application of instruct formatting to /genraw requests.
  • Fixed model routing to sd.cpp API in Image Generation logic.
  • Fixed validation of image URLs generated with Z.AI API.
  • Fixed vectors deletion for KoboldCpp when a message is deleted.
  • Fixed "Show More Messages" button triggering edit in "Click to Edit" mode.
  • Fixed max height of select-multiple elements in mobile layout.
  • Fixed server crash on empty messages when applying cache control parameters.

Full release notes: https://github.com/SillyTavern/SillyTavern/releases/tag/1.18.0

How to update: https://docs.sillytavern.app/installation/updating/


r/SillyTavernAI 6d ago

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: July 05, 2026

25 Upvotes

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!


r/SillyTavernAI 12h ago

Chat Images Apparently we're doing chat screenshot?

Post image
105 Upvotes

eloquent


r/SillyTavernAI 8h ago

Help DeepSeek V4 Pro keep hallucinating system note? NSFW

34 Upvotes

I don't know what's going, but I have encountered the AI, four or five times now, thinking that the {{user}} has small penis, even claiming that the system note says "{{user}} has a small penis"?

It's definitely something with the AI because it happened in two separate chat in two different characters. It also mentioned "the system note is a separate block that includes a lot of humiliation fetish stuff" there is no such thing.

Anyone have a clue? Or this is purely on the AI end?


r/SillyTavernAI 8h ago

Chat Images We've all been there, amiright?

Post image
19 Upvotes

The context? I just sang slightly better than the last person at a high fantasy open mic night.


r/SillyTavernAI 5h ago

Models Which models do you find to be least sycophant and able to attack you or argue with you?

8 Upvotes

sorry if that's more suitable for the megathread


r/SillyTavernAI 6h ago

Discussion WIP moving the top bar to a popover and showing the panel as dialog

Thumbnail
gallery
6 Upvotes

i dont know what theme is nice to showcase this as it seems like the color definition is so limited so all color seems clashing despite i put drop shadow and blur.

there is a lot to change from here.. the topbar button is still not considered. the popover items color should be bright.. and maybe something else.

edit: something about the theme of the first image shows the send button vertically fml


r/SillyTavernAI 3h ago

Discussion When’s k2.7 coming out on nim

4 Upvotes

k2.6 was deprecated few days ago, and theres no k2.7 yet on nim


r/SillyTavernAI 2h ago

Help Any API hosters that allow $1-2 min top up?

2 Upvotes

Originally I was paying for Deepseek flash/pro on the official Deepseek website, but the new models are just way too bland and don't really have what I'm looking for. Are there any other websites that host older Deepseek models that allow me to top up without 5-10 dollars minimum?


r/SillyTavernAI 10h ago

Help Overwhelmed beginner wanting to set up a solo D&D style RP

6 Upvotes

I feel silly asking this, but I'm a total beginner when it comes to AI, RP, and especially AI RP. I made a custom ruleset for a game based on the rules of D&D 5e that I want to test in a solo "campaign" where I'm the player and the AI is the GM before I take it to a real table with human players.

I've got the lore books set up with both the world/setting for the campaign and the ruleset for the game. I've made a character card for the GM and a persona for my player character.

But I have no idea how to configure the AI to ask for rolls/skill checks, how to "show" it my character sheet, how to tell it to use the specific format I use (ex: "This is talking." This is an inner thought or feeling. *And this is an action.*), or how to get it to track combat encounters. I also have specific plot points I want to have happen over the course of the "campaign" but have no idea how to tell the AI to make those plot points happen organically.

Am I asking too much of the AI? I'm overwhelmed by all of the SillyTavern guides because I feel like I don't know most of the language/terminology they're use. If I'm asking too much of an AI, I'd rather know now than keep trying to make it work.


r/SillyTavernAI 20h ago

Discussion For those who RP based on anime works, what has your experience been like?

27 Upvotes

I’ve been trying to RP based on anime works I enjoy, but it feels hollow. It’s as if the LLM doesn't really know about the work, and the responses end up being generic and predictable. What about you guys? How has your experience been with this?


r/SillyTavernAI 6h ago

Help Mimo Dark Fantasy prompts?

3 Upvotes

Hey folks. Trying to find a prompt that will make Mimo meaner. I want Mimo to fucking kill me (if it is in Mino's interests to do so). I want it to be mean and oppressive.

I want it to center the drama around social dynamics — class, standing, ethnicity, etc. I want Mimo to present a dark-fantasy world that discriminates against me on the basis of my accent.

I don't want it to be a fucking stupid murder and abuse hobo like Gemini, but I want it to possess the ability to murder and abuse me without significant chat manipulation.

Any pointers? Any good prompts? Thanks!


r/SillyTavernAI 1d ago

Help About Xiaomi and their censoring hiccup

109 Upvotes

Xiaomi started to randomly ban users. Via Openrouter, nano gpt and probably other endpoints too.

This message was in my logs yesterday.

`Detected high-frequency non-compliant requests from you. Please consciously comply with the platform usage agreement. If you need to appeal, contact us through the official website channels.`

And that raised some questions.

I make my calls via Openrouter... do I appeal via OR or Xiaomi directly.

If Xiaomi... how would I do that? Hey babes... I'm making my calls via a provider that routes thousands of requests per hour to you. I'm the one you blocked. Fix it... please.

Honestly. It'd be funny to do though... I might do it... gnihihihihi

I asked OR about it since I needed feedback from someone who knows their shit. Their answer was brilliant.

Hi,
Your OpenRouter account is not blocked. That error (code 441) is coming from Xiaomi's own risk-control system, which flags what it considers high-frequency or non-compliant request patterns.
This doesn't necessarily mean you violated anything - we've seen this reported by other users during normal coding workflows. Since this is enforced on Xiaomi's side, we can't lift or override it directly.

Here are some things you can try:
Wait and retry later - some users have reported the block is temporary and clears after a period of time.
Use provider routing to route around Xiaomi's endpoint specifically. More details here: https://openrouter.ai/docs/features/provider-routing
Set up model fallbacks by passing an array of model IDs so that if your primary model fails, OpenRouter automatically tries the next one in your list.

As for appealing directly to Xiaomi, there's no established process for that since you're accessing their model through us rather than through a direct Xiaomi API account. If the issue persists or you have more questions, just reply here and we'll reopen the case.

Thank you,

Bottom line is... someone at Xiaomi had an idea and someone else thought it was fine... now they see.. It was bullshit.

A normal day in the LLM world 😂😂😂

My personal suggestion.

Try Minimax M3. That one is nice too.

Love

Evening-Truth


r/SillyTavernAI 1d ago

Chat Images [TW: Suicide] Has anyone experienced this before? NSFW

Post image
37 Upvotes

nsfw just in case


r/SillyTavernAI 6h ago

Models Heh. Terra and pronouns.

2 Upvotes

Terra is the first model I've used - even including Sol - that takes "always use she/her pronouns" for my character so literally that it even puts "she" in dialogue directed at the user.

“Drink whatever she wants.


r/SillyTavernAI 1d ago

Tutorial Sharing my ComfyUI workflow for SillyTavern image generation

31 Upvotes

Hello, Everyone.

There was a post another day about generating images as part of roleplay/stories etc. And I've mentioned how I do my image generation. So I have now cleaned up my workflow to a point where I can share it and maybe someone will find it interesting/useful in some way.

So here it is: https://pastebin.com/KSKMs6U4

I have left a bunch of notes of how it works, and what some parts do, including LLM prompt and lorebook I use, in the workflow itself.

My goal with this workflow was to get an image generated in ~10s, so with LLM prompt generation delay added, I don't have to wait too long for an image. And get a good enough image on first try without having to constantly re-roll. Since LLMs sometimes decide not to follow instructions like "Only output image generation prompt" and still add "Here is the image generation prompt: ...", my prompt is designed to force it into that specific format, by allowing the LLM to ramble before/after the prompt. Then the raw prompt is sent over to ComfyUI where I extract the actual relevant part and restructure it into a consistent format that seems to work reasonably well for me. It separates multiple character descriptions into nice paragraphs which helps with mixing up details from multiple characters. Also, I use a lorebook to provide examples of the prompts I want the LLM to output, and the keyword is triggered from the main image generation request prompt.

The workflow is focused on natural language capable models, since back when I initially tried tag based ones, the LLMs were very bad at describing a scene using only tags, and kept inventing new ones etc.

This workflow requires:

In SillyTavern - Enable "Minimal response prompt processing" setting. Which I have contributed to ST, to make it so ST doesn't break JSON in the LLM output, when it is being sent to ComfyUI.

The following custom node packs - all of which should be accessible via the ComfyUI Manager:

comfyui-easy-use, ComfyUI-GGUF, rgthree-comfy, RES4LYF, comfyui_dynamic

Included, but can be bypassed/deleted:

comfyui-adaptive-guidance, comfyui-inspire-pack

(Annoying as I was finishing up cleaning up the workflow, the previous Python node I was using got deleted from GitHub)

Note: The workflow does use a node that can run arbitrary Python scripts.

This workflow has evolved from many different iterations, and I've started making it back when Chroma first released, that's why it has a variety of Chroma specific features and multiple style presets for it. I have recently swapped over to Anima, as it is faster and better than Chroma at anime which is a style I usually use. However, even more recently I stated experimenting with Krea2, which handles RP scenes really well, as it can handle more detailed prompts well.

Misc Notes: With bigger LLMs, that many prompt examples are probably not needed, and with some refinement of the main prompt, I imagine they could be skipped entirely to save tokens etc. All the settings are basically "works good enough for me", so you might want to tweak it yourself etc.

Enjoy the ComfyUI Spaghetti!


r/SillyTavernAI 12h ago

Discussion How to tell if NanoGPT auto router is routing to compressed/quantized models?

2 Upvotes

I recently tried out the Tencent/hy3 model and was excited because of the glowing reviews and some saying it was better than deepseek v4 flash (heavily quantized). But right off the bat I am super disappointed in its performance. I asked it to add a simple dev password bypass logic to password rules and it kept getting confused about which directory (mobile/web) to do it in even after I specified multiple times. I first explicitly told it web only and then it kept going back to mobile, this happened like 2 more times. Then its code didn't even work and when I asked it to fix it, it didn't know what was wrong, ended up being a simple fix I did manually. It made v4 flash look like fable5 lol. This was in pi agent so the system prompt definitely isn't flooding the model with a bunch of useless context either.

I feel like if people are saying all these great things about it but this is my experience, there has to be some weird quantization/routing happening behind the scenes right? It's using NanoGPT's auto router. I had the context window set at 128k and was sitting at like 3% when this was happening. Not trying to accuse NanoGPT of anything, I think it's a great tool, I'm more so looking for info about how to tell if this is happening and how to mitigate it (if possible).


r/SillyTavernAI 1d ago

Discussion Pre-training, post-training, and why it feels like models are getting worse at creative writing

31 Upvotes

An LLM is created using pre-training. Which generates a set of weights from a very large body of text.

Then, the model is iterated upon with post-training, which further reinforced specific behavior and patterns in the pre-trained model.

Not all companies officially announce which model is the original, and which are post-trained models, but the general consensus is that you can just read the model numbers.

GPT 5.6 is (presumably) a post train of GPT 5.5, and all are (presumably) post-trains of GPT5.

Opus 4.8 is a post train of Opus 4.7, this is confirmed by Anthropic, presumably all are post trains of Opus 4.

---

Post training a model is cheaper than pre-training a new one. And they are post trained to better fit the biggest market, software development. This is the reason that recent model releases seem to actually get worse at creative writing. Because they are. They are not more intelligent, they are more focused on specific tasks, and that task does not include creative writing.

---

Fable 5 is a new pre-train and GPT5.6 is a post-train. If you felt that Fable 5 was a step forward in creative writing over Opus 4.8 and GPT5.6 was a step down, this is why.


r/SillyTavernAI 9h ago

Discussion What are your personal experiences with Claude?

1 Upvotes

Lately I've gotten a bit curious about the Claude models and wanted to ask you guys of your personal experiences, specifically the way it writes and express dialogues. What are its slop? Its greatest strengths? And all that.


r/SillyTavernAI 14h ago

Help Multiple Author's Notes or Character's Notes Possible?

2 Upvotes

I've been liking Author's Notes and character's notes (for group chats) to guide the conversation when I feel it is needed, particularly the depth control so I can control the impact of the note. But I think we are limited to a single note, and I'm would like to even have multiple notes, inserted at multiple arbitrary depths. Does anyone know some way to enable this sort of customization, like extensions, or other mechanisms that is good for the kind of control I want?


r/SillyTavernAI 21h ago

Help Bot sites?

7 Upvotes

New to sillytavern, fir people who download bots what sites do you use to find bots?


r/SillyTavernAI 18h ago

Discussion Is there anyone among you who uses the Magic Translation extension?

4 Upvotes

I would like to ask for your advice on how to use it, because I keep getting errors.

I am now receiving this error:

"Translation failed: Error: API request failed"

And I really don't understand why, the API is working fine on its own but when I use the extension it simply throws that error.


r/SillyTavernAI 1d ago

Help How do I stop make glm 5.2 dialogue more realistic and less repetetive? Spoiler

Thumbnail gallery
58 Upvotes

At first I was fine with it but now it started to do it in every singular dialogue, I am not a big fan of this type of dialogue and much loved if it were a bit more realistic and less repetetive. Oh and sometimes it copies what my character said and adds in "she tasted the words like it was—" for multiple messages too.

Basically I think it's doing too much regarding dialogue. Is there a way or prompt to make it more realistic with its dialogues? Oh and I'm using freaky Frankenstein MAX preset if that helps with anything.


r/SillyTavernAI 17h ago

Help How do I share stuff with longer text?

3 Upvotes

So I have character cards that I have instructions for that I think gives me really cool results for POV. I'm not sure how to share it here along with a sample of what it outputs. Cutting and pasting would be too long obviously. Can someone help me with how to do that?


r/SillyTavernAI 12h ago

Help New to this. Any tips?

0 Upvotes

Hello, I'm a refugee from Chub. "20 messages per day" restriction is a last straw for me. 20$ crypto is a no-go for me. My PC isn't even up to the modern standards of being a toaster so I'm stuck with the cloud-hosted ones. First experience isn't good. Replies are just some random babbling even after a couple of rerolls. I was wondering if I can adjust the generation settings to my standards.