Hey everyone! 👋 The publictest version has been updated to V0.10.0. This is a major structural change. Runtime V2 completely replaces the old one. In the past, a lot of Python "glue code" was necessary between AI Pals Engine and the inference engine (llama.cpp). This layer was a necessity then, but it's becoming more and more redundant as the inference engine evolves. The goal of Runtime V2 was to eliminate that glue code entirely. By locking in on the inference engine we simplify things, ensure better long-term compatibility and faster updates.
What this improves for you:
✨Automatic Chat Formats & GPU Layers: Presets will be much less important now. The default preset is set to "auto" mode, so it automatically detects and sets the correct chat format and handles GPU layer allocation on its own.
⚡Better Responsiveness: With less overhead, the app should perform better and be more responsive in most cases.
🛠️New Native Tool Calling Mode: This is now supported for both local and remote text AI models. This means tool calling is determined by the model itself instead of being forced by AI Pals Engine. Keep in mind that not every text AI model supports the new mode, especially older ones weren't trained for tool usage.
Since this changes how the core engine operates, it needs some more testing to ensure everything is still fully supported. Please keep an eye out for any issues or unsupported features and report them on Discord or the Comm Hub so they can be fixed ASAP! 🐛
Once this update is stable, the plan is to further simplify and improve the UI in v0.11.x and hopefully, we can then focus on translating the app in v0.12.0! 🗺️
📝Changelog V0.10.0.0 (publictest Version)
Including smaller updates deployed since the last Devlog:
Engine: Switch to Runtime V2 and generally reduced python code usage to zero
New Feature: Native Tool Call Mode (for local and remote text AI models)
Improvement: Added Model Filter to Add Remote Text Model View
Presets: GPU Layer Auto Mode is now the default
Presets: Chat Format Auto Mode is now the default
Presets: Added Reasoning setting
Presets: Added Additional Stop tokens (removed from general settings)
Chars: Added toolcall-native example
Widgets: Improved tool call visualization
V9.6.0
TTS: Decreased supertonic3 standard speed (helps with cut off phrases)
TTS: Added setting to disable fadein and out
TTS: Added setting to disable multithreading for supertonic3 (tts output skips words bug)
V9.5.0
Assets and Chars: Added Favorites and Filter
Assets and Chars: Added Tags filter
Improvement: TTS ST3 Name includes now chosen language and Char TTS selection box is now sorted by Name
New Feature: Added TTS Text Selection Option (e.g. quoted text only)
V9.4.0 (Current Stable Version)
New Feature: Added full history export in history view (which includes deleted messages)
Improvement: Instruct now resolves dynamictokens (e.g. InstructAction Behavior Node)
Behaviors - Improvement: Made JsonExtractAction more relient to extract json
Behaviors - Improvement: SetDynamicTokenAction is now synchronous instead of async (delay needed otherwise)
Behaviors - Bug: SetDynamicTokenAction not accepting 0 as input
Behaviors - Improvement: ResolveTokenAction can now resolve multiple tokens and text from the text flow
Copy Functionality: Added retry logic to improve reliability in case some other app blocks the clipboard
V<9.4.0
Widgets: Added Conversation Starters to Widget Sidepanel + the option to hide it
Widgets: Math Latex Renderer (Optional: Enable it via Widget Config -> Use Syntax Highlighting and Math Latex Renderer in Text Highlighting)
Widgets: Improved Rendering and Output Panel Scrollbehavior
Improvement: Presets now support KV Cache Quant Types (Context Scaling Tab)
Improvement: The Test TTS View now breaks sentences like the normal Text Generation when generating the Audio
Improvement: Pauses after each text segment split before continuing playback can now be configured for TTS
Char Config: New Tokens -> current_date, current_time, current_datetime, current_weekday, current_weekday_short (see token overview)
Bug: Export as PNG, fixed error on empty conversation starter
Bug: Inspect Context Help Button not working
Bug: Chatview/Testview -> `Remove Last Message` after Stop sometimes not working correctly
Bug: The Char Config `Set Image` now works correctly in case there are pending changes
Bug: Char Overview now properly displays the latest Char preview Image after Char Config `Set Image`
Bug: Chat Format wizard suggesting wrong Qwen3.5 format
Bug: GroupChat AutoMode fails to determine participants after switching Char
Bug: Fixed GetNoteAction not working
Bug: chat-rp-morganlefay replaced wrong {{char}} with {{user}}
Bug: If the history or option count is zero the history sidepanel section will now hide properly
Help: Added Experimental Page