Releases: josStorer/RWKV-Runner
Releases · josStorer/RWKV-Runner
v1.9.6
Changes
Llama.cpp support
- Add llama.cpp support with pre-compiled Vulkan libraries for Windows that should work out-of-the-box with any modern GPU. Mac and Linux users still need to manually install llama-cpp-python. You can now use RWKV GGUF models as well as any other GGUF models such as DeepSeek, Qwen3, Gemma3, Phi4. You can select the llama.cpp tag in the Models page and download the required models with one click, or place downloaded GGUF models in the models directory for use.
-
- The software's preset configs have been streamlined and now include some GGUF format presets. You can click the reset button to fetch the latest presets.
-
- The RWKV-Runner Python server in llama.cpp mode has been optimized. After loading the model to GPU, the server process only occupies approximately 200MB of memory on Windows platform.
- When server users call the
/switch-modelAPI to load models, you only need to pass a file path ending with .gguf to themodelfield to use llama.cpp mode.
Features
- llama.cpp support
-
- Add a setting to save the full rwkv-runner client state, rather than just storing necessary settings. This option is enabled by default. You can disable it and restart the software to restore the previous version's behavior
-
- add a share button to save your chat screenshot
-
Improvements
- reduce peak memory usage when loading rwkv7 in cuda mode
- increase the maximum value of the top_k API parameter to 100
- remove language tags in Models page, as all new models support global languages
- remove useless/disabled resources
- other small improvements
- You can run RWKV-Runner on Windows 7 by installing the patches from the link below. Note that you still need to install Python 3.8 and dependencies manually. https://github.com/josStorer/wails/releases/tag/v2.9.2x
Fixes
- fix the issue of failing to load the state for RWKV7
- Fix the abnormal behavior when passing a Tool Definition array. This is a frontend only parameter construction issue.
- fix the issue where the model list did not refresh automatically after downloading the model when using a custom model path
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
- Windows 7 Patches: https://github.com/josStorer/wails/releases/tag/v2.9.2x
v1.9.5
Changes
- add torch-2.7.1+cu128 precompiled kernels
- hide unnecessary pop-up consoles on windows
- The linux binary files released in github releases now depend on libwebkit2gtk-4.1 to support Ubuntu 24.04. This means that versions below Ubuntu 20.04 will no longer be supported for running, and users will have to build it on their own. Additionally, Windows 7 is still supported, but you need to install the KB2999226 patch.
- add quick think support
- fix the issue where the line breaks in the thinking content did not take effect
- update manifest.json and defaultModelConfigs
- bump go-webview2
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.9.4
Changes
- Add NVIDIA hardware info display to Settings Page with PyTorch version switching capability. Auto-select optimal PyTorch version during initial setup based on detected hardware. (Currently only works on Windows)
- temporarily disable the standard WebGPU strategy as it's outdated
- improve details
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.9.3
Changes
- bump rwkv pip (improve VRAM usage when using rwkv7)
- the reasoning model renderer no longer modifies the original response's
<think>tags, but only processes them during the rendering process, and fixes the issue where markdown was not correctly rendered when rendering the<think>tags in certain cases - update the shortcut API list and model list in the settings, add OpenRouter and DeepSeek, and update the list with the most commonly used models at present
- update rwkv.cpp model conversion script (3e97b6f) @MollySophia
- update manifest (add rwkv7-g1 reasoning model)
- add
make devqcommand to improve the startup and reload speed during project development. Requiresgo install github.com/josStorer/wails/v2/cmd/[email protected]
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
Contributors
MollySophia
Assets 7
v1.9.2
Changes
- deepseek compatible prefix mode api support
- add deepthink toggle button
- chores
The image below shows the effect of RWKV7-G1 1.5B model trained to 16% completion. The results may not be optimal as it's mainly for demonstrating the API server and UI functionality.
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.9.1
Changes
- bump webgpu(python) (rwkv7 support) (https://github.com/cryscan/web-rwkv-py)
- bump rwkv.cpp (rwkv7 support) (https://github.com/RWKV/rwkv.cpp)
- reasoning model renderer support (like deepseek-r1, Qwen qwq)
- smart scroll area support, no longer locked to bottom when generating
- precision of penalty can be set to 0.01
- update manifest and default configs
- update welcome message
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.9.0
Changes
- fix the handling of AVOID_REPEAT_TOKENS (Chinese punctuation) that may lead to rwkv7 fp16 overflow, causing the generation to terminate
- fix the misidentification of rwkv5 as rwkv7 (#407)
- improve version comparison
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.8.9
Changes
- rwkv7 support (CPU and CUDA Mode only)
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.8.8
Changes
- potential crash fix (#396)
Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for WebView2, click Modify -> Repair to update your WebView2 runtime.
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.8.7
v1.8.7
- withdrawing the obfuscated tiny package, as it caused some exceptions in the html webui
v1.8.6
Features
- feat(python backend): function call support (#368) Great thanks to @EliwiiKeeya
- windows installer support: https://github.com/josStorer/RWKV-Runner/releases/latest/download/RWKV-Runner-amd64-installer.exe
- add penalty_decay to the Completion Page
Improvements
- improve WSL installation condition detection
Chores
- downgrade to golang1.20 for compatibility with windows7 (#377)
- update manifest.json (hide old models and add new models)
- html-webui.zip is now added to the release
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
Contributors
HaloWang and EliwiiKeeya