release v1.9.6

Author: josStorer

.github/workflows/pre-release.yml

@@ -31,7 +31,8 @@ jobs:
           Start-BitsTransfer https://github.com/josStorer/web-rwkv-converter/releases/latest/download/web-rwkv-converter_windows_x86_64.exe ./backend-rust/web-rwkv-converter.exe
           Start-BitsTransfer https://github.com/josStorer/LibreHardwareMonitor.Console/releases/latest/download/LibreHardwareMonitor.Console.zip ./LibreHardwareMonitor.Console.zip
           Expand-Archive ./LibreHardwareMonitor.Console.zip -DestinationPath ./components/LibreHardwareMonitor.Console
-          del ./py310 -Recurse -Force
+          del ./py310/Lib/site-packages/cyac -Recurse -Force
+          del ./py310/Lib/site-packages/cyac-1.9.dist-info -Recurse -Force
           Start-BitsTransfer https://www.python.org/ftp/python/3.10.11/python-3.10.11-embed-amd64.zip ./python-3.10.11-embed-amd64.zip
           Expand-Archive ./python-3.10.11-embed-amd64.zip -DestinationPath ./py310
           $content=Get-Content "./py310/python310._pth"; $content | ForEach-Object {if ($_.ReadCount -eq 3) {"Lib\\site-packages"} else {$_}} | Set-Content ./py310/python310._pth

.github/workflows/release.yml

@@ -59,7 +59,8 @@ jobs:
           Start-BitsTransfer https://github.com/josStorer/web-rwkv-converter/releases/latest/download/web-rwkv-converter_windows_x86_64.exe ./backend-rust/web-rwkv-converter.exe
           Start-BitsTransfer https://github.com/josStorer/LibreHardwareMonitor.Console/releases/latest/download/LibreHardwareMonitor.Console.zip ./LibreHardwareMonitor.Console.zip
           Expand-Archive ./LibreHardwareMonitor.Console.zip -DestinationPath ./components/LibreHardwareMonitor.Console
-          del ./py310 -Recurse -Force
+          del ./py310/Lib/site-packages/cyac -Recurse -Force
+          del ./py310/Lib/site-packages/cyac-1.9.dist-info -Recurse -Force
           Start-BitsTransfer https://www.python.org/ftp/python/3.10.11/python-3.10.11-embed-amd64.zip ./python-3.10.11-embed-amd64.zip
           Expand-Archive ./python-3.10.11-embed-amd64.zip -DestinationPath ./py310
           $content=Get-Content "./py310/python310._pth"; $content | ForEach-Object {if ($_.ReadCount -eq 3) {"Lib\\site-packages"} else {$_}} | Set-Content ./py310/python310._pth

CURRENT_CHANGE.md

@@ -1,14 +1,35 @@
 ## Changes
 
-- add torch-2.7.1+cu128 precompiled kernels
-![image](https://github.com/user-attachments/assets/aa1703ec-da0e-4e3f-820c-9253f4b9bf15)
-- hide unnecessary pop-up consoles on windows
-- The linux binary files released in github releases now depend on libwebkit2gtk-4.1 to support Ubuntu 24.04. This means that versions below Ubuntu 20.04 will no longer be supported for running, and users will have to build it on their own. Additionally, Windows 7 is still supported, but you need to install the KB2999226 patch.
-- add quick think support
-![Image](https://github.com/user-attachments/assets/ecf66622-0765-42c9-b8a0-633c30329349)
-- fix the issue where the line breaks in the thinking content did not take effect
-- update manifest.json and defaultModelConfigs
-- bump go-webview2
+### Llama.cpp support
+
+- Add llama.cpp support with pre-compiled Vulkan libraries for Windows that should work out-of-the-box with any modern GPU. Mac and Linux users still need to manually install llama-cpp-python. You can now use RWKV GGUF models as well as any other GGUF models such as DeepSeek, Qwen3, Gemma3, Phi4. You can select the llama.cpp tag in the Models page and download the required models with one click, or place downloaded GGUF models in the models directory for use.
+- <img src="https://github.com/user-attachments/assets/7ff56440-41cd-4ef2-8a63-b057061ddbf4" width="512"/>
+- The software's preset configs have been streamlined and now include some GGUF format presets. You can click the reset button to fetch the latest presets.
+- <img src="https://github.com/user-attachments/assets/b3203434-ccea-4043-8384-6cf412c37eb7" width="256"/>
+- The RWKV-Runner Python server in llama.cpp mode has been optimized. After loading the model to GPU, the server process only occupies approximately 200MB of memory on Windows platform.
+- When server users call the `/switch-model` API to load models, you only need to pass a file path ending with .gguf to the `model` field to use llama.cpp mode.
+
+### Features
+
+- llama.cpp support
+- <img src="https://github.com/user-attachments/assets/50de157f-16cb-4d86-bb25-a1f13e2a031f" width="512"/>
+- Add a setting to save the full rwkv-runner client state, rather than just storing necessary settings. This option is enabled by default. You can disable it and restart the software to restore the previous version's behavior
+- <img src="https://github.com/user-attachments/assets/4c8c7b13-8d62-4ff0-ab0d-d06c40d95f58" width="512"/>
+- add a share button to save your chat screenshot
+- <img src="https://github.com/user-attachments/assets/11533e20-836c-487f-b3ae-5cf7988f12bc" width="512"/>
+
+### Improvements
+- reduce peak memory usage when loading rwkv7 in cuda mode
+- increase the maximum value of the top_k API parameter to 100
+- remove language tags in Models page, as all new models support global languages
+- remove useless/disabled resources
+- other small improvements
+- You can run RWKV-Runner on Windows 7 by installing the patches from the link below. Note that you still need to install Python 3.8 and dependencies manually. https://github.com/josStorer/wails/releases/tag/v2.9.2x
+
+### Fixes
+- fix the issue of failing to load the state for RWKV7
+- Fix the abnormal behavior when passing a Tool Definition array. This is a frontend only parameter construction issue.
+- fix the issue where the model list did not refresh automatically after downloading the model when using a custom model path
 
 Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for
 WebView2, click Modify -> Repair to update your WebView2 runtime.
@@ -20,3 +41,4 @@ WebView2, click Modify -> Repair to update your WebView2 runtime.
 - Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
 - Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
 - Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
+- Windows 7 Patches: https://github.com/josStorer/wails/releases/tag/v2.9.2x