Releases: josStorer/RWKV-Runner
Releases · josStorer/RWKV-Runner
v1.5.6
Changes (v1.5.6 is a patch for v1.5.5)
- MIDI Input Audio Tracks (Experimental, playing tracks is not supported yet, please save to generation area to preview)
- fix autoPlayed midi cannot be stopped
- try to use local soundfont by default
- improve details
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
MIDI Input Audio Tracks
v1.5.5
Changes
- MIDI Input Audio Tracks (Experimental, playing tracks is not supported yet, please save to generation area to preview)
- fix autoPlayed midi cannot be stopped
- try to use local soundfont by default
- improve details
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
MIDI Input Audio Tracks
v1.5.4
Changes
- upgrade to rwkv 0.8.22 (rwkv6 support)
- allow reading attachments even if the model is offline
- improve launch flow of webgpu mode
- allow safetensors converter on macOS
- fix fs watcher of macOS
- update defaultConfigs
- update manifest
- chores
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.5.3
Changes
- add webgpu nf4
- add sidePanel for Chat page
- add hf-mirror for cn users
- use local API when it's working, even if a custom API URL is provided
- add rwkv API URL Option
- macos: change default webgpu backend to aarch64-apple-darwin and fix the permission issue
- strict default_stop
- fix state_cache of deploy mode
- fix a finetune bug
- improve lazy loading ui
- display lastModelName at the top (WorkHeader)
- chores
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.5.2
Changes
Improvements
- improve mobile webview
- add client upgrade progress
- improve user guide
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.5.1
Changes
Features
- add webUI for easier service sharing (enable it in Configs page or --webui command line parameter, compile it with
make build-web
) - add deployment mode. If
/switch-model
withdeploy: true
, will disable /switch-model, /exit and other dangerous APIs (state cache APIs, part of midi APIs)
Chores
- print error.txt to console when script fails
- api url getter
Fixes
- set deepspeed to 0.11.2 to avoid finetune error
- fix
/docs
default api params (Pydantic v2)
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.5.0
Changes
Features
- chat attachment is now related to single message (Experimental)
- port occupied detection
Upgrades
- upgrade to rwkv 0.8.20
Improvements
- improve the compatibility between frontend presets and chatgpt api
- improve memory usage of state cache
Chores
- update ngrok_connect
- python38 compatibility
- adjust startup process
Fixes
- fix log encoding error
- fix stop button status of Chat page
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.4.9
Changes
Features
- allow conversation with some document (.pdf, .txt) (Experimental)
- add
/file-to-text
api - allow avatarImg to be local absolute path
- base64 preset support
Upgrades
- upgrade to rwkv 0.8.16 (DirectML support; rwkv 5.2 no longer needs to ensure custom cuda kernel enabled)
- upgrade to webgpu 0.2.2 (WebGPU Mode is now recommended for AMD and Intel Users) (https://github.com/josStorer/ai00_rwkv_server)
- upgrade python packages
Improvements
- improve cuda kernel compatibility (compute compatibility 5.3, Jetson Nano, MX Series, Nvidia 10 Series+)
- RWKVType now no longer relies on the file name (use emb)
- improve message interruption and retry for Chat page
- update sample.jsonl of LoRA finetune
- update api stop strategy for better custom user_name and assistant_name support
- edited chat message now is marked as Normal
- change default World series prefix to User/Assistant
Chores
- update manifest.json (RWKV-5)
- update readme and client text description
- add pip --no-warn-script-location
- mark rwkv raven series as old model
- chore
Fixes
- fix linux kernel (partial revert 68228a4)
- fix the
make
command on Linux and macOS, no longer need manual operations on the wsl.go file. (#158, #173, #207)
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.4.8
Changes
- latest rwkv-5.2 is now supported (with pre-compiled kernel for windows)
- completion page: add format content button
- chore
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.4.7
Changes
- custom tokenizer .txt support
- add pre-compiled beta cuda kernel (rwkv-beta==0.8.5, 40%+ faster for fp16) (thanks to #180, pre-compiled kernel of RTX 40 Series will be included later)
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples