Releases: josStorer/RWKV-Runner
Releases · josStorer/RWKV-Runner
v1.7.6
Changes
Features
- make gate and out trainable (JL-er/RWKV-PEFT@834aea0)
- new chat template for /chat/completions api (better system support)
- add system role support for preset
- proxied fetch support (for custom api url)
Improvements
- improve preset editor
- better compatibility for custom api (ollama etc.)
- throttling saveConfigs
- improve error messages
- other details
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.7.5
Changes
Fixes
- fix v6 lora (JL-er/RWKV-PEFT@c03cdbb)
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.7.4
Changes
Features
- rwkv6 lora finetune support (https://github.com/JL-er/RWKV-LORA)
- latex support
Improvements
- improve markdown rendering
- improve theme
- improve usability
- for Chinese users, replace Tsinghua pip mirrors with Alibaba Cloud to avoid 403 http error
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.7.3
Changes
Features
- add Docker support (#291) @LonghronShen
Fixes
- fix a generation exception caused by potentially dangerous regex being passed into the stop array
- fix max_tokens parameter of Chat page not being passed to backend
- fix the issue where penalty_decay and global_penalty are not being passed to the backend default config when running the model through client
Improvements
- prevent 'torch' has no attribute 'cuda' error in torch_gc, so user can use CPU or WebGPU (#302)
Chores
- bump dependencies
- add pre-release workflow
- dep_check.py now ignores GPUtil
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
Contributors
LonghronShen
Assets 6
v1.7.2
Changes
Features
- allow setting tokenChunkSize of WebGPU mode
- expose global_penalty
Improvements
- improve parameters controllable range
Chores
- update defaultModelConfigs
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.7.1
Changes
This version includes important bug fixes, it is strongly recommended to upgrade to this version.
Upgrades
- webgpu 0.3.20 https://github.com/cgisky1980/ai00_rwkv_server
Features
- allow setting quantizedLayers of WebGPU mode
Improvements
- improve occurrence[token] condition
- disable AVOID_PENALTY_TOKENS when generating (still enabled when preprocessing)
- enable useHfMirror by default for chinese users
Fixes
- fix the issue where state cache could be modified leading to inconsistent hit results
- fix convert_safetensors.py for rwkv6
- add python3-dev to lora fine-tune dependencies (this may previously lead to the error of v5 fine-tune)
Chores
- hide MPS and CUDA-Beta Options
- update manifest
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.7.0
Changes
Upgrades
- rwkv 0.8.25 (fix v6 fp16i8)
Fixes
- fix /update-config can make the default value of unclearly specified fields invalid by passing in None fields
Chores
- change AVOID_PENALTY to \n only
- chores
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.9
Changes
Upgrades
- web-rwkv-py 0.1.2 (Support V4, V5 and V6) https://github.com/cryscan/web-rwkv-py
- webgpu 0.3.13 https://github.com/cgisky1980/ai00_rwkv_server
Features
- add markdown renderer switch
- allow loading conversation
- allow setting history message number
- expose penalty_decay, top_k
- add AVOID_PENALTY_TOKENS
- add parse_api_log.py, this script can extract
formatted data from api.log
Improvements
- improve macos experience
- improve fine-tune performance
- add better custom tokenizer support and tokenizer-midipiano.json
- improve path processing
- add EOS state cache point
- reduce package size
Fixes
- fix WSL2 WindowsOptionalFeature: Microsoft-Windows-Subsystem-Linux -> VirtualMachinePlatform
- fix finetune errorsMap ($modelInfo)
Chores
- update defaultPresets
- update defaultModelConfigs
- rename manifest tag "Main" -> "Official"
- update manifest.json
- update Related Repositories
- other minor changes
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.8
Changes
- abc music inference support
- basic abc frontend support
- fix finetune errorsMap ($modelInfo)
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.7
Changes
- rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)
- improve memory usage and speed of convert_safetensors.py
- webgpu(python) state cache support
- improve state cache performance (especially for rwkv.cpp)
- chore
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples