yang/CodeGeeX4
1
0
Fork 0
mirror of https://github.com/JasonYANG170/CodeGeeX4.git synced 2024-11-27 06:06:33 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
d624f752c2
CodeGeeX4/local_mode
History
shaobo feaa9d6b23 fix an index error
2024-07-11 23:27:15 +08:00
..
models fix an index error 2024-07-11 23:27:15 +08:00
protocols Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
resources Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
services Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
main.py Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
README_zh.md Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
README.md Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
requirements.txt Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00

README.md

English | 中文

Local Mode

The new version of the CodeGeeX plugin supports offline mode, allowing the use of offline deployed models to complete automatic completion and simple conversation functions.

Usage Tutorial

1. Install Dependencies

cd local_mode
pip install -r requirements.txt

2. Run the Project

python main.py --model_name_or_path THUDM/codegeex4-all-9b --device cuda --bf16 true
>>> Running on local URL:  http://127.0.0.1:8080

3. Set API Address and Model Name

As shown in the figure below, after opening the plugin with the local mode, enter the API address and model name in the settings.

4. Start Using

Click 'Connect' to test, or click 'Ask CodeGeeX' to start using.

Demo