yang/CodeGeeX4
1
0
Fork 0
mirror of https://github.com/JasonYANG170/CodeGeeX4.git synced 2024-10-19 14:01:48 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
5fe6c27ade
CodeGeeX4/local_mode
History
shaobo 5fe6c27ade fix some errors for auto-completion
2024-07-16 18:55:27 +08:00
..
models fix some errors for auto-completion 2024-07-16 18:55:27 +08:00
protocols fix some errors for auto-completion 2024-07-16 18:55:27 +08:00
resources Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
services Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
main.py Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
README_zh.md Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
README.md Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00
requirements.txt Add 'local mode' tutorials 2024-07-11 23:07:02 +08:00

README.md

English | 中文

Local Mode

The new version of the CodeGeeX plugin supports offline mode, allowing the use of offline deployed models to complete automatic completion and simple conversation functions.

Usage Tutorial

1. Install Dependencies

cd local_mode
pip install -r requirements.txt

2. Run the Project

python main.py --model_name_or_path THUDM/codegeex4-all-9b --device cuda --bf16 true
>>> Running on local URL:  http://127.0.0.1:8080

3. Set API Address and Model Name

As shown in the figure below, after opening the plugin with the local mode, enter the API address and model name in the settings.

4. Start Using

Click 'Connect' to test, or click 'Ask CodeGeeX' to start using.

Demo