[AI] serge docker runs LLM - 效率很低

Summary

• https://mariushosting.com/how-to-install-serge-on-your-synology-nas/

安装过程

cd ~/tmp_qh/data/
export DOCKER_PROJ=serge
# export DOCKER_PROJ_DOMAIN=$DOCKER_PROJ.xxx.xxx

mkdir $DOCKER_PROJ && cd $DOCKER_PROJ
mkdir db weights

# proxy_on

docker run -d --name=serge \
-p 14622:8008 \
-v ./db:/data/db/ \
-v ./weights:/usr/src/app/weights \
--restart always \
ghcr.io/serge-chat/serge:latest

http://127.0.0.1:14622

截图