awq-py : fix typo in awq-py/README.md (#4947)
This commit is contained in:
parent
ddb008d845
commit
d9aa4ffa6e
|
@ -43,7 +43,7 @@ Example for llama model
|
||||||
# For llama7b and llama2 models
|
# For llama7b and llama2 models
|
||||||
python convert.py models/llama-7b/ --awq-path awq_cache/llama-7b-w4-g128.pt --outfile models/llama_7b_fp16.gguf
|
python convert.py models/llama-7b/ --awq-path awq_cache/llama-7b-w4-g128.pt --outfile models/llama_7b_fp16.gguf
|
||||||
# For mistral and mpt models
|
# For mistral and mpt models
|
||||||
python convert-hf-to-gguf.py models/mpt-7b/ --awq-path awq_cache/llama-7b-w4-g128.pt --outfile models/mpt_7b_fp16.gguf
|
python convert-hf-to-gguf.py models/mpt-7b/ --awq-path awq_cache/mpt-7b-w4-g128.pt --outfile models/mpt_7b_fp16.gguf
|
||||||
```
|
```
|
||||||
|
|
||||||
## Quantize
|
## Quantize
|
||||||
|
|
Loading…
Reference in a new issue