whisper.cpp/examples/addon.node
Georgi Gerganov 794b162a46
whisper : add integer quantization support (#540)
* whisper : add integer quantization support

* examples : add common-ggml + prepare to add "quantize" tool

* whisper : quantization tool ready

* whisper : fix F32 support

* whisper : try to fix shared lib linkage

* wasm : update quantized models to Q5

* bench.wasm : remove "medium" button

* bench.wasm : fix custom model button

* ggml : add Q5_0 and Q5_1 WASM SIMD

* wasm : add quantized models to all WASM examples

* wasm : bump DB version number to 2

* talk-llama : update example to latest llama.cpp

* node : increase test timeout to 10s

* readme : add information for model quantization

* wasm : add links to other examples
2023-04-30 18:51:57 +03:00
..
__test__ whisper : add integer quantization support (#540) 2023-04-30 18:51:57 +03:00
.gitignore addon.node : using whisper as a Node.js addon (#443) 2023-02-04 09:10:25 +02:00
addon.cpp whisper : add initial_prompt param (#645) 2023-03-29 23:23:23 +03:00
CMakeLists.txt examples : refactor in order to reuse code and reduce duplication (#482) 2023-02-15 19:28:10 +02:00
index.js Nodejs Addon blocking main thread. Implemented Napi::AsyncWorker (#642) 2023-03-22 22:19:22 +02:00
package.json ci : add node addon test and optimize compilation configuration (#468) 2023-02-05 15:02:08 +02:00
README.md ci : add node addon test and optimize compilation configuration (#468) 2023-02-05 15:02:08 +02:00

addon

This is an addon demo that can perform whisper model reasoning in node and electron environments, based on cmake-js. It can be used as a reference for using the whisper.cpp project in other node projects.

Install

npm install

Compile

Make sure it is in the project root directory and compiled with make-js.

npx cmake-js compile -T whisper-addon -B Release

For Electron addon and cmake-js options, you can see cmake-js and make very few configuration changes.

Such as appointing special cmake path:

npx cmake-js compile -c 'xxx/cmake' -T whisper-addon -B Release

Run

cd examples/addon.node

node index.js --language='language' --model='model-path' --fname_inp='file-path'

Because this is a simple Demo, only the above parameters are set in the node environment.

Other parameters can also be specified in the node environment.