whisper.cpp/examples/bench.wasm
Georgi Gerganov 794b162a46
whisper : add integer quantization support (#540)
* whisper : add integer quantization support

* examples : add common-ggml + prepare to add "quantize" tool

* whisper : quantization tool ready

* whisper : fix F32 support

* whisper : try to fix shared lib linkage

* wasm : update quantized models to Q5

* bench.wasm : remove "medium" button

* bench.wasm : fix custom model button

* ggml : add Q5_0 and Q5_1 WASM SIMD

* wasm : add quantized models to all WASM examples

* wasm : bump DB version number to 2

* talk-llama : update example to latest llama.cpp

* node : increase test timeout to 10s

* readme : add information for model quantization

* wasm : add links to other examples
2023-04-30 18:51:57 +03:00
..
CMakeLists.txt whisper : add integer quantization support (#540) 2023-04-30 18:51:57 +03:00
README.md bench.wasm : same as "bench" but runs in the browser (#89) 2022-12-11 11:09:10 +02:00
emscripten.cpp bench.wasm : print system info 2023-01-15 11:34:03 +02:00
index-tmpl.html whisper : add integer quantization support (#540) 2023-04-30 18:51:57 +03:00

README.md

bench.wasm

Benchmark the performance of whisper.cpp in the browser using WebAssembly

Link: https://whisper.ggerganov.com/bench/

Terminal version: examples/bench

Build instructions

# build using Emscripten (v3.1.2)
git clone https://github.com/ggerganov/whisper.cpp
cd whisper.cpp
mkdir build-em && cd build-em
emcmake cmake ..
make -j

# copy the produced page to your HTTP path
cp bin/bench.wasm/*       /path/to/html/
cp bin/libbench.worker.js /path/to/html/