21e8c67a4f
Fix AVX etc. under GCC/CMake ( #1174 )
2023-08-19 21:39:03 +03:00
a792c4079c
cmake : fix MSVC compile error C3688 ( #1136 )
...
Instead of simply using 'add_compile_options(/utf-8)' to address the MSVC compile error C3688, a better approach would be to handle it in a way that prevents passing '/utf-8' to NVCC.
2023-07-26 18:57:25 +03:00
7b374c9ac9
Revert "cmake : fix MSVC compile error C3688 on non-unicode Windows ( #1110 )"
...
This reverts commit fe5c1a7341
2023-07-26 10:25:09 +03:00
a195bf899a
cmake : enable OpenBLAS on Windows ( #1128 )
...
Fixed the issue of not being able to find OpenBLAS on the Windows platform. Even though the name of the previously released binary file was whisper-blas-bin-x64.zip, BLAS was actually not enabled. After enabling, the inference speed can increase by 3-4 times.
2023-07-25 19:15:08 +03:00
fe5c1a7341
cmake : fix MSVC compile error C3688 on non-unicode Windows ( #1110 )
...
Co-authored-by: Gang Chen <cg@upiot.net>
2023-07-25 19:08:37 +03:00
3998465721
ci : more platforms coverage ( #1101 )
...
* add multi platform
* add image name
* fix
* fix /bin/sh path
* add missing \
* add all platforms for check
* remove platforms
* remove s390x
* - add arm v6
- format run cmd
* remove arm v6
* - bump checkout to v3
- use setup emsdk action
- add arch to all ubuntu jobs
* mymindstorm/setup-emsdk to v12
* add missing QEMU step
* add fail-fast: false for debug
* add freebsd
* remark all jobs except freebsd for test
* add sudo
* enable all tests again
* format
* check __AVX__ support before include immintrin.h
* try auto detect flag by cmake
* fix check for immintrin.h
* fix include check for immintrin.h
* Remove all platforms for sanitizer build except amd64
We have no clue why they failed.
---------
Co-authored-by: Alon Faraj <alon.faraj@mapcore.com>
2023-07-16 23:00:34 +03:00
62b81276e0
whisper : add OpenVINO support ( #1037 )
...
* openvino: use OpenVINO encoder inference
* openvino: add python script for OpenVINO model generation
* whisper: Fix 'unused' warnings when OpenVINO isn't enabled in build
* Apply suggestions from code review
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* whisper: Fix compilation error
* whisper: revert whisper_get_openvino_path_encoder & whisper_get_openvino_path_cache to non-const func signatures
* cmake: Add openvino-encoder as separate object target
* whisper : minor style fixes
* minor : indentation fixes
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-07-04 15:56:11 +03:00
6c25fae1c4
opencl : sync latest ggml-opencl
2023-06-25 15:38:30 +03:00
041be06d58
cmake : build with any BLAS compatible library ( #927 )
...
* Build with any BLAS library
* ci: Removed explicit CUDA nvcc path
2023-05-20 21:23:45 +03:00
a5defbc1b9
release : v1.4.2
2023-05-14 19:06:45 +03:00
bf2449dfae
cmake : fix define used for COREML_ALLOW_FALLBACK ( #893 )
2023-05-08 21:08:09 +03:00
1a548c048e
cmake : fix options disabling AVX and AVX2 flags ( #885 )
2023-05-08 20:45:53 +03:00
14bee39b29
cmake : add options to disable CPU flags ( #860 )
2023-05-04 19:31:04 +03:00
d458fcbc15
ci : add cuBLAS build workflow and fix error causing lines in CMakeLists ( #867 )
...
* Add windows build with cuBLAS
* Remove error causing lines for cuBLAS on Windows
2023-05-03 23:47:37 +03:00
05bef0f0e9
build : CLBlast support as in llama.cpp ( #862 )
...
* ggml : CLBlast support as in llama.cpp
Building with CLBlast speeds up whisper.cpp ~2x on low end / older AMD APUs (CPU with integrated GPU) such as the A9.
Usage:
WHISPER_CLBLAST=1 make
* CMake/Makefile : CLBlast support as in llama.cpp
Building with CLBlast speeds up whisper.cpp ~2x on low end / older AMD APUs (CPU with integrated GPU) such as the A9.
Usage:
```
Makefile:
cd whisper.cpp
WHISPER_CLBLAST=1 make
CMake:
cd whisper.cpp ; mkdir build ; cd build
cmake -DWHISPER_CLBLAST=ON ..
make
```
2023-05-02 22:50:32 +03:00
9c61f5f585
release : v1.4.1
2023-04-30 22:57:42 +03:00
fa8dbdc888
release : v1.4.0
2023-04-30 19:23:37 +03:00
794b162a46
whisper : add integer quantization support ( #540 )
...
* whisper : add integer quantization support
* examples : add common-ggml + prepare to add "quantize" tool
* whisper : quantization tool ready
* whisper : fix F32 support
* whisper : try to fix shared lib linkage
* wasm : update quantized models to Q5
* bench.wasm : remove "medium" button
* bench.wasm : fix custom model button
* ggml : add Q5_0 and Q5_1 WASM SIMD
* wasm : add quantized models to all WASM examples
* wasm : bump DB version number to 2
* talk-llama : update example to latest llama.cpp
* node : increase test timeout to 10s
* readme : add information for model quantization
* wasm : add links to other examples
2023-04-30 18:51:57 +03:00
5fd1bdd7fc
whisper : add GPU support via cuBLAS ( #834 )
...
* make : add WHISPER_CUBLAS
* make : fix CUBLAS build
* whisper : disable Flash Attention + adjust memory buffers
* whisper : remove old commented code
* readme : add cuBLAS instructions
* cmake : add WHISPER_CUBLAS option
* gitignore : ignore build-cublas
2023-04-30 12:14:33 +03:00
3efb81dec6
build : add WHISPER_COREML_ALLOW_FALLBACK to make / CMake ( #812 )
2023-04-29 10:55:24 +03:00
c23588cc4b
release : v1.3.0
2023-04-15 17:30:44 +03:00
5e47e223bd
whisper : add Core ML support ( #566 )
...
* coreml : use Core ML encoder inference
* coreml : simlpify whisper_encode + log messages
* whisper : resolve rebase conflicts
* coreml : add scripts for CoreML model generation
* bench-all : recognize COREML flag
2023-04-15 13:21:27 +03:00
61128870b8
cmake : add msvc compiler args /utf-8 fix error C3688 ( #721 )
...
* force msvc compiler use utf-8 encode
* only enable on msvc
2023-04-14 19:36:38 +03:00
fc49c44426
cmake : add a flag to disable F16C ( #628 )
2023-03-22 22:30:40 +02:00
ad1389003d
release : v1.2.1
2023-02-28 22:29:12 +02:00
113fcec513
cmake : install whisper.h header ( #485 )
...
Including the header file in the install bundle helps projects that ship binaries.
2023-02-11 09:13:32 +02:00
ab1916fc59
ci : add node addon test and optimize compilation configuration ( #468 )
...
* addon: implement node addon call whisper through cpp
* addon: modify the license to MIT
* addon: remove iostream
* addon: rename dir
* addon: fix typo
* addon: configure cmake to build when cmake-js is used
* ci: add addon.node test ci
* addon: remove build WHISPER_BUILD_TESTS
* addon: update build command
* addon: add test
* addon: add test file
* addon: adapt to compile on Windows
* addon: fix typo
* addon: reuse jfk.wav
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* addon: reuse jfk.wav
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-02-05 15:02:08 +02:00
b2083c5d02
release : v1.2.0
2023-02-04 09:49:49 +02:00
2c3f50a021
release : v1.1.1
2023-01-23 20:23:44 +02:00
8738427dd6
cmake : bump version to 1.1.0
2023-01-15 14:33:13 +02:00
44efbf7ff1
cmake : add -Wno-unused-function + update whisper.js
2023-01-07 20:18:34 +02:00
41e05c6b1b
cmake : support AVX2 in Windows better ( #381 )
2023-01-06 19:36:33 +02:00
fa379cb22a
Revert "tmp"
...
This reverts commit 1652965529
2023-01-06 19:33:09 +02:00
322f4e6c4e
go : bindings updated so they can be used in third party packages. ( #379 )
...
* Updated bindings so they can be used in third pary packages.
* Updated makefiles to set FMA flag on optionally, for xeon E5 on Darwin
2023-01-06 19:32:28 +02:00
1652965529
tmp
2023-01-06 19:32:12 +02:00
6042c7a3be
cmake : change min required version to 3.0 ( #351 )
...
We increase the min version only when want to use particular
functionality that is available in the newer version
2023-01-06 19:25:28 +02:00
4a214d2f07
cmake : add CMAKE_RUNTIME_OUTPUT_DIRECTORY
...
Currently needed by the wasm examples
2023-01-05 21:40:59 +02:00
84c6b42e65
cmake : update to 3.19 ( #351 )
...
- update from 3.0 (from 2014) to 3.19 (from 2020)
- move some global setting onto the targets (through a cmake include)
2023-01-05 21:22:48 +02:00
a091581eb3
cmake : add runtime destination install ( #345 )
...
needed for mingw32 build to successfully install the dlls in the correct location
2022-12-31 09:48:00 +02:00
76b6211f9b
cmake : add headers to target ( #298 )
...
This will show the header files in IDEs.
2022-12-22 16:34:47 +02:00
99da1e5cc8
cmake : enable and fix -Wall -Wextra -Wpedantic C++ warnings
2022-12-19 20:45:08 +02:00
1d716d6e34
release : v1.0.4
2022-12-17 19:52:42 +02:00
930c693989
release : v1.0.3
...
Fixed whisper.spm tests
2022-12-12 20:36:52 +02:00
9e3e6f253a
release : v1.0.2
2022-12-12 20:29:30 +02:00
f309f97df6
Node.js package ( #260 )
...
* npm : preparing infra for node package
* npm : package infra ready
* npm : initial version ready
* npm : change name to whisper.cpp
whisper.js is taken
2022-12-12 20:17:27 +02:00
37a93d2459
cmake : require c++11 instead of c++20
2022-12-11 20:04:05 +02:00
2f596f5b33
Find libopenblas.dll.a on windows
...
"lib" is needed for windows.
With this change, you can build whisper.cpp with OpenBLAS's prebuilt DLL.
1. extract a zip from https://github.com/xianyi/OpenBLAS/releases
2. copy the headers in (openblas)/include to the root directory of whisper.cpp
3. invoke cmake with -DCMAKE_LIBRARY_PATH=(openblas)\lib -DWHISPER_SUPPORT_OPENBLAS=ON
4. copy (openblas)/bin/libopenblas.dll to the same directory of whisper.dll after msbuild
https://github.com/ggerganov/whisper.cpp/issues/89#issuecomment-1324391258
2022-11-23 08:26:45 +02:00
a728be9cdb
Add WHISPER_NO_AVX and WHISPER_NO_AVX2 to CMakeLists ( #136 )
...
* Check for AVX and AVX2 on Darwin
* Add AVX options to CMakeLists
2022-11-11 18:10:01 +02:00
0bfe728b84
Fix the Windows pthread_create shim
...
The current implementation doesn't actually set the out parameter,
and it returns 0 on failure instead of on success.
2022-11-08 15:02:32 +02:00
4c66b6a828
cmake : add submodule whisper.spm
2022-11-07 20:50:24 +02:00
Marcin Mielniczuk
bobqianic
Georgi Gerganov
Gang Chen
alonfaraj
Ryan Metcalfe
Alexey Kharlamov
Jonathan Soo
ZaBlazzingZephyrus
RelatedTitle
Vulcan
LittleLoli
Andrew Huynh
Avik Sengupta
Qianhe Chen
m.bell
David Thorpe
Andy Maloney
Tamotsu Takahashi
Chidi Williams
boolemancer