93935980f8
* metal : init * whisper : factor out graph builds * whisper : allocate encoder and decoder using ggml-alloc * whisper : ggml-alloc is now supported * whisper : CoreML support ggml-alloc * build : fix ggml-alloc * ios : update submodule * extra : update sync-ggml.sh script to also sync ggml-alloc * ci : see if this is causing the crash * whisper : refactor ggml-alloc init * whisper.android : try to fix build * whisper : initial Metal version * ci : try to debug vmem issue * metal : decoder works on GPU! * metal : add multi-decoder support * ggml : fix ggml_nbytes (probably temp solution) * metal : run "cross" step on the GPU * whisper : remove ggml_repeat in the encoder * whisper : offload the Encoder to Metal * ggml : use simpler ggml_bytes() implementation * ggml-alloc : try to make CI happy by reducing vram to 128GB * whisper : add whisper_allocr to wrap ggml_allocr * whisper : factor out alloc init in a function * cmake : update to support Metal build * whisper : add <functional> header * objc : fix build (no Metal yet) * ios : add Metal support * swiftui : fix build * metal : speed-up KQ multiplication * metal : sync latest llama.cpp kernels * readme : add Metal info * ios : update submodule * coreml : add code to toggle Core ML config (CPU, ANE, GPU) * bench : fix timings by running a pre-heat * bench : start benching the decoder * whisper : add ggml_mul_mat_pad * bench : fix uninitialized vars * whisper : add comment for disabling mul-mat padding * whisper : add description of ggml_mul_mat_pad * whisper : clean-up ggml_mul_mat_pad * metal : remove the "concurrent" flag * bench : variable n_past * ios : update SPM package
24 lines
1.1 KiB
Bash
Executable file
24 lines
1.1 KiB
Bash
Executable file
#!/bin/bash
|
|
|
|
cp -rpv ../ggml/src/ggml.c ./ggml.c
|
|
cp -rpv ../ggml/src/ggml-alloc.c ./ggml-alloc.c
|
|
cp -rpv ../ggml/src/ggml-cuda.h ./ggml-cuda.h
|
|
cp -rpv ../ggml/src/ggml-cuda.cu ./ggml-cuda.cu
|
|
cp -rpv ../ggml/src/ggml-opencl.h ./ggml-opencl.h
|
|
cp -rpv ../ggml/src/ggml-opencl.cpp ./ggml-opencl.cpp
|
|
cp -rpv ../ggml/src/ggml-metal.h ./ggml-metal.h
|
|
cp -rpv ../ggml/src/ggml-metal.m ./ggml-metal.m
|
|
cp -rpv ../ggml/src/ggml-metal.metal ./ggml-metal.metal
|
|
cp -rpv ../ggml/include/ggml/ggml.h ./ggml.h
|
|
cp -rpv ../ggml/include/ggml/ggml-alloc.h ./ggml-alloc.h
|
|
cp -rpv ../ggml/examples/common.h ./examples/common.h
|
|
cp -rpv ../ggml/examples/common.cpp ./examples/common.cpp
|
|
cp -rpv ../ggml/examples/common-ggml.h ./examples/common-ggml.h
|
|
cp -rpv ../ggml/examples/common-ggml.cpp ./examples/common-ggml.cpp
|
|
|
|
cp -rpv ../ggml/examples/whisper/whisper.h ./whisper.h
|
|
cp -rpv ../ggml/examples/whisper/whisper.cpp ./whisper.cpp
|
|
cp -rpv ../ggml/examples/whisper/main.cpp ./examples/main/main.cpp
|
|
cp -rpv ../ggml/examples/whisper/quantize.cpp ./examples/quantize/quantize.cpp
|
|
|