8daa534818
Refactor validation and enumeration platform checks into functions to clean up ggml_vk_instance_init()
2024-02-22 15:12:36 +02:00
9fca69b410
Add check for VK_KHR_portability_enumeration for MoltenVK support
2024-02-22 15:12:36 +02:00
b26c645420
Add preprocessor checks for Apple devices.
...
Based on work by @rbourgeat in https://github.com/ggerganov/llama.cpp/pull/5322/files
2024-02-22 15:12:36 +02:00
1879ec556e
Resolve ErrorIncompatibleDriver with Vulkan on MacOS.
...
Refs:
- https://chat.openai.com/share/7020ce72-65fc-45ec-b7be-9d9d798a5f3f
- https://github.com/SaschaWillems/Vulkan/issues/954
- https://github.com/haasn/libplacebo/issues/128
- https://github.com/KhronosGroup/Vulkan-Samples/issues/476
2024-02-22 15:12:35 +02:00
74a6acc999
cmake : fix VULKAN and ROCm builds (llama/5525)
...
* cmake : fix VULKAN and ROCm builds
* cmake : fix (cont)
* vulkan : fix compile warnings
ggml-ci
* cmake : fix
ggml-ci
* cmake : minor
ggml-ci
2024-02-19 15:53:23 +02:00
a38efcb9fd
vulkan: Find optimal memory type but with fallback (llama/5381)
...
* @0cc4m feedback
* More feedback @0cc4m
2024-02-19 15:53:22 +02:00
04839bae22
vulkan: only use M-sized matmul on Apple GPUs (llama/5412)
...
* vulkan: refactor guess_matmul_pipeline for vendor
Refactor ggml_vk_guess_matmul_pipeline to simplify adding per-vendor
conditionals.
Signed-off-by: Sergio Lopez <slp@redhat.com>
* vulkan: only use M-sized matmul on Apple GPUs
L-sized and S-sized matmuls are broken on Apple GPUs, force using
M-size with this vendor.
Signed-off-by: Sergio Lopez <slp@redhat.com>
---------
Signed-off-by: Sergio Lopez <slp@redhat.com>
2024-02-12 09:31:12 +02:00
8b17a2f776
src : relocate new backend sources
2024-02-10 09:55:47 +02:00
0cc4m
Mathijs de Bruin
Georgi Gerganov
Neuman Vong
Sergio López