llama.cpp/docs
Reese Levine 21c021745d
ggml: Add initial WebGPU backend (#14521)
* Minimal setup of webgpu backend with dawn. Just prints out the adapter and segfaults

* Initialize webgpu device

* Making progress on setting up the backend

* Finish more boilerplate/utility functions

* Organize file and work on alloc buffer

* Add webgpu_context to prepare for actually running some shaders

* Work on memset and add shader loading

* Work on memset polyfill

* Implement set_tensor as webgpu WriteBuffer, remove host_buffer stubs since webgpu doesn't support it

* Implement get_tensor and buffer_clear

* Finish rest of setup

* Start work on compute graph

* Basic mat mul working

* Work on emscripten build

* Basic WebGPU backend instructions

* Use EMSCRIPTEN flag

* Work on passing ci, implement 4d tensor multiplication

* Pass thread safety test

* Implement permuting for mul_mat and cpy

* minor cleanups

* Address feedback

* Remove division by type size in cpy op

* Fix formatting and add github action workflows for vulkan and metal (m-series) webgpu backends

* Fix name

* Fix macos dawn prefix path
2025-07-16 18:18:51 +03:00
..
backend sycl: GGML_SYCL_DISABLE_OPT on by default for all Intel Devices (#13973) 2025-06-25 18:09:55 +02:00
development model : add SmolLM3 (#14581) 2025-07-08 18:07:01 +02:00
multimodal mtmd : rename llava directory to mtmd (#13311) 2025-05-05 16:02:55 +02:00
ops Docs: script to auto-generate ggml operations docs (#14598) 2025-07-10 23:29:01 +08:00
android.md repo : update links to new url (#11886) 2025-02-15 16:40:57 +02:00
build-s390x.md docs: update s390x documentation + add faq (#14389) 2025-06-26 12:41:41 +02:00
build.md ggml: Add initial WebGPU backend (#14521) 2025-07-16 18:18:51 +03:00
docker.md Add Vulkan images to docker.md (#14472) 2025-07-01 15:44:11 +02:00
function-calling.md docs : remove WIP since PR has been merged (#13912) 2025-06-15 08:06:37 +02:00
install.md docs : add "Quick start" section for new users (#13862) 2025-06-03 13:09:36 +02:00
llguidance.md llguidance build fixes for Windows (#11664) 2025-02-14 12:46:08 -08:00
multimodal.md docs : Update multimodal.md (#14122) 2025-06-13 15:17:53 +02:00
ops.md Docs: script to auto-generate ggml operations docs (#14598) 2025-07-10 23:29:01 +08:00