8000 Release b5544 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]
Skip to content

b5544
Compare
Choose a tag to compare
@github-actions github-actions released this 30 May 16:46
b5544
b49a8ff
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode. 
SYCL: Add mrope kernel (#13755)

* SYCL: Add mrope kernel

* feat: Optimize rope operations with vectorization

Uses `sycl::vec` to load and store two elements at a time,
significantly improving performance in `rope_norm`,
`rope_neox`, and `rope_multi`. This reduces the number of memory
accesses and leverages SIMD instructions for faster execution.

* Use ceil_div
Assets 18
Loading
0