10000 cuda : fix device sync on buffer clear by slaren · Pull Request #14033 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]
Skip to content

cuda : fix device sync on buffer clear #14033

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 9, 2025
Merged

cuda : fix device sync on buffer clear #14033

merged 1 commit into from
Jun 9, 2025

Conversation

slaren
Copy link
Member
@slaren slaren commented Jun 5, 2025 •
edited
Loading

The call to cudaDeviceSynchronize may cause CUDA graph stream capture in other threads to fail.

@slaren slaren mentioned this pull request Jun 5, 2025
Open
@github-actions github-actions bot added Nvidia GPU Issues specific to Nvidia GPUs ggml changes relating to the ggml tensor library for machine learning labels Jun 5, 2025
@slaren slaren merged commit 8f47e25 into master Jun 9, 2025
45 checks passed
@slaren slaren deleted the sl/fix-cuda-clear-sync branch June 9, 2025 14:36
@slaren slaren mentioned this pull request Jun 9, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ericcurtin ericcurtin ericcurtin approved these changes

@JohannesGaessler JohannesGaessler JohannesGaessler approved these changes

Assignees
No one assigned
Labels
ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@slaren @ericcurtin @JohannesGaessler
0