8000 Add install instructions for llama-cpp-python. by Vaibhavs10 · Pull Request #1520 · huggingface/huggingface.js · GitHub
[go: up one dir, main page]
Skip to content

Add install instructions for llama-cpp-python. #1520

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 5 commits into from
Jun 10, 2025
Merged

Add install instructions for llama-cpp-python. #1520

merged 5 commits into from
Jun 10, 2025

Conversation

Vaibhavs10
Copy link
Member

for better colab experience

@pcuenca
Copy link
Member
pcuenca commented Jun 9, 2025

Nice! Do you have any model examples that are transferred properly to Colab? In my tests, I get the default error snippet because library_name is not set for them. Example: https://huggingface.co/bartowski/Llama-3.2-3B-Instruct-GGUF/colab

Vaibhavs10
Vaibhavs10 commented Jun 9, 2025
View reviewed changes
Copy link
Member Author
@Vaibhavs10 Vaibhavs10 left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, this is just to make the snippet more complete.

re: colab we'll use something like this: https://github.com/huggingface-internal/moon-landing/pull/14031/files (internal PR)

@pcuenca
Copy link
Member
pcuenca commented Jun 9, 2025

Ah cool, that's what I had missed, thanks!

Wauplin
Wauplin approved these changes Jun 10, 2025
View reviewed changes
Copy link
Contributor
@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM :)

@Wauplin
Copy link
Contributor
Wauplin commented Jun 10, 2025

(failing CI is unrelated)

@Vaibhavs10 Vaibhavs10 merged commit a444bd0 into main Jun 10, 2025
4 of 5 checks passed
@Vaibhavs10 Vaibhavs10 deleted the vb/upd-l-cpp-python branch June 10, 2025 12:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@pcuenca pcuenca pcuenca approved these changes

@Wauplin Wauplin Wauplin approved these changes

@SBrandeis SBrandeis Awaiting requested review from SBrandeis SBrandeis is a code owner

@gary149 gary149 Awaiting requested 69AA review from gary149 gary149 is a code owner

@julien-c julien-c Awaiting requested review from julien-c julien-c is a code owner

@ngxson ngxson Awaiting requested review from ngxson ngxson is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Vaibhavs10 @pcuenca @Wauplin
0