8000 Add support for batch size to `--perplexity` by glinscott · Pull Request #407 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]
Skip to content

Add support for batch size to --perplexity #407

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Apr 13, 2023
Merged

Add support for batch size to --perplexity #407

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
9ea43d4
Add support to batch size for perplexity
glinscott Mar 22, 2023
9179d08
Merge remote-tracking branch 'origin/master' into batch_perplexity
glinscott Mar 24, 2023
57dc4dc
Revert "Fix memory allocation issues and seg faults"
glinscott Mar 24, 2023
c3d3cd2
Merge branch 'master' into batch_perplexity
glinscott Mar 25, 2023
7392ad6
update from merge
glinscott Mar 25, 2023
4352322
Remove perplexity from main
glinscott Mar 25, 2023
a17e745
Merge branch 'master' into batch_perplexity
glinscott Apr 3, 2023
864dcb2
updates
glinscott Apr 3, 2023
fbcecd5
Merge remote-tracking branch 'origin/master' into batch_perplexity
glinscott Apr 13, 2023
23fd782
Update batch size for efficiency
glinscott Apr 13, 2023
File filter
8000

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/master' into batch_perplexity
  • Loading branch information
@glinscott
glinscott committed Mar 24, 2023
commit 9179d089a25afcdc95e21e062d7f00bc536f98a3

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.
< 305E /div>
0