8000 updated lib docs and README.md · masmullin2000/llama_cpp-rs@0fa4fdb · GitHub
[go: up one dir, main page]

Skip to content

Commit 0fa4fdb

Browse files
committed
updated lib docs and README.md
1 parent 9c098a7 commit 0fa4fdb

File tree

2 files changed

+13
-1
lines changed

2 files changed

+13
-1
lines changed

README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,12 @@ for completion in completions {
4141
This repository hosts the high-level bindings (`crates/llama_cpp`) as well as automatically generated bindings to
4242
llama.cpp's low-level C API (`crates/llama_cpp_sys`). Contributions are welcome--just keep the UX clean!
4343

44+
## Building
45+
46+
Keep in mind that [llama.cpp](https://github.com/ggerganov/llama.cpp) is very computationally heavy, meaning standard
47+
debug builds (running just `cargo build`/`cargo run`) will suffer greatly from the lack of optimisations. Therefore, unless
48+
debugging is really necessary, it is highly recommended to build and run using Cargo's `--release` flag.
49+
4450
## License
4551

4652
MIT or Apache-2.0, at your option (the "Rust" license). See `LICENSE-MIT` and `LICENSE-APACHE`.

crates/llama_cpp/src/lib.rs

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@
4545
//! ## Dependencies
4646
//!
4747
//! This crate depends on (and builds atop) [`llama_cpp_sys`], and builds llama.cpp from source.
48-
//! You'll need `libclang`, `cmake`, and a C/C++ toolchain (`clang` is preferred) at the 9574 minimum.
48+
//! You'll need at least `libclang` and a C/C++ toolchain (`clang` is preferred).
4949
//! See [`llama_cpp_sys`] for more details.
5050
//!
5151
//! The bundled GGML and llama.cpp binaries are statically linked by default, and their logs
@@ -62,6 +62,12 @@
6262
//! While panics are considered less critical, **this crate should never panic**, and any
6363
//! panic should be considered a bug. We don't want your control flow!
6464
//!
65+
//! ## Building
66+
//!
67+
//! Keep in mind that [llama.cpp][llama.cpp] is very computationally heavy, meaning standard
68+
//! debug builds (running just `cargo build`/`cargo run`) will suffer greatly from the lack of optimisations. Therefore, unless
69+
//! debugging is really necessary, it is highly recommended to build and run using Cargo's `--release` flag.
70+
//!
6571
//! ## Minimum Stable Rust Version (MSRV) Policy
6672
//!
6773
//! This crates supports Rust 1.73.0 and above.

0 commit comments

Comments
 (0)
0