N
Hacker Next
new
past
show
ask
show
jobs
submit
login
▲
Rai: CPU-only LLM inference engine in pure Rust
(
github.com
)
4 points by
simonpure
17 hours ago
|
1 comment
add comment
Rendered at 10:18:36 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
ronsor 12 hours ago
[-]
Other than being in Rust, how does this compare to a CPU-only build of llama.cpp, which is both easy and already well-supported?