Worked Described
Modern Rust and llama.cpp on 20-year-old PowerPC Macs
The current Rust compiler and llama.cpp ported to run on Mac OS X Tiger and Leopard.
—
Credits
- HN submitter AutoJanitor Source ↗
Earliest dated source:
The full story
This project claims several world-first ports to 20-year-old PowerPC Macs: a modern Rust compiler (borrow checker, async, AltiVec) on Mac OS X Tiger, and llama.cpp running language models on Tiger and Leopard at 1 to 5 tokens per second on real G4 and G5 machines. It also runs llama.cpp on IBM POWER8 at 85+ tokens per second and bundles 59 tools for vintage Macs. The post also promotes a related cryptocurrency.
How it was done
Tools
Themes
Loading themes…
Sources
From a short post by the maker, so the details are as they tell them.
- Hacker News: Modern Rust and llama.cpp running on 20-year-old PowerPC Macs (Tiger/Leopard)HN submitter: AutoJanitorPosted
The post listing the ports.