Technology
llama.cpp
Memory-conscious local language-model inference across CPU and GPU resources.
Project evidence
2 case studies using llama.cpp.
Software Engineer
Technology
Memory-conscious local language-model inference across CPU and GPU resources.
2 case studies using llama.cpp.