GGML

0 次浏览

GGML is a tensor library for machine learning to enable large models and high performance on commodity hardware.

是什么

GGML is a tensor library for machine learning to enable large models and high performance on commodity hardware.

C-based Implementation—GGML is written in C, providing efficiency and compatibility across platforms.
16-bit Float Support—Supports 16-bit floating-point operations, reducing memory requirements and improving computation speed.
Integer Quantization—Enables optimization of memory and computation by quantizing model weights and activations to lower bit precision.

定价模式: Free