CLI/GUI tool for efficient and easy safetensors and gguf model conversion
-
Updated
Oct 6, 2026 - Zig
#
gguf-quantization
Here are 30 public repositories matching this topic...
GGUF Quantization support for native ComfyUI models
-
Updated
Oct 8, 2026 - Python
Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.
-
Updated
Sep 8, 2026 - C#
Análise Avançada de Dados com Causalidade e Aprendizado por Reforço
reinforcement-learning bug-tracker data-preprocessing experimental-psychology causal-machine-learning shap-analysis hypergraph-neural-network llms-reasoning llm-fine-tuning explainability-metric unsloth gguf-quantization
-
Updated
Feb 27, 2025 - Jupyter Notebook
Fatrocu converts your e-archive invoices, cash register receipts, and receipts into Excel format within minutes using a 100% locally running AI, drastically reducing manual data entry.
javascript json image-processing invoice llama e-invoice ubl-tr e-document llama-cpp local-ai gguf ai-analysis fatrocu gguf-models gguf-quantization gguf-model-support
-
Updated
Oct 9, 2026 - TypeScript
Which language models will actually run well on your machine. Measured, not looked up. Free, offline, for Windows, macOS and Linux.
windows macos linux gpu hardware-detection vram local-first llm llms llama-cpp local-llm local-ai ollama lm-studio gguf llm-evaluation gguf-models gguf-quantization vram-calculator gguf-model
-
Updated
Sep 16, 2026 - Rust
Auto GGUF Converter for HuggingFace Hub Models with Multiple Quantizations (GGUF Format)
machine-learning cmake ai tensorflow transformers huggingface ai-models huggingface-models bf16 safetensors llama-cpp gguf gguf-models gguf-quantization gguf-editor convert-gguf
-
Updated
Feb 11, 2026 - Python
Gemma-4-It fine-tuned on PubMedQA using SFT & RLVR
quantization fine-tuning sft llm low-rank-adaptation qlora parameter-efficient-fine-tuning grpo gguf-quantization rlvr pubmedqa gemma-4
-
Updated
Apr 27, 2026 - Python
Convert and quantize llm models
ai artificial-intelligence quantization top100 awesome-ai top10 quanta llm safetensors bestofthebest gguf bestofai awesome-ai-tools top-ai-tools gguf-models gguf-quantization best-ai-software gguf-model-support best-apps gguf-editor
-
Updated
Dec 30, 2025 - Python
Run large language models locally on Windows. A native Rust desktop app and local LLM API server for GGUF models fully offline, no Python, no Docker, no cloud account. It measures your GPU and the model file, then loads a configuration that fits. Tuned on an 8 GB laptop card.
rust ai rust-lang llama llm safetensors local-llm llm-inference llm-tools gguf llm-agents gguf-models gguf-quantization
-
Updated
Aug 7, 2026
Convert Safetensor weights to GGUF format using google colab and HuggingFace. Use the power of AI locally :)
-
Updated
Aug 20, 2026 - Jupyter Notebook
Power up your projects with Glyvex: All-in-one open-source AI suite for automation and innovation.
react javascript python open-source machine-learning automation ai artificial-intelligence ia workflow-automation fastapi ai-suite gguf gguf-models gguf-quantization gguf-model-support gguf-manager gguf-model gguf-runner
-
Updated
Oct 9, 2026 - Python
High-performance LLM compression engine using SVD matrix decomposition, INT8 quantization, and output caching training acceleration.
transformers pytorch transformer quantization svd model-compression model-compression-papers quantization-algorithms svd-recommendation-algorithm quantization-algorithm llm ollama gguf llm-compression gguf-models gguf-quantization
-
Updated
Sep 11, 2026 - Python
Convert Hugging Face models to GGUF with xet support.
-
Updated
Apr 26, 2025 - Jupyter Notebook
A 501M-parameter language model trained from scratch on 20B tokens: custom BPE tokenizer, original Llama-style architecture, training and SFT pipeline, and unattended cloud orchestration. 54 hours on one H100 for about $165.
nlp machine-learning tokenizer cuda pytorch transformer llama language-model from-scratch bpe pretraining llm pretraining-model fine-tuning-llm h100 gguf bpe-tokenizer pretraining-llms gguf-models gguf-quantization
-
Updated
Aug 13, 2026 - Python
AI Toolchain in Pure Zig, No Python, No C++
-
Updated
Sep 26, 2026 - Rust
Quantize LLMs automatically.
-
Updated
Mar 31, 2026 - Python
Run Qwen-Image 2.1 locally on a 16 GB Apple Silicon Mac. Free, offline AI image editor and generator with mask inpainting, 4-step Turbo LoRA, 4-bit GGUF models, upscaling and a private mode. Built on stable-diffusion.cpp.
macos image-editing image-generation macos-application stable-diffusion stablediffusion local-llm gguf gguf-quantization qwen-image qwen-image-edit local-image-generation qwen-image-2-1
-
Updated
Oct 2, 2026 - HTML
Autonomous, Sovereign & Zero-Cloud Local Generative AI Workstation
electron nodejs api flux server cpp vulkan cuda desktop-application image-generation ai-tools llm generative-ai safetensors llama-cpp gguf-models gguf-quantization gguf-runner solframe-studio solframe
-
Updated
Oct 7, 2026 - TypeScript
Offline LLM chat for Android & iOS. Download a GGUF model once, then chat fully on-device. No account, no cloud. Made possible with llama.rn and React Native.
android ios privacy react-native llama rag on-device-ai llamacpp llama-cpp local-llm gguf offline-ai gguf-quantization gguf-model-support local-llm-gguf local-llm-ui
-
Updated
Oct 3, 2026 - TypeScript
Add this topic to your repo
To associate your repository with the gguf-quantization topic, visit your repo's landing page and select "manage topics."