Kimi K3, previewed: inside the first open 3T-class model
• 7
AI & ML interests
None defined yet.
Recent Activity
Articles
Efficient Drop-In Replacement for the Classification Head in Language Model Inference. https://github.com/embedl/flash-head
nvidia/Cosmos-Reason2 multi-modal reasoning models optimized by Embedl.
-
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11 -
embedl/Cosmos-Reason2-2B-NVFP4A16
Image-Text-to-Text • 2B • Updated • 1 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13
Ultra-efficient model variants optimized for Jetson Orin Nano. Designed for constrained edge environments requiring low memory footprint.
-
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11 -
Edge Inference Benchmarks
🚀10On-Device benchmarks across devices and models.
Models validated and performance-optimized for NVIDIA Jetson AGX Thor. Tailored for high-performance edge AI workloads.
-
embedl/Cosmos-Reason2-2B-NVFP4A16
Image-Text-to-Text • 2B • Updated • 1 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11
Quantization strategy where most weights are converted to INT4, activations remain in FP16, and sensitive layers are preserved in FP16.
Qwen/Qwen3.5 variants optimized by embedl.
Models optimized and bench-marked for NVIDIA Jetson AGX Orin. Memory-efficient and latency-optimized variants designed for real-time edge inference.
-
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11 -
embedl/Qwen3.5-0.8B-FlashHead
Image-Text-to-Text • 0.9B • Updated • 2 • 1
Efficient Drop-In Replacement for the Classification Head in Language Model Inference. https://github.com/embedl/flash-head
Quantization strategy where most weights are converted to INT4, activations remain in FP16, and sensitive layers are preserved in FP16.
nvidia/Cosmos-Reason2 multi-modal reasoning models optimized by Embedl.
-
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11 -
embedl/Cosmos-Reason2-2B-NVFP4A16
Image-Text-to-Text • 2B • Updated • 1 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13
Qwen/Qwen3.5 variants optimized by embedl.
Ultra-efficient model variants optimized for Jetson Orin Nano. Designed for constrained edge environments requiring low memory footprint.
-
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11 -
Edge Inference Benchmarks
🚀10On-Device benchmarks across devices and models.
Models optimized and bench-marked for NVIDIA Jetson AGX Orin. Memory-efficient and latency-optimized variants designed for real-time edge inference.
-
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11 -
embedl/Qwen3.5-0.8B-FlashHead
Image-Text-to-Text • 0.9B • Updated • 2 • 1
Models validated and performance-optimized for NVIDIA Jetson AGX Thor. Tailored for high-performance edge AI workloads.
-
embedl/Cosmos-Reason2-2B-NVFP4A16
Image-Text-to-Text • 2B • Updated • 1 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2
Image-Text-to-Text • 2B • Updated • 133 • 16 -
embedl/Cosmos-Reason2-2B-W4A16
Image-Text-to-Text • 2B • Updated • 26 • 13 -
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text • 2B • Updated • 70 • 11