Efficient Inference | Mark Bosshttps://markboss.me/tag/efficient-inference/Efficient InferenceHugoBlox Kit (https://hugoblox.com)en-usThu, 21 May 2026 00:00:00 +0000https://markboss.me/media/icon_hu_305902ed81759b07.pngEfficient Inferencehttps://markboss.me/tag/efficient-inference/OCTOPUS: Optimized KV Cache for Transformers via Octahedral Parametrization Under Optimal Squared Error Quantizationhttps://markboss.me/publications/2026-octopus/Thu, 21 May 2026 00:00:00 +0000https://markboss.me/publications/2026-octopus/