comfy-kitchen 0.2.8
misc/py-comfy-kitchen
ComfyUI: Fast kernel library for Diffusion inference
Description
Comfy Kitchen is a high-performance kernel library designed for Diffusion model inference. It provides optimized implementations for critical operations, including various quantization formats and Rotary Positional Embeddings (RoPE). The library features a flexible dispatch system that automatically selects the most efficient compute backend—CUDA, Triton, or eager PyTorch—based on available hardware and input constraints. Key features include: * Optimized kernels specifically tuned for Diffusion inference workloads. * Support for multiple compute backends (CUDA C, Triton JIT, and pure PyTorch). * Transparent quantization via a QuantizedTensor subclass that intercepts PyTorch operations. * Support for advanced quantization formats including FP8, NVFP4, and MXFP8. * Automatic backend selection and constraint validation for hardware-specific optimizations. * Implementation of performance-critical functions like RoPE and scaled matrix multiplication.
Dependencies
- build devel/py-build
- build devel/py-installer
- build devel/py-nanobind
- build devel/py-setuptools
- build devel/py-wheel
- build lang/python311
- run devel/py-packaging
- run lang/python311
- run misc/py-pytorch
Commit History
may be incomplete — full history at freebsd-ports on GitHub
Loading commit history — this may take up to a minute on first view. Reload the page in a moment.