Naturally, the product release cycle keeps on keepin’ on, though actually keeping track of every new gadget and hi-fi release ...

Seamless integration of existing LLM infra with modular APIs: Decouples computation and data dependencies, enabling seamless integration with existing LLM frameworks, such as FSDP, Megatron-LM, vLLM, ...