ONLY AVAILABLE IN PAID PLANS.
Technology
Hawk and Griffin Models: Superior Latency and Throughput in AI Inference
This research shows Hawk and Griffin outperform MQA Transformers in latency and throughput, excelling in long-sequence and large-batch inference.