Workers AI runs Llama 3.1 70B at the edge
Posted by Rukmini Devi · 2024-08-15
Cloudflare Workers AI now runs Llama 3.1 70B with streaming. Combined with D1 and Vectorize, you can build a complete AI app on Workers. Zero GPU management, pay-per-token. https://github.com/cloudflare/workers-sdk