Since the first Llama launch in February 2023, Groq has set the fast AI inference standard for open-source models by delivering leading throughput with LPU™ AI inference technology. We’re still driving on this path today and are proud to partner with Meta as they advance the models and modalities being made available to the open-source ecosystem. This includes today’s Meta announcement of Llama 3.2, which includes small and medium-sized vision Large Language Models (LLMs) 11B and 90B, and text-only models, 1B and 3B.
自 2023 年 2 月首次推出 Llama 以來，Groq 就通過 LPU™ AI 推理技術向開源模型提供領先的吞吐量，為開源模型設定了快速的 AI 推理標準。 我們仍然在這條路上前進，並自豪地與 Meta 合作，推動模型和模式進入開源生態系統。 這包括今天的 Meta 宣布 Llama 3.2，該模型包含小型和中型的視覺大語言模型（LLMs）11B 和 90B， 以及僅文字模型，1B 和 3B。
Ahmad Al-Dahle, Head of GenAI at Meta, shared, “At Meta, we’re committed to providing developers and enterprises the most advanced openly-available AI models that unlock the next level of innovation. Our partnership with Groq is pivotal to this mission, as their cutting-edge, fast inference technology enables the seamless deployment of these models, giving developers the speed, agility, and scalability they need to build the next generation of AI-powered applications.”
Ahmad Al-Dahle，Meta 的 GenAI 負責人說道，「在 Meta，我們致力於為開發人員和企業提供最先進的開源 AI 模型，以啟動下一級別的創新。 我們與 Groq 的合作對此使命至關重要，因為他們的前沿、快速推理技術使得這些模型的部署變得無縫。同時為開發人員提供了速度、敏捷性和可擴展性，讓他們能夠打造下一代 AI 驅動的應用程式。」
This is the second time Groq and Meta have partnered on a key industry LLM launch, continuing to deliver on their shared commitment to building a cutting edge, cost-effective, modifiable, open AI ecosystem. This partnership ensures developers maintain their place at the front lines of innovation, and enable people to have creative, useful, and life-changing breakthroughs using generative AI.
這是 Groq 和 Meta 合作推出關鍵行業 LLM 發布的第二次，繼續履行共同承諾，打造前沿、成本有效、可修改和開源的 AI 生態系統。 這種合作保證開發人員在創新前沿保持領先地位，並能夠通過生成性 AI 創造出有創意、有用且改變人生的突破。
Groq is excited to share the preview version of a number of these models, with additional models from the 3.2 suite available via GroqCloud™ Dev Console soon. Llama 3.2 will join the other models Groq is driving industry-leading inference performance for, delivering multiple modalities as shown by text, audio (Whisper) and image (Llava) models. Llama 3.2 expands the image modalities and are fully integrated into the Llama 11B and 90B vision models.
Groq 很高興能夠與大家分享這些模型的預覽版本，另外，3.2 版中的其它模型也將很快通過 GroqCloud™ Dev Console 提供給大家。Llama 3.2 將加入 Groq 提供的行業領先推理性能的模型行列，提供多種模式，如文本、音頻（Whisper）和圖像（Llava）模型。Llama 3.2 擴展了圖像模式，並與 Llama 11B 和 90B 視覺模型完全集成。
The two largest models of the Llama 3.2 suite, 11B and 90B, support image reasoning use cases while the lightweight 1B and 3B models are text only. Today, developers can access llama-3.2-1b-preview, llama-3.2-3b-preview, llama-3.2-11b-text-preview, and llama-3.2-90b-text-preview on Groq.
Llama 3.2 套件中最大的兩個模型，11B 和 90B，支援圖像推理應用，而輕量級的 1B 和 3B 模型僅支援文本。今天，開發人員可以通過 Groq 存取 llama-3.2-1b-preview、llama-3.2-3b-preview、llama-3.2-11b-text-preview 和 llama-3.2-90b-text-preview。
With this release, Meta also shared the first official distribution of Llama Stack. Llama Stack is evidence of the developer being top of mind as Meta builds out the open-source ecosystem and enables providers like Groq to provide further resources and be aligned with the developer community.
在這次發布中，Meta 也分享了第一個官方版本的 Llama Stack。Llama Stack 是 Meta 在開源生態系統中頂尖的開發者，也使得提供者如 Groq 能夠提供更多資源並與開發者社群保持一致。
Sunny Madra, GM GroqCloud, shared, “With almost half a million developers who have adopted GroqCloud this year, we know developers are hungry for an open-source ecosystem. We’re excited that an industry leader as large and trusted as Meta offers partnership opportunities to startups like Groq in an effort to build the foundation of that ecosystem for both developers and the enterprise.”
GroqCloud 總經理 Sunny Madra 表示：「今年有近五十萬開發人員採用了 GroqCloud，我們知道開發人員渴望一個開源生態系統。我們很高興看到一個領導業界的企業，如 Meta，能夠與初創企業如 Groq 合作，共同打造開發者和企業的生態系統。」
This year, Llama has achieved 10x growth, and continues to be one of the leading openly-available LLMs in the industry, and combined with Groq fast inference speed, the speed of generation is now truly fueling the speed of innovation.
今年，Llama 成長了十倍，並繼續成為行業領先的開放式 LLMs，並與 Groq 快速推理速度結合，生成速度現在真正促進了創新的速度。
For developers it’s an easy three step process to get started with Groq. Simply replace your existing industry standard API key with a free Groq API key, set the base URL, and run. Head over to GroqCloud Dev Console and start building today!
開發人員可以輕鬆地經過三個步驟來開始使用 Groq。只要用免費的 Groq API 金鑰取代現有的業界標準 API 金鑰，設定基礎 URL，然後執行即可。前往 GroqCloud 開發人員主控台，立即開始建構吧！