Meta released Llama 3 (8B and 70B) on 18 April 2024, ‘the most capable openly available LLM to data’ (Meta, 2024).

In several key areas, llama 3 70B surpasses even the most renowned commercial LLMs, such as Claude Sonnet and Gemini 1.5 Pro. This unique superiority makes it an exceptional proposition for the open-source community.

Llama 3 uses the standard decoder-only transformer with high-quality data. Its instruct-fine-tuned version powers the Meta AI Assistant.

The current release is English text only. Meta announced that future releases will include a longer context window, multilingual support and multimodal capabilities.

References

Meta (2024) Introducing Meta Llama 3: The most capable openly available LLM to date. 18 April 2024. Meta AI. https://ai.meta.com/blog/meta-llama-3/ [Accessed: 22 April 2024].