Meta is reportedly preparing to release its Llama 3 model with 400B parameters, however the multimodal version will elude the EU.
A Meta official said the Llama 3 400B shall be launched on July 23. Since the launch of the 8B and 70B models in April, Meta has been hinting at a 400B multimodal that may “outshine its predecessors.”
At the moment, all now we have are some benchmark numbers that Meta released when Llama 3 400B was still in development in April.
When Llama 3 400B actually launches next week, it’ll likely be probably the most advanced open multimodal model in the marketplace. Although it might be just as “open” as Meta’s other models.
Jimmy Apples, a widely known source of AI leaks on X, suggested that Meta may not reveal the weights of the 400B model.
Meta plans not to reveal the weights for its 400B model.
The hope is that we are going to silently ignore it or let it go.
Don't let it drag.
— Jimmy Apples 🍎/acc (@apples_jimmy) May 22, 2024
Either way, if the multimodal model is introduced, you is not going to have the option to make use of it in the event you live within the EU.
Last month, Meta canceled plans to make use of social media data from EU residents to coach its models after opposition from privacy regulators and data protection advocates.
Now Meta has announced that it’ll withhold all future multimodal models from EU users, citing an absence of clarity and the “unpredictable nature of the European regulatory environment”.
EU users will eventually get a bigger text-only version of Llama 3 as an alternative, but will then need to do without the image and audio features and even Meta's Ray-Ban smart glasses and smartphones.
Meta has stated that in an effort to offer a top quality product to EU users, the corporate needs to make use of EU users' Facebook and Instagram posts as training data.
Current GDPR rules don’t seem to permit this, and the EU AI law coming into force next month is prone to expand data protection rules.
Adding to the issues facing the most important AI developers is the EU Digital Markets Act (DMA), which is meant to forestall large technology firms from gaining a monopoly position on the EU technology market.
Last month, Apple decided to attend to launch its recent AI features within the EU over concerns that the corporate may not have the option to comply with DMA rules.
EU rules offer its residents protections that will not be available in the remainder of the world.
But it might also prevent them from accessing the newest AI technology available to the remainder of us.
