A team at ๐๐ง๐ญ๐ก๐ซ๐จ๐ฉ๐ข๐, creator of the Claude models, published a paper about extracting ๐ข๐ง๐ญ๐๐ซ๐ฉ๐ซ๐๐ญ๐๐๐ฅ๐ ๐๐๐๐ญ๐ฎ๐ซ๐๐ฌ from Claude 3 Sonnet. This is achieved by placing a sparse autoencoder halfway through the model and then training it. An autoencoder is a neural network that learns to encode input data, here a middle layer of Claude, into
In a new paper, Meta announces ๐๐ก๐๐ฆ๐๐ฅ๐๐จ๐ง, a ๐ฆ๐ข๐ฑ๐๐-๐ฆ๐จ๐๐๐ฅ ๐๐๐ซ๐ฅ๐ฒ-๐๐ฎ๐ฌ๐ข๐จ๐ง foundation model. Contrary to earlier multimodal models, which model the different modalities (text, image, audio, etc.) separately, mixed-modal early-fusion foundation models like Chameleon are end-to-end models. They ingest all modalities from the start and project them into one representational space. That permits integrating information across
I resisted the temptation to have a GenAI summarize theย ๐๐๐จ๐ง๐จ๐ฆ๐ข๐ ๐๐ฆ๐ฉ๐๐๐ญ ๐จ๐ ๐๐๐ง๐๐ซ๐๐ญ๐ข๐ฏ๐ ๐๐ย report by Andrew McAfee (MIT). At around 20 pages long (excluding references), the report delivers on the titleโs promise in less than one hour of reading. It explains how ๐๐๐ง๐๐ ๐ข๐ฌ ๐ ๐ ๐๐ง๐๐ซ๐๐ฅ-๐ฉ๐ฎ๐ซ๐ฉ๐จ๐ฌ๐ ๐ญ๐๐๐ก๐ง๐จ๐ฅ๐จ๐ ๐ฒ that is rapidly improving, becoming pervasive, and spurring
This weekโs edition of the Economist (subscribers only) ran a feature on artificial intelligence and copyright. Generative AIs have been and continue to be trained on copyrighted material, including texts, images, music, videos, and more. Not all creators are amused. Some have chosen to sue the companies developing these Generative AI models. Others, including Associated
One of the weaknesses of the models currently available on the market is that they have been trained on a publicly accessible data set, which may not necessarily be sufficient to meet certain specific needs. Take, for example, a company with a large volume of proprietary data, a highly specialized vocabulary or specific data formats.
To kick off 2024, I’d like to talk about the current copyright situation for generative models. This is a highly topical issue, since two lawsuits on this subject are currently before the Anglo-Saxon courts: the first, in Great Britain, pits the Getty Images image library against Stability AI, a company that supplies an image-generating model.
You’ve probably read or heard about it in the media over the last few days: the European institutions reached an agreement on the future regulation of Artificial Intelligence on Friday December 8. This is the famous European Artificial Intelligence Act, the broad outlines of which I had already outlined in a previous article. At the
Introduction While 2023 was dominated by cloud-based models such as chatGPT and Claude, this approach could well change this year. This is due to the rapid progress of open-source models, which are gradually closing the gap with proprietary models. These open-source models make it possible to run models locally, which opens up new perspectives that
Over the past few weeks, French start-up Mistral has been making a lot of waves in the world of generative AI. Founded in May 2023 by three engineers from Google Deepmind, Mistral has already raised 385 million euros in capital in six months and is currently valued at around 2 billion euros! This unbridled growth
In his blog On holding back the strange AI tide, Ethan Mollick observes how the arrival of powerful AI systems like ChatGPT has been sudden and disruptive. These systems can now do many tasks previously reserved for humans, causing major impacts across work and life without warning or preparation. Many leaders are desperately trying to