Apple Publishes Details About New 'MM1' AI Model
Apple researchers have developed a new method for training large language models (LLMs) that seamlessly integrates both text and visual information.
![hey siri banner apple](https://images.macrumors.com/t/KnV8VAc6R5Dd_3U1Esmw774Zr2U=/400x0/article-new/2022/03/hey-siri-banner-apple.jpg?lossy)
The company's findings, detailed in a research paper titled "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training," showcase a new approach to creating more intelligent and flexible AI systems. By utilizing a diverse dataset comprising image-caption pairs, interleaved image-text documents, and text-only data, Apple's claims that the MM1 model sets a new standard in AI's ability to perform tasks such as image captioning, visual question answering, and natural language inference with a high level of accuracy.
Apple's research focuses on the combination of different types of training data and model architectures, which enables the AI to understand and generate language based on a mix of visual and linguistic cues. This capability is vital for tasks that require a nuanced comprehension of the world, such as interpreting complex images or answering questions that involve visual elements.
The paper also highlights the MM1 model's exceptional in-context learning abilities, particularly in the largest 30 billion parameter configuration of the model. This version apparently exhibits remarkable capabilities for multi-step reasoning over multiple images using few-shot "chain-of-thought" prompting, a technique that allows the AI to perform complex, open-ended problem solving based on minimal examples.
This research emerges as part of Apple's broader initiative to enhance its AI capabilities amid growing competition. Earlier today, Bloomberg's Mark Gurman reported that Apple is in discussions with Google to license Google's Gemini generative large-language models to power new features coming to the iPhone as part of iOS 18.
Popular Stories
iOS 18 will give iPhone users greater control over Home Screen app icon arrangement, according to sources familiar with the matter. While app icons will likely remain locked to an invisible grid system on the Home Screen, to ensure there is some uniformity, our sources say that users will be able to arrange icons more freely on iOS 18. For example, we expect that the update will introduce...
The next-generation iPad Pro will feature a landscape-oriented front-facing camera for the first time, according to the Apple leaker known as "Instant Digital." Instant Digital reiterated the design change earlier today on Weibo with a simple accompanying 2D image. The post reveals that the entire TrueDepth camera array will move to the right side of the device, while the microphone will...
Apple today released macOS Sonoma 14.4.1, a minor update for the macOS Sonoma operating system that launched last September. macOS Sonoma 14.4.1 comes three weeks after macOS Sonoma 14.4. The macOS Sonoma 14.4.1 update can be downloaded for free on all eligible Macs using the Software Update section of System Settings. There's also a macOS 13.6.6 release for those who...
Apple has previously announced three new iOS features that it said are coming to the iPhone later this year, as outlined below. The new features include the ability to install iPhone apps on the web in the EU, RCS support in the Messages app, and next-generation CarPlay. Web Distribution Apple recently announced that eligible developers will soon be able to distribute their iOS apps to ...
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models concurrently, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different, and already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
iOS 18 will feature a revamped Home Screen that is "more customizable," according to Bloomberg's Mark Gurman. He revealed this information in his Power On newsletter today, but he did not provide any specific details. Subscribe to the MacRumors YouTube channel for more videos. Apple will announce iOS 18 at its annual developers conference WWDC in June. Other features and changes rumored for...
We're getting closer to the launch of new iPad Pro and iPad Air models, while rumors about iOS 18 are continuing to ramp up with this week's surprise revelation that Apple has been talking to Google and others about potentially helping power the generative AI features expected to be a major part of this year's update. Other news this week saw the release of iOS 17.4.1 and iPadOS 17.4.1...
Top Rated Comments
Apple hasn't become who they are with such a vast treasure trove of expertise and wealth by sheer dumb luck.