Microsoft Researchers Announced a new foundation model on wedding that can perform agentic functions. Dubbed magma, the artificial intelligence (ai) model is pre-trained on a large Volume of Datasets Across Across text, images, videos, as well as spatile formats. The Redmond-Based Tech Giant said that magma is an extension of vision-language (vl) models and it can not only undersrstand multimodal information but can also plan and act on them. The AI agent-enabled model can be used in a wide range of tasks including computer vision, user interface (UI) Navigation, and Robot Manipulation.
Microsoft Announces Magma Foundation Model
In a github postMicrosoft Researchers Detailed The New Magma Foundation Model. Foundation models are distinctive large language models (llms), which are built from scratch and are not distilled from any other model. They often become the baseline for other models in the series. Magma is unique in the sense that ai model is pre-trained on a wide range of datasets.
The Researchers stated that the base Architecture Behind Magma is the llama 3 ai model. However, Magma is also also equipped with the ability to plan and act in the visual-spatial world. This allows the model to not only generate outputs like a chatbot but also execute actions.
It can be used as a computer vision chatbot that can offer information about the world it views when with paired with camera sensors. Magma can also be used to control the ui of a device. But more interestingly, it can also control robots to complete complex tasks using agentic capability.
The researchers said a major reason behind these capabilities is the divese dataset along with two two technical components-set-of-magnate and trace-of-magk. The Former Enables Action Grounding in Images, Videos and Spatial Data by Having the Model Predict Numeric Marks for Buttons or Robot Arms in Image Space. The latter feeds the model temporal video dynamics and makes it predict the next frames before it takes action. This allows the model to develop a strong spatial undersrstanding.
Microsoft Researchers also shared the benchmark scores of the ai model based on internal testing. It has achieved competitive scores all the agentic evaluation tests, outperforming models by openai, alibaba, and google. The company has not released magma in the public domain as of now.
6
