NVIDIA Unveils New Small Language Model With Cutting-Edge Accuracy

Technology company NVIDIA released Mistral-NeMo-Minitron 8B, a streamlined and condensed version of the open NeMo 12B model created by the AI-focused company Mistral AI. This new model demonstrates high accuracy throughout widely used benchmarks in areas encompassing chatbots, virtual assistants, content generation, coding, and educational tools.

Builders can begin utilizing Mistral-NeMo-Minitron 8B via an NVIDIA NIM microservice that includes a standard application programming interface, or it can be downloaded directly from Hugging Face.

Mistral-NeMo-Minitron 8B, a highly capable model in its category, offers enhanced accuracy and reduced computational requirements while achieving top performance on major benchmarks. It was crafted by width-pruning the Mistral AI NeMo 12B base model and then undergoing a light retraining procedure leveraging distillation.

Among similar models in size, Mistral-NeMo-Minitron 8B succeeds on well-regarded benchmarks for language models. They assess multiple tasks, including language understanding, common sense reasoning, mathematical reasoning, summarization, coding, and the generation of accurate answers.

It is presented as an NVIDIA NIM microservice, adjusted for low latency to offer quicker responses and high throughput to ensure greater computational efficiency in production environments.

Today we released Mistral-NeMo-Minitron 8B, a pruned and distilled version of the open @MistralAI NeMo 12B model, achieving high accuracy across nine popular benchmarks for chatbots, virtual assistants, content generation, coding, and educational tools.
➡
 pic.twitter.com/N8oS9hF0fd

— NVIDIA AI Developer (@NVIDIAAIDev) August 21, 2024

NVIDIA Introduces Nemotron-Mini-4B-Instruct For Efficient Memory Usage  

NVIDIA is known for pioneering and advancing graphics processing units (GPUs). Its primary revenue source is the Compute and Networking business segment, which encompasses AI. It creates and produces GPUs for various applications, including gaming, cryptocurrency mining, and professional use, along with chip systems for vehicles, robotics, and other technologies. AI has emerged as an important area of focus for the firm lately.

Recently, it unveiled the Nemotron-Mini-4B-Instruct small language model, which is made to be efficient in memory usage and offer quicker response times on the company’s computers and laptops.

The post NVIDIA Unveils New Small Language Model With Cutting-Edge Accuracy appeared first on Metaverse Post.