Search AI Products and News

In the field of artificial intelligence, reward models are a critical component for aligning large language models (LLMs) with human feedback, but existing models face the issue of "reward hacking." These models often focus on superficial features, such as the length or format of responses, rather than identifying genuine quality metrics, such as factual accuracy and relevance. The root cause lies in standard training objectives failing to distinguish between spurious associations and true causal drivers present in the training data. This failure leads to fragile reward models (RMs), which generate misaligned policies.

Large Language Models (LLMs) have achieved significant progress in complex reasoning tasks by combining task prompts with large-scale reinforcement learning (RL), as demonstrated by models like Deepseek-R1-Zero, which directly apply reinforcement learning to base models, showcasing strong reasoning capabilities. However, this success is difficult to replicate across different base model families, especially within the Llama series. This raises a core question: what factors lead to inconsistent performance of different base models during reinforcement learning? How does reinforcement learning perform in

The plan's advancement has triggered dissatisfaction among developers. According to VentureBeat, OpenAI's current API deprecation involves the GPT-4.5 Preview version, which is an intermediary model launched between GPT-4 and GPT-5. Multiple developers have stated that this sudden change has disrupted their development plans, forcing significant adjustments to applications already built based on this API. A developer who wished to remain anonymous commented: We understand the necessity of technological iteration, but the lack of sufficient buffer time in the schedule has brought additional pressure to development teams.

Mistral recently launched its new Agents API, a framework designed for developers to simplify the creation of AI agents that can execute various tasks such as running Python code, generating images, and performing Retrieval-Augmented Generation (RAG). The launch of this API aims to provide a unified environment for large language models (LLMs) to interact with multiple tools and data sources in a structured and persistent manner.

Cybersecurity researchers warn of a new software supply chain attack called "Slopsquatting." This attack exploits the 'package hallucination' phenomenon – where generative AI (like LLMs) may suggest non-existent package names during code writing. Attackers can preemptively register these fictitious names and inject malicious code. Image Note: Image generated by AI, courtesy of Midjourney. Research reveals that AI-fabricated package names often exhibit a high degree of...

Intel recently announced the open-sourcing of its AI Playground software, designed for local generative AI. AI Playground provides a powerful platform for running AI models on Intel Arc GPUs. It supports various image and video generation models, as well as Large Language Models (LLMs), significantly lowering the hardware barrier for AI applications by optimizing local computing resources. The project is available on GitHub and has attracted developers and AI enthusiasts worldwide.

DeepSeek AI, a prominent Chinese artificial intelligence research lab, following its powerful open-source language model DeepSeek-R1, has achieved another significant breakthrough in the field of Large Language Models (LLMs). Recently, DeepSeek AI officially launched an innovative technology called Self-Principled Critique Tuning (SPCT), aimed at building more general-purpose and scalable AI reward models.

Amidst the rapid advancement of Artificial Intelligence (AI), Microsoft is actively promoting AI literacy with its 50-day AI Skills Festival. This event is open to everyone, from beginners to professionals, offering free registration and access to a wealth of AI learning resources. The initiative aims not only to enhance public AI capabilities but also to break a Guinness World Record, making it a fun and practical event. AI is transforming the way various industries operate, particularly in daily office work. Microsoft hopes to...

The LLMs.txt Generator has received a major update with the release of version 2. This tool quickly converts any website content into text files usable by AI agents or Large Language Models (LLMs), greatly benefiting AI application developers and users. Developed by the @firecrawl_dev team and fully supported by their official llmstxt endpoint, the new version boasts an incredible 10x speed improvement over its predecessor. The LLMs.txt Generator v2...

A revolutionary technology is quietly emerging in the field of artificial intelligence. Inception Labs recently announced the Mercury series of diffusion large language models (dLLMs), a new generation of language models designed for fast and efficient high-quality text generation. Compared to traditional autoregressive large language models, Mercury boasts up to 10x faster generation speeds, achieving over 1000 tokens per second on an NVIDIA H100 GPU. This speed is...

In today's rapidly evolving technological landscape, Large Language Models (LLMs) play a crucial role across various industries, aiding in task automation and enhancing decision-making efficiency. However, in specialized fields like chip design, these models face unique challenges. NVIDIA's recently launched ChipAlign is specifically designed to address these challenges, aiming to combine the strengths of general-purpose LLMs with those of chip-specific LLMs. ChipAlign employs a new model merging strategy that...

Recently, AI large language models (LLMs) have been performing remarkably well in various tasks, effortlessly writing poetry, coding, and chatting; they seem to be capable of anything! But can you believe it? These 'genius' AIs are actually 'math novices'! They often fail dramatically when tackling simple arithmetic problems, leaving people astonished. A recent study unveiled the 'quirky' secret behind LLMs' arithmetic reasoning abilities: they rely neither on powerful algorithms nor solely on memory, but instead adopt a strategy known as 'heuristic hodgepodge'!

Andreesen Horowitz partner Justin Moore recently introduced a new investment concept on X, supporting a 'new wave of parenting co-pilots powered by LLMs and agents.' She mentioned companies like Cradlewise, which produces an AI baby monitor that can detect infants' sleep patterns and rock the crib, while Nanit uses artificial intelligence to analyze baby monitor footage to determine if the infant is breathing. Image Source Note: Image generated by AI, image licensed from service provider Midjourney.