Search AI Products and News

Google DeepMind recently released a comprehensive strategic document outlining its approach to developing safe Artificial General Intelligence (AGI). AGI is defined as a system capable of matching or exceeding human capabilities in most cognitive tasks. DeepMind anticipates that current machine learning approaches, particularly neural networks, will remain the primary path to achieving AGI. The report notes that future AGI systems could potentially surpass human performance and exhibit significant autonomy in planning and decision-making. This technology will have implications for healthcare...

AI company Anthropic recently updated its "responsible scaling" policy, outlining which models require additional safety protections. This move aims to mitigate potential risks before new technologies are released. According to Anthropic's blog, if stress testing reveals an AI model could assist a "resource-constrained state actor" in developing chemical and biological weapons, Anthropic will delay the technology's public launch.

ChatGPT's newly released 4.0 model's image generation capabilities are raising security concerns, particularly its advancements in generating realistic text, which could provide fraudsters with new tools. Multiple users on social media have already demonstrated creating fake restaurant receipts using this feature, receipts that appear convincingly authentic. Venture capitalist Deedy Das showcased on X a fake San Francisco steakhouse receipt generated using 4.0, highlighting: "Too many real-world verification processes rely on real images as proof. That era is over." Others have...

Researchers in China have unveiled the world's first three-dimensional atlas of a brain-computer interface at the micrometer scale. This groundbreaking achievement significantly improves the safety and precision of brain surgery involving BCIs.

Google recently announced a major upgrade to the image generation capabilities of its AI development platform, Google AI Studio. This update significantly reduces the rate of safety misclassifications while significantly improving usability, providing users with a more efficient and accurate AI generation experience. Google AI Studio, a generative AI platform for developers, supports the integration of multimodal models such as text and images. This optimization of the image generation feature addresses previous issues caused by overly strict safety filters that led to misclassifications. The new version...

Douyin's Safety Center recently announced a crackdown on stock investment content on its platform, aiming to foster a healthy online environment. While encouraging financial and securities professionals to share reliable information, Douyin is targeting accounts using AI tools to spread misinformation and even engage in fraudulent activities without proper qualifications. These accounts often promote supposedly high-efficiency AI stock picking tools to attract users.

In today's digital age, the issue of online safety for children is becoming increasingly important. Recently, Roblox, Discord, OpenAI, and Google launched a nonprofit organization called ROOST (Robust Open Online Safety Tools) aimed at building a scalable and interconnected safety infrastructure for the AI era. The objective of this new organization is to provide open-source safety tools to public and private entities to help them enhance protection on their platforms, with a particular focus on child safety. Source of the image: Image generated by AI.

Character AI, a platform that allows users to interact with AI chatbots for role-playing, recently filed a motion to dismiss a lawsuit brought by a teenager's parent in the U.S. District Court for the Middle District of Florida. The parent, Megan Garcia, alleges that Character AI's technology harmed her 14-year-old son, Sewell Setzer III, claiming that while interacting with a chatbot named 'Dany', he gradually became isolated from the real world and ultimately led to...

At the latest JP Morgan Healthcare Conference in 2025, NVIDIA and Innophore announced an exciting collaboration to launch an AI-driven drug safety screening platform named CavitOmiX by the end of January 2025. This platform aims to improve the efficiency and accuracy of drug design through the analysis of protein binding sites, marking a revolutionary transformation in the field of drug development. Christian Gruber, CEO of Innophore.

Recently, Nvidia announced the addition of three safety features on its NeMo Guardrails platform, aimed at helping businesses better manage and control AI chatbots. These microservices target common challenges in AI safety and content moderation, offering a range of practical solutions. Among them, the Content Safety service can review content before the AI responds to users, detecting any potential harmful information. This service helps prevent...

Recently, OpenAI showcased its more proactive red team testing strategy in the field of AI safety, surpassing its competitors, especially in the critical areas of multi-step reinforcement learning and external red team testing. The two papers released by the company establish new industry standards for enhancing the quality, reliability, and safety of AI models. The first paper, 'OpenAI's AI Model and System External Red Team Testing Methodology,' highlights the effectiveness of specialized external teams in identifying security vulnerabilities that internal testing may overlook. These external teams consist of cyber...