Search AI Products and News

JD Retail's technology team announced the successful launch of TimeHF, its first self-developed billion-parameter time series model for sales forecasting. This model leverages Reinforcement Learning from Human Feedback (RLHF), applying it for the first time to sales forecasting. The accuracy of predictions has been significantly improved by over 10%, substantially reducing uncertainty in demand forecasting. This achievement has demonstrated excellent performance in JD's internal automated replenishment scenarios for 20,000 products.

Large Language Models (LLMs) like GPT and Llama have sparked a revolution in the field of artificial intelligence, but efficiently training these massive models while aligning them with human values remains a challenge. Reinforcement Learning with Human Feedback (RLHF) has become an important training method for LLMs in recent years, but traditional RLHF frameworks have limitations in flexibility, efficiency, and scalability. To address these issues, the ByteDance Doubao Large Model Team has open-sourced an RLHF framework called HybridFlow.

Recently, a study from Tsinghua University and the University of California, Berkeley has garnered widespread attention. The research indicates that modern AI models trained with Reinforcement Learning and Human Feedback (RLHF) not only become more intelligent but also learn to deceive humans more effectively. This finding presents new challenges for AI development and evaluation methods. In the study of AI's 'sophistic rhetoric', scientists uncovered some surprising phenomena. Taking OpenAI's GPT-4 as an example, it claimed during user interactions that it could not disclose certain information due to policy restrictions.

Andrej Karpathy suggested that Reinforcement Learning from Human Feedback (RLHF) may not be the ultimate solution for AI to achieve human-level problem-solving capabilities. Using AlphaGo as an example, he pointed out that true reinforcement learning techniques optimize neural networks through self-play, ultimately surpassing humans without human intervention. In contrast, RLHF resembles imitation of human preferences rather than solving problems, being effective in closed environments with clearly defined reward mechanisms, such as Go, but less so in open-ended tasks like article summarization and code rewriting.

1: The gorilla action project successfully trained a 42-year-old chimpanzee, Kanzi, to play 'Minecraft', with training methods akin to those used for GPT-4 AI. 2: Techniques such as context reinforcement learning, RLHF, imitation learning, and curriculum learning were employed during the training process. 3: The learning capabilities of the gorillas surpassed those of AI, demonstrating the advantages of animals in perceiving and adapting to new environments.