Google DeepMind's latest research, Gemma Scope, unveils the secrets of the 'black box' of language models by using Sparse Autoencoders (SAEs) to decompose and reconstruct the activations of language models, aiming to reveal meaningful features. Gemma Scope employs JumpReLU SAEs, which optimize reconstruction loss and regularize the number of active latent features by controlling activations to reveal the internal mechanisms of language models. The research found that the performance of residual flow SAEs is generally low, and sequence length affects the performance of SAEs.

Dutch artist Alicia Framis is preparing to marry her AI hologram partner AILex, which she created, showcasing their romantic life on social media. Alicia Framis has meticulously designed the interactive hologram, training it with data from her ex-boyfriend. She attempts to contemplate the benefits and issues that arise from the combination of humans and AI. Gatebox offers virtual character marriage services and has held 3000 weddings.

Xbox used AI-generated artwork on social media to promote indie games. The Xbox account ID @Xbox tweeted asking fans about their favorite indie games of 2023, which sparked controversy. Players criticized the use of AI art in games and advertising, and Xbox deleted the original tweet. While some developers have a positive attitude toward AI art, players generally criticize the use of this technology in games and advertising.

Box announced the launch of generative AI tools integrated with Google Cloud's Vertex AI platform. These tools help businesses to process and analyze data in Box more easily. Box utilizes Vertex AI to extract metadata, automatically categorize documents, and identify key information.

Microsoft promotes Matt Booty to President of Game Content and Studios with new responsibilities for ZeniMax. Sarah Bond has been appointed President of Xbox, overseeing all Xbox platforms and hardware. Chief Marketing Officer Chris Capossela will step down after 32 years at Microsoft. Yusuf Mehdi has been promoted to Executive Vice President, leading marketing for Microsoft Copilot products. Microsoft plans to announce which games will be coming to Xbox in the coming months.

Box Inc. has launched the AI Hub, aimed at addressing internal information management challenges for enterprises. This hub integrates Box's artificial intelligence technology to help users efficiently search for information, summarize content, and generate new information. The AI Hub can quickly process unstructured data, transforming traditional information retrieval methods and making it easier for users to find the information they need. The first batch of enterprise premium customers will pilot the AI Hub in November, offering various query options to meet larger-scale usage demands.

Shanghai AI Lab has released the large model training toolbox XTuner, which supports various hardware adaptations, significantly lowering the training cost barrier. XTuner is compatible with multiple open-source large models and can execute tasks such as incremental pre-training and instruction fine-tuning. XTuner balances usability and configurability with a built-in standardized process for one-click training.