Dell Technologies and Red Hat have partnered to integrate Red Hat Enterprise Linux AI (RHEL AI) into PowerEdge servers, aiming to simplify the development, testing, and deployment of AI models for enterprises, particularly in hybrid cloud environments. This collaboration focuses on the resources required for AI implementation, such as powerful servers, computing capabilities, and GPUs, while providing a flexible platform. It is expected that in the third quarter, optimized AI hardware solutions combined with Dell PowerEdge servers and RH...

Researcher Naphtali Deutsch discovered that hundreds of open-source large language model (LLM) building servers and dozens of vector databases are leaking large amounts of sensitive information. This problem arises from companies neglecting the security of related tools in their haste to integrate AI into their workflows. By hacking into 438 Flowise servers, he revealed stored sensitive data, including GitHub access tokens, OpenAI API keys, Flowise passwords, and API keys. Additionally, he found...

OpenAI is facing a loss of up to $5 billion this year, primarily due to the high costs associated with running ChatGPT and other AI products. Major expenditures include nearly $4 billion for renting Microsoft servers and $3 billion for training and updating AI models. Labor costs account for $1.5 billion, reflecting the company's significant salary increases to attract and retain talent. In the face of massive losses and fierce competition, the profitability prospects for OpenAI are under scrutiny, especially as competitors offer similar technology for free.

Microsoft has announced the launch of serverless fine-tuning capabilities for the Phi-3 small language model, enabling developers to easily adjust model performance on the Azure AI platform without managing underlying infrastructure, and it is free for initial use. The Phi-3 model, with 3 billion parameters, is suitable for enterprise developers, offering efficient performance at a lower cost. Although it has fewer parameters compared to OpenAI's GPT-3.5, it performs similarly across various applications. Serverless fine-tuning simplifies operations, reduces barriers, and supports the fine-tuning of small to medium models.

Reports indicate that OpenAI is in discussions with Broadcom and other chip design companies to jointly develop a new type of AI server chip. This initiative, led by OpenAI CEO Sam Altman, aims to enhance the company's computing power for AI development. The project is seen as a response by OpenAI to address the current shortage of graphics processing units (GPUs) required for AI model development, which are primarily supplied by Nvidia.Image source note: The image was generated by AI, and the a

OpenAI Corporation is facing the situation where Microsoft has resigned from the observer seat on the board and Apple no longer holds a similar position. Microsoft had previously invested in OpenAI and enjoyed the right to observe the board, but with the increasing scrutiny by regulatory agencies over investment activities of technology companies, Microsoft decided to withdraw from the observer role. Image Source Note: The image was generated by AI, and the image licensing service provider is Mi

According to Bloomberg, Apple Inc. has chosen Phil Schiller, the CEO of the App Store and former marketing director, to represent the company on OpenAI's non-profit board. Schiller will take on an observer role, allowing him to attend board meetings but without the ability to vote or serve as a director.Image Source Note: The image is generated by AI, and the image licensing service is MidjourneyJoining the board will enable Schiller to gain a better understanding of OpenAI's internal operations

Elon Musk's artificial intelligence startup xAI is building a supercomputer, and Dell Technologies and Super Micro will supply the server racks for it. Musk stated on the social media platform X that Dell will assemble half of the racks for the xAI supercomputer. When referring to the other partner, the billionaire mentioned 'SMC' in response to another post, referring to the server manufacturer Super Micro. Based in San Francisco, Super Micro collaborates with chip companies like NVIDIA.

ZTE is increasing its investment in research and development for AI server-related products and solutions. The company has launched the AI servers R5300 G5, R6500 G5, and R6900 G5, continuously optimizing performance to strive for a greater market share.

["Dell predicts earnings for fiscal year 2025 will exceed expectations, primarily due to the growing demand for AI servers.", "AI servers equipped with Nvidia graphics processing units are experiencing a surge in orders.", "The personal computer market is recovering, and there is an optimistic long-term outlook due to AI."]

Dell's revenue for Q4 of Fiscal Year 2024 reached $22.3 billion, a 25% year-over-year increase, with total revenue for the year at $88.4 billion. Operating income stood at $5.2 billion, and cash dividends were raised by 20% to $1.78 per share. The Infrastructure Solutions Group reported Q4 revenue of $9.3 billion, with server and networking business generating $4.9 billion. The Client Solutions Group achieved Q4 revenue of $11.7 billion, with the commercial customer segment contributing $9.6 billion. Dell maintains an optimistic outlook for Fiscal Year 2025.

Apple is expected to spend $4.75 billion to purchase over 20,000 servers to support artificial intelligence technology. Apple aims to carve out a new territory in the field of generative AI. The global server shipment volume is estimated to be around 13.654 million units, with the market still focusing on the deployment of AI servers. Companies like Foxconn, Quanta, and Supermicro have performed well in AI server orders.

Estimated global server shipment growth of 2.05% in 2024, with AI servers making up approximately 12.1%.

Microsoft becomes a non-voting observer on OpenAI's board, marking an increased collaboration between the two tech giants. Following the dismissal of OpenAI's former CEO, the company faces employee turnover threats, leading Microsoft to hire the former CEO and executives to lead a new AI research team. The new board faces challenges in advancing AI development while ensuring transparency and safety of products, alongside navigating competition and regulatory issues. OpenAI announces new board members, including the chairman of Salesforce, a former U.S. Treasury Secretary, and a co-founder of Quora.

NVIDIA has launched a server product line utilizing Spectrum-X Ethernet technology tailored for generative AI. Dell Technologies, Hewlett Packard Enterprise, and Lenovo are the first companies to integrate Spectrum-X. Spectrum-X offers 1.6 times higher AI communication performance. The new system combines Spectrum-X with NVIDIA Tensor Core GPU and AI software. Spectrum-X works in conjunction with Spectrum-4 and BlueField-3 SuperN.

OpenAI has decided to suspend registrations for ChatGPT Plus accounts as server capacity has exceeded expectations to ensure a good user experience. The surge in usage of new features has led to instability in service.

OpenAI's ChatGPT and API experienced outages lasting approximately 100 minutes. The company's CEO stated that new features faced unexpected demand, making it difficult to meet the open plans for subscribed users. Users can create custom ChatGPTs for personal or professional tasks, such as education and entertainment. OpenAI plans to launch a store where users can find ChatGPTs created by others and earn revenue. The company will release a preview of GPT-4 Turbo, which will be more powerful and faster.

Ming-Chi Kuo expects Apple to invest $4.75 billion in purchasing AI servers in 2024. He believes that Apple will use these servers to train its self-developed AI models to enhance security. Apple is set to purchase AI servers equipped with Nvidia chips. Kuo notes that Apple's investments in AI still lag behind those of Microsoft, Meta, and others. He expresses concerns that Apple will need to continue making substantial investments in its AI business in the future.

ZTE has launched the latest AI server that supports large model training aimed at the training and inference needs of small to medium-sized models. ZTE has introduced the G5 series servers and plans to release the latest AI server supporting large model training this year.