Cybercriminals are starting to use generative artificial intelligence for attacks, including Meta's Llama2 large language model. The group known as Spider is using Llama2 to generate attack scripts targeting a North American financial services company. Security firms warn that the current ability to detect AI attacks is limited, but trends of malicious use of AI are expected to increase. The report notes that attempts to maliciously use large language models may still exist in 2023, but the generated results could be ineffective.

According to the '2023 Phishing Report' released by SlashNext, malicious phishing emails have surged by 1265% since the fourth quarter of 2022. Generative AI, such as ChatGPT, is widely used to create sophisticated phishing messages, ushering in a new era of cybercrime. There are 31,000 phishing attacks occurring each day, with 68% being text-based Business Email Compromise (BEC) fraud. IBM research has found that ChatGPT can generate fake emails and has made recommendations for addressing email deception threats.