Recently, a federal lawsuit regarding a Minnesota law on 'using deepfake technology to influence elections' has sparked new controversy. The plaintiff's legal team pointed out in the latest legal documents that the affidavits supporting this law may contain text generated by artificial intelligence. Image source note: The image was generated by AI, provided by Midjourney according to reports from the Minnesota Reformer, where the state's Attorney General Keith Ellison had requested the Stanford Social Media Lab's assistance.

After the 2024 U.S. presidential election, the rapid spread of misinformation online severely impacts Americans' perceptions of candidates, as well as public health, climate change, and immigration topics. The development of generative AI, along with its ability to create deepfake content and its tendency to 'hallucinate' facts, may further exacerbate this issue. Image credit: Image generated by AI, licensed from Midjourney. To address this challenge, Norwegian startup Factiverse was born.

Singapore has recently announced a series of important measures in cybersecurity, particularly regarding safety guidelines for Artificial Intelligence (AI) systems and legislation banning the use of deepfake technology in election advertising. These initiatives aim to help organizations mitigate potential risks during the development and deployment of AI, ensuring the security of the technology. Image Credit: The image is generated by AI and licensed through Midjourney. The 'AI System Security Guidelines' launched by the Cyber Security Agency of Singapore (CSA) emphasize the concept of 'security by design.'

AI technology is like a double-edged sword; it brings convenience but also poses risks. To better manage these risks, California Governor Gavin Newsom recently signed nine bills specifically regulating AI-generated content, particularly focusing on the phenomenon of deepfakes. Note: The image is AI-generated, and the image licensing provider Midjourney is referenced. Among these bills, SB1047 stands out as it requires AI developers to implement safety measures to mitigate risks.

Recently, California Governor Gavin Newsom signed eight laws addressing challenges in the field of artificial intelligence. These laws aim to tackle issues related to the existential risks posed by AI systems, the deepfake production of nude images by AI generators, and the creation of AI clones of deceased actors by Hollywood studios. Among these, SB926 criminalizes the creation and distribution of deepfake nude images and defines using AI-generated nude images resembling others for blackmail as illegal. The SB981 bill requires social media platforms to establish user reporting channels for relevant content.

During a recent signing ceremony, California Governor Gavin Newsom announced a series of new laws aimed at the artificial intelligence (AI) industry, which are relatively strict on a national level. The new regulations comprise five items, three of which specifically address AI deepfake technology that could impact elections, while the other two concern the cloning of Hollywood actors' voices and images. Image source note: Image generated by AI, image authorized by service provider Midjourney. The new law AB2655 requires large online platforms...

Recently, several major American artificial intelligence companies made a solemn pledge to the White House, stating that they will prevent their AI products from being used to generate non-consensual deepfake pornography and child sexual abuse materials. Six companies, including Adobe, Anthropic, Cohere, Microsoft, OpenAI, and the open-source web data repository Common Crawl, signed this non-binding commitment to ensure that their products are not misused to create harmful images of gender violence.

In today's world, deepfakes and synthetic media have become increasingly common due to the advancements in generative artificial intelligence (gen AI). To tackle this challenge, many organizations are working to improve digital watermarking technologies for tracking the origins of content. While no organization has completely succeeded yet, the Coalition for Content Provenance and Authenticity (C2PA) is expanding its membership. C2PA has announced that Amazon has become a new member of the organization's advisory board. C2PA is an open technical standard organization under the Linux Foundation.

With the continuous advancement of artificial intelligence technology, the difficulty of forging images and videos has decreased significantly, making the deepfake phenomenon increasingly severe. Identifying these false contents has become an urgent issue to address. Recently, a research team from Binghamton University conducted an in-depth discussion on this topic, using frequency domain analysis techniques to reveal the characteristics of AI-generated images, thus helping people identify false information. Image source note: The image is AI-generated, with permission from image licensing provider Midjourney. This research was conducted by the Department of Electrical and Computer Engineering.

Singapore has recently introduced a new bill aimed at banning the use of deepfake technology during elections to ensure the authenticity of information and the fairness of the electoral process. With the advancement of generative AI technology, the risk of deepfake content has increased. The bill seeks to regulate the production of false content created by both AI and non-AI technologies, including videos, audio, and images. The core provisions prohibit the publication of online ads that falsely depict candidates' words and actions during election periods, with violators facing fines or imprisonment. The bill also allows for issuing correction orders to individuals and social media platforms that publish false content.

Microsoft collaborates with the anti-revenge pornography organization StopNCII to provide victims with tools to erase deepfake pornographic images from search engines. By creating a digital fingerprint (hash value) of the images on the device, it helps to completely remove related synthetic nude images from platforms like Bing. This initiative aims to address the issue of deepfake pornography caused by the misuse of generative AI technology, tackling the challenges that cannot be effectively managed solely through user reports. However, Google has not yet partnered with StopNCII, and there is a lack of specific federal laws addressing such behavior in the United States.

As the 2024 U.S. presidential election approaches, generative artificial intelligence (AI) is increasingly becoming a new player on the electoral battlefield. AI technology can generate false images, videos, and audio, influencing voter decision-making, a trend that has manifested in multiple instances. For example, former President Trump shared AI-generated images attempting to mislead the public, while residents of New Hampshire encountered deepfake calls aimed at dissuading them from participating in the Democratic primaries. Experts warn that the impact of AI-generated misinformation could substantially alter election outcomes, and current detection technologies remain underdeveloped.

The issue of South Korean teenagers using deepfake technology to create pornographic content has garnered widespread attention, with a surge in online sexual crimes. Police are urging for enhanced education and guidance for youth to improve online safety and moral awareness. Instances of pornographic content targeting schools and teachers have emerged on Telegram, with multiple cases reported. In the first seven months of this year, the number of....

The issue of deepfake crimes in South Korea has drawn widespread attention from society, particularly concerning the increasing number of cases involving minors, with an estimated 220,000 individuals affected. The victim demographics are broad, including students, teachers, military personnel, and a significant proportion of minors. These crimes are rapidly disseminated through social media, with some victims' information being used for validation in illicit groups. Cases of deepfake targeting women have garnered particular attention, with known affected schools exceeding 100, including both domestic and overseas Korean international schools. In response, the South Korean president has called for strengthened investigations and the eradication of crimes utilizing digital technology.

The Federal Communications Commission (FCC) has fined Lingo Telecom $1 million for distributing a fabricated voice call of President Joe Biden, aimed at influencing voters in New Hampshire. The investigation revealed that the mastermind behind the call was political consultant Steve Kramer, who the FCC had previously proposed a $6 million fine against. To reach a settlement with Lingo, the FCC has required the company to strictly adhere to caller ID authentication rules going forward, including implementing 'Know Your Customer' (KYC) measures.

San Francisco's Deputy Mayor Yvonne Meré has initiated a lawsuit against 16 websites that exploit AI technology to create deepfake pornographic content without the consent of women and girls. The lawsuit addresses the harmful trend among teenagers, particularly regarding the use of "strip apps" to manipulate peers' images. These websites garnered 200 million visits in their first six months, offering free initial services followed by paid options....

Recently, Google has taken action to combat non-consensual deepfake content in response to public concern and legislative pressure. Following the Taylor Swift incident eight months ago, tech companies and lawmakers began seriously addressing this issue. Google announced measures to prevent pornographic deepfake content from appearing in search results, including streamlining the process for victims to remove non-consensual pornography, filtering pornographic search results, removing duplicate images, and optimizing search results to reduce the exposure of deepfake content. Henry Ajdah has expressed support for Google's initiatives, believing it will significantly reduce the exposure of non-consensual content.

Google has launched a series of online safety measures aimed at eliminating deepfake content from search results, particularly explicit images without consent. When users request removal of such content, the system not only processes the specific item but also filters out related results and even removes duplicates. To prevent such content from appearing prominently in search results, Google has adjusted its ranking algorithm to prioritize high-q....

Microsoft Vice Chairman Brad Smith urged the U.S. Congress to implement laws targeting AI-generated deepfake technology to protect citizens from fraud and manipulation. He pointed out that while the industry and nonprofit organizations have taken measures to address this issue, laws need to be updated to combat deepfake fraud. Smith emphasized the need for a comprehensive 'Deepfake Fraud Act' to provide a legal framework for law enforcement to prosecute cybercriminals who exploit the technology for fraud. He also called for updating laws concerning child sexual abuse and non-consensual intimate images to include those generated by AI.