Website Master (ChinaZ.com) June 17 News: 65-year-old AI artist, IT editor, and musician Koya Matsuo has brought his wife Tori-chan, who passed away 11 years ago, back to life through technology. Using Luma's AI video Dream Machine, he created a video that has moved countless people.
Video by Koya Matsuo
Tori-chan died of breast cancer in 2013. To commemorate her, Matsuo started a project: rearranging and rerecording her past songs and releasing them on iTunes Store. However, her condition was already very serious at that time, and her voice was unstable. So, Matsuo used her voice to create a UTAU sound source, synthesized new songs, and then merged them with the original recordings to achieve a complete effect.
UTAU is an open-source voice synthesis software, often used by Bilibili netizens to create ghost videos. Matsuo completed the first song made with a UTAU sound source on September 1, 2023. In this way, he silently created hundreds of songs to commemorate Tori-chan.
Entering the era of AI, Matsuo's longing transformed from intangible to tangible. He learned and tried various AI technologies, using pixel and remini to restore old photos, DID to make videos, and Stable Audio, Udio, Suno, and other AI music tools to create. Until Luma's Dream Machine was launched, he saw hope.
Matsuo said, "My purpose in using it is not for video production, but to bring still images to life and see my wife who passed away 11 years ago in motion." He used film photos from 1978-1987, generating dynamic videos through Dream Machine. He continuously adjusted the facial expressions, background, and movements, eagerly building the image of her in his memory.
He also used Dream Machine to generate multiple clips of Tori-chan, wrote a song with Suno, then used Logic Pro11's STEM Splitter to separate the vocals, and Vocoflex to replace the voice with Tori-chan's, creating a deeply touching MV.
Matsuo also used AI to extract and translate a letter Tori-chan wrote to him in 1984, filled with deep affection. This video is Matsuo's reply to his wife in 2024, written with technology, expressing his longing and love.
This is the story of an ordinary person who dreams with technology. In the limited old photos and voice fragments, he weaves a dream filled with gentleness and love, belonging to himself and his wife. He said, "Even if life ends, the story continues."
Love transcends life and death. In the era of AI, it brings the most beautiful memories into our dreams and sight. This is the story of a man who will forever sing with his wife. His tale will forever be passed down.
Dream Machine Product Entry: https://top.aibase.com/tool/luma-ai
