My thoughts after making this film...
As a writer and video editor, I feel that AI filmmaking won’t enter the mainstream until we have emotional dialogue scenes with expressive characters. So I challenged myself with this film to create the most compelling and emotional dialogue scene that anyone has ever seen in an AI film (no big deal 🤷♂️).
Whether I did or not is subjective. The dialogue scene I’m referring to is toward the end of the film, but I implore you to watch from the beginning.
I used
@FAL to train a Flux Lora for my main characters, and used Mystic and Flux pro on
@freepik for my scenes. I upscaled in
@Magnific_AI to get the best possible init images. We were also given a 3D Diner asset made by Global Objects to use in
@playbook3d 's new diffusion based engine for 3D scenes.
Then I performed the dialogue parts.
I sat there at my computer, performing take after take using
@elevenlabs speech to speech tool, fake sobbing and moaning and breathing like an idiot, really selling it lol… then I used a combination of
@lipdubai and
@Kling_ai 's lip sync tool, plus some editing tricks to make the lip sync very smooth and natural.
But the tools to achieve realistic lip-sync are only half the battle. Good dialogue scenes are hard to do, and it can take years to hone the craft of advancing a story in an entertaining way. This led me to the conclusion that there are 3 paths for
#AIfilmmaking in the near future…
Path 1: People will try making
#aifilm , realize filmmaking is hard and either just make little things for fun or give up on it altogether.
Path 2: People will keep going and actually learn filmmaking. This will take time, but AI workflows will be incorporated in film school programs and taught in online courses.
PATH 3: People will hire skilled professionals. It’s my belief that we will need more
#VFX artists, editors and writers, not less, due to the explosion of content that’s coming. Currently when I work with my commercial agency
@secret__level on a project, we use multiple VFX artists. If you are a VFX artist and you align yourself with the AI community, I think you can work everyday if you want to.
As for the inspiration for the film… my grandmother Judy passed away about one year ago at the age of 93, and she had dementia. Her husband, my grandfather, passed away in the 1980s. I visited her last year in the assisted living home she was in and watched as she experienced vivid hallucinations from her past. I thought that maybe I captured a little bit of what it was like for her in the flashback scenes in Mnemonade.
My film debuted at the Culver Cup competition organized by
@fbrcai and
@AWSstartups . 50 filmmakers, of which I was one, were given a creative treatment crafted by @DAVID_A_SLADE and we had 3 weeks to go from idea conception to finished video. 8 of us were selected as finalists, and I’m honored to say that Mnemonade was chosen as the winning film.
Guillermo del Toro
@RealGDT recently claimed that AI-generated films couldn't evoke deep emotions by stating, "Are they going to make them cry because they lost a son? A mother? F*** no!"
Several people came up to me after my film was shown and told me how they lost a loved one to dementia and that the film made them cry. I’m a fan of Guillermo’s work, but the reason why he made that quote about AI film is because he just hasn’t seen the proof yet.
In the past 2 years of AI video’s infancy, the tech has outshined the story. That’s on me, and creators like myself, who have come from traditional filmmaking backgrounds and embraced AI, but have not used it to its full potential. As early as we may be, it’s our job to create content where the story speaks louder than the tools used to tell it. My hope is that Guillermo and others see work like this and realize its potential.
The
#Filmmaking pipeline in
#Hollywood is too small for today’s technology, and it’s about to get a lot bigger. Companies and platforms are stepping up to provide the tools needed to lift new voices and stories up out of obscurity. If you want to be one of those voices, the biggest thing you can do to help yourself is to learn the fundamentals of filmmaking. AI tools change frequently, but the fundamentals of storytelling do not.
Social media feedback is not always the most constructive, but there are a lot of people in this community who will help and I hope to be one of them. So get started and have fun.
To quote Rob Schneider from the movie Waterboy, “You can do it!” 🫶