How I Made My First A.I Music Video
If you’re interested in exploring the world of A.I music videos, you’re in luck! Thanks to the amazing work of Sebastian Kamph, an Art Director from Sweden, it’s now possible to create your very own music video using Stable Diffusion and A.I tools. In this blog post, we’ll take a look at how I made my first A.I music video using the recommended sd-v1-4 model and following Sebs instructions. Step 1: Isolate your musics drum track, export it and then upload it to Audio to Keyframe String Generator. This tool allows you to extract the rhythmic patterns and beats from your audio track and convert them into keyframe data that can be used to create your A.I music video. Step 2: Browse Lexica.art for stylised prompts to make your A.I music video more visually interesting. Once I found something I was happy with, I copied the non-descriptive “stylisation” words and added my own description after. This helped me create a unique and personalised video. Step 3: Use Deforum to add a series of prompts that will be called in the image generation process on specific frames. Deforum is a tool that allows you to generate images using a combination of prompts and pre-trained A.I models. For my music video, I used the 2D animation mode, toggled the wrap border and pasted the keyframe data into the angle and zoom fields, manually toggling the amount it would be affected. Step 4: Render out the images and make final tweaks in Premiere and After Effects. This includes adjusting the colour and fixing a couple of sync issues. As a bit of an experiment, I was fairly happy with the results. The final video reminded me of some of the old media player animations in the late 90s/early 2000s. The A.I music video was visually engaging although I do reckon this style of animation will probably be overused this year. I can see it being a bit of a fad. In conclusion, creating your very own A.I music video is not as difficult as you may think. Thanks to the amazing tools and resources available, it’s now easier than ever to create stunning visuals that perfectly complement your music. If you’re interested in giving it a try, be sure to check out Sebastian Kamph’s tutorials on A.I music videos using the Audio to Keyframe String Generator and Deforum. With a little bit of creativity and experimentation, you too can create an A.I music video that will leave your audience mesmerised!


