Videogen
Some notes from the videogen project I did for a few weeks in 2023:
Videos: https://www.youtube.com/@paramsingh258/shorts
thoughts:
- the videos were slop. the best image to video model i had available for actual use programatically was stable video diffusion and it only output ~4-5s for each image at very low resolutions.
- eventually i gave up on image to video completely as the videos were too low res for the algorithm to like
- shorts are better than full videos if you want algorithmic pull.
- subtitles are very important. shorts with subtitles do much better than shorts without them.
- the amount of views you need to make money off of youtube is kind of insane. as far as i understand, youtube doesn't count views that come from the shorts feed or from the home page feed for monetization. videos need to be really really good to make it.
- another thing i tried was a video with much more manual interference. i tried making a rk narayan story in the style of paperman. sadly, while it turned out reasonably, it took me a lot of time and i didn't really enjoy the process enough to put more time into it.
- overall, my personal intuition is thinking about this as an artist is better than thinking about it from a swe perspective. inevitably someone will use these models to make great art, it would be nice to be that person.