Open-Sora does promising video generation on consumer GPUs
27 Junio 2024 at 09:49
Generating a 240p 2/4s clip takes 30/60s and uses up nearly all the memory (24GB). It follows prompts decently well but struggles with detail. You may need quite a few attempts to get a share worthy result. The Open-Sora GitHub repository provides access to the model and details on how to get started. Alternatively, there's a hosted environment on Backprop that shows more examples and lets you try out the model on a 3090 without any setup. This is just version 1.2 - excited to see what future improvements bring! [link] [comments] |