Traceback (most recent call last):
File "/app/app.py", line 14, in <module>
api = APIHandler() # <-- FIXED: no api_key anymore
File "/app/api_handler.py", line 29, in __init__
from generate import LeVoPipeline # from Tencent's repo
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'generate'
I’m sure it wouldn’t be too hard to fix that error, but could you please describe the functionality you want to implement in that space using “natural language” rather than just model names?
Just a few lines would be fine… Otherwise, while I can fix the error itself, I won’t be able to make it work properly.
The tencent/SongGeneration model is primarily designed as a large-scale framework (LeLM and music codec) with parameters extending into the billions. Because of its immense memory requirements and specialized inference architecture, it cannot be hosted on Hugging Face’s free CPU-based Inference API.
The daydreamlive/DreamVAE model is not available through the free hosted API because it requires specific, dedicated hardware. Inference requires a robust machine with around ~ 7.5 GB of VRAM and 27 GB of RAM, which exceeds the limitations of the free Hugging Face infrastructure.
Yeah. That’s right. And that’s a problem that can’t be solved even with the best programming or coding. Generative AI is very powerful, but “it’s not magic. It’s technology.” It’s technology that makes it easy to achieve what’s possible. So, it can’t make the impossible possible. By the way, even without generative AI, it’s impossible for me, at least, to make the impossible possible.
So, as a minimum solution, you’ll probably need to rent a GPU from HF for a fee, or if that’s not possible, you’ll need to find some kind of existing API. However, APIs aren’t usually free either.