teganewux022966 - Profile
About me
Profile
You might have to make use of the gpu_memory_limit and/or lora_on_cpu config selections in order to avoid operating away from memory. If you still run away from CUDA memory, you may attempt to merge
https://im-token-io.com/