chatglm吧 关注:286贴子:453
  • 7回复贴,共1

求教大佬,Langchain-chatchat启动报错

只看楼主收藏回复

请教大佬,我本地跑langchain-chatchat,我的自身GPU是6G 共享内存是16G但是他只使用了我的6G的自身GPU没有用我的共享内存,怎么才能让他使用我的共享内存呢,现在报错是内存不足
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 214.00 MiB. GPU 0 has a total capacity of 6.00 GiB of which 0 bytes is free. Of the allocated memory 5.13 GiB is allocated by PyTorch, and 1.68 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)


IP属地:上海1楼2024-02-08 12:28回复
    共享不了,cuda只能用专用gpu内存,也就是6g


    IP属地:上海来自iPhone客户端2楼2024-02-15 18:33
    收起回复
      更新显卡驱动


      IP属地:广东来自Android客户端3楼2024-06-17 01:28
      回复