WSL2ã§ãAlpaca-LoRAã䜿ãããïŒ(RAMãè¶³ããªããŠæ«æ)
WSL2ã§Alpaca-LoRAã䜿ãããïŒã§ãããªãããšã©ãŒãåºãŠåããã¯ãã¹ïŒ
ãªããã¢ã¬ãªã®ã§ãæåã«æžããŠçœ®ããŸã
GPU RAMãè¶³ããªããŠãåãããŸããã§ãã(^o^)ïŒ

ã§ãããäžå¿ãããã°ã©ã ã¯åãããããã«ãªã£ãã®ã§ãããã®ããŠããŠãæžããŠçœ®ããŸãã
Windowsã§ãã€ã¹ããã¯ããœã³ã³ãæã£ãŠããæ¹ã§ãWSL2ã§åããããããïœãšãã人ã¯ãåèã«ããŠãïŒ
åæç¶æ ã§åããªãçç±
- WSL2ã®èšå®ãäžè¶³ããŠããŠGPUãåãããªãããã«ãªã£ãŠãªã
- bitsandbytesãæ¹å€ããŠããªã
ã§ãã
1. WSL2ã®èšå®ãäžè¶³
1çªç®ã«ã€ããŠã¯ãMicrosoftå çã®å ¬åŒããŒãžãã
NVIDIAå çã®è§£èª¬ããŒãžã«æžããŠãããŸãã
ãã®ä»¶ã«ã€ããŠã¯ãããŠã³ããŒãïŒã€ã³ã¹ããŒã«ããã ããªã®ã§å²ãšé£ããã¯ãªãã§ãã
åé¡ã¯ã2çªç®ã®bitsandbytesã§ãã
2. bitsandbytesãæ¹å€ããŠããªã
ã¯ããããã¯ãããžã§ãããŸãããããã®æ¹åã«ã3æ¥éãã€ã¶ããŸããã
åèè³æ
äœãããã®ãïŒ
æåã«èšã£ãŠãããŸããšãåèè³æã®å
容ããçŽ çŽã«ãã®ãŸãŸãã£ãŠãåããŸããã
ãŸãåºãŠãããã°ã§ãããç§ã®å Žåã¯2ã€ã»ã©ãããŸããã
- libcudart.soãèªã¿èŸŒããªãã
- ç°å¢ãGPUã«å¯Ÿå¿ããŠãªã
- MarkupSafeã§soft_unicodeãèŠã€ãããªã
ãã°ã®è¡šç€ºããããªãã§ãã1çªã¯ãããšããŠã2çªã¯WSL2ã®èšå®ãåã£ãŠããŠãåºãŠããŸãã
ã§ã¯ãäœãæªãã®ããšãããšãbitsandbytesã§ãã
bitsandbytesããç°å¢ã«å¯Ÿå¿ããŠãªãããGPUãåç
§åºæ¥ãŠãªãã§ãã
(ãã®ãããã€ãããããšã¯èšããªããã©ãã¡ãã£ãšãããªæã)
ãlibcudart.soãèªã¿èŸŒããªãã察ç
ããã±ãŒãžãrootã€ã³ã¹ããŒã«ããŠãããªãã
/usr/local/lib/python3.8/dist-packages/bitsandbytes/cuda_setup/
ãããã«main.pyããããšæããŸãã
ãããæ¹å€ããŸãã

260è¡ä»¥éãããã«'/usr/local/cuda/lib64'ãšãããšãããåç
§ããããã«æžããŠãããŸããããã®
æããifã®å€ã«çœ®ããŸãã(ãAddããšå²ã£ãŠãããšãããã远å ã§æžãããã®ã§ã)
ãããããªããšåŸã§èŠåãåºãŠé¢åãªã®ã§ãèµ·ããŸãã
ADD
ãªãããã®æã«æžããã¹ã¯ãCUDAã®libcudart.soãã¡ã€ã«ããããšãããæžããŠãã ããã
ãç°å¢ãGPUã«å¯Ÿå¿ããŠãªãã察ç


375è¡ä»¥éãããã«ããCUDAãç¡å¹ãªãã°'libsbitsandbytes_cpu.so'ããšãããšãããŸããã
ããããCUDAãæå¹ãªãã°'libbitsandbytes_cuda***.so'ãšãããã«å€æŽããŸãã
ããæžãæããªããšãæ£åžžã«soãã¡ã€ã«ãèŠãŠãããŸããã
REMOVE
if not torch.cuda.is_available(): return 'libsbitsandbytes_cpu.so', None, None, None, None
self.lib = ct.cdll.LoadLibrary(binry_path)
ADD
if torch.cuda.is_available(): return 'libbitsandbytes_cuda117.so', None, None, None, None
self.lib = ct.cdll.LoadLibrary(str(binary_path))
ä»åã¯ãlibbitsandbytes_cuda117.soã®117ã¯CUDAã®ããŒãžã§ã³ã®ããšãæããŠããŸãããªã®ã§ãèªåã®ç°å¢ã®ããŒãžã§ã³ã«åãããŠãã ããã
äžã®ãotherãã«ç¢ºèªã»å€æŽæ¹æ³ãæžããŠçœ®ããŸãã確èªããŠãïŒ
other
ã¡ãªã¿ã«CUDAã®ããŒãžã§ã³ã¯ã
äžèšã§ç¢ºèªã§ããŸãã
nvidia-smi
nvcc
äžèšã§å€æŽã§ããŸãã
sudo update-alternatives â-config cuda
ãMarkupSafeã§soft_unicodeãèŠã€ãããªãã察ç
ããã¯ãWSL2é¢ä¿ãããŸãããâŠ
MarkupSafeã®ããŒãžã§ã³2.1.0ãããsoft_unicodeã¯ç¡ããªããŸããã
ãªã®ã§ããã以åã®ãã®ã䜿ãå¿
èŠããããŸãã
pip install markupsafe==2.0.0
ãããªæãã§ãã€ã³ã¹ããŒã«ããŠããã°å€§äžå€«ã§ãã
ãªã¯ãªïŒ
çµããã§ãã( ïŸÏ^ã)ã ä¹ã§ãããŸãïŒ
ãšèšã£ãŠããèªåã®ç°å¢ã§ã¯å®å
šã«åãããªãã£ãã®ã§ãããå¿æ®ãã§ããâŠ(ŽÏ`)
Discussion