
ãé ãšæçã®çžæ§ã«ç¹åããLLMãã€ããïŒãã€ã³ã¿ãŒã³äœéšèš#5ã
ã瀟äŒã§éçšããAIã«è§ŠããŠãã§ããããšãå¢ããããããã®éçšã§ãããããããšãèŠå®ãããïŒã
ã¯ãããŸããŠãåå€å±å€§åŠæ
å ±åŠç ç©¶ç§ä¿®å£«2幎ïŒ2025幎9æçŸåšïŒã®æ£®å
åªæã§ãã
ç§ã¯2025幎1æããçŸåšãæ ªåŒäŒç€Ÿã€ã³ãµã€ããªãŒãã«ãŠAIã»ããŒã¿ãµã€ãšã³ã¹ã®é·æã€ã³ã¿ãŒã³ã·ããã«åå ããŠããŸãã
ã€ã³ã¿ãŒã³ã·ãããéãã倧åŠã§ã¯åŠã¹ãªãã¹ãã«ãçµéšãæ¥ã ç©ãã§ããŸãã
åœèšäºã§ã¯ã€ã³ã¿ãŒã³ã·ããã®å 容ãåŠã³ããããŠãã®é åã«ã€ããŠãæ å ±ç³»ã®åŠçã®çããã«ãäŒãã§ããããšæããŸãã
1. ã€ã³ã¿ãŒã³ã·ããã«åå ãããã£ãã
ç§ãã€ã³ã¿ãŒã³ã·ãããžã®åå ãæ±ºããçç±ã¯ä»¥äžã®ïŒã€ã§ãã
æ å ±æè¡è ãç¹ã«AIéçºè ã«æ±ããããã¹ãã«ã磚ããã
倧åŠã§åŠãã ããšãå®ç€ŸäŒã«å¿çšã§ãããã
ã©ã®ãããªè·çš®ãèªåã«åããŠãããèŠå®ãããã
ç§ã¯å€§åŠã§æ å ±åŠãç¹ã«æ©æ¢°åŠç¿ãäžå¿ã«åŠãã§ããŸãããå®è·µã®æ©äŒãå°ãªããç¥èãæŽ»ããå ŽãããŸããããŸããã§ããã
ãŸããè³æ Œå匷ãªã©ãéããŠæ å ±æè¡ã®åºç€ç¥èã¯èº«ã«ã€ããŠããŸããããå®éã«æãåãããŠæŽ»çšããåããæ å ±æè¡è ã«æ±ããããã¹ãã«ã¯ãŸã ååã§ã¯ãªããšæããŠããŸããã
å®éã«å°±è·æŽ»åã§ã¯ãAIã瀟äŒã«å¿çšã§ããåéã»äŒæ¥ããå¿æããŠããŸãããããããããåŠãã«ããã¹ãã«ãšåŒã¹ããã®ããªãèŠåŽããŸããã
ãŸããå¿æããæ¥çãäŒæ¥ã¯ããçšåºŠå®ãŸã£ãŠããŸããããæ£çŽãèªåã®ããããããšãå°±ãããè·çš®ãææ§ã§ãããïŒèªåã«ã¯éçºãåããŠããã®ãããããšããããžã¡ã³ããåããŠããã®ããéçºã«æºãããšããŠããœãããŠã§ã¢ãšã³ãžãã¢ããã¢ããªã±ãŒã·ã§ã³ãšã³ãžãã¢ããããã¯ãšã³ããšã³ãžãã¢ããªã©ãªã©ïŒ
ãããªäžãæ ªåŒäŒç€Ÿã€ã³ãµã€ããªãŒãã§ã€ã³ã¿ãŒã³ã·ããçãåéããŠããããšãç¥ããå®åã«è¿ãç°å¢ã§ç¥èãçµéšãç©ã¿ãèªå·±çè§£ãæ·±ããæé·ã«ã€ãªããããšèããã€ã³ã¿ãŒã³ã«åå ããŸããã
2. ãããžã§ã¯ãã®æŠèŠ
æ ªåŒäŒç€Ÿã€ã³ãµã€ããªãŒãã®ã°ã«ãŒãäŒç€Ÿã§ããæ ªåŒäŒç€ŸMMGããŒã«ãã£ã³ã°ã¹ã¯ãæ°žç¶å¯èœãªå€é£åºåµé æ¥ããæ²ããŠããŸãã
ããããã¹ãã³ããã§ããçŸåšããå€é£ç£æ¥ã¯ç©äŸ¡é«éš°ã人æäžè¶³ã®åœ±é¿ãåããäŸç¶ãšããŠå³ããçµå¶ç°å¢ã«çŽé¢ããŠããŸãã
ããããç¶æ³ã®äžãå€é£åºã®å£²äžåäžã«ã¯ã飲é£åºã§ã®äœéšïŒDXïŒãã®é²åãæ¬ ãããŸããã
ãããŠã€ã³ãµã€ããªãŒããæ³šç®ããŠããã®ããDXã®äžã€ã§ããããã¢ãªã³ã°ãã§ãã
çžæ§ã®è¯ããé
ãšæçãçµã¿åãããããšã§ã飿åãããæ·±ã楜ãã¿ãåãªãé£äºä»¥äžã®äŸ¡å€ãèŠãã ãããã¢ãªã³ã°ã§ãããäžæ¹ã§ç¥èã®ç¿åŸãé£ãããææ¡ã§ãããœã ãªãšãéãããå°å
¥ããŠããåºèãå°ãªãã®ãçŸç¶ã§ããããã§ç«ã¡äžãã£ãã®ãæ¬ãããžã§ã¯ãã§ãã
æ¬ãããžã§ã¯ãã§ã¯ããã¢ãªã³ã°ãAIã§å®çŸããããšã§ãæ¶è²»è
ã«è±ããªå€é£äœéšãæäŸããå€é£åºã®å£²äžåäžã«è²¢ç®ããããšãç®çãšãããæ¥åºå®¢ã飲é£åºå
ã§æ°è»œã«ããã¢ãªã³ã°ã楜ãããããã«ããŸãã§ãœã ãªãšããããã®ãããªé£äœéšãåµãããšããç®æããŸãã
3. æ¥åå 容
3-1. ã¯ã€ã³ã»æ¥æ¬é ã»ãã¢ãªã³ã°ã«è©³ããå€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒã®éçº
ãAIã§ãã¢ãªã³ã°ãææ¡ããããšãã£ãŠãæ§ã ãªææ³ãèããããŸãããä»åç§ãæ åœããã®ã¯ãã¢ãªã³ã°ã«è©³ããLLMã®éçºã§ãã
LLMãšã¯ã倧éã®ããã¹ãããŒã¿ã䜿ã£ãŠãã¬ãŒãã³ã°ãããèšèªãæ±ãã¢ãã«ã®ããšã§ãïŒå€§éã®ããã¹ãããŒã¿ã䜿ã£ãŠåŠç¿ããããã»ã¹ãäºååŠç¿ãšãããŸãïŒã
ãããŠã埮調æŽïŒãã¡ã€ã³ãã¥ãŒãã³ã°ïŒããããšã«ãã£ãŠãããã¹ãã®å±æ§åé¡ãææ
åæãæ
å ±æœåºãæç« èŠçŽãããã¹ãçæã質åå¿çãªã©æ§ã
ãªã¿ã¹ã¯ã«é©å¿ã§ããŸãã身è¿ãªäŸã ãšãOpenAI瀟ã®Chat GPTãæåã§ãã
æ¬ã€ã³ã¿ãŒã³ã·ããã§ã¯ãLLMã®äžçš®ã§ããBERTãšåŒã°ããã¢ãã«ã«ã倧éã®ã¯ã€ã³ã»æ¥æ¬é
ã«é¢é£ããæç« ããŒã¿ããã¬ãŒãã³ã°ãããããã¯ã€ã³ã»æ¥æ¬é
ããšãæçãã®ãã¢ã®çžæ§ãè¯ãã倿ããããšããã¿ã¹ã¯ã«ãã¡ã€ã³ãã¥ãŒãã³ã°ãããŸããã
3-2. èŠåŽããç¹
èŠåŽããã®ã¯ãç¶ç¶äºååŠç¿ããšããåŠç¿ããã»ã¹ã§ãããã®éçšã§ã¯æ§ã ãªåé¡ã«çŽé¢ããäœæ¥æéãç¹ã«å€ãã£ãã§ãã
ç¶ç¶äºååŠç¿ãšã¯ãäºååŠç¿æžã¿ã®LLMã«å¯Ÿããããã«ç¥èãç¿åŸãããããšãæããŸãã
ç¹å®ã®åéïŒãã¡ã€ã³ïŒã®ã¿ã¹ã¯ã«LLMããã¡ã€ã³ãã¥ãŒãã³ã°ããéãå ã®äºååŠç¿æžã¿ã¢ãã«ãçŽæ¥ãã¡ã€ã³ãã¥ãŒãã³ã°ããããããã®ãã¡ã€ã³ã®ç¥èãç¶ç¶äºååŠç¿ãããã¢ãã«ããã¡ã€ã³ãã¥ãŒãã³ã°ããæ¹ãããã粟床ãé«ãããã®ãã¡ã€ã³ã«é©å¿ã§ããããšãç¥ãããŠããŸãã
ç¶ç¶äºååŠç¿ãè¡ãäžã§ãç¹ã«äžèšã®2ç¹ã«èŠåŽããŸããã
ïŒïŒGPUã¡ã¢ãªäžè¶³
ä»åã¯ãæ¥æ¬èªãšäžè¬çãªç¥èãåŠç¿ããäºååŠç¿æžã¿LLMã«ãã¯ã€ã³ã»æ¥æ¬é
ã«ã€ããŠã®ç¥èãç¶ç¶äºååŠç¿ãããã®ã§ããããŸããLLMã¯ã¢ãã«å®¹éã倧ãããæ¢åã®GPUã§ã¯ã¡ã¢ãªãè¶³ããªããšããç¶æ³ã«çŽé¢ããŸããã
GPUãè²·ãè¶³ãããã«ããããªããããåŠç¿æ¹æ³ã®å·¥å€«ãèããããã§æ¡çšããã®ããLoRAããšããææ³ã§ãã
LoRAïŒLow-Rank AdaptationïŒã¯å
ã®ã¢ãã«ã®åŠç¿ãã©ã¡ãŒã¿ãçŽæ¥å€æŽãã代ããã«ãïŒå€ä»ãã®ïŒäœã©ã³ã¯ã®è¡åãå°å
¥ããŠãå°ãªãèšç®éã§åŠç¿ããææ³ã§ãã
å®éã«ç²ŸåºŠãèœãšããã«ãåŠç¿ãã©ã¡ãŒã¿ãæžããããšãã§ããåŠç¿ãé²ããããšã«æåããŸããã
åé¡ã«çŽé¢ããéã¯å€§å€ã§ããããGPUãšãã£ãããŒããŠã§ã¢ã«å°ã詳ãããªãããšãã§ããè³æ Œå匷ã§åŠãã§ãããPCã®ããã»ã¹ãšã¯ïŒããã¡ã¢ãªã®ä»çµã¿ãšã¯ïŒãããããçµéšã§ããã®ã§ãçµæçã«è¯ãã£ããšèããŠããŸãã
ïŒïŒåŠç¿åŸã®LLMã®èšèªèœåã®äœäž
次ã«çºçããåé¡ã¯ãç¶ç¶äºååŠç¿åŸã®LLMã®èšèªèœåã®äœäžã§ããã
倧åŠã®ç ç©¶ã§ãLLMãå©çšããŠããŸããããã®ãããªåé¡ã«çŽé¢ããã®ã¯åããŠã§ããã
ãã®ãããåå ã®èª¿æ»ãè§£æ±ºææ³ã®å®è£
ã«ã¯ç¹ã«èŠåŽããŸããããã®åé¡ã«å¯ŸããŠã¯ã調æ»ã®æ«ã«èŠã€ãããAdapting Large Language Models to Domains via Reading Comprehensionããšããè«æã圹ã«ç«ã¡ãŸããã
è«æã«ã¯ãåŠç¿ããŒã¿ããåçŽãªæç« ããããå
ã®æç« ïŒQ&Aãå ããæç« ãã«å€æŽãããšãèšèªèœåãèœãšãããLLMãåŠç¿ãè¡ããããšã瀺ãããŠãããè«æã®å
容ãåºã«ãç¬èªã§åŠç¿ããŒã¿ã®å å·¥ãå®è£
ããŸããã
çµæçã«ãLLMã¯èšèªèœåãèœãšãããã¯ã€ã³ã»æ¥æ¬é
ã«å¯Ÿããç¥èãç²åŸããããšã確èªã§ããŸããã
ãã®éçšã§ã¯ç¬èªã®ã³ãŒããå®è£
ããæ©äŒãå€ãã£ãã®ã§ãã³ãŒãã£ã³ã°èœåã倧å¹
ã«åäžãããšæããŸãã
ãŸããåå ã®èª¿æ»ã®ãããå®éšçã«éçºãšæ€èšŒãç¹°ãè¿ããŠããã®ã§ããœãŒã¹ç®¡çã®ããã®ãã¢ãžã¥ãŒã«åå²ããªã©ã®éèŠæ§ãã身ããã£ãŠçè§£ã§ããçŸåšã¯ã€ã³ã¿ãŒã³ã·ããã倧åŠã§ã®ç 究掻ååãããèªèº«ã®ã³ãŒãã£ã³ã°ã«åãå
¥ããããã«ãªããŸããã
4. ã€ã³ã¿ãŒã³ã·ãããéããŠ
ã€ã³ã¿ãŒã³ã·ããã§ã¯ãéçºã¹ãã«ãå°éç¥èã ãã§ãªããããŒã ã§éçºããäžã§å€§åãªããªããžã§ã¯ãæåããã³ãã¥ãã±ãŒã·ã§ã³ã®éèŠæ§ã質ã粟床ãšããçµæã§ã¯ãªããåæ°ã»æéã»æé ãªã©ã®ããã»ã¹ãç®æšã«ããããããéç®ãã¿ã¹ã¯ãç«ãŠããšãã£ããææã«è³ããŸã§ã®èšç»ã®çµã¿ç«ãŠæ¹ãªã©ãæ å ±æè¡ã«éãããå®åã§æ±ããããå§¿å¢ãå¿ èŠãªåãåŠã¶ããšãã§ããŸããã
ãŸããã€ã³ã¿ãŒã³ãéå§ããåœåãèªåã¯è£œåããµãŒãã¹ã®äŒç»ãäœãããæ°ããã¢ã€ãã¢ãèããã®ã奜ãã ãšæã£ãŠããŸããããéçºãé²ãã«ã€ããæãå®éã«åãããŠãäœãããç©ãäœãäžããããšããæå€ãšå¥œããªã®ã ãšæããŸããã
ãããŠããã®ãããªæ§ã ãªåŠã³ãèªå·±çè§£ãã瀟äŒäººã®æ¹ã ãšã®å¯Ÿè©±ãéããŠåŸãããã®ããã€ã³ã¿ãŒã³ã·ããã®é åã ãšæããŸããã
AIéçºãéããŠåŠãã ããšã¯ãæè¡ã ãã§ãªããæè¡ã®å¿çšå ïŒä»åã¯ãã¢ãªã³ã°ïŒã®ç¥èãéèŠã ãšããããšã§ãã
äŸãã°ãéçºãé²ããäžã§ããã¢ãªã³ã°ã®ææ¡ãLLMã«æç€ºãããšããããåºåãèŠãå Žé¢ããããŸãããããããå°éç¥èã®ãªãç§ã«ã¯ãã®ãã¢ãªã³ã°ãæ£ããã®ã倿ã§ãããããã©ãããã¯ã€ã³ã®ååããåãããªããšããããšããããŸããã
ãAIéçºã§ã¯å¿çšå ã®ç¥èãšçµéšãéèŠããšããããšã¯ãå°±è·æŽ»åãéãããç¥èããšããŠçè§£ããŠããããšã§ãããããããå®åã«æºããäžã§ããããçµéšããšããŠèç©ã§ããããšã¯ãæ³å以äžã«å€§ããã£ããšæããŠããŸãã
ä»åŸã¯ãæè¡ã¯ãã¡ãããæ§ã ãªç¥èã»çµéšãç©æ¥µçã«åžåããæ§ã ãªåéã§AIãæ±ãã人æã«ãªããããšèããŠããŸãã
æ ªåŒäŒç€Ÿã€ã³ãµã€ããªãŒãã®ã€ã³ã¿ãŒã³ã·ããã¯ãå°±è·æŽ»åãç 究掻åãå¿ããåå€å±åžå ã®åŠçã«ããããã§ãã
å®éã«ç§ãå°±è·æŽ»åãç 究掻åã§å¿ããææããã£ãã®ã§ãããæè»ã«å¯Ÿå¿ããŠããã ããŸããã
ãŸãã¹ã±ãžã¥ãŒã«é¢ã ãã§ãªããäžåŠçã®ææ¡ãææãå°éããäž»äœçã«åãçµãŸããŠãããããªã©ãåŠçãå¿æŽããŠãã ããäœå¶ãæŽã£ãŠãããšæããŸãã
ãã®ãããAIã»ããŒã¿ãµã€ãšã³ã¹ã«é¢ããç¥èãã¹ãã«ãçµéšãç©ã¿ããæ¹ã¯ãã¡ãããç§èªèº«ãã£ãªã¢ãèãããšãŠãè¯ãæ©äŒã«ãªã£ãã®ã§ããæŒ ç¶ãšã ãã©å°æ¥AIãå®ç€ŸäŒã«åœ¹ç«ãŠãä»äºã«æºããããããšèããŠããæ¹ã«ããããã§ãã
ã€ã³ãµã€ããªãŒãã¯é·æã€ã³ã¿ãŒã³çãåéããŠããŸãïŒ
ããŒã¿ãµã€ãšã³ãã£ã¹ããAIãšã³ãžãã¢ãç®æããŠããåŠçã®ã¿ãªããïŒ
AIéçºããããã¯ãéçºã«ä»äºãšããŠåçµã¿ãå®åãä»ããªããã人ã
ã®æ®ãããè±ãã«ããçµéšãããŠã¿ãŸãããïŒ
åŒç€Ÿã§ã¯çŸå Žã§äœ¿ããããªã¢ã«ãªããŒã¿ã掻çšãã飲飿¥çã®é©æ°ãç®æããŸãïŒ
ãé£ x ITãã®é åã§ãäžç·ã«ã§ããããšãæ¢ããŠãç§ãã¡ãšæ°ããªææŠãããŠãããŸãããïŒ
ã«ãžã¥ã¢ã«é¢è«ã®ãç³èŸŒã¿ã¯ãã¡ãããïŒ
ç§ãã¡ã®åãçµã¿ã®è©³çްã¯ãã¡ãããã§ãã¯ïŒ
