
12 Days of OpenAI: Day 2 ãå°éå®¶ã ããéããŠããŒã¿ãã¹ããå§ããã ãšïŒïŒããããäžè¬ããŒããŒã¯ãããªããé£ããããšããŠããªãã»ã»ã»ãç¶æ ïŒïŒŸïŒŸïŒ
åå3æã«èµ·ããè¶³ç«æç©ã§ãïœãããã12 Days of OpenAIã®2æ¥ç®ã§ãã
çµãã£ãåŸã«ããã€ãã¯ãæææ¥ã®åå10æã«ãã£ãŠè¡šç€ºãããŠãåæ¥ã®æ·±å€ã¯è§£æŸãããŠã»ã£ãšããŠããŸãïœ

ã§ã2æ¥ç®ã§ãããçŸæç¹ïŒæ¥æ¬æéåå4æåã远å ãããã®ã§ãäžã«è¿œèšããŠãããŸãïŒã§ãåç»ãã¢ãããããŠãªãã®ã§ãããããé§äœ¿ããŠèªå翻蚳ããŠçè§£ããã¬ãã«ãªãã§ããïŒãŠãžã£ïœïŒãã¶ã£ã¡ãã
è³¢ã人ãã¡ã®èšããŠãããšã¯ãå¡äººã«ã¯åããããïŒïŒ
ã§ããïŒïŒŸïŒŸïŒ
ããããå°éå®¶ã«åããŠãæ°ããChatGPTã䜿ãã¢ãã¿ãŒåéãŸã§ããŠãŸãããšãŠããããªããã©ãå¿åã§ããªãïŒïŒŸïŒŸïŒ
https://openai.com/form/rft-research-program/
誰ãå¿åãã¹ãã§ããïŒ
ç§ãã¡ã¯ãç ç©¶æ©é¢ã倧åŠãäŒæ¥ãç¹ã«çŸåšå°éå®¶ãäž»å°ããè€éãªã¿ã¹ã¯ã®çãã»ãããå®è¡ããŠãããAIã®æ¯æŽããæ©æµãåããã§ãããäŒæ¥ã«å¿åããããšãæšå¥šããŸãã æ³åŸãä¿éºãå»çãéèãå·¥åŠãªã©ã®é åã§ææãªçµæãåŸãããŠããŸãã匷åãã¡ã€ã³ãã¥ãŒãã³ã°ã¯ãçµæã客芳çã«ãæ£è§£ãã§ãããã»ãšãã©ã®å°éå®¶ãåæãããããªã¿ã¹ã¯ãåŸæãšããŠããããã§ãã
ãããChatGPTããã«æããŠããããªããšãäœãèšã£ãŠãã®ããã£ã±ãããããïŒïŒŸïŒŸïŒ
äŸã«ãã£ãŠãã©ã€ãã®å 容ã¯ãChatGPTããã«ãŸãšããŠããã£ãã®ã§ãèšäºã®æåŸã«ã¢ããããŠããã®ã§ãèå³ã®ããããã¯ããã¡ããã
â»ã©ã€ãåç»ãå ¬éãããã®ã§ã远èšããŠãããŸãã
ãã¡ã€ã³ã»ãã¥ãŒãã³ã°( Fine Tuning )ã£ãŠãªãã ïŒ
ä»åã®ããŒãã¯ã匷ååŠç¿ãå©çšãããã¡ã€ã³ãã¥ãŒãã³ã°ã®è©±ããããããé ãç®ãããã§ããïŒïœ
ãªããšãåããããã説æããããããChatGPTããã«èª¬æããŠãããã®ã§ãèªãã§ã¿ãŠãã ãããªïœ
ä»åã®å 容ãäžåŠçã«ããããããã«èª¬æããŠã»ãããã ãã©ããŸããåŸæ¥ã®Fine Tuningã£ãŠã®ãã©ãããããšãªã®ãæããŠ
**åŸæ¥ã®Fine TuningïŒãã¡ã€ã³ãã¥ãŒãã³ã°ïŒ**ãäžåŠçã«ãåããããã説æãããšã以äžã®ãããªã€ã¡ãŒãžã§ãïŒ
ããããFine Tuningã£ãŠäœïŒ
AIã¯ããšããšè²ã ãªããŒã¿ã§èšç·ŽãããŠããŠããªããšãªãè²ã ãªããšãã§ããããã«ãªã£ãŠããŸããã§ããåŠæ ¡ã®ææ¥ã¿ããã«ã**ãç¹å®ã®ç§ç®ãããŒãããã£ããå匷ããŠè©³ãããªãã**ã®ãFine Tuningã§ãã
äŸã話ã§èª¬æ
AIã®åºæ¬ç¶æ : æ¬ãããããèªãã§äœã§ãå°ãç¥ã£ãŠãããã©ãã©ããæ·±ãã¯ç¥ããªãåã
Fine Tuning: ãã®åã«ãæ°åŠãã ããç¹èšããŠããæ°åŠã®åé¡ãªãã©ããªåé¡ã§ãè§£ããïŒããšããã¬ãã«ã«ããããšã
å ·äœçã«ã¯ã©ãããã®ïŒ
ããŒã¿ãçšæãã:
äŸãã°ãããããã質åããããããããçããããšããäŸãããããçšæã
ãããAIã«èŠããã
AIã«åŠã°ãã:
AIã¯ãã®ããŒã¿ã䜿ã£ãŠãããã®ããŒãã§ã¯ããçããã°ãããã ãªããšèŠããã
çµæ:
AIããã®ããŒãã«ç¹åããŠãããæ£ç¢ºã§åœ¹ã«ç«ã€çããåºããããã«ãªãã
åŸæ¥ã®Fine Tuningã®ãã€ã³ã
AIã«æš¡å£ããã: AIã¯äžããããããŒã¿ãå ã«ããããããæãã§çããã°ãããã ããšåŠã³ãŸãã
äŸãã°ãã質åã®èšèé£ãã«åãããŠäžå¯§ãªèšèã§è¿ãããšãã£ãããšã
å¶éããã:
AIã¯æãããããã¿ãŒã³ãç䌌ããããšã¯åŸæã ãã©ãèªåã§æ°ããèããäœã£ãããé£ããæšè«ããããããã®ã¯èŠæã
ã€ãŸããåŸæ¥ã®Fine Tuningã¯ãAIããç¹å®ã®ããŒããã¹ã¿ã€ã«ãããã£ããèŠããŠãããã«ç¹åããã®ãå©ããæ¹æ³ãªãã ãïŒ
ãªããšãªãããã£ããšæããŸãããããŒãã«ïŒïŒïŒã®ChatGPTã ãšãããŸããŸãªããšãåºãæµ ãç¥ã£ãŠããç¶æ ïŒãšãèšã£ãŠããããªãã®ã¬ãã«ã ãã©ãïœïŒã
ã§ãããã«ãç¹å®ã®åéã®åŠç¿ããŒã¿ãããããåŠç¿ããŠããã£ãŠãå°éå®¶ã«ãªã£ãŠãããã£ãŠããšã§ããããã ããã®ããã«ã¯ããã¡ããã¡ãããããã®åŠç¿ããŒã¿ãå¿ èŠã«ãªããšããããšããããŸãã
äœè«ã§ãããChatGPTããã®åçãèŠãŠããããŒãŒãŒïŒãã£ãŠæããã©ãããã¯ãæ¡éãã«å€§éã®æç« ãèªã¿èŸŒãããšãã§ããããã
ããã£ãŠãçè«çã«ã¯ããã§ããããããŒãã£ãŠããããšã¯åãã£ãŠãããã ãã©ãå®éã«ããããšãããšããšãã§ããªãæ°ã®ã³ã³ãã¥ãŒã¿ãšãã³ã£ããããã»ã©ã®ããŒã¿ãå¿ èŠã ã£ãã
èšãæããã°ãå·šé¡ãªæè³ãå¿ èŠãªã®ã§ããã
ã§ãã³ã³ãã¥ãŒã¿ã®æ§èœãæ¡éãã«äžãã£ãŠãã£ãããšããã€ã³ã¿ãŒããããSNSã«ãã£ãŠãããžã¿ã«åãããæç« ã»åçã»åç»ããããã§ããïŒãšããã»ã©ååšããããã«ãªã£ããšããããšããã£ãŠãæè³é¡ã10幎åã«æ¯ã¹ãã°ããŒããïŒã€ãïŒã€ãéããããªç¶æ ã«ãªã£ãã®ã§ããïŒã£ãŠèšã£ãŠããæ¡éããªæè³ã§ããããšã«ã¯éããªããã©ïœã倩æåŠçãªæ°å€ãããå°ç1åšã®èšæž¬ã§ãããããã«ãªã£ããããããããã«åããã«ããããïŒïŒ
ã§ãã£ãŠãããããã£ãŠã¿ãããšãã人ãã¡ãåºãŠããŠãChatGPTããã«ä»£è¡šãããçæïŒ¡ïŒ©ããŒã ã«ãªã£ãã®ã§ããã
ããŠããã¡ã€ã³ã»ãã¥ãŒãã³ã°ã§ã¯ããå°éå®¶ã«ãããšããããšãªãã ãã©ãå°éå®¶ã®ããŒã¿ã倧éã«å¿ èŠã«ãªãã
ãããã倧åŠãç ç©¶æã«ã¯ãè«æãå°éæžã¯ãããã©ãå°éå®¶ã¯ãã©ãã©ã现ååããŠãããŸãã
äŸãã°ãã¹ã£ãŒãïŒãïŒïœïŒã
æåãªæä»£ã¯ãã¢ã€ã¹ã¯ãªãŒã ã£ãŠèšãã°ãã¢ã€ã¹ãã£ã³ãã£ãŒãšãã«ããã«å ¥ã£ãã¢ã€ã¹ããããŠããœããã¯ãªãŒã ãšèšããããŠãºããã®ãã€ããããããªãã£ããããããããã©ã®ã¿ïœ
ããããä»ã¯ãã³ã³ããã§ãã20çš®é¡ããã売ã£ãŠãŸãããïŒããã§ã³ããªã¬ã³ãžãæ¹è¶ã«ããã³ãŽãŒãã¬ã¢ã³ã»ã»ã»ã»ã»
ã©ãã©ã现ååããŠããŸãã
ã¢ã€ã¹ã¯ãªãŒã ãšããåéã®äžã§ã现ååãããŠãã£ãŠãæ¹è¶ãšããæ°ããªå°éåéãåºãŠããŠããŸãããããŠããæ¹è¶ã¢ã€ã¹ã¯ãªãŒã ããšãããžã£ã³ã«ã«çµã蟌ãã§ãããšãæ¥æ¬ã«ãããªããããããŒã¿ããããå°ãªããªããã§ãïœ
ãã®ããã«ããå°éå®¶ã«ä»ç«ãŠãããšãããšãåŠç¿ããŒã¿ã倧éã«çšæããªããã°ãªãããã ãã©ããããããããšãããšãããããç ç©¶è ã®ããŒã¿ãå°ãªãã£ãŠããšã«ãªã£ãŠããŸãã®ã§ãããã
ããã§ãã€ãã«ã匷ååŠç¿ãšããããšãåºãŠããŸãã
匷ååŠç¿ã£ãŠïŒ
ã§ã¯ããã£ãããChatGPTããã«æããŠããããŸãããïœ
ãªãã»ã©ãã§ã¯ã次ã«ã匷ååŠç¿ã«ã€ããŠãåãããããæããŠã
**匷ååŠç¿ïŒReinforcement LearningïŒ**ãäžåŠçã«ãåããããã説æãããšã以äžã®ãããªã€ã¡ãŒãžã§ãïŒ
匷ååŠç¿ã£ãŠäœïŒ
AIãã**ã詊è¡é¯èª€ãéããŠãã©ãããã°äžçªããçµæã«ãªãã®ããåŠãã§ããæ¹æ³ã**ã®ããšã§ããã€ãŸããAIãäœãè¡åãããŠãè¯ãçµæãåŸããè€ããŠãæªãçµæãåŸããæãçŽãããšããæãã
äŸã話ã§èª¬æ
ã²ãŒã ãããŠããAI:
äŸãã°ãAIããè¿·è·¯ãããŽãŒã«ãç®æãã²ãŒã ãããã¬ã€ããŠãããšããã
åãã¯ã©ã£ã¡ã«é²ãã°ãããåããããé©åœã«åãã
詊è¡é¯èª€ãã:
ãŽãŒã«ã«è¿ã¥ããšè€ããããïŒåŸç¹ããããïŒã
å£ã«ã¶ã€ãããšæ³šæãããïŒåŸç¹ãæžãïŒã
åŠãã§ãã:
äœåºŠããã¬ã€ããŠãããã®æ¹åã«é²ããšãŽãŒã«ã«è¿ã¥ãããªïŒããšåŠãã§ããã
æçµçã«ããæçã§ãŽãŒã«ã«ãã©ãçãæ¹æ³ããèŠã€ãåºãã
匷ååŠç¿ã®ä»çµã¿
ãšãŒãžã§ã³ãïŒAIïŒ:
å®éã«è¡åããAIã®ããšã
ç°å¢:
AIã詊è¡é¯èª€ããå ŽïŒäŸãã°ãè¿·è·¯ãã²ãŒã ïŒã
å ±é ¬:
è¯ãè¡åããããšãã«ããããããã»ãã³ãã
äŸãã°ãããŽãŒã«ã«è¿ã¥ããããæ£ããçããåºãããšãã€ã³ããããããã
ç®ç:
ã§ããã ãããããã®å ±é ¬ãããããããã«ãè¡åãæ¹åããŠããã
ãã€ã³ã
詊è¡é¯èª€ã倧äºïŒå€±æããŠãããã®çµéšãå ã«è³¢ããªã£ãŠããã
ãã»ãã³ãæå€§åïŒAIã¯ãã©ãããã°äžçªããçµæã«ãªããããèããããã«ãªãã
èªåã§èããåãã€ããïŒæããããéãã«åãã ããããªãããã©ãããã°è¯ããããèªåã§æšæž¬ããã
身è¿ãªäŸã§åŒ·ååŠç¿ãèãã
éšæŽ»ã®ç·Žç¿:
åãã¯ã«ãŒã«ãããåãããªããã©ãç·Žç¿ããŠäžæããããšã³ãŒãã«è€ããããã
è€ãããããã¬ã€ãç¹°ãè¿ããŠãããã¡ã«ãã©ãããã°åãŠããåãã£ãŠããã
èªè»¢è»ã«ä¹ã:
åãã¯è»¢ãã§å€±æãããã©ãæåãããšãã§ããïŒããšããéææïŒå ±é ¬ïŒãåŸãããã
倱æãšæåãç¹°ãè¿ããŠãæçµçã«äžæã«ä¹ããããã«ãªãã
匷ååŠç¿ã¯ãçµéšããåŠã¶ãæ¹æ³ãªãã ãAIã人éãšåãããã«ã倱æããªããæé·ããä»çµã¿ã䜿ã£ãŠãããã ãïŒ
ã¡ãã£ãšãããã«ãããããããªããã©ãAIãèªã詊è¡é¯èª€ããããšã§ãå°ãªãããŒã¿ã§ãåŠç¿å¹æã倧ããããããšãã§ããã£ãŠããšããã€ã³ãã§ãã
ChatGPTããã説æããŠãéšæŽ»ã®äŸã®ããã«ãäŸãã°ããµãã«ãŒã®è©Šåããäœåããã£ãŠããã¹ãããŸããããšããéäžã§ããŒã«ããšãããŠããŸããšãããŽãŒã«ã決ãŸããšãã倱æãããšããªã©ããããããªãçµéšããããã
ãããŠãããŸãè¡ãæ¹æ³ãèªãç·šã¿åºããŠããã®ã§ããã
ã§ãããã§éèŠãªã®ã¯ããã³ãŒãã®åœ¹å²ããããã«å°œããŸãã
ãã ãããã¿ãããã«ãäœçŸåããµãã«ãŒã®è©ŠåãããŠãã匷ãã¯ãªããŸãããã³ãŒããã€ããŠããã£ãããšããæ¹åæ§ã瀺ããããšãéèŠã§ãããåºãŸããããŠããããããäºãã«è·é¢ããšã£ãŠãã¹ãéãããšãããçžæã®åŒ·ãéžæã«ã¯2人匵ãä»ãããšããã¢ããã€ã¹ããªããšç¡é§ãªããšãç¹°ãè¿ããŸãã
ãããšåãããã«ãAIã®åŒ·ååŠç¿ã§ã¯ãããã»ãã³ãæå€§åããéèŠãªãã€ã³ãã«ãªããŸãã
ãïŒããAIã£ãŠãããã€ãããããšåã¶ã®ïŒãã£ãŠïŒïœ
ãŸããä»çµã¿çã«ã¯ãããªã®ã§ãããåçŽã«ã¯ç¹æ°ãã€ããŸãããããŠãã«ã¯ãç¹æ°ãé«ããªãããã«ã詊è¡é¯èª€ãããŸãã
å ã®ãµãã«ãŒãªãããŽãŒã«ããŠæ±ºããã°10ç¹ããã¹ãéãã°3ç¹ãçžæã®ãã¹ãã«ããããã°5ç¹ãšãã£ãç¹æ°ãã€ããŠããã®ã§ãããããŠããã®ç¹æ°ãæå€§ã«ãªãããã«ãäœåºŠã詊è¡é¯èª€ãããŠãããŸãã
ãããã£ãŠã匷ååŠç¿ãè¡ã£ãŠãããŸãã
ããããä»åã®OpenAIãçºè¡šããæ°æè¡ã¯ã©ãããããïŒ
ããŠããã¡ã€ã³ã»ãã¥ãŒãã³ã°ãšåŒ·ååŠç¿ã¯ããã§ã«ããæè¡ããããçµã¿åãããããšã§ããã£ãšãæè»œã«å°éå®¶ã®AIãäœã£ã¡ããïŒã£ãŠã®ããOpenAIã®æ°ããªæè¡ã
ã£ãŠãèšãããŠããããŒããããã®ã§ãChatGPTããããé¡ãããŸãïŒïœ
ãã¡ã€ã³ã»ãã¥ãŒãã³ã°ãšåŒ·ååŠç¿ã«ã€ããŠã¯ãããããŸãããã§ã¯ãä»åã®æ°æè¡ã®åŒ·ååŠç¿ãå¿çšãããã¡ã€ã³ãã¥ãŒãã³ã°ã§ããã£ãŠã®ãåãããããæããŠïŒããããäžçªç¥ãããïŒïŒ
æ°ããæè¡ã§ããã匷ååŠç¿ãå¿çšãããã¡ã€ã³ãã¥ãŒãã³ã°ïŒReinforcement Fine Tuning, RFTïŒãããäžåŠçã«ãåããããã説æããŸãïŒ
RFTã£ãŠã©ããªæè¡ïŒ
ç°¡åã«èšããšã **ãæ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°ïŒAIã«ç¹å®ã®ããŒã¿ãåŠã°ããæ¹æ³ïŒã**ãš **ã匷ååŠç¿ïŒè©Šè¡é¯èª€ã§åŠã¶æ¹æ³ïŒã**ãçµã¿åããããã®ã ãã
æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°ã§ã¯ãAIããæããããããšãããã èŠããã ãã ã£ããã©ãRFTã§ã¯AIãèªåã§èããåã身ã«ã€ããããšãã§ãããã ïŒ
ã©ãããä»çµã¿ãªã®ïŒ
AIãã¿ã¹ã¯ã«ææŠ
äŸãã°ãæ£è ã®çç¶ãããåå ãšãªãéºäŒåããç¹å®ãããããªé£ããåé¡ãè§£ãã
æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°ã§ã¯ãããçããã°ãããããšæš¡ç¯è§£çãæããã ãã ã£ãã
AIã«èªç±ã«èãããã
RFTã§ã¯AIãçããèãããæéããšãèªç±ããäžããã
AIã詊è¡é¯èª€ã§çããåºããã©ãèããã®ããå«ããŠçµæãåºãã
çããè©äŸ¡ããïŒå ±é ¬ãäžããïŒ
AIã®çãã**ãæ£ãããã©ããã**ã§ç¹æ°ïŒå ±é ¬ïŒãäžããã
æ£è§£ã«è¿ãçãã¯ããããã£ãïŒããšè€ããŠå ±é ¬ãå¢ããã
ééã£ãçãã¯ããããéããããšæããŠå ±é ¬ãæžããã
åŠç¿ãã
AIã¯ãã©ãããã°è¯ãçããåºãããããèªåã§èãçŽããŠãæ¬¡ã®ææŠã§æ¹åããŠããã
ã©ããªè¯ãããšãããã®ïŒ
å°ãªãããŒã¿ã§ãåŠç¿ã§ãã
æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°ã ãšãäœåãäœäžãã®ããŒã¿ãå¿ èŠã ã£ãã
RFTã§ã¯ã10ã12åã®äŸãã§ããAIãå¹çããåŠãã§ãããã
ããè³¢ããªã
æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°ã§ã¯AIããç䌌ããã ããã ã£ããã©ãRFTã§ã¯AIããæ°ããèãæ¹ããåŠã¹ãããã«ãªãã
äŸãã°ãæ£è ã®çç¶ããéºäŒåãæšæž¬ããéãããªããã®éºäŒåã ãšæãã®ããã説æã§ããã
ãããããªåéã§äœ¿ãã
å»çãæ³åŸãç§åŠç ç©¶ãªã©ã®å°éçãªåéã§ãæ®éã®AIã§ã¯ã§ããªãã£ãè€éãªã¿ã¹ã¯ã解決ã§ããã
身è¿ãªäŸã§èª¬æãããšâŠ
æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°:
å çããããããåé¡ã«ã¯ããçããªããããšçããæããŠãããããã èŠããã ãã
RFT:
å çããèªåã§èããŠçããŠã¿ãŠããšèšããæ£è§£ãªããããã§ãããïŒããééããªãããã®éšåãçŽããããšãã£ãŒãããã¯ã
èªåã§èããåãã€ããããæç§æžã«ãªãåé¡ã§ãè§£ããããã«ãªãã
äŸ: éºäŒæ§çŸæ£ã蚺æããAI
æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°:
éºäŒåãšçç¶ã®é¢ä¿ããã æèšãããããã®çç¶ãªããã®éºäŒåã ããšèŠããã ãã
RFT:
AIãããã®çç¶ã¯ã©ãããŠãã®éºäŒåãåå ãªãã ããïŒããšèããèªåã§çç±ãäœã£ãŠçããã
æ£ããçãã«ãã©ãçãæ¹æ³ãåŠã³ãå¿çšåãã€ãã
ãŸãšã
RFTã¯ã**æ®éã®ãã¡ã€ã³ãã¥ãŒãã³ã°ã®ãèŠããåã**ã«å ããŠã
**匷ååŠç¿ã®ãèããåã**ãçµã¿åãããããšã§ã
AIãèªåã§æšè«ããæ°ããåé¡ã«ã察å¿ã§ããèœåãæã€ããã«ãªãç»æçãªæ¹æ³ã ãïŒ
ã ãããä»åã®æè¡ã¯ãAIã«èªåã§èããããæ°ããå匷æ³ããšèãããšåããããããããããªããïŒ
æåŸã®ãAIã«èªåã§èããããæ°ããå匷æ³ãã£ãŠèšããããšãã¯ã¯ã¯ã¯ãããšåæã«ããŸã¯ããšãããšããããããŸããïŒïŒŸïŒŸïŒ
楜ããåŠã¹ãããã«ãChatGPTããã«ç©èªãäœã£ãŠããããŸããïœ
ãã¡ã€ã³ã»ãã¥ãŒãã³ã°ãšåŒ·ååŠç¿ã«ã€ããŠã¯ãããããŸãããã§ã¯ãä»åã®æ°æè¡ã®åŒ·ååŠç¿ãå¿çšãããã¡ã€ã³ãã¥ãŒãã³ã°ã§ããã£ãŠã®ãåãããããæããŠïŒããããäžçªç¥ãããïŒïŒ
ç©èª: æ°Žæ³³å çãšçåŸAIã®åŒ·ååŠç¿ã¬ãã¹ã³
ç»å Žäººç©å çïŒãã¬ãŒããŒïŒ: æ°Žæ³³ãå€§åŸæã§ãçåŸã«æ³³ãæ¹ãæããããã
çåŸïŒAIïŒ: æ³³ãã ããšããªããã©ãç·Žç¿ãéããŠãèªåã§èããŠæ³³ããåŠã¶ãããšãç®æšã
1. æåã®ææŠ: æ³³ããªãAI
å ç: ãããããŸãããŒã«ã«å ¥ã£ãŠæ³³ãã§ã¿ããïŒãŽãŒã«ãŸã§è¡ããããã€ã³ãïŒå ±é ¬ïŒãããããããïŒã
çåŸAI: ããã£ïŒæ³³ãæ¹åãããªããã©ããšããããé²ãæ¹åãæ±ºããŠè¶³ããã¿ãã¿ãããŠã¿ãŸãïŒã
çµæ: çåŸAIã¯ãããŸãé²ããæ°Žã飲ãã§ããŸãã
å ç: ãããŒããæ°Žã飲ãããã£ãããããã¯ã¡ãã£ãšééãã ã£ããããã€ã³ãã¯ãŒããã§ã倧äžå€«ïŒæ¬¡ã«è©Šããæ¹æ³ãèããŠã¿ããïŒã
2. 詊è¡é¯èª€: å°ããã€æ¹å
çåŸAIã¯æ¬¡ã®ææŠã§èããã
çåŸAI: ãããããä»åºŠã¯è ãåãããŠã¿ããïŒãã¿è¶³ãšçµã¿åããããé²ããããïŒã
çµæãå°ãåã«é²ãããšã«æåïŒ
å ç: ããããïŒã¡ãã£ãšã ããŽãŒã«ã«è¿ã¥ãããïŒã ãã1ãã€ã³ããããïŒãã®è ã®åããè¯ãèãã ã£ãããã
çåŸAI: ãããïŒãã£ãšè ã匷ãåããããã©ããªãããªïŒã
3. 倧ããªé²æ©: AIãåŠã³ã掻ãã
æ¬¡ã®ææŠã§ã¯ãçåŸAIãããã¿è¶³ïŒè ã®åããã匷åããŠãããã«é²ãã
çåŸAI: ããã£ãïŒãŽãŒã«ã®ååããããŸã§è¡ãããïŒãã®åããããªãè¯ãæ°ãããïŒã
å ç: ãçŽ æŽãããïŒ5ãã€ã³ãããããïŒã§ããã¡ãã£ãšè¶³ã®ã¿ã€ãã³ã°ããã©ãã©ã ããããããçŽãã°ãã£ãšéãæ³³ããã¯ãã ããã
4. æçµææ: èªä¿¡ãæã€AI
äœåºŠãææŠããŠå€±æãæåãç¹°ãè¿ããåŸãçåŸAIã¯ãè ãšè¶³ã®ã¿ã€ãã³ã°ãåãããŠæ³³ããããšãåŠã³ãã€ãã«ãŽãŒã«ã«å°éïŒ
å ç: ãå®ç§ïŒãŽãŒã«ã«å°éãããïŒ10ãã€ã³ãïŒåã¯ããæ³³ãã®é人ã ïŒã
çåŸAI: ããã£ãïŒæ¬¡ã¯èæ³³ãã«ãææŠããŠã¿ãããªïŒèªåã§æ°ããæ³³ãæ¹ãèããŠã¿ããïŒã
ç©èªã®ãã€ã³ã
æåã¯å€±æãæããªã:
AIïŒçåŸïŒã¯ééããããšã§ãäœããã¡ã ã£ããããåŠã¶ã
å çïŒãã¬ãŒããŒïŒã¯åªãããã£ãŒãããã¯ãäžããã
æåäœéšãç©ã¿éãã:
è¯ãåããããããè€ããïŒå ±é ¬ïŒãããšã§ããã®åãã匷åã
ãããããã°è¯ããã ïŒããšAIãèªåã§æ°ã¥ãã
æçµçã«AIãèªç«ãã:
AIã¯ãæ£è§£ããèŠããã ãã§ãªãããèªåã§ã©ãããã°ãããèããåãã身ã«ã€ããã
æ°Žæ³³ã ãã§ãªããæ°ããæ³³ãæ¹ãç°å¢ã«ãå¿çšã§ããããã«ãªãã
ãã®ç©èªãšRFTã®é¢ä¿
ãã®ç©èªã®äžã§ãå çã®ãã£ãŒããã㯠â RFTã®ãå ±é ¬ãšããã«ãã£ãã
çåŸAIã®è©Šè¡é¯èª€ â RFTã§AIãèªåã§æ°ããèãæ¹ãåŠã¶ããã»ã¹ã
ãŽãŒã«éæåŸã®å¿çšå â RFTã§AIãæ°ããã¿ã¹ã¯ã«ã察å¿ã§ããå¿çšåã身ã«ã€ããã
ã€ãŸããRFTã¯AIã«ãæ³³ãæ¹ïŒåé¡ã®è§£ãæ¹ïŒããæããã ãã§ãªãããèªåã§èããŠã©ããªæ°ŽïŒæ°ããåé¡ïŒã§ãæ³³ããããã«ãããããã®æ¹æ³ãªãã ãïŒ
ã©ãã§ããïŒïœãããªãåããããããªã£ãã®ã§ã¯ïŒïœ
ãã§ããããããã©ã圹ã«ç«ã€ã®ïŒïŒã
ã£ãŠãæã£ãã§ããïŒïœ
ãããåçã«äŸ¿å©ã«ãªãã®ã§ããïŒïŒïŒ
ä»å¹Žã®å€ããããèšã£ãŠãŸããããæ¥å¹Žã¯ãããããã®äººã«ã«ã¹ã¿ãã€ãºãããAIã䜿ããã«ãªããŸããããããããžã§ãå®çŸããŸããïŒ
å°éå®¶ã®AIãäœãã£ãŠããšã¯ããããªãã«é¢ããå°éå®¶AIãã§ãããã®ã§ãã
ããªãã®äœéšãçµéšãæ¥ã ã®è¡åãªã©ãåŠç¿ããŠããããªããçæ³ãšããæªæ¥ã®èªåã«ãªãããã«ãã¢ããã€ã¹ããŠãããããã«ãªããŸããæ¥ã ã®é£äºãããæè£ ãã¡ãŒã«ãSNSã®æçš¿æç« ãåçæ®åœ±ãã©ããªäººãšäŒãã°ããã®ãã»ã»ã»
ãïŒãæãïŒïœ
ã©ã€ãåç»æåŸã®ã¯ãªã¹ãã¹ã»ãžã§ãŒã¯
ã©ã€ãåç»ã®æåŸã«ãã¯ãªã¹ãã¹ã»ãžã§ãŒã¯ããããŸããã
æåŸã«ã¯ãªã¹ãã¹ã»ãžã§ãŒã¯ããã£ããã©ããã®äŒè©±ãæããŠ
ã¯ãªã¹ãã¹ã»ãžã§ãŒã¯ã®äŒè©±
話è 3:
ãããŠãæ¯å¹ŽæäŸã§ãããã¯ãªã¹ãã¹ã«ã¡ãªãã ãžã§ãŒã¯ãäžã€ã玹ä»ããŸããç§ãã¡ã¯ãµã³ãã©ã³ã·ã¹ã³ã«äœãã§ããŸãããæè¿ã§ã¯èªåé転è»ãæµè¡ã£ãŠããŸããããå®ã¯ãµã³ã¿ããããã®æµãã«ä¹ãããšããŠãèªåé転ã®ãœãªãéçºããŠãããã§ããã§ããã©ãããŠãæšãèªèã§ããªããŠããœãªãæšã«ã¶ã€ãã£ãŠã°ããããããããã§ãããã
話è 1:
ããžããããã¯å°ããŸãããããªãã§æšãèªèã§ããªããã§ããïŒã
話è 3:
ãããã¯âŠâŠã¢ãã«ã«æšãïŒpine toïŒåŠç¿ãããã®ãå¿ããããã§ãïŒã
話è 1:
ãâŠâŠãããããããŸãããïŒç¬ïŒïŒ ã§ã¯ã次åããæ¥œãã¿ã«ã仿¥ã¯ããã§çµããã§ãïŒã
ãžã§ãŒã¯ã®è§£èª¬ãžã§ãŒã¯ã®ãã€ã³ãã¯ãpineããšããèšèã«ãããããžã£ã¬ã§ãã
ãpineãã«ã¯ãæŸã®æšããšããæå³ããããŸãã
åæã«ãpinïŒããŒã¿ãåºå®ãã/åŠç¿ãããïŒãã®é³ã«äŒŒãŠããããã¢ãã«ã«æšïŒpineïŒãåŠç¿ãããªãã£ãããšããæè¡çãªç¬ã話ã«ããŠããŸãã
æè¡ãã¬ãŒã³ã®ç· ãããããšããŠãå°ããªã©ãã¯ã¹ãããŠãŒã¢ã¢ã§çµãããã圢ã§ããïŒ
ããããªäººãã¡ã®ãžã§ãŒã¯ã¯ããããããïœïœïœïœ
ChatGPTããã®ãã£ãããŸãšãïŒ
åç»ã§äœã話ããŠãã®ãæ°ã«ãªããšæãã®ã§ãChatGPTããã«ãŸãšããŠãããŠããããŸããïœ
以äžã¯ãåç»ã®èŠçŽã§ãã
1. æŠèŠ
ããŒã: OpenAIã®æ°æè¡ãReinforcement Fine Tuning (RFT)ãã
ç®ç:
AIã¢ãã«ãç¹å®ã®ã¿ã¹ã¯ãå°éåéã«æé©åããã
匷ååŠç¿ïŒReinforcement LearningïŒã掻çšããŠãã¢ãã«ã®æšè«èœåãåäžã
èæ¯: RFTã¯ãOpenAIå éšã§GPT-4ã®ãããªããã³ãã£ã¢ã¢ãã«ããã¬ãŒãã³ã°ããéã«äœ¿çšãããæè¡ã
2. æè¡ã®è©³çް
åŸæ¥ã®Fine Tuningãšã®éã:
åŸæ¥ã®Fine Tuning: ããŒã¿ã«åºã¥ããã¢ãã«ãç¹å®ã®åœ¢åŒãã¹ã¿ã€ã«ãæš¡å£ããã
RFT: ã¢ãã«ãæ°ããåé¡è§£æ±ºã®æ¹æ³ãåŠç¿ããè«ççã«æšè«ã§ããããã«ããã
匷ååŠç¿ã®ä»çµã¿:
ã¢ãã«ãã¿ã¹ã¯ãå®è¡ããéã«ãèããäœå°ããäžããçããè©äŸ¡ã
æ£ããçãã匷åããééã£ãçããæå¶ã
å°æ°ã®äŸïŒ10ã12åïŒã§ãã¢ãã«ãæ°ããé åã«é©å¿å¯èœã
3. å ·äœäŸãšå¿çš
æ³åŸåé:
Thomson Reutersãšã®ææºã§ãæ³åŸã¢ã·ã¹ã¿ã³ããCo Counsel AIããéçºã
è€éãªæ³åŸææžã®åæãå°éå®¶ã®äœæ¥ãæ¯æŽã
å»çåé:
Berkeley Labãšã®å ±åç ç©¶ã§ãéºäŒæ§çŸæ£ã®èšºææ¯æŽã«AIãæŽ»çšã
æ£è ã®çç¶ããŒã¿ãããé¢é£ããéºäŒåãç¹å®ããã¢ãã«ãæ§ç¯ã
ç§åŠè«æããåŸãçŽ1100äŸã®ããŒã¿ã䜿ãã匷ååŠç¿ã§ç²ŸåºŠãåäžã
ãã®ä»ã®åé:
ç§åŠç ç©¶ãAIã®å®å šæ§ããã€ãªã€ã³ãã©ããã£ã¯ã¹ãæ³åããã«ã¹ã±ã¢ãªã©ã
4. ãã¢ã³ã¹ãã¬ãŒã·ã§ã³
ãã¬ãŒãã³ã°ããã»ã¹:
ããŒã¿ã»ããïŒJSONL圢åŒïŒãã¢ããããŒãããã¢ãã«ãFine Tuneã
ã°ã¬ãŒããŒïŒèªåæ¡ç¹ã·ã¹ãã ïŒã䜿çšããŠã¢ãã«ã®åºåãè©äŸ¡ã
çµæã®å¯èŠå:
Fine TuningåŸãã¢ãã«ã®ç²ŸåºŠãåäžã
Fine Tunedã¢ãã«ããåŸæ¥ã®ã¢ãã«ïŒäŸ: GPT-4ããŒã¹ïŒãè¶ ããæ§èœãçºæ®ã
5. çºè¡šã®ç®ç
ããã°ã©ã æ¡å€§:
Alphaããã°ã©ã ãéããŠãç ç©¶è ãäŒæ¥ã«RFTãæäŸã
2024å¹Žã«æ£åŒãªãªãŒã¹äºå®ã
æåŸ :
åå è ãRFTãæŽ»çšããŠãç¬èªã®å°éåéã«AIãé©å¿ãããã
ãŠãŒã¶ãŒãæ°ããå¿çšäŸãçºèŠããAIã®éçãæŒãåºããã
6. ç· ãããã
ç ç©¶ãšå®ç€ŸäŒãžã®å¿çš:
ãã®æè¡ããç§åŠãæ³åãå»çãæè²ãªã©ã®åéã§é©åœãèµ·ããå¯èœæ§ã
AIã®å¯èœæ§ãçŸå®äžçã§æŽ»çšããããšãç®æãã
ãŠãŒã¢ã©ã¹ãªãšã³ãã£ã³ã°:
ãã¢ãã«ãæšãèªèã§ããããµã³ã¿ã®ãœãªãæšã«è¡çªããããšããã¯ãªã¹ãã¹ãžã§ãŒã¯ã§çµäºã
2æ¥ç®ã«ããŠãã¬ãã«é«ããïŒïœïœïœ
æåŸãŸã§èªãã§ããã ããŠãããããšãããããŸãïŒ
ãã®èšäºã®ã¹ããã¯ãªãã¯ãã³ã¡ã³ããããã ãããšãå±ã¿ã«ãªããŸãïŒïŒ
å¿æŽããããããé¡ãããŸãïŒ