
Gæ€å®åæ Œãžã®éïŒææ°ãã¬ã³ããšæè¡ã®æ·±æã
æ£çŽã«èšãã
20幎ãITã®äžçã«ããŠãPMPïŒãããžã§ã¯ããããžã¡ã³ãã»ãããã§ãã·ã§ãã«ïŒãšããŠæ°ããããªãçŸå ŽãåããŠããèªè² ããããããã§ããææ°AIã®åœéã«ãŒã«ãçµ±èšææ³ã®åã§ã¯ãæ¯æ¥ããæé·çãã®é£ç¶ã ããŸãããã®çã¿ããªããªã£ããæé·ãæ¢ãŸããã ãã©ãã
å æ¥ã®ç¬¬40ã»ãããæ£è§£çã¯80%ã奜調ã ãšæããã§ãããããžã£ãŒã®èŠç¹ã§å·éã«èŠãã°ãæ®ãã®20%ã®ãèŠèœãšãããããããããžã§ã¯ãïŒïŒè©Šéšæ¬çªïŒã«ãããæå€§ã®ãªã¹ã¯ã ã詊éšã§ãå®åã§ãããã§ãããšãããã§ã¯ãªããã§ããªãã£ããšãããã«ãããçã®äŒžã³ä»£ãããã
仿¥ã¯ãã®äŒžã³ä»£ã確å®ã«åããããã«ããã€ã©ã€ããæ§é åããŠãŸãšããŠããã
ð 仿¥ã®ãã€ã©ã€ãïŒããã詊éšã®åããç®ïŒ
1. ãæäºãåºå³¶AIããã»ã¹ïŒæ¥æ¬ãäž»å°ããåœéã«ãŒã«
2023幎ãG7è°é·åœã ã£ãæ¥æ¬ãäž»å°ããŠæ¡æããããçæAIã®éçºè ã»å©çšè åãã®åœéçãªæéã ãååã¯ç¥ã£ãŠããŠãããããäœãç¹åŸŽãªã®ïŒããšèããããšè©°ãŸã人ãå€ãããã€ã³ãã¯ã²ãšã€ã ã
ð¡ 詊éšå¯Ÿçã¡ã¢ïŒ
éžæè¢ã«ãæ³çææåãããããšæžãããŠããããããã¯çœ ã ãæ£è§£ã®éµã¯ãèªäž»çãªã¬ã€ãã©ã€ã³ããåœéçãªè¡åèŠç¯ããšãããã¥ã¢ã³ã¹ã«ãããæ³åŸã§ã¯ãªãããããŸã§ãã¿ããªã§å®ãããããšããåæã ãâ ïž æ··åæ³šæïŒ
ããªåå® â ç°å¢ïŒæ°åå€åïŒã®è©±ãAIãšã¯ç¡é¢ä¿ã
EU AIæ³ïŒAI ActïŒ â ãã¡ãã¯æ³çææåããããèŠå¶ãããšãŒãããã®è©±ã
ãåºå³¶AIããã»ã¹ïŒæ³çææåãªãïŒåœéè¡åèŠç¯ãããã®3ç¹ã»ããã§é ã«å©ã蟌ãã§ããã°ãæ¬çªã§è¿·ããªãã
2. ãNLPãBPEïŒByte Pair EncodingïŒïŒLLMã®ãèšèã®å»ã¿æ¹ã
å€§èŠæš¡èšèªã¢ãã«ïŒLLMïŒããã©ããã£ãŠåãã®èšèãçè§£ããŠãããããã®æ žå¿ã«ããã®ããã®ããŒã¯ãã€ãºæè¡ã ã
圹å²ïŒ åèªããã®ãŸãŸäžžããšæ±ãããããªããŠãæå³ã®ããæå°åäœãsubwordïŒãµãã¯ãŒãïŒãã«åå²ããã
ã¡ãªããïŒ èªåœã«ãªãæªç¥èªïŒ`OOV: Out-of-Vocabulary`ïŒãåçã«æžããããçµæãšããŠåŠç¿å¹çãã°ã³ãšäžããã
ð¡ å®åã«çœ®ãæãããšïŒ
æ®æ®µChatGPTãClaudeã«é·ãæ¥æ¬èªãå ¥åãããšããè£åŽã§åããŠããã®ããŸãã«ãã®BPEããŒã¹ã®ããŒã¯ãã€ã¶ã ããããŒã¯ã³æ°ã®äžéã«åŒã£ããã£ãâŠããšãããã®å®åäžã®å¶çŽãããã®è£åŽã«ã¯ãã€ããã®æè¡ããããä»çµã¿ãç¥ã£ãŠãããšãããã³ããã®æžãæ¹ãŸã§å€ãã£ãŠããã
ð§ æ·±æãïŒé£åããã¯ã¢ãã
ð ååž°äžé£ç¶ãã¶ã€ã³ïŒRDDïŒRegression Discontinuity DesignïŒ
å ææšè«ã®ææ³ã®äžã§ããå人çã«ãç²ã ãªããšæãã®ãããã ã
äŸãã°ããã¹ãã§80ç¹ä»¥äžã®äººã«ã ãè£å©éãåºãããšããå¶åºŠããã£ããšããããã®ãšãã79ç¹ã®äººãš81ç¹ã®äººãæ¯ã¹ãŠã¿ããšããã®2人ã®èœåå·®ã¯ã»ãŒãªããã§ãäžæ¹ã¯è£å©éãããããŠãäžæ¹ã¯ããããªããã€ãŸããèªç¶ã«çãŸããå¢çç·ïŒéŸå€ïŒã®ãããã§ãã»ãŒã©ã³ãã ã«æ¯ãåããã®ãšåãå¹æãæž¬ãããšããããã ã
ð 仿¥ã®èªåãžã®ãã£ãŒãããã¯
芳ç¹è©äŸ¡åŒ·ã¿çµ±èšåŠïŒRDDçã®å ææšè«ïŒã匷ååŠç¿ïŒPPOãªã©ïŒã®æ°ççãªæ§é çè§£ã¯å®å®ããŠãããè£åŒ·ãã€ã³ãææ°ã¬ããã³ã¹ã®åºæåè©ïŒåºå³¶AIããã»ã¹ãªã©ïŒããLLMé¢é£çšèªïŒBPEãªã©ïŒã®æ£ç¢ºãªçŽä»ããå確èªããå¿ èŠããã
ð¡ ææ¥ãžã®äžèš ãææ°ã·ã©ãã¹ã®æäºã¯ããã¥ãŒã¹ã®ããŒã¯ãŒããæ£ç¢ºã«æŸãã ãã§ç¢ºå®ã«åŸç¹æºã«ãªããã
ãå ææšè«ãææ³ããšã®ç¹åŸŽãšRDDãšã®æ±ºå®çãªéã
å®åã§å ææšè«ã䜿ãåããéãã©ã®ææ³ãé©åãè¿·ãããšããããŸããããã§ã¯ãäž»èŠãª3ã€ã®ææ³ããæ¯èŒå¯Ÿè±¡ããšãRDDãšã®å·®åããšããèŠç¹ã§æŽçããŸããã
â RCTïŒã©ã³ãã 忝èŒè©ŠéšïŒ
ç¹åŸŽïŒ å ææšè«ã«ãããããŽãŒã«ãã¹ã¿ã³ããŒããã
RDDãšã®éãïŒ å®éšè ããæå³çã«ãã©ã³ãã ãªå²ãåœãŠãè¡ãå¿ èŠãããç¹ã
â DIDïŒå·®åã®å·®åæ³ïŒ
ç¹åŸŽïŒ åŠçœ®çŸ€ãšå¯Ÿç §çŸ€ã®ãååŸæ¯èŒããè¡ãã
RDDãšã®éãïŒ å¢çç·ïŒéŸå€ïŒã§ã¯ãªããä»å ¥ãè¡ããããæç¹ãã®ååŸã掻çšããç¹ã
â RDDïŒååž°äžé£ç¶ãã¶ã€ã³ïŒ
ç¹åŸŽïŒ å¢çç·ïŒéŸå€ïŒä»è¿ã®ããŒã¿ãæ¯èŒããã
ç¬èªã®åŒ·ã¿ïŒ å®éšçãªæäœã§ã¯ãªããå¶åºŠäžã®ã«ãŒã«ãªã©ã§ãèªç¶ã«çãŸããå¢çããæŽ»çšã§ããç¹ã
æ¬çªã§æãã®ã¯ããã©ã®ç¶æ³ã§ã©ã®ææ³ãé©åãããåãå¿çšåé¡ã ãææ³ã®ååã ãã§ãªããããã€äœ¿ããããŸã§ã»ããã§èŠããŠããããã
ð¡ïž æµå¯ŸçåŠç¿ïŒAdversarial TrainingïŒ
AIã«ãããšã人éã«ã¯èŠããªãã¬ãã«ã®ãã€ãºããå ããããŒã¿ãåŠç¿ãããŠãæ»æã«åŒ·ãããææ³ã ãããããããèšãã°ãAIãžã®ãäºé²æ¥çš®ãã
Adversarial ExamplesïŒ å ¥åã«ããããªæåïŒãã€ãºïŒãå ããŠãã¢ãã«ã誀èªèãããæ»æææ³ã
Adversarial TrainingïŒ ãã®æ»æããŒã¿ãèšç·Žã«å«ããããšã§ãã¢ãã«ã®é 奿§ãé«ããé²åŸ¡ææ³ã
â ïž æ··åæ³šæïŒ
GANïŒæµå¯Ÿççæãããã¯ãŒã¯ïŒã®ãæµå¯Ÿçããšã¯ç®çããŸã£ããéããGANã¯ããªã¢ã«ãªããŒã¿ãçæããããããAdversarial Trainingã¯ãæ»æããå®ããããã
ð 仿¥ã®èªåãžã®ãã£ãŒãããã¯
匷ã¿
çµ±èšåŠïŒRDDçã®å ææšè«ïŒã匷ååŠç¿ïŒPPOãªã©ïŒã®æ°ççãªæ§é çè§£ã¯å®å®ããŠããã
è£åŒ·ãã€ã³ã
ææ°ã¬ããã³ã¹ã®åºæåè©ïŒåºå³¶AIããã»ã¹ãªã©ïŒããLLMé¢é£çšèªïŒBPEãªã©ïŒã®æ£ç¢ºãªçŽä»ããå確èªããå¿ èŠããã
æ£çŽã«èšããšãæ°ççãªãšããã¯20幎ã®å®åçµéšãå¹ããŠãããã§ãæäºãNLPåšãã®çšèªã¯ããç¥ã£ãŠããã€ããããäžçªå±ãªããååãšäžèº«ãã»ããã§ãäœåºŠã§ã確èªãããæ³¥èããããããäžçªç¢ºå®ã ã
ð¡ ææ¥ãžã®äžèš
ãææ°ã·ã©ãã¹ã®æäºã¯ããã¥ãŒã¹ã®ããŒã¯ãŒããæ£ç¢ºã«æŸãã ãã§ã確å®ã«åŸç¹æºã«ãªããã
å š39ã»ãããŸã§æ®ã4ã»ããããããŸã§æ¥ãããããæ¢ãŸãçç±ã¯ãªããPMPã®æå°ã«ãããŠãæåŸãŸã§é«ãç±éãç¶æããŠå®éããã
ð Gæ€å®ææŠã·ãªãŒãº
第1äœïŒGæ€å®ãåãããšæ±ºããçç±
第3äœïŒæ¯æ¥äœ¿ãAIããŒã«ãGæ€å®ã®æç§æžã ã£ã
ð ãã®ãã¬ãžã³ã®ä»ã®èšäº
ð AI掻çšå®éšå®€
https://note.com/quiet_emu2080/m/m79242a34a2cb
ð çŸå ŽPMã®å®è·µããŒãhttps://note.com/quiet_emu2080/m/mb3eda5b30688
ð Gæ€å®ÃCopilotå匷æ³ã®èšäºã¯ãã¡ã
https://note.com/quiet_emu2080/n/nc7ee056f8fe9
Gæ€å®å匷äžã®æ¹ãäžç·ã«é 匵ããŸãããïŒ Xã§DMãã©ãã â @NoteCcm42090
©shiracoïœPMPããããã®å®è·µããŒãã@NoteCcm42090