
cosΞãå¿ããŠãã40代åŸåã®ãã£ãããšã³ãžãã¢ããAIã®ã䌌ãŠããæ¢ãæè¡ããçè§£ããæ¥
ä»åã¯ãServiceNowã®ãã¯ãã«ã«ãªè©±é¡ã¯ãªãã§ããæè¿ããŒã¿åæé¢é£ã®ãã¿ãåœããã°ã§åãæ±ã£ãŠããŸããã
ãã®äžã®âé¡äŒŒæ§ã®åæâã§ãåãäžããæ¯èŒææ³ã§
ã»Cosine SimilarityïŒã³ãµã€ã³é¡äŒŒåºŠïŒ
ãšãããã®ããããŸããã
ããã¯ã2ã€ã®ãã¯ãã«ããã©ã®ãããåãæ¹åãåããŠãããããæž¬ãããšã§ãããŒã¿ã®é¡äŒŒæ§ãè©äŸ¡ããææ³ã§ãã
çªç¶ã§ãããããèŠããŠããŸããïŒ
cosΞ ïŒ åºèŸº ÷ æèŸº
髿 ¡æ°åŠã®äžè§é¢æ°ããã®å ¬åŒã§ãã
ããã¹ãã§äœ¿ã£ããã©ã瀟äŒäººã«ãªã£ãŠããäžåºŠã䜿ã£ãŠãªããââããæã£ãŠããäººãæ£çŽã«æãæããŠãã ããã
ç§ã¯æããŸãããšã³ãžãã¢æŽ25幎以äžããã£ãšããæã£ãŠããŸããã
ãšãããããæ¥ãDataLakeã®ããŒã¿åæåºç€ãè§Šããªãããã³ãµã€ã³é¡äŒŒåºŠããšããæŠå¿µã«åäŒããŠãæãã声ãåºãŸããã
ãããããã髿 ¡ã§ç¿ã£ããã€ãããªããã

髿 ¡çã®ããªããžïŒæ°åŠã®ææ¥ãã¡ãããšèããšããŠ
ãŸã髿 ¡æ°åŠã®cosΞã®è©±ããããã£ãšããããããŸãããã

çŽè§äžè§åœ¢ã§è§åºŠÎžãå°ãããªããšãåºèŸºãæèŸºã«ã©ãã©ãè¿ã¥ããŠãããŸãã
åœç¶ã§ããããã
è§åºŠ(Ξ)ã0ãšããããšã¯ã
ã»åºèŸºãšæèŸºã¯ã»ãŒåãé·ããâãã ããcosΞïŒåºèŸºÃ·æèŸºïŒã¯1ã«è¿ã¥ãã
å察ã«ãè§åºŠ(Ξ)ã90°ã«ãªããšåºèŸºã¯ãŒãã«ãªãã®ã§ãcosΞã¯0ã«ãªãã
ãã€ã³ãã¯ãΞãå°ãã = cosΞã1ã«è¿ã = æå€§å€ããšããé¢ä¿ã§ãã
ããã
ã»é«æ ¡ã§ã¯ãäžè§åœ¢ã®è§åºŠãšèŸºã®æ¯ãæ±ããéå ·ããšããŠç¿ããŸãã
ã§ãå®ã¯ã
ã»AIã®äžçã§ã¯ããåããã®æ¢ãã®éå
·ããšããŠãã®ãŸãŸäœ¿ãããŠãããã§ãã
40代ãšã³ãžãã¢ã®ããªããžïŒé«æ ¡æ°åŠãçŸåœ¹ã ã£ã話
ããŒã¿åæãã©ãããïŒããšããèŠä»¶ã«å¯ŸããŠãããŒã¿ã¬ã€ã¯åºç€ãšã®é£æºãæ±ãäžã§ãããã¯ãã«æ€çŽ¢ããRAGïŒæ€çŽ¢æ¡åŒµçæïŒããšããæè¡ãé »ç¹ã«åºãŠããŸãã
ããã§å¿
ãç»å Žããã®ãåé ã§ã玹ä»ãã
ã»Cosine SimilarityïŒã³ãµã€ã³é¡äŒŒåºŠïŒ
ã§ããã
æåã¯ããŸãæ°ããæŠå¿µã®ç»å Žããã»ã»ðŠããšæã£ãŠèª¿ã¹å§ãããââæç§æžã®äžè§é¢æ°ã®ããŒãžãé ã«æµ®ããã§ããŸããã
ãã®å ¬åŒãé ã®çé ã«æ®ã£ãŠãŠãåãŸã¿ããªç¶æ ã§ã»ã»ã§ãæšãŠãªããŠããã£ãã»ã»
ã髿 ¡æ°åŠ â AIãã®ããªããžïŒäœãåããªã®ã

AIã§ã®ã³ãµã€ã³é¡äŒŒåºŠã¯ãã䜿ããŸãã
äŸãã°æ ç»ã¬ãã¥ãŒã®ããŒã¿ããããšããŠïŒ
ãŠãŒã¶ãŒAã®å¥œã¿ïŒæ ç»=5ç¹ã鳿¥œ=1ç¹
ãŠãŒã¶ãŒBã®å¥œã¿ïŒæ ç»=4ç¹ã鳿¥œ=2ç¹
ãã®2ã€ãã2次å ã®ç¢å°ïŒãã¯ãã«ïŒããšããŠç©ºéã«ããããããŸãããããŠ2æ¬ã®ç¢å°ããªãè§Îžãèšç®ããââããã ãã§ãã
Ξãå°ããïŒç¢å°ã®åããè¿ãïŒâ cosΞã1ã«è¿ã â ããã®2人ã®å¥œã¿ã¯äŒŒãŠããã
Ξã90°ïŒç¢å°ãçŽè§ïŒâ cosΞã0 â ããã®2人ã¯ç¡é¢ä¿ã
髿 ¡ã®äžè§åœ¢ãšãŸã£ããåãè«çã§ãã

âã²ãšã€ã ãéèŠãªéã
髿 ¡ã§ã¯ã2次å ã®äžè§åœ¢ãã§ããã
AIã®äžçã§ã¯äœçŸæ¬¡å
ã«ãæ¡åŒµãããã ãã§ãã
人éã«ã¯æ³åããããã§ããŸããããæ°åŠçã«ã¯åãèšç®ãæãç«ã¡ãŸãã
ããã ããªãã§ãããé£ããããšã¯äœããªãããªãšã
å®åã§ã©ã䜿ãããŠããã
å ·äœçãªããŒã¿åæå Žé¢ãããã€ãæããŠã¿ãŸãã
ã»æšèŠã·ã¹ãã ïŒNetflixã Spotifyãªã©ïŒïŒ
ããªããšäŒŒãèŠèŽå±¥æŽãæã€ãŠãŒã¶ãŒãæ¢ããšãããã¯ãã«ã®ã³ãµã€ã³é¡äŒŒåºŠã§ãæãè¿ãæ¹åã®äººããèŠã€ããŸãã
ã»RAGïŒæ€çŽ¢æ¡åŒµçæïŒïŒ
ChatGPTãªã©ã®AIããããªãã®è³ªåã«é¢ä¿ããããã¥ã¡ã³ãããæ¢ããšãã質åæãšåããã¥ã¡ã³ãããã¯ãã«ã«å€æããŠãã³ãµã€ã³é¡äŒŒåºŠã§ãæãè¿ããã®ããè¿ããŸãã
ã»ããŒã¿ã¬ã€ã¯äžã§ã®å®è£
äŸïŒ
Delta Lakeã«Embeddingãä¿åããŠãã³ãµã€ã³é¡äŒŒåºŠã§ãã¯ãã«æ€çŽ¢ââãããçŸå Žã§ã®RAGã®å®è£
ãã¿ãŒã³ã§ããç§ãDatabricksäžã§ã®åæè©äŸ¡ãããäžã§ãããŸãã«ãã®ä»çµã¿ãæ€èšŒããŸããã
髿 ¡çãžã®ã¡ãã»ãŒãž
æ°åŠã®ææ¥ã§ãããã£ãŠãå°æ¥äœ¿ãã®ïŒããšæã£ãç¬éããããšæããŸãã
ã¯ããç§ããæ¯æ¥æã£ãŠãŸããðŠ

ã絶察ã«åœ¹ã«ç«ããªãã£ããïŒä»£ããã«ãè±åèªã10åèŠããæ¹ããŸãã ãïŒããšèãäœã«æã£ãŠãŸããã»ã»
cosΞã«ã€ããŠã¯ã䜿ããŸããééããªãã
AIãšã³ãžãã¢ã«ãªããããªããŠãé¢ä¿ãªãã§ãã
ããŒã¿ãæ±ãä»äºãªãã©ãã§ãããã®æŠå¿µãåå°ã«æ±ããããŸãã
æç³»ã»çç³»é¢ä¿ãªãããããŒã¿ã䌌ãŠãããã©ããã倿ãããå Žé¢ã¯ããããæ¥çã«ååšããŸãã
40代ãšã³ãžãã¢ãžã®ã¡ãã»ãŒãž
æ°ããAIæè¡ãæ¯æ¥ã®ããã«åºãŠããŠãå匷ã远ãã€ããªãæèŠããããšæããŸããç§ããŸãã«ããã§ãã
ã§ããTransformerããRAGãããã¯ãã«DBãââæ ¹ã£ãã«ããæ°åŠã¯ãæå€ãšæããç¥ã£ãŠãããã®ã ã£ããããŸãã
髿 ¡ã®æç§æžããŸã æšãŠãªãã§ãã ããïŒ
次åã®èšäºãä¹ããæåŸ
ãã ãããã§ã¯ã