2024幎çæAIã®é²æ©ãŸãšã
ããã«ã¡ã¯ïŒéç¬å· ( https://x.com/gyakuse ) ã§ãïŒ
çæAI Advent Calendar 2024ã®èšäºãæžãã®å¿ããŠããã®ã§ãçŸæç¹ã§ã®çæçAIã®é²æ©ããŸãšããŠã¿ãŸããïŒä»æ¥ã¯AIãããŸãªã«ã§ããã®ïŒã£ãŠããšèããããšãã«ããã§ãããïŒã£ãŠæããããã®ã¡ã¢ãšããŠæŽ»çšããŠãã ããïŒãŸããçæAIãããã¯ã Advent Calendar 2024ãšããã®ããœãã§ãã£ãŠããŸãããã®ã«ã¬ã³ããŒã§ã¯LLMã®åºç€çè«ããModelã®Fine-Tuningããããã¯ãéçºçããŸãšããŠããŸãããã²ãã¡ããèŠãŠãã ããïŒ
æªæ¥ãæããæè¡ã®é²æ©
åç»çæã§ã¯ãVeo2 ã Sora ãç»å ŽããŸããã
ã€ã³ã¿ã©ã¯ãã£ããªåç»çæã§ã¯ãGenie2 (WASDãšæ¹åããŒã§æäœå¯èœãªäžçã¢ãã«)ãéåžžã«é©æ°çãªé²æ©ãéããŠããŸã (æ¯ãè¿ã£ãŠãäžè²«æ§ãä¿ã€é·ææ§ãæ¬åœã«ããã)ã

ç©çã·ãã¥ã¬ãŒã·ã§ã³ã§ã¯Genesisãç»å ŽããŸããã

åµè¬åéã§ã¯ããŒãã«è³ãåè³ããã¿ã³ãã¯è³ªæ§é äºæž¬ã·ã¹ãã ã§ããAlphaFoldã®æ°ããããŒãžã§ã³: AlphaFold3ãç»å ŽããŸãããåŸæ¥ã®MSA+Evoformerã¢ãžã¥ãŒã«ããã®æ§é äºæž¬ã§ã¯ãªããPairformerããæ¡æ£ã¢ãã«ã䜿ã£ãæ§é äºæž¬ãããããã«ãªã£ãŠããŸã

ãããã£ã¯ã¹åéã§ã¯èªç¶èšèªã§ã®æç€ºã»å¯Ÿè©±ã»æè»ãªã¢ã¯ã·ã§ã³ã®èšèšã»å®è¡ãã§ãããããããå¢ããŠããŸãããŸã çºå±éäžã§ãããOpenAIãæè³ãã1xã§ã¯å®¶åºåãããããNeoãéçºããŠããŸãã
æ®æ®µã®ä»äºã«çŽçµããããªæè¡ã®é²æ©
1. ä»äºã®å¹çåäž
1.1 ãã«ãã¢ãŒãã«ã¢ãã«ã®äžè¬å
2024幎ã¯ãã«ãã¢ãŒãã«ã¢ãã«ãäžè¬åãããã€ããè³¢ããªããè¿çé床ãéåžžã«éããªã£ãããšã倧ããªå€åãšããŠæåã«æããããŸããããã«ãã£ãŠãç»åãé³å£°ãããšã«è³ªåå¿çãæ°è»œã«è¡ãããšãã§ããããã«ãªããŸããã
äž»ãªã¢ãã«:
- ChatGPT: 4o
- Gemini: gemini-1.5-pro
- Claude: Claude-3.5-Sonnet
ã©ããªããšãã§ããããã«ãªã£ãã:
- Excelã§ããããªãããšããã£ãããã¹ã¯ã·ã§ããŠèãã°æžãããã«ãªã£ã
- PDFãã¶ããªããŠè³ªåå¿çãæ°è»œã«ã§ããããã«ãªã£ã
䜿çšäŸ:

1.2 çæ ®ããã¢ãã«ã®ç»å Ž
ChatGPTã®o1ãã¯ãããšããçæ ®ãããã¢ãã«ãç»å Žããããšã«ãã£ãŠãããŸãŸã§ç絡çãªè§£çã«ãã誀ããçºçããŠããã±ãŒã¹ãé²ãããšãã§ãããŸãããŸãŸã§ãªãè€æ°ã®äŒè©±ã®å¿çã§ãã£ãšå°éããŠããæ·±ãçµè«ã«ãŒãã·ã§ããã§å°éã§ããããã«ãªããŸããã
o1ã¯æšè«æéãé·ããã (30ç§ã1åçšåºŠ)ã䜿ãåããšããŠã¯ãåºç€ã¢ãã«ã§è§£çå°é£ãªå Žåã¯o1ã«æãããšè¯ãã§ãããã
äž»ãªã¢ãã«:
- ChatGPT: o1, o1 Pro
- Gemini: Gemini 2.0 Flash Thinking Experimental
ã©ããªããšãã§ããããã«ãªã£ãã:
- è€éãªåé¡ã«å¯ŸããŠã®ããæ·±ãæ€èš
䜿çšäŸ:

å°èª¬ã®ã¢ã€ãã¢æ¯èŒ:
- 4o: https://chatgpt.com/share/676733af-7bd0-800d-9aa3-9e2e10da7c05
- o1: https://chatgpt.com/share/676733a4-3b24-800d-b2c2-f61303bb22c3
2. ããã°ã©ãã³ã°ã®å¹çå
2.1 éçºå¹çåã¢ããªã®æµžé
CursorãGitHub Copilotãçšãããšãéåžžã«å¹ççã«ããã°ã©ãã³ã°ãè¡ãããšãã§ããŸããçŸç¶ããããžã§ã¯ãã®èŠæš¡ãéåžžã«å€§ãããªããšCursorã®ãããªãã®ã¯æ©æµãå°ãããªããŸããããã®ãã¡ããæãã«ãªãã¯ãïŒãšããããã®äººã¯GitHub Copilotãããããã§ã (ç¡æã§ç¥ã§ã)ã
äž»ãªããŒã«:
2.2 ããã°ã©ãã³ã°èœåã®é«ãã¢ãã«ã®ç»å Ž
o1 ã®ç»å Žã«ãã£ãŠãããã°ã©ãã³ã°èœåãåäžããŸãããäœæãšããŠã¯ãã¹ã®å°ãªãå®è£ ãã§ããããã«ãªã£ããšæããŸããæèãããã¹ãéšåãããæœè±¡çãªéšåã«ãªã£ãŠããããã®æœè±¡çãªéšå (ã¢ã€ãã¢ç) ãæ ä¿ããŠãããããã«ãããã¯ãªãã§ãããã
äž»ãªã¢ãã«:
- ChatGPT: o1, o1 Pro
䜿çšäŸ:
3. 調æ»ã®å¹çå
æ€çŽ¢ãšLLM(ãããã¯ãã«ãã¢ãŒãã«ã¢ãã«ãšããã)ãçµã¿åããããšèª¿æ»ã¿ã¹ã¯ãå¹çåããåŸæ¥ãªãµãŒãæ¥åãšããŠè¡ã£ãŠããæŽ»åã«ã€ããŠéšåçãŸãã¯å šäœã眮ãæããããšãå¯èœãšãªããŸãããã®åéã¯ãŸã ãŸã çºå±éäžã§ãããç¹ã«NotebookLMã¯å®åã§ã䜿ããã¬ãã«ã«éããŠããŸããã
äž»ãªããŒã«:
䜿çšäŸ:
DeepResearchã䜿ããšãã¡ãã®ãããªã¬ããŒããããäœæã§ããŸã: ã¬ããŒãäŸ

詳现ã¯Appendixåç §ã®ããš
2025幎以éã¯ã©ã®ãããªé©æ°ãããããã
æ¥å¹Žãã§ã«äºå®ãããŠããäž»èŠãªãã®ã®ã²ãšã€ã«Googleã®Project Astraã®ã¡ã¬ãåããã€ã¹ããããŸãã
äž»ã«æåŸ ããã補åãšããŠã¯ä»¥äžã®ãããªãã®ãããã§ããã:
- AIããŒã¹ã®ããã€ã¹ã»AIã¢ã·ã¹ã¿ã³ã (ã¹ããŒããã©ã³ãã¡ã¬ãåããã€ã¹)
- æ±çš / ç¹å®é ååãã®ãšãŒãžã§ã³ã (ã¿ããªã ãããã ãã©, ã¡ãããšç€ŸäŒã«ãã£ãããããã®ã¯ãã¡ããã¡ãé£ãã. UIUXã¯ãã¡ãããå šéšèªååã§ããªãå Žåã¯ãã¯ãŒã¯ãããŒã®ãã¶ã€ã³ã倧äº)
ãŸãão3ã®ç»å Žã«ããã人éçšåºŠããããã¯è¶ ç¥èœãå®çŸããã倧ããªç€ŸäŒå€é©ãæåŸ ãããŸããã以äžã®èª²é¡ãæ®ã£ãŠããŸãã
- é·ãã³ã³ããã¹ã (ããã¹ã圢ç¶ã ãã§ãªããåç»çå«ããŠ) ã®çè§£ããããã¯RAGçãªææ³ã®æ¹å
- æšè«ã³ã¹ãã®äœæž
- ãããã£ã¯ã¹ãšã®é£å
éçºè ã«ãšã£ãŠã®é²æ©
2024幎ã¯ãšã³ãžãã¢ã«ãšã£ãŠã鲿©ã®ãã£ã幎ã§ãããå人çã«ã¯gemma-2-2b-jpn-itã®æ©æµããã¡ããã¡ãæããŠããŸããããã以å€ã«ãããã€ãã€ã³ãã¯ãã®ããAPIã»ã©ã€ãã©ãªã»ã¢ãã«ãçºè¡šãããŠããŸãã
1.å ¬éãããAPI矀
å ¬éãããAPIãšããŠã¯äž»ã«ä»¥äžã®ãããªãã®ãã€ã³ãã¯ãã®å€§ãããã®ãšããŠãããŸããã
äž»ãªã¢ãã«:
- OpenAI
- gpt-4o: ãã«ãã¢ãŒãã«API
- o1: çæ ®æšè«API
- Realtime API: é³å£°å¯Ÿè©±çšAPI
- Google
- gemini-1.5-flash: 軜éã®ãã«ãã¢ãŒãã«API
- gemini-1.5-flash-8b: æè»œéã®ãã«ãã¢ãŒãã«API
- gemini-1.5-pro: ãã«ãã¢ãŒãã«API
- gemini-2.0-flash-experimental: æšè«èœåãåäžããææ°ã®ãã«ãã¢ãŒãã«API
- gemini-2.0-flash-exp: åœåãåããã¥ããã§ããããã«ãã¢ãŒãã«ã©ã€ãçšã®APIã§ã
- gemini-2.0-flash-thinking-exp: çæ ®æšè«API
- Anthropic
- Claude 3.5 Sonnet: ãã«ãã¢ãŒãã«API
äœãã§ããããã«ãªã£ãã:
- æžãèµ·ãããéåžžã«å®äŸ¡ã«
- gemini-1.5-flashã䜿ããšæžãèµ·ãããéåžžã«å®äŸ¡ã«ã§ããããã«ãªããŸãããã³ã³ããã¹ãã«çšèªéãå ¥ããããšã«ãã£ãŠãæžãèµ·ããã®ãã¹ãæžããããšãã§ããŸãããªããtimestampãåºåãããããšãã§ããŸããããã«ã·ããŒã·ã§ã³ãèµ·ããããã®ã§(誀ã£ãtimestampãã€ããã¡)ãWERäœæžã®æ©æµãåãã€ã€timestampããŒã¹ã®åºåãåŸããå Žåã¯å¥éWhisperçã§æžãèµ·ãããããããšã«levenshteinè·é¢çã§çªåããå¿ èŠããããŸãã
- OCRã容æã«
- ãããgemini-1.5-flashçã䜿ããstructured outputããããã°ã容æã«æ§é çã«ããŒã¿ãåãåºãããšãã§ããŸã (æ£ç¢ºã«ã¯OCRãšãããããç»åææžçè§£ã¿ã¹ã¯ã§ãã)
- ãŸããå€å žçãªOCRãšçµã¿åãããããšã§ãã粟床ãäžããããšãå¯èœã§ã: 確信床ãåºããŠãããOCRãäœã£ãŠã¿ãïŒ
- é³å£°å¯Ÿè©±ã»æ å察話ãå¯èœã«
- Realtime APIã䜿ããšé³å£°å¯Ÿè©±ã·ã¹ãã ã容æã«æ§ç¯ã§ããŸãã
- ãŸããgemini-2.0-flash-expã䜿ããšæ å察話(ç»é¢å ±æã»ã«ã¡ã©å ±æããªããã¡ãåŽã®ã¿ã§ãããããAIåŽã®æ åã¯å¥éäœããªããã°ãªããªã)ãã§ããŸã
- ãã ããAPIã³ã¹ããé«ãããªã¯ãšã¹ãã§ããåæ°ãå°ãããããå€å žçãªASR+LLM+TTSãè¯ãå Žé¢ãå€ãã§ã
- åè: èªåã®PCãªã³ãªãŒã§ãã£ã©ã¯ã¿ãŒãšé³å£°å¯Ÿè©±ããããïŒããŒã«ã«ã§åãspeech-to-speechãµãŒããŒãäœãæ¹æ³
2.å ¬éãããã©ã€ãã©ãªçŸ€
ã©ã€ãã©ãªã¯å€§éã«ããããã以äžã¯å人çã«ãã䜿ããã®ãæããŠãããŸãã
- LLMã®æšè«é«éå
-
vLLM
- èšèªã¢ãã«ã®é«éæšè«+æšè«ãµãŒããŒã©ã€ãã©ãªã§ã
- 2023幎ã«å ¬éããããã®ã§ãããæè¿ã¯çããã䜿ãããã«ãªã£ãŠããŸããã
- åºæ¬çãªã¢ã€ãã¢ãšããŠã¯KV Cachingã®å¹çåãšãããåŠçã®é«éåãäžå¿ãšãªã£ãŠããŸãã
- ã»ãã«ã¯TensorRT-LLMãªã©ãæåã§ãã
-
vLLM
- LLMã®fine-tuning
-
LLaMA Factory
- ãšããããããã䜿ãã°å®¹æã§ããä»ã«ã¯trl, nemoãã¬ãŒã ã¯ãŒã¯, LLamaTuner, LLMBoxãªã©ããããŸã (èªåã¯ããtrlã䜿ããŸã)
-
LLaMA Factory
3.å ¬éãããã¢ãã«çŸ€
以äžã§ã¯æ³šç®ããŠããã¢ãã«çŸ€ãã¿ãŠãããŸããå人çãªèå³ã«åºã¥ããŠãããããåãããããŸãããŸããåºæ¬çã«äºååŠç¿æžã¿ã¢ãã«ãæäŸãããŠãããã®ãšãªããŸãã
- çæã¢ãã«
- ããã¹ã
- é³å£°
- 3D (3Dã¢ãã«, ã·ãŒã³)
- https://github.com/yanghb22-fdu/Hi3D-Official
- https://github.com/facebookresearch/vfusion3d
- https://github.com/pkunliu/Isotropic3D
- https://github.com/thu-ml/CRM
- https://github.com/VAST-AI-Research/TripoSR
- https://github.com/heheyas/V3D
- https://huggingface.co/stabilityai/sv3d
- https://github.com/3DTopia/3DTopia-XL
- https://github.com/3DTopia/LGM
- https://github.com/SOTAMak1r/GVGEN
- https://github.com/NIRVANALAN/GaussianAnything
- https://github.com/wenqsun/DimensionX
- åç»
- https://huggingface.co/THUDM/CogVideoX-5b
- https://github.com/AILab-CVC/VideoCrafter
-
https://github.com/ali-vilab/VGen
- InstructVideo
- DreamVideo
- TF-T2V
- VideoLCM
- https://github.com/Vchitect/Vlogger
- https://github.com/HumanAIGC/AnimateAnyone (2024ã§ã¯ãªãã)
- LLM
- MLM
- speech-to-speech
- Audio
- ASR
- whisper-large-v3-turbo
- ASR
- Vision
- 深床æšå®
- ç©äœæ€åº
- ç»å埩å
- åç»çè§£
- æç³»åäºæž¬
- ãµãŒãã€
- https://huggingface.co/thuml/timer-base-84m
-
https://huggingface.co/amazon/chronos-bolt-base
- Chronos-Boltã¢ãã«ã¯ãChronosã¢ãã«ããã5%粟床åäžãæå€§250åé«éåã20åã¡ã¢ãªå¹çåãå®çŸããæç³»åäºæž¬ã¢ãã«
- https://huggingface.co/amazon/chronos-t5-large
- https://huggingface.co/google/timesfm-1.0-200m
- https://huggingface.co/ibm-granite/granite-timeseries-ttm-r2
- https://github.com/kwuking/TimeMixer
- MoE
- ããŒã¿ã»ãã
- æšå¥šèšäº
- Mamba
äž»ãªäŒç€Ÿã®çºè¡š
OpenAI
npakaããã®ãŸãšããåèã«æç³»åã§èŠãŠãããŸãããã
- 5/13 GPT-4o: ãã«ãã¢ãŒãã«ãã€GPT-4ããé«éãªã¢ãã«
- 9/12 o1-preview: çæ ®ãããããšã§æšè«èœåãæ Œæ®µã«åäžããã¢ãã«
- 9/25 Advanced Voice: æ»ãããªé³å£°å¯Ÿè©±ãããããšãã§ããé«åºŠãªé³å£°ã¢ãŒããRealtime APIãšããŠãæäŸããã誰ã§ãé«åºŠãªé³å£°å¯Ÿè©±åã®ãã£ããããããäœããããã«
- 12/5 ChatGPT Pro: æ200ãã«ã§o1ãç¡å¶éã«ããŸão1 Proã䜿ãããšãã§ããããé«é¡ãªèª²éäœç³»
- 12/9 Sora: åç»çæãµãŒãã¹ãæå€§20ç§ãŸã§ (1080pã®å Žå10ç§ãŸã§) äœãããšãã§ãã
ãã®äžã§ã¯å人çã«ã¯o1-previewããã³o1 Proãéåžžã«ã€ã³ãã¯ãã®åŒ·ããã®ãšããŠãããŸããã
ãã¡ããnpakaããã®ãŸãšããåèã«æç³»åã§èŠãŠãããŸãããã
- 2/16 Gemini 1.5: GPT-4oã®ãããªéåžžã«åªç§ãªã¢ãã«
- 2/21 Gemmaã·ãªãŒãº:
- 5/8 AlphaFold 3
- 5/14 Project Astra: ã¹ããŒããã©ã³ãšAIã°ã©ã¹ã«å¯Ÿå¿ããAIã¢ã·ã¹ã¿ã³ã (éçºäž)
- 6/27 Gemma 1.5 Proã®æå€§ã³ã³ããã¹ãé·ã200äžããŒã¯ã³ã«æ¡åŒµ
- 12/4 Genie2
- 12/11 Deep Research
- 12/13 NotebookLM Plus: Notebook LMã®
- 12/14 Agentspace
- 12/16 Veo2, Imagen3
- 12/17 Gemini 2.0 Experimental Advanced
ãã®ä»
- 10/23 Computer Use
Appendix
Deep Research
Gemini 1.5 ProãçšããŠèªåçã«ã¬ããŒããäœæããŠãããæ©èœã
PerprexityãSearchGPTã®ãããªæµ ãæ¢çŽ¢ã§ã¯ãªãã調æ»èšç»ãå ã«éåžžã«å€ãã®èšäºãåéããäžã€ã®ã¬ããŒããšããŠãŸãšããŠãããŸã (Perprexityã¯èšç»éšåã¯ã¡ãããšããŠããããåéèŠæš¡ãå°ãããæµ ãæ¢çŽ¢ã«ãªããã¡)ã
åŠçã®æµã:
(1) èšç»ç«æ¡

(2) æ€çŽ¢

(3) ã¬ããŒãåºå

åºåããããã®ã¯Google Docãã¡ã€ã«ãšããŠä¿åå¯èœ: ãµã³ãã«
課é¡
- ãããããèšäºã®å 容 (ç¹ã«äžäœã«ããããããã®) ã«åŒã£åŒµããããããã
- äžèŠã80ç¹çšåºŠããããã«èŠããããå®åäžã¯ããŸã䜿ããªã (å®åã®æ§è³ªã«ãããããå人çã«ã¯ã¬ããŒãäŸé Œããã³ããã調æŽããããæ¢çŽ¢ç¯å²ãçµããããªäŸé Œã§ãããªãå³ããå Žåãå€ã â ç¹å®ã®ãã¡ã€ã³ä»¥äžã®ç¹å®åéã«çµãç)
- æ¥æ¬èªã ãããããšããããã§ããªã (å ã¯è±èªã®ã¿å¯Ÿå¿ã ã£ãã®ã§ãè±èªäžå¿ã§äœ¿ã£ãŠã¿ãŠãã)
- ãã¥ã¬ãŒã·ã§ã³æŠç¥ãããã³ããã§ãã£ããå®çŸ©ããŠããããšè¯ããã (ã€ãŸãã調æ»äŸé Œè ã察象é åã«å¯ŸããŠååçè§£ããŠãããšããŸãåã
ãã ãããã¯ãããã工倫次第ã§ãªããšããªãã®ã§ãæ¹åã¯æ©ããšã¿ãŠããŸããå人çã«ç¹å®é åçšã®Deep Searchã¿ãããªãã®ãäœã£ãããšãããããããã¯ããŸãåããŸãããçµå±å€èšèªãã€æ±çšçã«äœãã®ã¯é£ãããšãã話ã§ããããŸãã
NotebookLM (Plus)
Deep ResearchãçŽæ¥èª¿æ»ãè¡ã£ãŠããããã®ã ãšããããNotebookLMã¯èª¿æ»ããµããŒãããŠããããµãŒãã¹ãšãããŸããä»»æã®ãœãŒã¹ (URL, PDF, .txt, .mp3çã®åçš®ãã¡ã€ã«, Googleã¹ã©ã€ã, Google ããã¥ã¡ã³ãç) ãããšã«ãã£ãããåŠç¿ã¬ã€ãçæçãè¡ã£ãŠãããŸãããŸã è±èªã®ã¿ã ããããããã£ã¹ãçæãè¡ã£ãŠãããŸããäž»ã«åŠç¿ãç ç©¶ã®è£å©ãšãã£ãæå³ã匷ããé¡äŒŒãµãŒãã¹ãšããŠã¯ãChatGPTã®ãClaudeã®ProjectãæããããŸãã
ãŸãã倧éã®ãœãŒã¹ (Plusã§ã¯æå€§300) ãç»é²ã§ãããããç°¡æRAGãã£ããã·ã¹ãã ãšããŠã䜿ãããäŒæ¥åãã®ãã£ããã¯ã»ãšãã©ããã§è³ããæ°ãããŸãã
Discussion