
ã¹ããã§ãåãããŒã«ã«LLMã©ã³ãã³ã°
ããŒã«ã«LLMåãããªãPCãããã¹ããã§åããããïŒã£ãŠæããŸãããïŒ åããããïŒ...ãã©ããã¡ã®ã¹ããã§ãæ¬åœã«åãã®ãåãããã®ã... ãšããããã§ãææ°ã®iPhone17 Pro MaxãšiPhone12ã§ãç§ãè²ããªããŒã«ã«LLMã®ãã³ãããŒã¯ã枬ã£ãŠå®éã«è©ŠããŠã¿ãŸããïŒ ãªãã§ãããªæ€èšŒããã®ãïŒ
ãšããããšiPhone17 Pro Maxãè²·ãåã¯ããã¡ã®iPhone12ã§ã©ããŸã§è©Šããã®ãåãããªãã£ãããããããã®ã¢ãã«ãããåãããããã¹ããã ãã§è³¢ãããŒã«ã«LLMãšè©±ãããã£ããããªãã§ãã
ã¹ããã§èªåã®ããšãçè§£ããŠãããã®ã«æé©ãªã軜ããŠéããŠãããããªããŒã«ã«LLMãšè©±ãããã£ãã
ãããã¹ããã§ã®ããŒã«ã«LLMã®æ€èšŒã¯æµ·å€ã®èšäºã°ããã§ãæ¥æ¬èªã®ããŒã¿ãå°ãªããããããæ¬åœãã©ãããããåãããªãã£ããšããããã§ãã
ãããïŒä»ã§ã¯iPhone17 Pro Maxã§è²ã ã§ããããã«ãªã£ãã®ã§ãåãæ©ã¿ãæ±ããŠãã人ã®ããã«åèãšãªãããŒã¿ããŸãšããŠãããå ±æãããïŒãšããã®ãçç±ã§ãã ...åãã£ããããæ€èšŒçµæã¯ãïŒ ã§ã¯ã以äžã«çµæãšããããã®ã©ã³ãã³ã°ãæ®ããŠãããŸãã11åã®ããŒã«ã«LLMã§ãã¹ããããããæ å ±éãå€ãã®ã§ããŒã¿éšåã ããããµãªèªã¿é£ã°ãã¡ãã£ãŠãæ§ããŸããïŒã©ã³ãã³ã°ã¯äžã®æ¹ã«è¡ãã°ãããŸãïŒ ä»åã®æ€èšŒæ¡ä»¶ã¯ä»¥äžã®éãã
ð§ å ±éæ€èšŒæ¡ä»¶
ãé
ç® ãšèšå®å€ã
PP (Prompt Processing) ã512ããŒã¯ã³
TG (Text Generation) ã128ããŒã¯ã³
PL (Parallel)ã1
Rep (ç¹°ãè¿ãåæ°) ã3
ã³ã³ããã¹ãé· ã1024
Flash Attention ãæå¹
å€éšããã®è©Šè¡åæ° ã3åïŒäžå€®å€æ¡çšïŒ
ð± æ€èšŒç«¯æ«
ç«¯æ« / ããã / RAM / GPUã¬ã€ã€ãŒ
iPhone 17 Pro Max (A19 Pro / 12 GB / 6ã³ã¢GPU)
iPhone 12 (A14 Bionic / 4 GB / 4ã³ã¢GPU)
ð å šã¢ãã« ã¹ããã¯äžèЧ
ã¢ãã«å / ãã¡ã€ã«ãµã€ãº / éçºå
Gemma 3-1B-it QAT-Q4_0. / 713 MB / Google
Gemma 3-4B-it Q4_K_M. / 2.49 GB / Google
Gemma 3n-E2B-it Q4_K_M. / 3.03 GB / Google
Gemma 3n-E4B-it Q4_K_M. / 4.54 GB / Google
Qwen3.5 0.8B-Q4_K_M. / 533 MB / Alibaba
Qwen3.5 2B-Q4_K_M. / 1.28 GB / Alibaba
Qwen3.5-4B-Q4_K_M. / 2.74 GB / Alibaba
Nanbeige4.1 3B-Q4_K_M. / 2.44 GB / Nanbeige
LFM2 2.6B-Q4_K_M. / 1.56 GB / LiquidAI
LFM2 2.6B-Exp-Q4_K_M. / 1.64 GB / LiquidAI
LFM2.5 1.2B-JP-Q4_K_M. / 731 MB / LiquidAI
ð± iPhone 17 Pro Max â å šã¢ãã«3åå
PP (t/s)â¡ããã³ããåŠç
TG (t/s)â¡ããŒã¯ã³çæ
ã¡ã¢ãªâ¡æå€§ã¡ã¢ãªäœ¿çšé
1. Gemma 3-1B-it QAT-Q4_0.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 1175.02 / 82.79 / 6s / 976 MB
2åç® 1240.27 / 82.87 / 5s / 977 MB
3åç® 1204.17 / 82.77 / 5s / 982 MB
äžå€®å€ 1204.17 / 82.79 / 5s / 977 MB
TGã°ãã€ãïŒ82.77ã82.87ïŒ0.12%ïŒâ 極ããŠå®å® 2. Gemma 3-4B-it Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 267.06 / 23.73 / 22s / 4 GB
2åç® 251.32 / 23.59 / 22s / 4 GB
3åç® 211.63 / 19.86 / 26s / 4 GB
äžå€®å€ 251.32 / 23.59 / 22s / 4 GB
TGã°ãã€ãïŒ19.86ã23.73 â 3åç®ã«ãµãŒãã«ã¹ããããªã³ã°(ã¹ãããç±ããªã£ãŠèªåçã«é床ãèœã¡ãçŸè±¡)ãçºçïŒ-16.3%ïŒ
3. Gemma 3n-E2B-it Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 280.11 / 33.72 / 17s / 3 GB
2åç® 266.16 / 32.14 / 17s / 3 GB
3åç® 255.12 / 30.38 / 18s / 3 GB
äžå€®å€ 266.16 / 32.14 / 17s / 3 GB
TGã°ãã€ãïŒ30.38ã33.72ïŒ9.9%ïŒâ ããå£åãã
4. Gemma 3n-E4B-it Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 156.19 / 19.76 / 29s / 5 GB
2åç® 141.27 / 18.30 / 32s / 5 GB
3åç® 140.09 / 17.85 / 32s / 5 GB
äžå€®å€ 141.27 / 18.30 / 32s / 5 GB
TGã°ãã€ãïŒ17.85ã19.76ïŒ9.7%ïŒâ ããå£åãã
5. Qwen3.5 0.8B-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 936.21 / 51.92 / 9s / 1 GB
2åç® 939.95 / 50.96 / 9s / 1 GB
3åç® 903.20 / 50.22 / 9s / 1 GB
äžå€®å€ 936.21 / 50.96 / 9s / 1 GB
TGã°ãã€ãïŒ50.22ã51.92ïŒ3.3%ïŒâ å®å®
6. Qwen3.5 2B-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 491.40 / 31.73 / 15s / 2 GB
2åç® 448.76 / 30.61 / 16s / 2 GB
3åç® 455.59 / 30.43 / 16s / 2 GB
äžå€®å€ 455.59 / 30.61 / 16s / 2 GB
TGã°ãã€ãïŒ30.43ã31.73ïŒ4.1%ïŒâ å®å®
7. Qwen3.5-4B-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 175.27 / 13.40 / 37s / 3 GB
2åç® 152.71 / 11.71 / 43s / 3 GB
3åç® 156.34 / 11.67 / 43s / 3 GB
äžå€®å€ 156.34 / 11.71 / 43s / 3 GB
TGã°ãã€ãïŒ11.67ã13.40ïŒ12.9%ïŒâ 1åç®ããæ¥èœããµãŒãã«ã¹ããããªã³ã°ãé¡è
8. Nanbeige4.1 3B-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 280.06 / 27.48 / 19s / 3 GB
2åç® 256.17 / 27.09 / 20s / 3 GB
3åç® 253.06 / 26.88 / 20s / 3 GB
äžå€®å€ 256.17 / 27.09 / 20s / 3 GB
TGã°ãã€ãïŒ26.88ã27.48ïŒ2.2%ïŒâ éåžžã«å®å®
9. LFM2 2.6B-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 358.95 / 37.87 / 14s / 2 GB
2åç® 325.07 / 37.57 / 15s / 2 GB
3åç® 323.54 / 37.31 / 15s / 2 GB
äžå€®å€ 325.07 / 37.57 / 15s / 2 GB
TGã°ãã€ãïŒ37.31ã37.87ïŒ1.5%ïŒâ éåžžã«å®å®
10. LFM2 2.6B-Exp-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 363.36 / 38.80 / 14s / 2 GB
2åç® 338.98 / 38.75 / 14s / 2 GB
3åç® 323.32 / 38.18 / 14s / 2 GB
äžå€®å€ 338.98 / 38.75 / 14s / 2 GB
TGã°ãã€ãïŒ38.18ã38.80ïŒ1.6%ïŒâ éåžžã«å®å®
11. LFM2.5 1.2B-JP-Q4_K_M.
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 887.70 / 81.41 / 6s / 1 GB
2åç® 829.12 / 80.40 / 6s / 1 GB
3åç® 785.77 / 80.21 / 6s / 1 GB
äžå€®å€ 829.12 / 80.40 / 6s / 1 GB
TGã°ãã€ãïŒ80.21ã81.41ïŒ1.5%ïŒâ éåžžã«å®å®
ð± iPhone 12 â å šã¢ãã«3åå
1. Gemma 3-1B-it QAT-Q4_0. â åäœ
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 392.41 / 32.75 / 15s / 894 MB
2åç® 394.90 / 33.43 / 15s / 891 MB
3åç® 373.26 / 33.68 / 15s / 888 MB
äžå€®å€ 392.41 / 33.43 / 15s / 891 MB
TGã°ãã€ãïŒ32.75ã33.68ïŒ2.8%ïŒâ å®å®
2. Gemma 3-4B-it Q4_K_M. â ã¯ã©ãã·ã¥
ã¡ã¢ãªäžè¶³ã§ã¢ããªã匷å¶çµäºã
3. Gemma 3n-E2B-it Q4_K_M. â ã¯ã©ãã·ã¥
ã¡ã¢ãªäžè¶³ã§ã¢ããªã匷å¶çµäºã
4. Gemma 3n-E4B-it Q4_K_M. â ã¯ã©ãã·ã¥
ã¡ã¢ãªäžè¶³ã§ã¢ããªã匷å¶çµäºã
5. Qwen3.5 0.8B-Q4_K_M. â åäœ
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 269.26 / 16.63 / 29s / 939 MB
2åç® 245.02 / 14.39 / 33s / 913 MB
3åç® 249.29 / 15.29 / 31s / 916 MB
äžå€®å€ 249.29 / 15.29 / 31s / 916 MB
TGã°ãã€ãïŒ14.39ã16.63ïŒ13.5%ïŒâ ããäžå®å®
6. Qwen3.5 2B-Q4_K_M. â ã¯ã©ãã·ã¥
ã¡ã¢ãªäžè¶³ã§ã¢ããªã匷å¶çµäºã
7. Qwen3.5-4B-Q4_K_M. â ã¯ã©ãã·ã¥
ã¡ã¢ãªäžè¶³ã§ã¢ããªã匷å¶çµäºã
8. Nanbeige4.1 3B-Q4_K_M. â ã¯ã©ãã·ã¥
ã¡ã¢ãªäžè¶³ã§ã¢ããªã匷å¶çµäºã
9. LFM2 2.6B-Q4_K_M. â åäœ
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 109.15 / 17.16 / 36s / 1 GB
2åç® 99.56 / 14.60 / 42s / 1 GB
3åç® 88.25 / 11.52 / 51s / 1 GB
äžå€®å€ 99.56 / 14.60 / 42s / 1 GB
TGã°ãã€ãïŒ11.52ã17.16ïŒ32.9%ïŒâ ãµãŒãã«ã¹ããããªã³ã°æ·±å»
10. LFM2 2.6B-Exp-Q4_K_M. â åäœ
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 111.37 / 17.32 / 36s / 885 MB
2åç® 106.73 / 15.12 / 41s / 877 MB
3åç® 87.02 / 11.60 / 51s / 860 MB
äžå€®å€ 106.73 / 15.12 / 41s / 877 MB
TGã°ãã€ãïŒ11.60ã17.32ïŒ33.0%ïŒâ ãµãŒãã«ã¹ããããªã³ã°æ·±å»
11. LFM2.5 1.2B-JP-Q4_K_M. â åäœ
å / PP (t/s) / TG (t/s) / åèšæé / ã¡ã¢ãª
1åç® 267.45 / 37.10 / 16s / 929 MB
2åç® 259.31 / 35.73 / 16s / 929 MB
3åç® 245.00 / 33.81 / 17s / 930 MB
äžå€®å€ 259.31 / 35.73 / 16s / 929 MB
TGã°ãã€ãïŒ33.81ã37.10ïŒ8.9%ïŒâ 軜床ã®å£åãã
ð iPhone 17 Pro Max â é床ãéã(TGäžå€®å€)ã©ã³ãã³ã°
ð¥ 1äœ Gemma 3-1B-it QAT-Q4_0.
ð¥ 2äœ LFM2.5 1.2B-JP-Q4_K_M.
ð¥ 3äœ Qwen3.5 0.8B-Q4_K_M.
4äœ LFM2 2.6B-Exp-Q4_K_M.
5äœ LFM2 2.6B-Q4_K_M.
6äœ Gemma 3n-E2B-it Q4_K_M.
7äœ Qwen3.5 2B-Q4_K_M.
8äœ Nanbeige4.1 3B-Q4_K_M.
9äœ Gemma 3-4B-it Q4_K_M.
10äœ Gemma 3n-E4B-it Q4_K_M.
11äœ Qwen3.5-4B-Q4_K_M.
ð iPhone 12 â é床ãéã(TGäžå€®å€)ã©ã³ãã³ã°
ð¥ 1äœ LFM2.5 1.2B-JP-Q4_K_M.
ð¥ 2äœ Gemma 3-1B-it QAT-Q4_0.
ð¥3äœ Qwen3.5 0.8B-Q4_K_M.
4äœ LFM2 2.6B-Exp-Q4_K_M.
5äœ LFM2 2.6B-Q4_K_M.
â Gemma 3-4B-it Q4_K_M.
â Gemma 3n-E2B-it Q4_K_M.
â Gemma 3n-E4B-it Q4_K_M.
â Qwen3.5 2B-Q4_K_M.
â Qwen3.5-4B-Q4_K_M.
â Nanbeige4.1 3B-Q4_K_M.
ð 端æ«éæ¯èŒïŒåäžã¢ãã«ïŒ
ã¢ãã« / iPhone 17 ProMaxã®TG (t/s) / iPhone 12ã®TG (t/s)/ åç /
Gemma 3-1B-it QAT-Q4_0. / 82.79 / 33.43 / 2.48x
LFM2.5 1.2B-JP-Q4_K_M. / 80.40 / 35.73 / 2.25x
Qwen3.5 0.8B-Q4_K_M. / 50.96 / 15.29 / 3.33x
LFM2 2.6B-Exp-Q4_K_M. / 38.75 / 15.12 / 2.56x
LFM2 2.6B-Q4_K_M. / 37.57 / 14.60 / 2.57x
iPhone 12ã§ã®åäœè©äŸ¡â
Gemma 3-1B-it QAT-Q4_0. â
å¿«é©
LFM2.5 1.2B-JP-Q4_K_M. â
å¿«é©
Qwen3.5 0.8B-Q4_K_M. â³ ã®ãªã®ãªå®çš
LFM2 2.6B-Exp-Q4_K_M. â³ äžå®å®
LFM2 2.6B-Q4_K_M. â³ äžå®å®
ð ãµã€ãºåž¯å¥ æ¯èŒåæ
ð·ïž 1Bã¯ã©ã¹
çµè«ïŒé床ãªãGemma 3-1Bãæ¥æ¬èªå質ãªãLFM2.5-JPãã¹ãã¬ãŒãž(容é)ç¯çŽãªãQwen3.5-0.8B
ð·ïž 2ã3Bã¯ã©ã¹
çµè«ïŒLFM2-2.6B-Expãäžæãã¡ã¢ãª2 GBã»38 t/sã§å®å®æ§ããããã¯ã©ã¹
ð·ïž 4Bã¯ã©ã¹ä»¥äž
çµè«ïŒ4Bã¯ã©ã¹ã䜿ããªãGemma-3n-E2Bäžæããã©ã¡ãŒã¿ã§ã¯æå€§ãªã®ã«é床ãã¡ã¢ãªãæé©
ðãŸãšã(Opus4.6ã®åæ)
1. æ¥æ¬èªã¹ããLLMã®æé©è§£ã¯LFM2.5-1.2B-JP
iPhone 17 ProMaxã§80 t/sãiPhone 12ã§35 t/sãšäž¡ç«¯æ«ã§å®çšçãªé床ãGemma 3 1Bãšã»ãŒäºè§ã®é床ã§ãããæ¥æ¬èªç¹åããã¡ã€ã«728 MBãã¡ã¢ãª1 GB以äžã§éåžžã«è»œéãªã®ã§èª°ã§ãå°å
¥ããããã
2. ã¢ãã€ã«æé©è§£ã¯Gemma-3n
Gemma-3n-E2Bã¯Gemma-3-4Bããããã©ã¡ãŒã¿å€ãã»é床éãã»ã¡ã¢ãªå°ãªããã®è¯ããšãäžæåãE4Bã¯é床äœäžã倧ãããããE2Bãããããã
3. LiquidAIïŒSSMç³»ïŒã¯å®å®æ§ã§ç°æ¬¡å
LFM2ç³»ã®TGã°ãã€ãã¯1.5ã1.6%ã§ãTransformerããŒã¹ã®å€§åã¢ãã«ïŒ10ã16%ïŒãšæ¯ã¹ãŠå§åçã«å®å®ããµãŒãã«ã¹ããããªã³ã°ã®åœ±é¿ãåãã«ããã¢ãŒããã¯ãã£äžã§ã®åªäœæ§ãããã
4. RAM 4 GB端æ«ã®éçç·ãæç¢º
ã¡ã¢ãªäœ¿çšé1 GBè¶
ã®ã¢ãã«ã¯å
šæ»
(ã¯ã©ãã·ã¥)ãRAM 4 GB端æ«ã¯1Bã¯ã©ã¹ãŸã§ãRAM 8 GB以äžã¯2ã4Bã¯ã©ã¹ãŸã§å¯èœãRAM 12 GBã¯5 GB以äžã®ã¢ãã«ãäœè£ã§åãããã
5. Qwen3.5ã·ãªãŒãºã¯é床é¢ã§èŠæŠ
0.8Bã¯åããåãµã€ãºã®Gemmaã»LFMã«é床ã§å£ãã4Bã¯å
šã¢ãã«æäžäœã®11 t/sãæ¥æ¬èªå質ãã¹ãã§æœåã§ããããçŠç¹ã
6. LFM2-2.6B-Expã¯2ã3Bã¯ã©ã¹ã®ãã¹ããã§ã€ã¹
ç¡å°ã®å®å
šäžäœäºæãé床+3%ãã¡ã¢ãªåçãå®å®æ§åçãExpãéžã°ãªãçç±ããªãã
以äžã§ãïŒ ã¹ããã§ããŒã«ã«LLMãåãããã人ã®åèã«ãªãã°å¹žãã§ãïŒ ãããŸã§ãèªã¿ããã ãããããšãããããŸããïŒ