
Hugging Face å ¥é å š10å-ã第3åã
ã第2åãã¯ãã¡ã
ã第3åãGoogle Colab ã§æåã® AI ãåãã
ãã®åã§ã¯3ã€ã®ç»å Žäººç©ãåºãŠããŸããããããã®åœ¹å²ãæåã«æŽçããŠãããŸãã
Hugging Face ãçŽæ¥é¢ä¿ããã®ã¯ãã¢ãã«ã®å ¥æãã®éšåã§ãã
pipeline() ã from_pretrained() ãå®è¡ããç¬éã«ãHugging Face Hub ããã¢ãã«ããŒã¿ãèªåã§ããŠã³ããŒããããŸãã
Google Colab ãéã
ãã©ãŠã¶ã§ä»¥äžã® URL ã«ã¢ã¯ã»ã¹ããŸãã
https://colab.research.google.comGoogle ã¢ã«ãŠã³ãã§ãã°ã€ã³åŸããæ°ããããŒãããã¯ããéžæãããŸãã
ç»é¢ã«ã»ã«ïŒã³ãŒããå ¥åããæ ïŒã衚瀺ãããã°æºåå®äºã§ãã
ã¹ããã1ãã©ã€ãã©ãªãã€ã³ã¹ããŒã«ãã
æåã®ã»ã«ã«ä»¥äžãå
¥åããâ¶ ãã¿ã³ã§å®è¡ããŸãã
!pip install transformers torch -qããã«ãã Hugging Face ã®ã¢ãã«ãæ±ãããã®ãéå ·ãã PyPIïŒPython å ¬åŒã®ã©ã€ãã©ãªé åžãµãŒããŒïŒããããŠã³ããŒãããŸãã
Hugging Face Hub ãšã¯ãŸã éä¿¡ããŠããŸããã
ã€ã³ã¹ããŒã«ãå®äºãããŸã§æ°åç§ããããŸãã
ãšã©ãŒãåºãªããã°æ¬¡ãžé²ã¿ãŸãã
ã¹ããã2ãææ åæã詊ã
æ°ããã»ã«ã«ä»¥äžãå
¥åããŠå®è¡ããŸãã
from transformers import pipeline
classifier = pipeline("sentiment-analysis")
result = classifier("I love physics!")
print(result)
å®è¡çµæã®äŸ
[{'label': 'POSITIVE', 'score': 0.9998}]pipeline("sentiment-analysis") ãå®è¡ããæç¹ã§ãHugging Face Hub ããããã©ã«ãã®ææ åæã¢ãã«ãèªåã§ããŠã³ããŒããããŸãã
ã¢ãã«åãçç¥ããå Žå㯠Hugging Face åŽãæšå¥šããã¢ãã«ãéžã°ããŸãã
POSITIVE ã¯ããžãã£ããªæç« ãšå€å®ãããããšã0.9998 㯠AI ã®ç¢ºä¿¡åºŠïŒ1.0 ã«è¿ãã»ã©èªä¿¡ããïŒãæå³ããŸãã
ã¹ããã3ãæ¥æ¬èªã詊ã
æ¥æ¬èªã¢ãã«ã®ããŒã¯ãã€ã¶ãŒã«ã¯ã圢æ
çŽ è§£æåšã® fugashi ãšèŸæžããŒã¿Â unidic-lite ãå¿
èŠã«ãªããŸãã
ãŸãæ°ããã»ã«ã§ä»¥äžãå®è¡ããŸãã
!pip install fugashi unidic-lite -qè£è¶³ãunidic-lite ã®éšåã§ãšã©ãŒãåºãå Žå㯠ipadic ã詊ããŠãã ãããã©ã¡ããå¿ èŠãã¯ã¢ãã«ã«ãã£ãŠç°ãªããŸãã
次ã®ã»ã«ã§ãHugging Face Hub äžã®æ¥æ¬èªã¢ãã«ãååã§æå®ããŠååŸããŸãã
ã€ã³ã¹ããŒã«ãå®äºããããæ¬¡ã®ã»ã«ãå®è¡ããŸãã
from transformers import pipeline
classifier = pipeline(
"text-classification",
model="koheiduck/bert-japanese-finetuned-sentiment"
)
result = classifier("æ žèåçã®ç ç©¶ã¯é¢çœã")
print(result)model= ã«æå®ããŠãã "koheiduck/bert-japanese-finetuned-sentiment" ã Hugging Face Hub äžã®ã¢ãã« ID ã§ãã
ãã©ãŠã¶ã§ huggingface.co/koheiduck/bert-japanese-finetuned-sentiment ã«ã¢ã¯ã»ã¹ãããšããã®ã¢ãã«ã®ããŒãžã確èªã§ããŸãã
æ¥æ¬èªã®ããã¹ããå ¥åããåæ§ã«ããžãã£ãã»ãã¬ãã£ããå€å®ã§ããŸãã
åŠçã®æµã
ã³ãŒããå®è¡ãããšããå
éšã§ã¯ä»¥äžã®é ã«åŠçãé²ãã§ããŸãã
èªåã®ã³ãŒã
â
transformers ã©ã€ãã©ãª
â
ã¢ãã«ã®ããŠã³ããŒãïŒååã®ã¿ã»èªåïŒ
â
æšè«ïŒAI ã«ããå€å®ïŒ
â
çµæãè¿ã£ãŠããå šäœã®æµã
ã¹ããã1ïŒpip install
â PyPI ããã©ã€ãã©ãªïŒéå
·ïŒãååŸ
â Hugging Face ãšã¯ç¡é¢ä¿
ã¹ããã2ã»3ïŒpipeline() ãå®è¡
â Hugging Face Hub ããã¢ãã«ããŒã¿ãèªåããŠã³ããŒã
â ããã§åã㊠Hugging Face ãç»å Žãã
以éã®å®è¡ïŒ
â ãã£ãã·ã¥ããã¢ãã«ãèªã¿èŸŒã
â Hugging Face ãžã®éä¿¡ã¯äžèŠçšèªè§£èª¬
PyPIïŒãã€ãã€: Python Package IndexïŒ Python ã®ã©ã€ãã©ãªãå ¬éã»é åžããå ¬åŒãµãŒããŒãpip install ã®ããŠã³ããŒãå ã¯ãããHugging Face ãšã¯å¥ã®ãµãŒãã¹ã
transformersïŒãã©ã³ã¹ãã©ãŒããŒãºïŒ Hugging Face ãéçºãããªãŒãã³ãœãŒã¹ã® Python ã©ã€ãã©ãªãæ§ã 㪠AI ã¢ãã«ãçµ±äžçãªã€ã³ã¿ãŒãã§ãŒã¹ã§äœ¿ããããã«ããŠããã
torch / PyTorchïŒãã€ããŒãïŒ MetaïŒæ§ FacebookïŒãéçºããæ·±å±€åŠç¿ãã¬ãŒã ã¯ãŒã¯ãtransformers ã©ã€ãã©ãªã®åäœåºç€ãšããŠäœ¿ãããããšãå€ãã
pipelineïŒãã€ãã©ã€ã³ïŒ è€éãªåŠçãäžæ¬ã®æµãã«ãŸãšããä»çµã¿ããã¢ãã«ã®èªã¿èŸŒã¿ â å ¥ååŠç â æšè« â åºåããäžè¡ã§å®è¡ã§ãã颿°ã
ã¢ãã« ID Hugging Face Hub äžã®ã¢ãã«ãèå¥ããååããŠãŒã¶ãŒå/ã¢ãã«å ã®åœ¢åŒïŒäŸïŒkoheiduck/bert-japanese-finetuned-sentimentïŒã
fugashiïŒãã¬ã·ïŒ æ¥æ¬èªã®åœ¢æ çŽ è§£æãè¡ãã©ã€ãã©ãªãæ¥æ¬èªã¢ãã«ã®ããŒã¯ãã€ã¶ãŒãå éšã§äœ¿çšãããPyPI ããã€ã³ã¹ããŒã«ããã
unidic-lite / ipadic fugashi ãäœ¿ãæ¥æ¬èªèŸæžããŒã¿ãã¢ãã«ã«ãã£ãŠã©ã¡ããå¿ èŠããç°ãªãããšã©ãŒã¡ãã»ãŒãžã§å€æããã
圢æ çŽ è§£æïŒãããããããããïŒ æ¥æ¬èªããã¹ããæå³ã®ããæå°åäœã«åå²ããåŠçãè±èªã¯ã¹ããŒã¹ã§åèªãåºåãããŠããããæ¥æ¬èªã«ã¯åºåãããªããããã®åŠçãå¿ èŠã«ãªãããæ žèåçã®ç ç©¶ãâãæ žèåããçããã®ããç ç©¶ãã®ããã«åå²ãããã
sentiment-analysisïŒææ åæïŒ ããã¹ãã®ææ çãªåŸåïŒããžãã£ãã»ãã¬ãã£ããªã©ïŒãå€å®ãã AI ã¿ã¹ã¯ã
scoreïŒã¹ã³ã¢ïŒ AI ã®åºåã«ä»éããç¢ºä¿¡åºŠã®æ°å€ïŒ0ã1ïŒã1.0 ã«è¿ãã»ã© AI ããã®å€å®ã«èªä¿¡ãæã£ãŠããããšã瀺ãã
ã©ã€ãã©ãª ãã䜿ãåŠçããŸãšããåå©çšå¯èœãªããã°ã©ã ã®éãŸããpip install ã§ã€ã³ã¹ããŒã«ããŠäœ¿ãã
pipïŒãŽã£ã·ïŒ Python ã®ããã±ãŒãžç®¡çããŒã«ãpip install ã©ã€ãã©ãªå ã§ã©ã€ãã©ãªã远å ã§ãããColab ã§ã¯å
é ã« ! ãã€ããŠå®è¡ããã
次å㯠pipeline ã§äœ¿ããäž»èŠã¿ã¹ã¯ã®äžèЧã玹ä»ããŸãã
(2026幎3æ5æ¥èš)
#HuggingFace #GoogleColab #æ©æ¢°åŠç¿å ¥é #Pythonå ¥é #AIå ¥é