
Omostã§ç»åçæã现ããå¶åŸ¡ããã(2) GPT-4o ã§Canvasã Stable Diffusion åãã«æé©åãã
- å²åŒãã
ãOmostãã¯å€§èŠæš¡èšèªã¢ãã«(LLM)ã®ã³ãŒãã£ã³ã°èœåãç»åçæã«å€æãããªãŒãã³ãœãŒã¹ãããžã§ã¯ãã§ããControlNetãStable Diffusion WebUI ForgeãFoocusã®éçºè
ãšããŠèåãªlllyasvielæ°ãäžå¿ã«éçºããŠããŸãã
ãããããOmostã£ãŠäœããšããæ¹ã¯ååã®èšäºããåç
§ãã ããã
âšïžæ¬èšäºã¯ Nobuyuki Kobayashi @nyaa_toraneko ããã«ãå¯çš¿ããã ããèšäºãããŒã¹ã«ç·šééšã§ãªã©ã€ãããŠãããŸãã
OmostãçæããCanvasãšã¯
Canvasã¯çæãããç»åã«æãããã¹ãèŠçŽ ãã¢ããŒããå®çŸ©ãããªããžã§ã¯ãã§ãã
ãã®æ§é ã¯ã倧ããåããŠ2ã€ã®ãããã¯ããæ§æãããŠããŸãã
1.ã°ããŒãã«æå
ãŸãã¯ãã·ãŒã³å šäœã®ããŒããé°å²æ°ãèšå®ãããããã¯ã§ãããããã°ããŒãã«æåãšåŒã³ãŸããã°ããŒãã«æåã§ã¯ã以äžã®æ å ±ãèšå®ããŸã
description: ã·ãŒã³å šäœã®ç°¡åãªèª¬æã§ããäŸãã°ããéæ³ã®çãç©ãäœãé®®ãããªãã¡ã³ã¿ãžãŒã®äžçããªã©ã§ãã
detailed_descriptions: ã·ãŒã³ã«é¢ããããå°ã詳现ãªèª¬æããªã¹ãã§æäŸããŸããäŸãã°ããæããã«ã©ãã«ãªç°å¢ããã空æ°äžã«æŒãç¥ç§çãªèŒãããªã©ã§ãã
tags: ã·ãŒã³ã«é¢é£ããããŒã¯ãŒããæå®ããŸããäŸãã°ãããã¡ã³ã¿ãžãŒãããéæ³ãããèªç¶ããªã©ã§ãã
HTML_web_color_name: ã·ãŒã³ã®äž»ãªè²ãHTMLã«ã©ãŒåã§æå®ããŸããäŸãã°ããã¹ã«ã€ãã«ãŒããªã©ã§ãã
2.ããŒã«ã«æå
次ã«ããã£ã³ãã¹äžã®ç¹å®ã®éšåã«ã€ããŠè©³çްãèšå®ãããããã¯ã§ãããããããŒã«ã«æåãšåŒã³ãŸããããŒã«ã«æåã§ã¯ã以äžã®æ å ±ãèšå®ããŸã
location: æåãããéšåã®äœçœ®ã§ããäŸãã°ããäžå€®ããªã©ã§ãã
offset: ãªãã»ããã®æç¡ã§ããäŸãã°ãããªãã»ãããªãããªã©ã§ãã
area: æåãããéšåã®é¢ç©ã§ããäŸãã°ãã倧ããªåè§ããšãªã¢ããªã©ã§ãã
distance_to_viewer: èŠèŽè ããã®è·é¢ã§ããäŸãã°ãã1.0ãŠãããããªã©ã§ãã
description: æåãããéšåã®ç°¡åãªèª¬æã§ããäŸãã°ããæµãããããªããŒãããŸãšã£ãåšå³ã®ããéæ³äœ¿ãããªã©ã§ãã
detailed_descriptions: æåãããéšåã«é¢ããããå°ã詳现ãªèª¬æããªã¹ãã§æäŸããŸããäŸãã°ããææã®ãã³ããçãŠãããããå ãæãæã£ãŠãããããé·ãçœé«ããªã©ã§ãã
tags: æåãããéšåã«é¢é£ããããŒã¯ãŒããæå®ããŸããäŸãã°ããéæ³äœ¿ããããéæ³ããããã£ã©ã¯ã¿ãŒããªã©ã§ãã
atmosphere: æåãããéšåã®é°å²æ°ã§ããäŸãã°ããç¥ç§çããªã©ã§ãã
style: æåãããéšåã®ã¹ã¿ã€ã«ã§ããäŸãã°ãããã¡ã³ã¿ãžãŒããªã©ã§ãã
quality_meta: æåã®å質ã«é¢ããã¡ã¿ããŒã¿ã§ããäŸãã°ããé«è©³çްããªã©ã§ãã
HTML_web_color_name: æåãããéšåã®äž»ãªè²ãHTMLã«ã©ãŒåã§æå®ããŸããäŸãã°ãã玫ããªã©ã§ãã
äŸãã°ãå®éã«CanvasãçšããŠStable Diffusionã§çæããããã€ã©ã¹ãã§ã¯ã以äžã®ããã«Canvasã«ããŒã«ã«æåãæå®ããããŠããŸãã

ãã®ããã«ãã€ã©ã¹ãå šäœã®çžå¯Ÿçãªäœçœ®ã«ããããã©ããªã¢ããŒããé 眮ããããæå®ããããšã«ãã£ãŠãã€ã©ã¹ãå šäœã®ã¬ã€ã¢ãŠããã§ãããããšããããšã§ãã
ãã çæãããCanvasã§ãããèªã¿ãããè©³çŽ°ãªæå®ãªã®ã¯ããã®ã§ããããšã«ããé·ããããããã®ãŸãŸ Stable Diffusion ã®ããžãã£ãããã³ããã«ã³ããããŠãçµµãåºãããšãã§ããŸãããã¡ãã£ãšãã®ãŸãŸã§ã¯æ±ãã«ããã®ãäºå®ã§ãã
ããã§Canvasã®èŠçŽ ããªãã¹ãæ®ããªãããæå®ãæé©åããŠãããŸãããã
çè
ã®å Žåãããããã¯OpenAI瀟㮠GPT-4oäž ã§My GPTsãèšèšãããOmost Converterããšãããã£ããããããäœããŸããã

Stable Diffusionåãã«Canvasã®æé©åãChatGPT 4oã§è¡ã
ããã§ã¯ãCanvasã®æé©åã®æé ã玹ä»ããŸãã
èå³ãããæ¹ã¯ãèªåèªèº«ã§ãOmost Converterãäœã£ãŠã¿ããšããã§ãããã
1. Canvasã®èšè¿°ãããã«ããã³ãããäœæãã
ãŸããCanvasã®æ
å ±ãå
ã«ãã°ããŒãã«æåãšåããŒã«ã«æåãåéãããã«ããã³ãããäœæããŸãã以äžã®ãããªãã©ãŒãããã§äœæããŸãã
# ã°ããŒãã«æå
"{description} with elements of {detailed_descriptions}. The scene has a {tags} feel, colored primarily in {HTML_web_color_name}."
# åããŒã«ã«æå
"In the {location}, there is a {description}. It is {offset} and occupies {area}. It is {distance_to_viewer} units away from the viewer. Detailed features include {detailed_descriptions}. The atmosphere is {atmosphere}, and the style is {style}, colored in {HTML_web_color_name}."
...
ãã®æ®µéã§Canvasã®æ å ±ã¯çžåœå§çž®ãããŸãã®ã§ãChatGPT 4oã§ããããDALL-E 3ã§çµµãçæããããšãå¯èœã§ããããŸã ãŸã ç¡é§ãå€ãããã§ãã®ã§ããã«æé©åãé²ããŸãããã
2. ãã«ããã³ãããæé©åãã
ç¶ããŠãã«ããã³ãããæé©åããŸããæé©åã®ç®çã¯ãããã³ãããçããããããããããããšã§ãStable Diffusionãçæããç»åã®å質ãåäžãããããšã§ãã以äžã®ã¹ãããã«åŸã£ãŠãããã³ãããæé©åããŸãããã
æé 1: äžèŠãªæ å ±ãåé€
ããã³ããããåé·ãªæ å ±ãéè€ããæ å ±ãåé€ããŸããäŸãã°ãåãæå³ã®èª¬æãç¹°ãè¿ãããŠããå ŽåããããäžåºŠã ãèšè¿°ããããã«ããŸãã
æé 2: ç°¡æœãªèšèãéžã¶
é·ããã¬ãŒãºãæããåãæå³ãæã€ããçãèšèããã¬ãŒãºã«çœ®ãæããŸããããšãã°ããé·ãçœé«ãæã€éæ³äœ¿ããã§ã¯ãªãããçœé«ã®éæ³äœ¿ãããšãã£ãå ·åã§ãã
æé 3: äž»èŠãªããŒã¯ãŒãã匷調
ããã³ããã®äž»èŠãªããŒã¯ãŒãããã¬ãŒãºã匷調ããéèŠã§ãªã詳现ãçç¥ããŸããããã«ãããAIãéèŠãªèŠçŽ ã«çŠç¹ãåããããããªããŸãã
æé 4: äžè²«ããã¹ã¿ã€ã«ãšããŒã³ãç¶æ
ããã³ããå šäœã§äžè²«ããã¹ã¿ã€ã«ãšããŒã³ãç¶æããŸããããã¯ãèªè ãããã³ãããçè§£ããããããAIãæå³ãæ£ç¢ºã«ææ¡ããã®ã«åœ¹ç«ã¡ãŸãã
æé 5: æé©åãããããã³ããã®äŸ
ããã§ãå ·äœçãªäŸã䜿ã£ãŠãæé©åãããããã³ãããäœæããŸãã
å ã®ãã«ããã³ãã
# Global Description
"éæ³ã®çãç©ãäœãé®®ãããªãã¡ã³ã¿ãžãŒã®äžç with elements of æããã«ã©ãã«ãªç°å¢, 空æ°äžã«æŒãç¥ç§çãªèŒã, å¹»æ³çãªé°å²æ°. The scene has a ãã¡ã³ã¿ãžãŒ, éæ³, èªç¶ feel, colored primarily in skyblue."
# Local Descriptions
"In the äžå€®, there is a æµãããããªããŒãããŸãšã£ãåšå³ã®ããéæ³äœ¿ã. It is ãªãã»ãããªã and occupies 倧ããªåè§ããšãªã¢. It is 1.0 units away from the viewer. Detailed features include ææã®ãã³ããçãŠãã, å ãæãæã£ãŠãã, é·ãçœé«. The atmosphere is ç¥ç§ç, and the style is ãã¡ã³ã¿ãžãŒ, colored in purple."
æé©åãããããã³ãã
# Global Description
"ã«ã©ãã«ãªéæ³ã®äžç, æããç°å¢, 空æ°äžã«ç¥ç§çãªèŒã, å¹»æ³çãªé°å²æ°. ãã¡ã³ã¿ãžãŒ, éæ³, èªç¶, ã¹ã«ã€ãã«ãŒ."
# Local Descriptions
"äžå€®ã«ææã®ãã³ããšå ãæãæã€çœé«ã®éæ³äœ¿ã. ãªãã»ãããªã, 倧ããªãšãªã¢, 1.0ãŠãããè·é¢. ç¥ç§çãªé°å²æ°, ãã¡ã³ã¿ãžãŒã¹ã¿ã€ã«, 玫è²."
æé 6: ããŒã¯ã³ã®æ°ã確èª
æé©åãããåããã³ãããçŽ75ããŒã¯ã³ä»¥å ã§ããããšã確èªããŸããããã¯ãAIãããã³ããã广çã«åŠçã§ããããã«ããããã§ãã
æé©åãããããã³ããã¯ãå ã®ããã³ããã«æ¯ã¹ãŠçããæç¢ºã§ãéèŠãªæ å ±ã«çŠç¹ãåœãŠãŠããŸããããã«ãããStable Diffusionãããæ£ç¢ºã§é åçãªç»åãçæã§ããããã«ãªããŸãã
ãŸããã®æ®µéã§ãDALL-E 3ã«æé©åãããããã³ããã詊ãã«æãããŠã¿ãŠãããã§ããããå ã«Omostã§çæããç»åãšåæ§ã®ã¢ããŒãã®ç»åãçæãããŠããã°æåã§ãã
ãããã®æé©åãå®è¡ããããšã§ãçæãããã€ã©ã¹ãã®ããã³ããã¯ä»¥äžã®ããã«ãªããŸããã
A curious yet anxious girl with white hair floats in a dark, surreal alternate dimension, reaching out to a glowing orb through an open door. She is dressed as a bunny girl, with her white hair flowing around her, adding motion and wonder. Her expression mixes curiosity and anxiety, reflecting uncertainty about the future. The central focus is on her dynamic posture. The dimension features a tilted horizon and floating doors, creating a chaotic and disordered feel. The open door, made of otherworldly material, emits light that contrasts sharply with the dark space, enhancing the mystery. The glowing orb, symbolizing a wonderful future, emits radiant light, creating hope and anticipation. The scene is designed in a 16:9 aspect ratio, with detailed textures and light effects. The atmosphere is a mix of curiosity, anxiety, wonder, and trepidation, rendered in high-quality with a focus on detailed expressions and flowing hair.
奜å¥å¿æºçã§ãããªããäžå®ããªçœã髪ã®å°å¥³ããæãè¶ çŸå®çãªç°æ¬¡å ã«æµ®ãã³ãéãããã¢ããå ãèŒããªãŒãã«æã䌞ã°ããŠããŸãã圌女ã¯ãããŒã¬ãŒã«ã®æ Œå¥œãããŠãããçœã髪ãåšãã«æµããåããšé©ããå ããŠããŸãã圌女ã®è¡šæ ã¯å¥œå¥å¿ãšäžå®ãå ¥ãæ··ãããæªæ¥ãžã®äžå®ãåæ ããŠããŸããäžå¿ã¯åœŒå¥³ã®ãã€ãããã¯ãªå§¿å¢ã次å ã¯ãåŸããå°å¹³ç·ãšæµ®éãããã¢ãç¹åŸŽã§ãæ··æ²ãšããç¡ç§©åºãªé°å²æ°ãéžãåºããŠããŸããå¥äžçã®ãããªçŽ æã§ã§ããéããæã¯å ãæŸã¡ãæã空éãšã®ã³ã³ãã©ã¹ããéç«ãããç¥ç§æ§ãé«ããŠããŸããçŽ æŽãããæªæ¥ã象城ããå ãèŒããªãŒãã¯ãåžæãšæåŸ ãçã¿åºããŸãããã®ã·ãŒã³ã¯16:9ã®ã¢ã¹ãã¯ãæ¯ã§ãã¶ã€ã³ããã詳现ãªãã¯ã¹ãã£ãšå ã®ãšãã§ã¯ããæœãããŠããŸãã奜å¥å¿ãäžå®ãé©ããæ¯ããå ¥ãæ··ãã£ãé°å²æ°ãã现ãã衚æ ãæµãã髪ãäžå¿ã«ãã€ã¯ãªãªãã£ã§è¡šçŸããŠããŸãã
ãã®ããã³ãããDALL-E 3ã§åºåãããŠãããšã以äžã®ããã«ãªããŸããããªããªãããã§ããã


ã¹ã¿ã€ã«ã¯éããŸãããOmostã§çæããç»åãšèŠçŽ ãäžèŽããŠããŸãã
å ããŠä»åã¯ã空éã«æµ®ããŠãããã¢ãããããªã§ãããã ãã¢ã沢山ç»é¢å
ã«é
眮ãããšãåœç¶ãã£ã©ãå°ãããªã£ãŠããŸãã®ãé£ãããšããã§ããããããããšããã¯æ€èšææã«ããŠãããŸãããã
Stable Diffusionã§æé©åãããããã³ãããå®è¡ãã
æé©åãããããã³ããããã©ããªçµµãåºãããDALL-E 3ã§ç¢ºèªã§ããã®ã§ã次ã¯Stable Diffusionã§ãã¹ãããŠã¿ãŸãããã
Stable Diffusionã§ã¯ãæ§ã ãªCheckpointïŒã¢ãã«ïŒãéžã¹ãŸãããã©ã¡ãããšèšãã°æç« ã§æ§æãããŠããããã³ããããç»åãçæããã«ã¯ãSDXLç³»ã®ã¢ãã«ã䜿ãããšããèŠãããŸããä»åã¯ãAnimagineXL v3.1ã䜿çšããŸããã
ãŸãããžãã£ãããã³ããã«æé©åãããããã³ãããããŒã¹ããããã¬ãã£ãããã³ããã«ã¯ãçããããã䜿ããããªãã®ãå ¥ããŠãçæããŸãããã

ä»åã¯1åç®ãããããªãè¿ãããŒãã®çµµãçæãããŸãããããã§Omostã®ããã³ãããStable Diffusionã§ã䜿ããããšãããã£ããšæããŸãã
äœåã詊ããŠã¿ããšããã£ã©ã倧ãã衚瀺ãããã·ãŒããèŠã€ãããŸããã
ããã§ã·ãŒã次第ã§ããã£ã©ã倧ãã衚çŸã§ããããšãããããŸãã

ããããã¯ãããã³ããã«èªç±ã«éæ¹é ãæœããŠãããŸãããã