
AIã§äœã£ãMVããæå ã§4Kã«ããŠã¿ããããããŠã£ã³ã¢ããŒããã®ç·šéãšã¢ããã¹ã±ãŒã«
ãããŠã£ã³ã®ã¢ã³ã¹ã¿ãŒãã¡ãããèå代ãå šéšäœ¿ã£ãŠããŸãããããªã³ã¡ãã£ã®MVããããŠã£ã³ã¢ããŒãããå¶äœããŸããã
ä»åã¯æ åãã€ãªãäœæ¥ã«å ããŠãæå ã®PCã§ã¢ããã¹ã±ãŒã«ã詊ããŠããŸããããšã®åç»çŽ æã¯ãäž»ã«1024Ã1024ãã¯ã»ã«ã®æ£æ¹åœ¢ãããã倧ããããããã©ããªèŠãæ¹ã«ãªãã®ãã
æ®éã«æ¡å€§ããå ŽåãšAIåŠçã䜿ãå ŽåãããŸãçãåºéã§æ¯ã¹ãŠã¿ãŸããããã®èšäºã§ã¯ããã®åŠçæ¹æ³ãšãç·šéã§èŠçŽãããšããããŸãšããŸãã
ãŸãã¯ãåã6.3ç§ã3çš®é¡ã§æ¯èŒãã
æåã®è©Šäœã«ã¯ã颚æ¯ãå人ã®ã¢ã³ã¹ã¿ãŒããã©ãã¥ã©ã®é¡ãå ¥ã£ãåé ã®6.3ç§ã䜿ããŸããã30fpsã§189ãã¬ãŒã ãåºåã¯4096Ã4096ã§ãã
æ¯èŒçšã«ãåãå Žé¢ããäžã€ã®åç»ãäœã£ãŠããŸãã
éåžžæ¡å€§ïŒLanczosã§4096Ã4096ãžæ¡å€§ã
AIåŠç100ïŒ ïŒReal-ESRGANã®åºåã䜿çšã
AIåŠç65ïŒ ïŒAIåŠçããæ åãšéåžžæ¡å€§ãæ··ããã
AIåŠçã«ã¯Real-ESRGANã®ncnn Vulkançã䜿ããã¢ãã«ã¯ã¢ãã¡åç»åãã®realesr-animevideov3ãéžã³ãŸãããåŠçåçã¯4åã§ãã
æ¯èŒç»åã§ã¯ã髪ãæã建ç©ã®èŒªéãã¯ã£ããããäžæ¹ã现ããªæ¿æ·¡ãå¹³ãã«æŽçããããšãããèŠããŸããããã©ãã¥ã©ã®é«ªãç®å ãå€ç©ºãšçŽ èããåããã¬ãŒã ã»åãç¯å²ã§æ¯ã¹ãŠããŸãã


ãAI65ïŒ ãã¯ãç¬èªã®ãã¬ã³ãæ¯ç
ä»å䜿ã£ããAI65ïŒ ãã¯ãã¢ãã«å éšã®åŒ·åºŠèšå®ã§ã¯ãããŸãããåã倧ããã«ããããäºã€ã®ç»åããæ¬¡ã®æ¯çã§æ··ããŠããŸãã
ä»äžãã ïŒ AIã¢ããã¹ã±ãŒã«ç»å à 0.65 ïŒ éåžžæ¡å€§ç»å à 0.35
AIåŠçã§æŽçããã茪éãåãå ¥ãã€ã€ãå åç»ã«ãã£ãæ¿æ·¡ãæ®ãããšãããã®ã§ããåæã«ã¯FFmpegã®blendãã£ã«ã¿ãŒã䜿ããŸããã
ä»åã¯ãã®65ïŒ ãå šäœã®åºæºã«ããŠããŸãããã ããåã©ãã®å°ããªé¡ãã匷ãåãåã£ã人ç©ã»å°éå ·ãªã©ã¯ãåŠçã®åœ±é¿ãæ éã«èŠããå Žæã§ããã
äžéšã§ã¯45ïŒ ã»55ïŒ ã»65ïŒ ãæ¯èŒãã茪éãšé°åœ±ã®ãã©ã³ã¹ãã55ïŒ ãéžãã§ããŸãããã®æ°åã¯ä»åã®çŽ æã«å¯Ÿãã調æŽã§ãå¥ã®æ åã§ã65ïŒ ãæé©ããšããçµæã§ã¯ãããŸããã

åŠçã¯ãã«ããåäœã«åãã
倧ãŸããªåŠçã®æµãã¯ã次ã®ããã«ãªããŸããã
䜿ãåç»ãšåºéãæ±ºããã
ãã¬ãŒã ç»åãåãåºãã
Real-ESRGANã§æ¡å€§ããã
éåžžæ¡å€§ããç»åãšãã¬ã³ãããã
30fpsã®åç»ãžæ»ãã
æ²ã»åå¹ãšåãããŠæžãåºãã
åŠçã®ç®¡çã«ã¯Pythonããã¬ãŒã ã®åãåºããåæã»æžãåºãã«ã¯FFmpegã䜿ã£ãŠããŸããå šç·šã®åŠçã§ã¯ãåç»ã®ãšã³ã³ãŒãã«NVENCã䜿ããŸããã
ã«ããããšã«åããŠãããšãäžãæãçŽãããšãã«ãå šç·šã®AIåŠçãããçŽããã«æžã¿ãŸããå®éã«äœ¿ãç¯å²ãåãåãæ¹ãäœåºŠã倿Žããã®ã§ã倿Žã®ãªãåŠçæžã¿çŽ æãåå©çšã§ãã圢ã¯å©ãããŸããã
ãŸããæåã®è©Šäœã§ã¯ããã§ã«æ¡å€§ããç·šéçšåç»ãããã«æ¡å€§ããããšãé¿ãã1024Ã1024ã®èŠªçŽ æãžæ»ã£ãŠããŸãã
4Kã«ããŠããå€ãªæãé¡ã¯çŽããªã
å¶äœäžã«ã¯ããã©ãã¥ã©ã®æå ããã¯ã€ã³ãåºãŠããããã«èŠããåãããåã©ãã®é¡ãæã®åœ¢ãäžèªç¶ã«ãªãå Žé¢ããããŸãããããããéšåã«ã¯ã䜿ãåºéã®å€æŽãã«ããã®å·®ãæ¿ãã§å¯Ÿå¿ããŠããŸãã
ã¢ããã¹ã±ãŒã«ãšã¯å¥ã«ãå åç»ã®åäœãåœ¢ãæ£ãããã確èªããå¿ èŠããããŸãããä»åã¯é¡åŸ©å ããã¬ãŒã è£éãå ããŠããŸããã
ãŸããä»åã®è©Šäœã¯ãã¯ãããããŠããªã1024Ã1024ã®çŽ æã4ååãããã®ã§ããå šç·šã§ã¯åãåãæžã¿ã®ã«ããããããå®éã«æ®ã£ãŠããæ å ±éã¯ã«ããã«ãã£ãŠéããŸãã
åºåã4096Ã4096ã«ãªã£ãŠããå ãããã®è§£ååºŠã§æãããæ åãšåãæ å ±ãåŸããããšã¯èšããŸãããç»çŽ æ°ãšãå®éã«èŠãã现éšã¯åããŠèããŠããŸãã
鿢ç»ã®æ¯èŒã ãã§ã¯ãåç»ã®ç¢ºèªã¯çµãããªã
ã¢ããã¹ã±ãŒã«ã®æ¯èŒã§ã¯ãäžæã®ç»åãæ¡å€§ãããšã髪ã®ç·ãç®ãæ¯äžŠã¿ãããã®ç·šã¿ç®ãªã©ã®éããæ¢ãããããªããŸãããã ãåç»ã«ã¯æéæ¹åã®å€åããããŸãã
ç·ã现éšããã¬ãŒã ããšã«å€ãããšã鿢ç»ã§ã¯ãããã§ããåçæã«ã¯æ°ã«ãªãå¯èœæ§ããããŸãã
ä»åã¯OpenCVã䜿ããå æ åã®åããèæ ®ããªãããåŠçã§å ãã£ãå€åãæ°å€ã§èª¿ã¹ãè£å©åŠçãå ¥ããŸãããå€åã®å€§ããã«ããããåªå ããŠç¢ºèªããããã§ãã
ãã ããæ°å€ã§ç°åžžãåºãªãã£ãããšããã¡ãã€ãããªãããšããä¿èšŒã«ã¯ããŠããŸãããä»åã®èšé²ã§ããå šãã¬ãŒã ã®æ°å€æ€æ»ãæœåºç»åã®ç¢ºèªãéåžžé床ã§ã®å šç·šèŠèŽãåããéåžžé床ã®å šç·šèŠèŽã¯æªç¢ºèªãšããŠæ®ããŠããŸãã
ãã¡ã€ã«ãæåŸãŸã§èªã¿åããããšãå 鳿ºãšäžèŽããŠããããšãåããèªç¶ã«èŠããããšãããããã«å¥ã®ç¢ºèªãå¿ èŠã§ããã
è±èªçã§ã¯ãæå·®ããçŽäºåéã«ãªã£ãŠãã
ã¢ããã¹ã±ãŒã«ãšã¯å¥ã«ãè±èªçãHalloween Apartmentsããžã®ç·šéã§ã倱æããããŸãããè±èªã®æå±ã«åãããŠæ åã調æŽãããšããããã©ãã¥ã©ã®æå·®ããæ©éãã®ããã«ãªã£ãŠãããã§ãã
ç·šéããŒã¿ã確èªãããšããã®ã«ããã¯53ãã¬ãŒã åã®åäœã26ãã¬ãŒã ã«åããŠããŠãçŽ2.04åéã«ãªã£ãŠããŸããã
ããã¯äœ¿ãåäœã®ç¯å²ãçãããå ã®4KçŽ æã«å¯ŸããŠçéãžæ»ããŸãããååŸã®ã«ãããåæ§ã«ä¿®æ£ããŠããŸãã
æ²ãåå¹ã®ã¿ã€ãã³ã°ãã«ããã®é·ãã¯ç¶æãããã®æ ã®äžã§äœ¿ãåããéžã³çŽããŸãããçãå°è©ãžåããããšãã«ãå åç»ã®åäœãå šéšæ®ãããšããããäŸã§ãã
æåŸã«ãç»é¢ã®æ¯çããšã«ç¢ºèªãã
ä»åã¯æ¬¡ã®3圢åŒãçšæããŸããã
1:1ã»å šç·šïŒ4096Ã4096ãæ£æ¹åœ¢ã®æ åã䜿çšã
16:9ã»å šç·šïŒ3840Ã2160ãã«ããããšã«åãåãäœçœ®ã調æŽã
9:16ã»ãµãïŒ2160Ã3840ãæ£æ¹åœ¢æ åãæ®ããäžäžã«é»äœçœã
ããã§æ£æ¹åœ¢ã®ã4Kãã¯4096Ã4096ãæããŠããŸããæšªé·UHDã®3840Ã2160ãšã¯ã瞊暪ã®åœ¢ãç·ç»çŽ æ°ãéããŸãã瞊çãã2160Ã2160ã®æ åãé»äœçœã®äžã«é 眮ããæ§æã§ãã
暪é·ã«ãããšãé¡ã¯èŠããŠããŠããèå¿ã®ç©ºããã风ãåããŠããŸãããšããããŸããããã®MVã§ã¯ã空ãããèŠããããå人ã®çŠããäŒããã风çã²ãšã€ãèŠããããçŒç·ã®å€±æãåãããŸãã
è§£å床ãäžããäœæ¥ãšåãããããå¿ èŠãªãã®ãç»é¢ã«æ®ã£ãŠããããéèŠã§ãããåå¹ããæåŸã®åºåãµã€ãºã«åãããŠçœæåã»äžäžå€®ã»çžåããšåœ±ãªãã§å ¥ããŠããŸãã
æå ã§è©Šããšã調æŽã§ããå Žæãå¢ãã
ä»åã®ã¢ããã¹ã±ãŒã«ã¯ãçãåºéãæ®éã«æ¡å€§ãããã©ããªãããAIåŠçã䜿ã£ããã©ããªãããå°ãæ··ãããã©ããªããããšããæ¯èŒããå§ãŸããŸããã
ããããå šäœãžé©çšããæ°ã«ãªãã«ããã¯æ¯çã䜿ãç¯å²ãå€ããŠããŸããæå ã§åŠçã§ãããšãåãæ¡ä»¶ã§æ¯èŒããããäžãæã ãããçŽãããããããããã®ç¹ã¯ãä»å詊ããŠããã£ããšããã§ãã
ä»äžãã§æ»ãå ã¯ã髪ã®äžæ¬ã®ç·ã ã£ãããæã®ã²ãã®å°ããªé£Žã ã£ããããŸããã倧ããããŠåããŠæ°ã¥ãããšãããã°ãæ ãç¯å²ãå€ããã»ããäŒããããšããããŸããã
äœåã®ç©èªã«ã€ããŠã¯ããã¡ãã®å¶äœããŒãã«ãŸãšããŠããŸãã