Video and audio is being converted despite the options to copy the audio and video streams being ticked.

The previous version worked fine, and I've had to go back to using that one for the time being.

Selecting sleep when done no longer works. I get a box asking whether I want to sleep immediately, and it goes no further. I want to leave a project running and have the computer sleep when done automatically This no longer works..

Whenever i try upscaling a gif it makes some kind of weird double frames and it looks like its skipping some frames in the upscaled one, it isn't like the original, not sure what's the problem.

Is your feature request related to a problem? Please describe. No, this is merely a request to add an upscaler.

Describe the solution you'd like https://github.com/xinntao/Real-ESRGAN In there, is a ncnn version of Real-ESRGAN, which in structure is very similar to RealSR, but has superior video quality. it would be really cool to have it in your software!

Describe alternatives you've considered Theres no alternative, just a request.

Additional context I have no further context.

我测试一段视频，对比v0.37有着一眼能看出的劣化，囧 我一开始以为是视频编码器问题

但是我重新折腾几次发现 v0.461这个，在处理视频的时候，拆分图像上，就已经和v0.37有着画质差别（比0.37更糊） 然后，用这个已经劣化的图片再放大，就是糊上加糊

我已经把v0.461和v0.37的最终视频，拆分图像，以及放大图像，原始视频，都单独复制出来并上传网盘了 其中 160，眼镜的脸，和肌肉那块

232，妹子的边缘

链接：https://pan.baidu.com/s/10kf3j7e2KpJGJpAW0tw9yg 提取码：cgow

请查收

软件设置参数 自定义分辨率3840x2160 保持宽高比 视频，降噪3 视频，内部线程3

压缩JPG和保存为JPG都未勾选

引擎默认，块大小200默认

硬件参数 8700k oc4.69 64g ram 1080TI

烦请排查问题所在 如果需要，我也可以提供更详细信息

Reply @AaronFeng753 : https://github.com/AaronFeng753/Waifu2x-Extension-GUI/issues/433#issuecomment-1288146214

Software Version Latest BETA or Latest Stable? v3.95.23-Premium

Describe the bug enabling keep mkv subtitles feature causes output to be malformed/broken

in vlc

video stays black with vlc logo unless manually scrub to a different time.. when scrubbed back to start, image shows but is still and doesnt actually play images, just audio.

in windows media player

video starts without problem. but trying to play any timestamp where audio is missing, it would immediately skip to next part where audio exists.

in both vlc and windows media player

large portion of audio is missing in the center.

How to Reproduce the bug Steps to reproduce the bug:

sourcefile: 27 minute long mkv segment: 40 sec model: RealESRGAN animev3 tilesize: 400
2D custom resolution: 1920x1080 2x scale keep subtitles mkv nvidia x265 encoding nvidia decoder

1. enable keep mkv subtitle feature
2. upscale and render
3. play output video.

Expected behavior output is not malformed if keep subtitles is enabled

Screenshots If applicable, add screenshots to help explain your problem.

Files you were trying to process when encountered the BUG If you encountered the BUG when processing certain files, please send me some of that files so I can do some research.(You can zip it before send it to me)

[link removed]

The settings you were using when issue occured You can save your settings than zip and upload the settings.ini, or just take screenshots.

VideoConfiguration_[Kayoanime] Domestic Na Kanojo S01E01_mkv_Waifu2xEX.ini.md

Desktop (please complete the following information):

• OS: windows 11
• GPU Model RTX 3080Ti
• CPU Model ryzen9 7950x
• Amount of RAM: 64GB
• Amount of VRAM: 12GB
• Amount of Storage: 2TB

Additional context VLC player small 1 minute samples arent having this problem

I'm using version 0.52 beta, my video card is an RX570. When using Waifu2x-ncn-vulkan engine the result is black images (see screenshot). This did not happen in any previous version. To get around this I'm having to use the waifu2x-converter engine, which is much slower.

Software Version: 3.92.01 Stable Release

Description of Issue: Waifu2x Extension GUI is unable to split a video into pictures while upscaling and inteprolating to 8K (a resolution of 7680 x 4320). It starts the upscaling process fine but around the ~50 minute mark, it randomly says there is an error splitting the video into pictures. Video is around 5 minutes long and running at 24FPS 1080P originally. Rendered in DaVinci Resolve in the .mp4 format using h.264.

How to Reproduce: Not sure if it only works with this video for some reason, but take any high bitrate video that's longer than ~6 or so minutes, upscale to 8K and it fails halfway through the upscale. Make the resolution 8K and enable frame interprolation (for 8K 48FPS).

Expected Behavior: The program successfully splits the video and moves on.

Screenshots: Console Log (you can see that it was working for 40 or so minutes) The video I was attempting to upscale to 8K 48FPS

File: https://mega.nz/file/q8cyEY5Z#fneW9bhDCUY40C_0LvQWnoXdDvZKyEUE5QmyjHF2_ek

Settings File: `[Warning] .="Do not modify this file! It may cause the program to crash! If problems occur after the modification, delete this file and restart the program."

[settings] VERSION=v3.92.01 ImageScaleRatio=2 GIFScaleRatio=2 VideoScaleRatio=2 ImageDenoiseLevel=2 GIFDenoiseLevel=2 VideoDenoiseLevel=2 CustResWidth=7680 CustResHeight=4320 CustResAspectRatioMode=1 ImageThreadNum=12 GIFThreadNumInternal=12 VideoThreadNumInternal=12 isStopShowUseImportModelWarn_RealEsrgan=false checkBox_isEnableImportModel_RealEsrganNcnnVulkan=false lineEdit_ImportedModelName_RealEsrganNcnnVulkan= spinBox_ImportedModelNativeScaleRatio_RealEsrganNcnnVulkan=4 checkBox_Always2x_RealCugan=false comboBox_SyncGapMode_RealCugan=3 comboBox_ImageStyle_Waifu2xCaffe=0 comboBox_ImageStyle_RealEsrGanNcnnVulkan=0 checkBox_isAutoOptEngine=true checkBox_isVramSizeEnabled=false spinBox_VramSize=2000 ImageEngine=0 GIFEngine=0 VideoEngine=0 ImageStyle=0 ModelVulkan=0 TileSize=400 BlockSizeConverter=256 DisableGPUConverter=false ForceOpenCLConverter=false TTAVulkan=false TTAConverter=false TTA_SRMD=false TileSize_SRMD=128 TTA_RealCugan=false TileSize_RealCugan=128 Version_Waifu2xNCNNVulkan=0 comboBox_BitDepth_Waifu2xCaffe=0 TTA_Waifu2xCaffe=false Model_2D_Waifu2xCaffe=0 Model_3D_Waifu2xCaffe=0 ProcessMode_Waifu2xCaffe=1 BatchSize_Waifu2xCaffe=1 GPUID_Waifu2xCaffe=0 SplitSize_Waifu2xCaffe=128 checkBox_EnableMultiGPU_Waifu2xCaffe=false lineEdit_MultiGPUInfo_Waifu2xCaffe="0,1,128:" checkBox_TTA_RealsrNCNNVulkan=false comboBox_Model_RealsrNCNNVulkan=0 spinBox_TileSize_RealsrNCNNVulkan=128 checkBox_TTA_RealEsrganNCNNVulkan=false comboBox_Model_RealEsrganNCNNVulkan=0 spinBox_TileSize_RealEsrganNCNNVulkan=128 CurrentGPUID_Waifu2xNCNNVulkan=0 [email protected]() [email protected](\0\0\0\x7f\0\0\0\x14QList_QMap_QStrQStr\0\0\0\0\0) checkBox_MultiGPU_Waifu2xNCNNVulkan=false comboBox_GPUID_RealsrNCNNVulkan=0 [email protected]() [email protected](\0\0\0\x7f\0\0\0\x14QList_QMap_QStrQStr\0\0\0\0\0) checkBox_MultiGPU_RealsrNcnnVulkan=false comboBox_GPUID_RealEsrganNCNNVulkan=0 [email protected]() [email protected](\0\0\0\x7f\0\0\0\x14QList_QMap_QStrQStr\0\0\0\0\0) checkBox_MultiGPU_RealEsrganNcnnVulkan=false checkBox_AutoSwitch2AnimeVideoModel=false checkBox_ForceXSX4_RealESRGAN=false checkBox_AlwaysV2AnimeVideoModelForVid=true comboBox_TargetProcessor_converter=0 [email protected]() [email protected](\0\0\0\x7f\0\0\0\x14QList_QMap_QStrQStr\0\0\0\0\0) checkBox_MultiGPU_Waifu2xConverter=false comboBox_GPUID_srmd=0 [email protected]() [email protected](\0\0\0\x7f\0\0\0\x14QList_QMap_QStrQStr\0\0\0\0\0) checkBox_MultiGPU_SrmdNCNNVulkan=false comboBox_GPUID_RealCugan=0 [email protected]() [email protected](\0\0\0\x7f\0\0\0\x14QList_QMap_QStrQStr\0\0\0\0\0) checkBox_MultiGPU_RealCuganNCNNVulkan=false ImageEXT=png:jpg:jpeg:tif:tiff:bmp:psd:heic:avif:webp:jfif VideoEXT=mp4:3gp:avi:flv:mkv:mov:mpg:ogg:vob:webm:wmv:ts spinBox_Hour_VidSampStart=0 spinBox_Min_VidSampStart=0 spinBox_Sec_VidSampStart=0 spinBox_Hour_VidSampEND=0 spinBox_Min_VidSampEND=0 spinBox_Sec_VidSampEND=10 spinBox_MaxTriggerRes_AlphaClarityEnhance=720 checkBox_MaxTriggerRes_AlphaClarityEnhance=true checkBox_AlphaClarityEnhance=true checkBox_AutoEmptyFilesList=false checkBox_AlwaysConvertToCFRmp4=false checkBox_SaveCfrMp4_2RAM=false checkBox_AlwaysDelRedirectIO=false checkBox_RedirectIO=true checkBox_RamCacheValidityCheck=true checkBox_InsufficientVRamWarning=true checkBox_NvRtxON=false checkBox_isHyperThreadingSupported=true checkBox_SummaryPopup=true checkBox_DisableResize_gif=false checkBox_AutoSkip_CustomRes=false checkBox_AlwaysPreProcessAlphaPNG=false spinBox_ImageQualityLevel=100 comboBox_ImageSaveFormat=0 checkBox_KeepParentFolder=false checkBox_BanGitee=false comboBox_UpdateChannel=0 checkBox_MinimizeToTaskbar=false checkBox_custres_isAll=true DelOriginal=false OptGIF=false NFSound=true ReProFinFiles=false ShowInterPro=true UpdatePopup=true FileListAutoScroll=true AutoSaveSettings=true AlwaysHideSettings=false AlwaysHideTextBrowser=false ScanSubFolders=true InteractiveFileList=false RetryTimes=10 AutoDetectAlphaChannel=true PromptWhenExit=true KeepVideoCache=false checkBox_ReplaceOriginalFile=false QAction_checkBox_MoveToRecycleBin_checkBox_ReplaceOriginalFile=true QAction_checkBox_MoveToRecycleBin_checkBox_DelOriginal=true ProcessVideoBySegment=true SegmentDuration=30 AudioDenoise=false AudioDenoiseLevel=0.2 checkBox_PreProcessImage=false isSrmdCudaWarningDisabled=false checkBox_AutoScroll_textBrowser=true TextBrowserFontSize=9 checkBox_UnlimitLines_textBrowser=false Language=0 GlobalFontSize=15 [email protected](\0\0\[email protected]\0\0\0\x1c\0M\0S\0 \0S\0h\0\x65\0l\0l\0 \0\x44\0l\0g\0 \0\[email protected] \x80\0\0\0\0\0\xff\xff\xff\xff\x5\x1\0\x32\x10) CustFont_isEnabled=false isStopShowHWAccEncodeWarn_1=false isStopShowHWAccDecodeWarn=false lineEdit_OutputVidExt=mp4 VideoSettingsIsEnabled=false EncoderVideo=libx264 EncoderAudio=aac PixelFormat=yuv420p BitrateVideo=6000 BitrateAudio=320 ExtraCommandOutput= spinBox_CRF_2res=17 comboBox_VidEncoder_2mp4=0 BitrateVideo2mp4=2500 BitrateAudio2mp4=320 vcodecCopy=false acodecCopy=false checkBox_IgnoreFrameRateMode=false ExtraCommand2mp4= spinBox_CRF_2mp4=17 groupBox_HWAccEncode=false comboBox_HWAccEncode_Codec=0 comboBox_HWAccEncode_Platform=0 groupBox_HWAccDecode=false comboBox_HWAccDecode_Codec=0 comboBox_FrameImgCodec=0 comboBox_Format_VidContainerSelect=0 checkBox_KeepSubsMKV=false isStopShowAudioDenoiseWarn=false OutPutPath= OutPutPathIsEnabled=false checkBox_OutPath_KeepOriginalFileName=false checkBox_OutPath_Overwrite=false checkBox_AutoOpenOutputPath=false checkBox_KeepALLParentFolders=false spinBox_OpenCLCommandQueues_A4k=1 checkBox_OpenCLParallelIO_A4k=false comboBox_GPGPUModel_A4k=0 checkBox_HDNMode_Anime4k=true checkBox_FastMode_Anime4K=false checkBox_ACNet_Anime4K=true checkBox_GPUMode_Anime4K=true spinBox_Passes_Anime4K=2 spinBox_PushColorCount_Anime4K=2 doubleSpinBox_PushColorStrength_Anime4K=0.3 doubleSpinBox_PushGradientStrength_Anime4K=1 checkBox_SpecifyGPU_Anime4k=false lineEdit_GPUs_Anime4k="0,0:" checkBox_EnablePreProcessing_Anime4k=true checkBox_MedianBlur_Pre_Anime4k=false checkBox_MeanBlur_Pre_Anime4k=false checkBox_CASSharping_Pre_Anime4k=true checkBox_GaussianBlurWeak_Pre_Anime4k=false checkBox_GaussianBlur_Pre_Anime4k=false checkBox_BilateralFilter_Pre_Anime4k=false checkBox_BilateralFilterFaster_Pre_Anime4k=false checkBox_EnablePostProcessing_Anime4k=true checkBox_MedianBlur_Post_Anime4k=false checkBox_MeanBlur_Post_Anime4k=false checkBox_CASSharping_Post_Anime4k=false checkBox_GaussianBlurWeak_Post_Anime4k=true checkBox_GaussianBlur_Post_Anime4k=false checkBox_BilateralFilter_Post_Anime4k=true checkBox_BilateralFilterFaster_Post_Anime4k=false checkBox_isCompatible_Waifu2x_NCNN_Vulkan_NEW=true checkBox_isCompatible_Waifu2x_NCNN_Vulkan_NEW_FP16P=true checkBox_isCompatible_Waifu2x_NCNN_Vulkan_OLD=true checkBox_isCompatible_Waifu2x_Converter=true checkBox_isCompatible_SRMD_NCNN_Vulkan=true checkBox_isCompatible_SRMD_CUDA=true checkBox_isCompatible_RealCugan_NCNN_Vulkan=true checkBox_isCompatible_Anime4k_CPU=true checkBox_isCompatible_Anime4k_GPU=true checkBox_isCompatible_FFmpeg=true checkBox_isCompatible_FFprobe=true checkBox_isCompatible_ImageMagick=true checkBox_isCompatible_Gifsicle=true checkBox_isCompatible_SoX=true checkBox_isCompatible_Waifu2x_Caffe_CPU=true checkBox_isCompatible_Waifu2x_Caffe_GPU=true checkBox_isCompatible_Waifu2x_Caffe_cuDNN=true checkBox_isCompatible_Realsr_NCNN_Vulkan=true checkBox_isCompatible_RealEsrgan_NCNN_Vulkan=true checkBox_isCompatible_RifeNcnnVulkan=true checkBox_isCompatible_CainNcnnVulkan=true checkBox_isCompatible_DainNcnnVulkan=true checkBox_isCompatible_ApngPlugins=true checkBox_VfiAfterScale_VFI=false checkBox_MultiThread_VFI=true checkBox_AutoAdjustNumOfThreads_VFI=true checkBox_FrameInterpolationOnly_Video=false groupBox_FrameInterpolation=true checkBox_MultiGPU_VFI=false checkBox_TTA_VFI=false checkBox_UHD_VFI=false comboBox_Model_VFI=9 comboBox_GPUID_VFI=0 [email protected]() lineEdit_MultiGPU_IDs_VFI= spinBox_NumOfThreads_VFI=1 comboBox_Engine_VFI=0 spinBox_MultipleOfFPS_VFI=2 spinBox_TileSize_VFI=128 comboBox_FPSSetMethod=1 spinBox_NumOfFPS=60 checkBox_RemoveAllDupedFramesPermanently=false checkBox_isSceneDetectionEnabled=false checkBox_isFrameDedupEnabled=false spinBox_FrameDedup_Tolerance=11 spinBox_SceneDetection_Fuzz=12 spinBox_SceneDetection_MinDiff=38 isStopShowSpeedBoostWarn=false lineEdit_GimpExePath= lineEdit_GimpScriptsFolderPath= spinBox_NumOfIterations_APNG=1 comboBox_CompressMethod_APNG=1 comboBox_OptLevel_GIF=2 comboBox_GifSaveAsFormats=0 comboBox_ApngSaveAsFormats=0 comboBox_HEIF_QualityMode=0 comboBox_HEIF_Chroma=0 checkBox_isRamDiskEnabled=false comboBox_DriveLetter_RamDisk=19 spinBox_DriveSize_RamDisk=4000 lineEdit_ImDiskInstFolder=C:\Program Files\ImDisk Height_MainWindowSize=0 Width_MainWindowSize=0 checkBox_RememberWinSize=false`

Specs:

• OS: Windows 11 21H2
• GPU Model: RTX 3070
• CPU Model: i5 12600K (not overclocked)
• Amount of RAM: 32GB
• Amount of VRAM: 8GB
• Amount of Storage: 500GB boot drive, 1TB project drive (where the content I'm upscaling is saved)

Additional Context: It should be mentioned I tried upscaling this video at least 3 times, with all 3 failing. I restarted my computer on my 3rd try, still no luck.

Edit: (@AaronFeng753)

[Patch] Quick FIX for PSD processing

https://www.patreon.com/posts/53351638

OR just download the v3.70.11-BETA version:

https://www.patreon.com/posts/v3-70-11-beta-53564792

Software Version Latest Stable

Describe the bug When attempting to upscale a PSD, the program reaches the stage of extracting layer information before crashing. A folder is generated in the output directory with an empty results.txt file.

How to Reproduce the bug Steps to reproduce the bug:

1. Make sure that the GIMP .exe path and scripts folder path are correctly set before running, otherwise the program will display an error message before getting to the point where the crash occurs.
2. Load the provided test file into the processing queue.
3. Hit start and wait.

Expected behavior The program should go through the steps of processing the PSD instead of crashing.

Screenshots Video recording of an attempt to upscale the provided test file.

https://user-images.githubusercontent.com/24994538/124498455-e2d9c200-ddab-11eb-9110-7a979be1660b.mp4

Files you were trying to process when encountered the BUG

test.zip

Desktop (please complete the following information):

• OS: Windows 10 20H2
• GPU Model: AMD Radeon 5700 XT
• CPU Model: AMD Ryzen 7 3700X
• Amount of RAM: 32GB
• Amount of VRAM: 8GB
• Amount of Storage: 930GB (569GB free)

⭐ The latest answer from @AaronFeng753:

➡🔗 https://github.com/AaronFeng753/Waifu2x-Extension-GUI/issues/432#issuecomment-1327483718

*Edited by @AaronFeng753

I'm running the latest stable version, but I've had this issue with previous releases too. I assume it has something to do with the tile size, but I've tried changing it and it's still the same.

Whenever I use the RealESRGAN models, it makes the tiles so obvious that some parts are very noisy, and some over smoothened. This doesn't happen when I use RealESRGAN with other apps.

• Program freezes the first time it opens during compatibility test;
• Even after several minutes the other commands remain grayed out;
• Closing the program and reopening solves the problem.

My current Specs Intel Core i5-9400F 16GB DIMM DDR4 clocked @ 2400 MHz GeForce GTX 1660 SUPER GAMING OC 6G

Software Version Latest BETA

Describe the bug As said in the title, the model is just not present in the update archive making it obviously non functional.

Is your feature request related to a problem? Please describe.

Nvidia has released a full SDK of their Maxine tech (also used in their Broadcast app and the up-coming browser video upscaling).

The SDK package includes pre-compiled binaries and models, so it should be easy to integrate with Waifu2x-Extension-GUI.

From my limited testing of real-life videos, the best quality is VideoEffectApp with SuperRes and mode 0, and the end result is slightly better than Waifu2x, but not quite as good as Real-ESRGAN. It is however at least 5x faster than other upscalers on my RTX3090!

(Pending more testing: comparison pics, actual timed durations, anime videos)

Describe the solution you'd like

Have Maxine as an additional upscaler, just like how we have ESRGAN.

Describe alternatives you've considered

The upscaler can be used standalone, if @AaronFeng753 decides not to implement it into Waifu2x-Extension-GUI.

SET PATH=%PATH%;..\external\opencv\bin;..\..\bin;
VideoEffectsApp.exe --effect=SuperRes --mode=0 --model_dir=..\..\bin\models --in_file=..\input\in.mp4 --resolution=1080 --out_file=out.mp4

Additional context

Limitation: The video can only be scaled to 1.3333x, 1.5x, 2x, 3x or 4x times the input, no arbitrary resolution.

General info: https://developer.nvidia.com/maxine

SDK package download: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/maxine/resources/maxine_windows_video_effects_sdk_ga (Nvidia account required to download)

Usage guide: https://docs.nvidia.com/deeplearning/maxine/vfx-sdk-system-guide/index.html

Github but use the SDK download instead because that comes with everything: https://github.com/NVIDIA/MAXINE-VFX-SDK

SDK guide but probably not relevant to us: https://docs.nvidia.com/deeplearning/maxine/vfx-sdk-programming-guide/index.html

⚠⚠Please read the followings before you create a new issue⚠⚠

• Be civil and polite.
• Only BUG Report and Suggestions are allowed here, this is NOT customer-service center.
• You are only allowed to report bugs you encounter when using Latest version.(Beta/Stable)
• English and Chinese languages only.

Is your feature request related to a problem? Please describe. No

Describe the solution you'd like Adding WaifuXL model inside waifu2x extension gui

Describe alternatives you've considered Well, its just that WaifuXL works much better than any model on waifu2x extension gui, so the alternative is just using the other models

Additional context I found out recently about this new model, WaifuXL, this is a Real-ESRGAN model trained on anime images, to be more precise, as the official github page says (where the model is, and yes, is open source) "For our super resolution network we are using the state-of-the-art Real-ESRGAN and for our image tagging network we are using a MobileNetV3. Both were trained on a subset of Danbooru2021." So, i did some tests myself and.. i can say that WaifuXL outperforms all the models inside (as of now) Waifu2x-Extension-GUI here are some examples on a photo completely custom: WaifuXL has sort of better "fine-detailing" compared to the standard RealESRGAN-NCNN-Vulkan, so, adding it is up to you

Please add Code Former's Real-ESRGAN models, as they are better at face restoration than vanilla Real-ESRGAN models. https://github.com/sczhou/CodeFormer