I\'m trying to use FFMPEG to transcode a video with very large frames (4096 x 4096). It\'s a short video - just under two minutes, but the source video file is 15.8GB. (Th
I suspect your problem is hinted at here:
x264 [error]: malloc of size 17305600 failed
Is this a 32-bit build of ffmpeg? If so, I fear you may be out of luck. 4k video processing really requires >4 GB of memory. Better switch to a 64-bit build and try again.
Of course you actually need to have enough memory available in your computer, too. It could be a lot more than 4 GB, depending on your x264 settings.