I did that with avidemux (gtk tool). It is available as a package under most linuxes, also for Windows and Mac.
I simply opened the first file. Then I added the next ones in order.
Finally, I saved the concatenated video using audio and video copy and format mp4.