Merging two files column and row-wise in bash

Question

I would like to merge two files, column and row-wise but am having difficulty doing so with bash. Here is what I would like to do.

File1:

1 2 3

4 5 6