Recently I tested some computation in GPU that I just added two huge matrices by GPU. And I just found that the duration become twice when I double the size of the matrix.