XGBoost regression test scores are not increasing on X having set of multinominal categorical variable and binary categorical variables

Question

Attempting a multivariate linear regression with all categorical variables.Data structure as below.

X.shape
(4209, 359)
X.head()
X0  X1  X2  X3  X4  X5  X6  X