As far as I can tell you cannot remove this icon, it is part of the UI on Android O.
The icon is there to make the manual editing of the time more apparent because in previous versions it was not obvious that you could click on the time and change it via keyboard