Following
How to draw a path between two markers
I had to add lot of polylines between two markers, to make a path.
One of the markers is draggable,
If you want to removes all markers, polylines, polygons, overlays, etc from the map use
mMap.clear(); //it will remove all additional objects from map
and if you only want to remove all or single polyline, polygon, marker etc see @DiskDev Answer above. In this case you must keep track of every single additional object you add to map