You cannot get rid of these stops, but still, you can change their color. So, to change the color, you need to first go to the “Gradient Stops” color circle and click on it.