If you are using the white arrow, which selects parts of a path (points of line segments) then it's likely that you had the path selected anyway, and when you switched pointers it kept all parts of the path selected to "match" that. Try clicking away from the path, and the background drawing if it isn't locked, to deselect and then click the segment you wish to delete.