you can delete them one at a time a real pain when using global sets.there's a little trash can icon next to the lighting globe,just click on the light you want to delete then click trash can.click yes on popup.if using global light sets the only thing i've found is save scene with only one infinite light and when you want to delete global set just delete your scene and reload it.