Disabling an alert feature was created for the times when you do not want to delete the alert permanently, but still want to temporarily disable notifications.
Since you cannot delete all subscribers, the solution is to change the notifications to "Never".
- Go to edit your Alert

- Go to the "Set info for the Alert" step

- Select "Never"

- Hit "Save"