Yes, you can delete endpoints billed on a pay-as-you-go basis at any time. Prepaid endpoints will be deleted automatically once the prepaid period expires.
In both cases, you do not need to delete the associated virtual machines or dedicated servers separately — they will be removed automatically.