You can tie key usage to a monotonic counter and then increment that counter in event of compromise - all the keys would then become unusable forever.