We have a CrossVendorRepeatedFailedLoginAttempts rule that auto-resolves and I am not sure what is the condition that actually causes this rule to resolve.
The alert's rule is based on NumericThresholdOnDoubleMetricWithItemsTemplateRule and as far as I can tell it doesn't have any parameter that defines when it should auto-resolve.