It may sound weird but, a few examples:
-Swiftness: usually good but in some cases, the classical example being CoE, where you need to ‘hop’ and do precise short distance jumps, it just makes things worse.
-Infiltrator’s Return on thief: it forms a core part of the mechanic behind the chain but sometimes you just want to use sword #2 as a gap closer.