How to exclude colours from filter?

Can I filter for, say, ‘not yellow’ highlights? That is, to exclude yellow excerpts from my filter results.