Why do horses spook at orange and yellow?

Horses have dichromatic color vision. Light orange and yellow stand out more to them than other colors, and that can result in the horse being startled, especially if the item colored that is flapping or moving. (The barn I rode at as a kid had a single orange jump pole and that thing elicited more stops and runouts than any other obstacle used!)