It would seem to me that the need for using anything other than the luminance would depend on the application.  You don't provide any application information.  

Why do you think you need to use color for your difference?  

This sounds a bit like a STUPIDENT question...

Not that I'm not willing to help... I just couldn't resist saying that.  ;^)

Rick