When browsing the internet I stumpled across this article. In summary, Xv does currently bypass the video card's LUTs in most cases. Tools like dispwin and xcalib have no effect.
It seems to me - after reading the entire thread - that these guys are willing to add hooks for color-management. Let's see what the result will be!