Your debian installation probably uses X for all its graphical needs. My OSX installation does not.43
for me it worked flawlessly. Keep in mind though that all the rendering load is on the connecting computer. If it does not have a good enough GPU it will have lag.