If you add it in debian/rules then you know it will be set for the whole package build instead of just what the Makefile covers.
It might also be a qtchooser issue, specially if you can't reproduce it on a porter box. If you want try another porter box and if everything goes ok ask for a give back or upload a new version.