Use output walkers when ordering by non-fetched relation

[Sajito]

fixes #4936

Q	A
Branch?	2.7 - current stable version branch for bug fixes
Tickets	#4936
License	MIT
Doc PR	-

Here is a PR with the changes proposed in the corresponding issue. From my understanding there is already a way to define this option on per operation basis, but setting that option would result in always using the output walkers, even if they are not needed. I've described the changes in the issue already, if needed we may discuss here.

I'm submitting this as a bugfix, even though the behavior seems intended, because this change should fix potentially unexpected errors and should not break anything existing.