However, properly reacting isn't exactly easy, either.
It's similar to an entirely custom handling like the one you describe.
Sure, I can do that. However, the actual behavior of the control is much more complex. The map moves faster the closer I draw to the edges.
And slower again if I move back to the center.
I can actually "fly" across the map by just keeping the mousekey down and moving the cursor around.
Replicating this isn't as trivial as making a simple pan.
Which is why I was hoping to resolve the stuttering in the control itself, but appearently, it's not possible.
At least nobody here seems to know how to pull it off.