As a bonus, correctly report was_cancelled when the server writes error

Slightly increases the amount of polling we have to do, but lets us move
interest registration under the channel lock, simplifying our code (and
fixing a bug)

This effectively doubles our qps/core on qps_test on my machine.