Updates server shutdown handling

- ensures that servers cancels calls after the shutdown timeout
- uses an infinite timeout when request server calls

This two changes fix the issue where the server segfaults on shutdown.