Disconnecting from a multi-player session?

[BiggBaddWolf]

Sometimes when I go to disconnect from a multi player session my computer stops responding. I open the task manager and it will show program not responding, so I have to turn off the computer manually

Any ideas what causes it to not shut down properly and/or how to fix it