Why do you not want to handle exceptions in your app? You'll certainly get them if you're doing any sort of network IO. I would have the while loop and in it i would just be using ContinueWith on all ...
There's a lot of confusion about async/await, Task/TPL and asynchronous and parallel programming in general, so Jeremy Clark is on a mission to inform developers on how to use everything properly.