Clean up poll queue handling, avoid doing any wait-queue operations
when we only want to get the current state.