This is a minor simplification and will help with converting the platform
to use the dmaengine helpers.
Signed-off-by: Mark Brown <broonie@linaro.org>