This reverts commit ef492d08.

This patch breaks the RNG on i.MX8MM.
Reported-by: Bastian Krause <bst@pengutronix.de>
Link: https://lore.kernel.org/all/e1f3f073-9d5e-1bae-f4f8-08dc48adad62@pengutronix.de/Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>