No functional changes, just making sure we're dealing
with unsigned ints.
Signed-off-by: Felipe Balbi <balbi@ti.com>