Irda support is handled by the normal ims serial driver, so
we do not need this device.
Signed-off-by: Sascha Hauer <s.hauer@pengutronix.de>