Since clk_xusbxti.rate is 24Mhz as a default,
so we don't need to set that when it is 24Mhz.
Signed-off-by: Kukjin Kim <kgene.kim@samsung.com>