Now that sparse keymap uses managed memory, we no longer need to clean it
up manually.
Signed-off-by: Dmitry Torokhov <dmitry.torokhov@gmail.com>