Cursor keys can't be used to navigate among the icons

It would be nice if there's a way to navigate the desktop with the keyboard. That includes selecting the active icon as well as having a keyboard shortcut to open the context menu.