Got the vector ball thing kind of working. If the selection bit looks weird it's because you're supposed to align the object in the right eye and the Unity game camera only shows the left eye.
More updates soon. I've got an idea for a keyboard to go with this.