OK I get it now. I figured you only needed to add a desktop library if you were going to call it. I see now that you have to add the desktop library version, even if you only plan on using the device library (when using the desktop IDE).
Sorry for thinking this was a bug, but in my defense I don't recall reading this anywhere - of course my memory is subject to failure