@DavidFuquen we have been discussing this recently. You can see the thread here: Does the XRP require a drive station computer in order to be able to use a bluetooth xbox controller?
My understanding, and others will correct me if I am wrong, is that the XRP currently lacks a Micropython stack to pair with the BLE controllers directly. For that reason, one has to use some sort of Driver Station. I am hoping that some of my students can create a solution, over the summer, because it would definitely make life easier if we could do exactly what you are proposing.