In my experience, the controller doesn’t handle a flood of requests well. In fact, more than one device is pretty much to many.
After a reboot, try to limit interaction (sounds odd but isn’t a problem unless playing/testing).
Ray knows about the issue and no real solution has presented itself yet.
If that doesn’t help I am not sure. You said wired so probably not but make sure you aren’t using wireless (for now).