Save yourself some frustration and remove the kinect now. When it was first released I was one of the biggest kinect supporters out there, but that went downhill fast and now mine is not even connected. I do not have any accent and sometimes it works and sometimes it doesn't.
So many times I repeated myself over and over, muted the volume, repeated over and over and finally just used the controller.