That's called living in a community. Go put up some foam on the backboard, close the window, or gently move the infant during the odd hour of basketball.