If you're doing yoga or any other low-impact activity, not wearing a bra shouldn't be a problem. However, during high-impact exercises, sports bras help to keep the breasts in place and offer support — especially for large-breasted women — that can help you avoid discomfort in the form of back pain or neck pain, and of course, breast pain.