How so? Everyone I’ve seen using them just tapes the adapter to their earbuds and keeps the phone in their pocket or arm straps while jogging. Seems like you would have the same issue with a 3.5mm audio jack.
Speakers use Bluetooth or a lightning jack in a cradle.