Can you fix a warped elastic neckline?

Can you fix a warped elastic neckline?

While not a major issue, the neckline on my cotton Patagonia sweater is looking scruffy as the elastic has stretched and warped. It now looks all wavy as seen in the picture attached. Is there a way to make it look tidier?