Seems like a rookie mistake. Always connect unused inputs per manufacturers datasheet recommendation - don't just let them float or you'll see oscillations.Turns out that shorting the unused inputs made the 1.25pins stable again and I was not able to get the noise to come back.