I was thinking of avoiding an external compensation and let the internal frequency compensation of LM2576 do the job - since the adder was with the unity gain, the frequency response will not get altered within the bandwidth of interest. Will such a thing affect the stability or the response time of the converter? Of course, since the Vref pin is not available directly, there could be variations arising out of a matching Vref under varying operating conditions.