That would be fine.Many low voltage indicator circuits oscillate on and off when the battery voltage is low because the voltage is low when loaded and rebounds up when unloaded.
As long as the LED comes ON when the LOADED voltage dips to approximately 2v (for the two AA's in series) give or take