Sounds would be distant and low, gain would be adjustable, that sound level limiter is there just to avoid hearing damage from microphones bumping/brushing when moving around.Quality sound for solid state amplifiers means primarily headroom and low negative feedback.
Headroom is to minimize clipping. Low negative feedback is to avoid transient distortions.
If your input signal is so strong that it requires attenuation, going high gain is the opposite of what you want to do.
For most headphones, a headphone amps primary job is impedance transformation. (Voltage) gain is typically the least of your concerns.