Why smoothing .. what are you trying to achieve ?
Is it RMS power measurement , then your best off oversampling and doing maths digitally
If it's an alias filter then what low pass values do you need ?
Yes. that can smooth the output to (near) DC which will give you the average value of the input sinewave (LTspice sim below, Out1, yellow trace):
For a much faster response for a given ripple voltage, you could add a single op amp, 2-pole Sallen-Key filter at the output instead which, with C4, gives a 3-pole rolloff (Out2, red trace).
For the filter values shown, which give about the same ripple value for a 60Hz input, the response time to a steady output is about 0.5s for the 3-pole filter, and 30s for the single-pole filter (a factor of ≈60 reduction).
The filter values can be adjusted, of course, to the lowest frequency you will be converting, and the ripple voltage you can tolerate (as determined by the 6dB/octave rolloff for the single-pole and 18dB/octave for the 3-pole).
I have a circuit almost like yours. Here "out" is without a cap, and "out2" has a 0.01uf cap.
Note it takes a while for the cap to charge up.
1Vpk in 5khz.
Make C2 the size you want. It makes reading the voltage easy. Click on the picture to see a bigger version.