You could take one out, measure impedance to see what you get. If you get a reasonable ohm value (usually low impedance), it's a thermistor. If you measure high impedance it's likely a capacitor.

This was my next step, I probably should have already done this but I was hoping someone might recognize it. If it's a cap, I'm unsure of what to replace them with.

 

I believe that it is a 22pF ceramic capacitor with a voltage rating of 1500V. It's definitely not a thermistor.

 

I have the exact same thoughts as @SLK001 on it being 22pF cap.

 

This is probably a stupid question but why would a ceramic capacitor be made of paper?

 

This is probably a stupid question but why would a ceramic capacitor be made of paper?

What makes you think that it is made out of paper?

 

There was paper peeling off one of the other ones like it, but after removing it from the board and cleaning it the paper came off and it seems that it was not a part of it after all. But unlike the other one, this one has the number 0047 printed on the opposite side.

 

Photo