Odd, I rechecked it again this morning, and the button board 1 pin is reading 5.01, and the probe pins are reading 4.95-5.00 relative to ground, 0 relative to pin 21 of the ATmega.
Would having D1 backwards potentially damaged anything? It's the only thing I saw wrong with the board yesterday...