Doesn’t the earth itself provide a significant amount of heat from the core? I’m sure I read somewhere that for something like every 10 meters down you dig, the temperature raises by 1° celcius. So maybe we’d not notice a temperature drop so quickly?
Maybe if I lived in the countryside, here in a city, I only really notice the moon if I’m looking for it (which I do often, I love seeing our moon).