Temmie Village can be found after the lowermost set of mushrooms is lit in the fluorescent mushroom room (directly before the room with the dimming crystal lights). The entrance to the village is at the bottom right of the room. This path is dark when the protagonist first encounters it and becomes lit after they progress further through Waterfall, regardless of whether or not the village was encountered before.