It does sound a bit like the Cheval’s Ideal Palace, well worth a visit as well (and also in France like Guédelon, though not in the same area): https://en.m.wikipedia.org/wiki/Ferdinand_Cheval