Kellie House is three miles north-northwest from the fishing village of Pittenweem (Scottish Gaelic: Baile na h-Uaimh, Fìobha, Alba). The oldest part of the castle, the present northwest tower, possibly dates back to mid fourteenth century. A new tower was added in 1573 with a new range linking the two towers to another tower built in the late sixteenth, early seventeenth centuries. Within the castle there are magnificent plaster ceilings, painted panelling and fine furniture designed by Sir Robert Lorimer. It also contains a long-concealed mural by the celebrated Arts & Crafts pioneer, Phoebe Anna Traquair.
There are substantial grounds covering some 16 acres (6.5 hectares). A woodland walk can be explored and the Arts & Crafts garden has beautiful borders of old-fashioned roses and herbaceous plants, as well as fruit and vegetables. The house and gardens are managed by the National Trust for Scotland and open to the public daily throughout the year. It is located off the B9171 about three miles north northwest from Pittenweem/Baile na h-Uaimh.