On November 1, 1889, in Madison, Wisconsin, the Martin Luther Orphan's Home was established by the Norwegian Synod of the Lutheran Church for children orphaned by disease, epidemics, poverty, and war. In 1894, the Home was relocated on a 52 acre site outside of Stoughton, on land donated by Gyermund and Rebecca Skaalen. By 1898, between 90 and 120 children were being cared for. Fire destroyed the girls dormitory on Palm Sunday, 1925, and the boys dormitory in 1934. The two story red brick building was the homes nursery and girls dormitory was rebuilt in 1927 (currently the home of Luther's Restaurant). In 1935, the stone house was built to house the boys dormitory and workshop. During this time the orphanage was home to nearly 200 children and 20 employees. The home was totally self- sufficient, raising its own livestock and crops and educating the children in the old school house (next to our pool). In 1940 the direction of services changed focus from orphans to troubled youths.

Abandoned in 1974, the property stood vacant until 1978. At this time, the former Martin Luther Orphan's Home site was purchased by Stanley Midtbo, a Stoughton native, to be developed as a Recreational Vehicle Campground and Resort. In 1979, Viking Village Campground was opened, with a swimming pool and miniature golf course being added. July 1984 saw the opening of Luther's Restaurant, in the lower level of the former girls dormitory. In 1993, a 40 x 80 picnic pavilion was added.