The Discalced Carmelites came to Holy Hill from Bavaria at the invitation of Archbishop Messmer on June 26, 1906. These first Carmelites were Fathers Eliseus Mackina and Kilian Gutmann and Brothers Adam Modlmayer of the Nativity of the Lord and Alphonse Merl. The men were officially introduced to the local community by Fr. John Bertram on the Feast of the Visitation, July 2, 1906.

The men braved their first Wisconsin winter in a farmhouse known as the old Whelan home. The conversion from house to friary was complete by December 8, 1907. Hardships were many. The men wanted to leave often, but Br. Adam insisted upon staying. He was convinced that God wanted the Carmelites to remain at Holy Hill.

Br. Adam died on October 7, 1916, and was originally buried behind the second shrine. During excavation for the third shrine, his body was moved to the approximate location of his marker which is near the tenth station, just below the current friary parking lot. His actual grave was covered over during construction of the present friary.