The governor granted a property grant to Thomas Miller, a Sergeant in the 73rd Regiment of Foot, on June 30, 1814. Nearby stood a tiny mill that belonged to Jack Leighton, an ex-convict. Jack, Miller’s Point, was the name given to the region.

In 1833, Governor Bourke gave the Catholic Church property at Millers Point so that a school house could be built there that could double as a chapel on Sundays. The school building was planned by Ambrose Hallen, a Colonial architect, in collaboration with Bishop Ullathorne. It was finished by May 1835.