Phat Diem Cathedral was built between 1875 and 1899 with four roofs and six sets of iron wooden pillars, and consists of a number of ponds, lakes, churches, and artificial caves.

On both sides of the church are four smaller churches of different styles. Phuong Dinh Church, part of the Phat Diem complex, is a giant building entirely made of stone. Numerous stone sculptures are on the inside and outside walls. A large bell cast in the 1890s weighing nearly 2 tons is found in the bell tower.

On the extreme North corner are three stone caves. The most beautiful of these caves is Lo Duc Grotto. Unlike these structures which were built by Europeans and resemble typical churches of the era, Phat Diem Cathedral was designed by a Vietnamese priest, known as Father Luc.