At the location of this house was in 1300 the house of Jan Breydel.
Three houses were joined in the eighteenth century to form a large mansion.
Around 1900 the industrialist Jean de Brouwer did undertake significant transformations, both inside and outside. The splendid interior with Neo-Renaissance frescoes by Emile Rommelaere is unique in Bruges.
Having underestimated the cost of transformations, Jean de Brouwer had to sell the house in 1903 to Baron Charles Gillès de Pélichy. He redeveloped parts of the interior in the Gothic style (his favorite style), mostly in his office and library.
The house now belongs to his grand-son, the Knight Baudouin de la Kethulle de Ryhove, Ambassador of His Majesty King of Belgium.