In what sense was Mill an outlier? His ideas informed 19th Century America and Britain. He is still considered one of the foremost modern political philosophers.
Lady Astor denied that the Clivedon Set was pro-fascist (although she was very antisemitic) and in fact, their names were in the Black Book of those to be arrested after a Nazi invasion of Britain.
Lincoln was not a liberal. If he was he would have let the South secede. He would have even let slavery continue if he thought that both it and the Union could be preserved. He was a conservative in the sense that he believed that law and order are the highest values.
Wilfrid Laurier? Now there is an outlier.