Queen Victoria and Abdul Karim

Queen Victoria loved two men: Prince Albert, and after his death, her servant, John Brown. Late in life, the Queen had a third partner, a Muslim man named Abdul Karim. So why did Victoria's children want the records of this relationship destroyed?