The story behind some of London’s most familiar flowers begins, improbably, with tiny wildflowers growing from the mortar of Colditz