Setting change doesn't appear on public site

Settings changes take several minutes to be applied to the public site.