ea89265347
This adds a test to check the file actually exists, and that changes update them, serving as a regression test for #537466.