When he's in the guard house he's wearing dance shoes instead of boots, but then he needs them for a dance number.
As Fred Astaire and Robert Benchley are discussing the upcoming show they pass several soldiers who are working with shovels. Though the soldiers are supposed to be breaking up clods and smoothing the dirt the shovels never come within six inches of the ground.