Ferguson turns back the instant that Roy appears around the bend in the cave-tunnel, so he doesn't look long enough as Roy comes into view in the dimly-lit tunnel to be able to identify him; from getting just that split-second glance, Ferguson would not have been able to tell Allen who it was.