The first time the fitting reaches the view-substitution component, the masked region is still not supervised. As detailed in the paper, to add view-dependent effects to the reference view and supervise other views, we render the scene from the reference camera, but with the colours from other views. The difference between these renderings and the refenrece view is then inpainted inside the masked region using bilateral solvers to add propagate proper view-dependent effects inside the mask. Below, we show sample view-substituted images for two scenes (the target views used in the following examples are the spiral cameras).
After fitting, the view-substituted images look like this: