Anybody, any useful ideas or tips on how I could go about tackling this problem. I tried correlation between the patch and the second image but not much luck.
Another idea i had was to create a mixture of gaussian using the patch from the second image and then calculating the probability of pixels from the first image belonging to this mixture. But without a false model I can't do much with this model.
Over here I've just shown the binary masks but i have the gray scale and the rgb images available as well.