Recognize recurring images into a larger one

Question

Edit: this is not a duplicate of Determine if an image exists within a larger image, and if so, find it, using Python since I do not know the pattern beforehand<

Answer 1

The goal is to find several equal or very similar patterns which are not known before in a picture. As it is this problem is still a bit ill posed.

• Are the patterns exactly equal or only similar (added noise maybe)?
• Do you want to have the largest possible patterns or are smaller subpatterns okay too or are all possible patterns needed? Reason is that of course each pattern could consist of equal patterns too.
• Is the background always that simple (completely white) or can it be much more difficult? What do we know about it?
• Are the patterns always equally oriented, equally scaled, non-overlapping?

For the simple case of non-overlapping patterns with simple background, the answer of Yves Daoust using segmentation is well performing but fails if patterns are very close or overlapping.

For other cases the idea of the keypoints by Micka will help but might not perform well if there is noise or might be slow.

I have one alternative: look at correlations of subblocks of the image.

In pseudocode:

• Divide the image in overlapping areas of size MxN for a suitable M,N (pixel width and height chosen to be approximately the size of the desired pattern)
• Correlate each subblock with the whole image. Look for local maxima in the correlation. The position of these maxima denotes the position of similar regions.
• Choose a global threshold on all correlations (smartly somehow) and find sets of equal patterns.
• Determine the fine structure of these patterns by shanging the shape from rectangular (bounding box) to a more sophisticaed shape (maybe by looking at the shape of the peaks in the correlation)
• In case the approximate size of the desired patterns is not known before, try with large values of M, N and go down to smaller ones.
• To speed up the whole process start on a coarse scale (downscaled version of the image) and then process finer scales only where needed. Needs balancing of zooming in and performing correlations.

Sorry, I cannot make this a full Matlab project right now, but I hope this helps you.