Machine Vision problem - Photo matching. Is a solution possible / known, using OpenCV?

时间秒杀一切 提交于 2019-12-10 10:39:35

问题


Having searched around on SO, and also checked on OpenCV list but not having found an answer, posting my query here.

Problem: Match 2 photos of the same scene, shot from 2 slightly different camera angles, and with slightly different lens distortions, with slightly different zoom-levels, and shot under slightly different lighting conditions.

Constraints:

  1. Slightly different in the above statements can be taken to mean max. of 10% in most cases.
  2. The scene in question is to be considered an indoor scene, or an outdoor seen with limited details.
  3. Matching accuracy of 75% would be acceptable.
  4. The photos aren't high-resolution (shot with consumer grade mostly budget / cell-phone cameras)

What gives me the hope that this problem might be solvable is the existence of software that stitches photos to create panoramas. They seem to figure out the overlapping sections auto-magically. They do so even when the horizon orientations don't match exactly, slight differences exist in exposure level or background illumination, and minor zoom level differences exist. I think, what I need is a very similar workflow and set of algorithms.

Note that while my question might seem similar to one here, actually it is not.


回答1:


You need to compute the homography between the images which needs point correspondences such as SURF interest points.

Once you have the homography, you can do a projective transformation of the images so that they match up. Following that, you can try some sort of blending at the seams to make it look seamless.

This paper describes it pretty well. You can replace the Multi-scale Oriented Patches used by Szeliski with SURF interest points. Here are some more resources to get you started:

  1. CMU Lecture on homography and mosaics
  2. Same thing with a bit about feathering
  3. Detailed PPT


来源:https://stackoverflow.com/questions/7258425/machine-vision-problem-photo-matching-is-a-solution-possible-known-using-o

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!