CN104766315A - Method for calibrating relative position relation between image collection device and display screen and equipment - Google Patents
Method for calibrating relative position relation between image collection device and display screen and equipment Download PDFInfo
- Publication number
- CN104766315A CN104766315A CN201510145995.5A CN201510145995A CN104766315A CN 104766315 A CN104766315 A CN 104766315A CN 201510145995 A CN201510145995 A CN 201510145995A CN 104766315 A CN104766315 A CN 104766315A
- Authority
- CN
- China
- Prior art keywords
- image
- mirror
- display screen
- reference frame
- unique points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Processing Or Creating Images (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the invention discloses a method for calibrating the relative position relation between an image collection device and a display screen. The method comprises the steps that a pattern is displayed on the display screen of electronic equipment; a collected image is obtained through the image collection device, wherein the collected image comprises an image corresponding to a mirror and a virtual image, presented in a physical imaging mode, of the pattern; the collected image is analyzed, and the relative position relation between the image collection device and the display screen is determined; based on the relative position relation, the space operation, collected by the image collection device, of an operating body corresponds to the display screen to be responded. The embodiment of the invention further discloses the electronic equipment.
Description
Technical field
The present invention relates to the information processing technology, particularly relate to method and the electronic equipment of a kind of uncalibrated image harvester and display screen relative position relation.
Background technology
Current, three-dimensional (3D) camera technical development is swift and violent, along with volume constantly reduce, power consumption and cost constantly reduces, precision improves constantly, constantly improving of related application service and the ecosystem and wideling popularize of the industry such as all big enterprises such as Intel, Microsoft, 3D camera product turns to individual consumer market from laboratory and industrial circle application gradually, becomes popular product.
Be generally that reference frame is set up around electronic equipment screen due to the virtual world in electronic equipment, and the true 3D world that electronic equipment is perceived by 3D camera is generally that reference frame is set up around 3D camera, in order to can better the real world that the virtual world in electronic equipment and user are lived be combined, need to set up the corresponding relation between electronic equipment screen reference frame and 3D camera reference frame, namely need to demarcate the position relationship between electronic equipment screen and 3D camera.But existing scaling method is comparatively complicated, domestic consumer is difficult to grasp, 3D camera is often fixed a certain position on an electronic device by the equipment manufacturers being more therefore integrated with 3D camera, user is not allowed arbitrarily to move, thus just the position relationship between camera and electronic equipment screen is measured before equipment dispatches from the factory, forever retained in the electronic device by correlation parameter, user can directly use this electronic equipment without the need to demarcating.But aforesaid way makes user be limited to parameter configuration when 3D camera dispatches from the factory, such as field angle, gather the resolution, sharpness etc. of image, therefore, limit the use degree of freedom of user, reduce Consumer's Experience.
Summary of the invention
For solving the technical matters of existing existence, embodiments provide method and the electronic equipment of a kind of uncalibrated image harvester and display screen relative position relation.
The technical scheme of the embodiment of the present invention is achieved in that
Embodiments provide a kind of method of uncalibrated image harvester and display screen relative position relation, described method comprises:
The display screen of electronic equipment shows a pattern;
Obtain one by image collecting device and gather image, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
Analyze described collection image, determine the relative position relation of described image collecting device and described display screen;
The spatial operation of the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
The embodiment of the present invention also provides a kind of electronic equipment, and described electronic equipment comprises:
Display unit, for showing a pattern on the display screen of electronic equipment;
Image acquisition unit, gather image for obtaining one by image collecting device, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
Analytic unit, for analyzing described collection image, determines the relative position relation of described image collecting device and described display screen;
Response unit, the spatial operation for the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
Uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation and electronic equipment, a pattern can be shown on the display screen of electronic equipment, obtain by image collecting device the collection image that includes the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode; And then the relative position relation of described image collecting device and described display screen is determined according to described collection image, the spatial operation of the operating body gathered with the most described image collecting device corresponds on described display screen and responds, realize real world corresponding to image collecting device to be combined with the virtual world that the display screen of described electronic equipment shows, promote Consumer's Experience.
In addition, uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation be simple, be convenient to user realizes, therefore, without the need to the image collecting device will be connected with described electronic equipment, or the described image collecting device in described electronic equipment is fixed in described electronic equipment, therefore, compared with the mode of existing fixing described image collecting device, the embodiment of the present invention uses degree of freedom higher, more can meet the different demands of user.
Accompanying drawing explanation
Fig. 1 is the realization flow schematic diagram one of the method for embodiment of the present invention uncalibrated image harvester and display screen relative position relation;
Fig. 2 is embodiment of the present invention application scenarios schematic diagram;
Fig. 3 is the realization flow schematic diagram two of the method for embodiment of the present invention uncalibrated image harvester and display screen relative position relation;
Fig. 4 is the realization flow schematic diagram three of the method for embodiment of the present invention uncalibrated image harvester and display screen relative position relation;
Fig. 5 is the structural representation one of embodiment of the present invention electronic equipment;
Fig. 6 is the structural representation two of embodiment of the present invention electronic equipment.
Embodiment
The basic thought of the embodiment of the present invention is: on the display screen of electronic equipment, show a pattern; Obtain one by image collecting device and gather image, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode; Analyze described collection image, determine the relative position relation of described image collecting device and described display screen; The spatial operation of the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
In the actual use scenes of 3D camera, 3D camera, generally as input end, mainly carries out perception to environment residing for user and user; And the display screen of electronic equipment is as output terminal, be mainly used in exporting to user the content that residing for user and user that described 3D camera perceives, environment facies adapt to; Therefore, consider the collection convenience of 3D camera to image corresponding to environment residing for user and user, and display screen is to the convenience of user's output content, 3D camera and display screen be often arranged at same towards; Therefore, the present invention mainly based on 3D camera and display screen be in same towards application scenarios under, realize the object of uncalibrated image harvester and display screen relative position relation.
In order to more at large understand feature of the present invention and technology contents, below in conjunction with accompanying drawing, realization of the present invention is described in detail, the use of appended accompanying drawing explanation only for reference, is not used for limiting the present invention.
Embodiment one
Fig. 1 is the realization flow schematic diagram one of the method for embodiment of the present invention uncalibrated image harvester and display screen relative position relation; Described method is applied to an electronic equipment; Described electronic equipment connects or includes image collecting device; Described image collecting device supports 3D rendering collection; As shown in Figure 1, described method comprises:
Step 101: show a pattern on the display screen of electronic equipment;
In the present embodiment, described electronic equipment can be specially the electronic equipment that 3D display supported by computer, televisor etc.
In the present embodiment, when described electronic equipment includes described image collecting device, described image collecting device can rotate relative to described electronic equipment, or mobile.
In the present embodiment, described pattern is two dimensional image, also namely described pattern and described display screen at same plane.
Step 102: obtain one by the image collecting device of described electronic equipment and gather image, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
In the present embodiment, due to the image acquisition direction of described image collecting device and the display screen of electronic equipment be in same towards, now, as shown in Figure 2, when a mirror 22 is placed in display screen 21 front of described electronic equipment, described mirror 22 can reflect the described pattern 23 in described display screen 21, and then, make described image collecting device 24 can collect image corresponding to described mirror, and the virtual images of described pattern that described mirror is presented by physics imaging mode, so, for uncalibrated image harvester and display screen relative position relation are laid a good foundation.
Here, it should be noted that the application scenarios that Fig. 2 provides is only for explaining the embodiment of the present invention, not for limiting the embodiment of the present invention, in actual applications, the position that described mirror is placed is unrestricted, as long as can reflect pattern and mirror that described display screen presents.
In the present embodiment, because described image collecting device supports 3D rendering collection, therefore, described image acquisition device is a 3-D view to described collection image; Further, described image collecting device can be specially 3D camera.
Step 103: analyze described collection image, determine the relative position relation of described image collecting device and described display screen;
In the present embodiment, image corresponding to described mirror is analyzed based on described mirror image-forming principle, and the described virtual images that described pattern is corresponding, and then determine the relative position relation of described image collecting device and described display screen, the Parameter Switch relation of the reference frame that the reference frame that also namely described image collecting device is corresponding is corresponding with the display screen of described electronic equipment.
Step 104: the spatial operation of the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
In the present embodiment, when the relative position relation of described image collecting device and described display screen determined by described electronic equipment, after the Parameter Switch relation of the reference frame that the reference frame that also namely described image collecting device is corresponding is corresponding with the display screen of described electronic equipment, described electronic equipment can according to the Parameter Switch relation of reference system by described image acquisition device to image correspond on the display screen of described electronic equipment, combine with the real world making the virtual world of described display screen and electronic equipment user live, and then lifting Consumer's Experience.
Uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation, a pattern can be shown on the display screen of electronic equipment, obtain by image collecting device the collection image that includes the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode; And then the relative position relation of described image collecting device and described display screen is determined according to described collection image, the spatial operation of the operating body gathered with the most described image collecting device corresponds on described display screen and responds, realize real world corresponding to image collecting device to be combined with the virtual world that the display screen of described electronic equipment shows, promote Consumer's Experience.
In addition, uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation be simple, be convenient to user realizes, therefore, without the need to the image collecting device will be connected with described electronic equipment, or the described image collecting device in described electronic equipment is fixed in described electronic equipment, therefore, compared with the mode of existing fixing described image collecting device, the embodiment of the present invention uses degree of freedom higher, more can meet the different demands of user.
And, due to without the need to described image collecting device is fixed, so user can adjust described image collecting device arbitrarily according to the actual requirements, even can change the higher image collecting device of parameter configuration, therefore, meet user's multiple demands.
Embodiment two
Fig. 3 is the realization flow schematic diagram two of the method for embodiment of the present invention uncalibrated image harvester and display screen relative position relation; Described method is applied to an electronic equipment; Described electronic equipment connects or includes image collecting device; Described image collecting device supports 3D rendering collection; As shown in Figure 3, described method comprises:
Step 301: show a pattern on the display screen of electronic equipment;
In the present embodiment, described electronic equipment can be specially the electronic equipment that 3D display supported by computer, televisor etc.
In the present embodiment, when described electronic equipment includes described image collecting device, described image collecting device can rotate relative to described electronic equipment, or mobile.
In the present embodiment, described pattern is two dimensional image, also namely described pattern and described display screen at same plane.
Step 302: obtain one by image collecting device and gather image, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
In the present embodiment, due to the image acquisition direction of described image collecting device and the display screen of electronic equipment be in same towards, now, as shown in Figure 2, when a mirror 22 is placed in display screen 21 front of described electronic equipment, described mirror 22 can reflect the described pattern 23 in described display screen 21, and then, make described image collecting device 24 can collect image corresponding to described mirror, and the virtual images of described pattern that described mirror is presented by physics imaging mode, so, for uncalibrated image harvester and display screen relative position relation are laid a good foundation.
Here, it should be noted that the application scenarios that Fig. 2 provides is only for explaining the embodiment of the present invention, not for limiting the embodiment of the present invention, in actual applications, the position that described mirror is placed is unrestricted, as long as can reflect pattern and mirror that described display screen presents.
In the present embodiment, because described image collecting device supports 3D rendering collection, therefore, described image acquisition device is a 3-D view to described collection image; Further, described image collecting device can be specially 3D camera.
Step 303: obtain the first group coordinate information of image under the first reference frame that described in described collection image, mirror is corresponding; Described first reference is the reference frame that described image collecting device is corresponding;
Step 304: the second group coordinate information of virtual images under described first reference frame obtaining the described pattern that the described mirror in described collection image is presented by physics imaging mode;
Step 305: the relative position relation determining described image collecting device and described display screen according to described first group of coordinate information and described second group of coordinate information;
Step 306: the spatial operation of the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
In the present embodiment, when the relative position relation of described image collecting device and described display screen determined by described electronic equipment, after the Parameter Switch relation of the reference frame that the reference frame that also namely described image collecting device is corresponding is corresponding with the display screen of described electronic equipment, described electronic equipment can according to the Parameter Switch relation of reference system by described image acquisition device to image correspond on the display screen of described electronic equipment, combine with the real world making the virtual world of described display screen and electronic equipment user live, and then lifting Consumer's Experience.
In the present embodiment, because described image collecting device supports 3D rendering collection, therefore, the image that the described mirror got by described image collecting device is corresponding is a 3-D view, is also that each coordinate in described first group of coordinate information is a three-dimensional coordinate; Therefore, after described electronic equipment gets described first group of coordinate information, the plane at the described mirror place under described first reference frame can be determined according to described first group of coordinate information.
In like manner, the described virtual image that the described pattern obtained by described image collecting device is corresponding is also a 3-D view, is also that each coordinate in described second group of coordinate information is also a three-dimensional coordinate; Therefore, after described electronic equipment gets described second group of coordinate information, the described virtual image place plane can determined under described first reference frame according to described second group of coordinate information.
And then, when the plane at the described mirror place under described first reference frame determined by described electronic equipment, and after the plane at virtual image place, the described pattern place plane under described first reference frame can be determined according to mirror-reflection principle, also be the described display screen place plane under described first reference frame, again because described first reference is the reference frame that described image collecting device is corresponding, therefore, the coordinate of described display screen under described first reference frame that described image collecting device is corresponding can be determined by the way, and then determine the relative position relation of described image collecting device and described display screen, the spatial operation of the operating body that described image collecting device can be gathered based on described relative position relation by described electronic equipment corresponds on described display screen and responds, realize real world corresponding to image collecting device to be combined with the virtual world that the display screen of described electronic equipment shows.
Uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation, a pattern can be shown on the display screen of electronic equipment, obtain by image collecting device the collection image that includes the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode; And then the relative position relation of described image collecting device and described display screen is determined according to described collection image, the spatial operation of the operating body gathered with the most described image collecting device corresponds on described display screen and responds, realize real world corresponding to image collecting device to be combined with the virtual world that the display screen of described electronic equipment shows, promote Consumer's Experience.
In addition, uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation be simple, be convenient to user realizes, therefore, without the need to the image collecting device will be connected with described electronic equipment, or the described image collecting device in described electronic equipment is fixed in described electronic equipment, therefore, compared with the mode of existing fixing described image collecting device, the embodiment of the present invention uses degree of freedom higher, more can meet the different demands of user.
And, due to without the need to described image collecting device is fixed, so user can adjust described image collecting device arbitrarily according to the actual requirements, even can change the higher image collecting device of parameter configuration, therefore, meet user's multiple demands.
Embodiment three
Fig. 4 is the realization flow schematic diagram three of the method for embodiment of the present invention uncalibrated image harvester and display screen relative position relation; Described method is applied to an electronic equipment; Described electronic equipment connects or includes image collecting device; Described image collecting device supports 3D rendering collection; As shown in Figure 4, described method comprises:
Step 401: show a pattern on the display screen of electronic equipment;
In the present embodiment, described electronic equipment can be specially the electronic equipment that 3D display supported by computer, televisor etc.
In the present embodiment, when described electronic equipment includes described image collecting device, described image collecting device can rotate relative to described electronic equipment, or mobile.
In the present embodiment, described pattern is two dimensional image, also namely described pattern and described display screen at same plane.
Step 402: obtain one by image collecting device and gather image, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
In the present embodiment, due to the image acquisition direction of described image collecting device and the display screen of electronic equipment be in same towards, now, as shown in Figure 2, when a mirror 22 is placed in display screen 21 front of described electronic equipment, described mirror 22 can reflect the described pattern 23 in described display screen 21, and then, make described image collecting device 24 can collect image corresponding to described mirror, and the virtual images of described pattern that described mirror is presented by physics imaging mode, so, for uncalibrated image harvester and display screen relative position relation are laid a good foundation.
Here, it should be noted that the application scenarios that Fig. 2 provides is only for explaining the embodiment of the present invention, not for limiting the embodiment of the present invention, in actual applications, the position that described mirror is placed is unrestricted, as long as can reflect pattern and mirror that described display screen presents.
In the present embodiment, because described image collecting device supports 3D rendering collection, therefore, described image acquisition device is a 3-D view to described collection image; Further, described image collecting device can be specially 3D camera.
Step 403: obtain at least three unique points in image corresponding to described mirror in described collection image;
Step 404: determine first group of coordinate information under the first reference frame according at least three unique points in the image that described mirror is corresponding; Described first reference is the reference frame that described image collecting device is corresponding;
In the present embodiment, at least three unique points in the described image corresponding according to described mirror determine first group of coordinate information under the first reference frame, comprising:
Judge whether at least three unique points in the image that described mirror is corresponding meet the first preset rules; Described first preset rules uniquely can determine mirror place plane described in for being characterized under described first reference frame according at least three unique points in image corresponding to described mirror;
When the judged result got at least three unique points characterized in image corresponding to described mirror meet described first preset rules, determine first group of coordinate information under the first reference frame according at least three unique points in the image that described mirror is corresponding.
In the present embodiment, determine that the object of described first group of coordinate information is the plane in order to determine the image place that described mirror is corresponding under described first reference frame; Therefore, when after at least three unique points that described electronic equipment gets in image corresponding to described mirror, whether at least three unique points in the image that the described mirror needing judgement to get is corresponding uniquely can determine the plane that described mirror is corresponding, and then uniquely can determine that at least three feature point group of the plane that described mirror is corresponding synthesize first group of coordinate information.
In one embodiment, the plane that the described mirror determined by least three unique points of plane corresponding to described mirror is corresponding is the plane that there is primary importance relation with described display screen, such as corresponding with a described display plane plane.
In one embodiment, utilize angle point and line detection algorithm, four edges and four summits of mirror plane can be detected, and then obtain the three-dimensional coordinate on four summits corresponding to described mirror, and then plane fitting goes out the position of plane under described first reference frame at described mirror place.
Step 405: obtain at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode;
In one embodiment, utilize feature point detection algorithm, the three-dimensional coordinate of at least three specified points in virtual image corresponding to described pattern can be collected, and then utilize plane fitting algorithm can simulate the position of plane under described first reference frame at virtual image place corresponding to described pattern.
Step 406: at least three unique points in the virtual images of the described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame;
In the present embodiment, at least three unique points in the virtual images of the described described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame, comprising:
Judge whether at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode meet the second preset rules; Described second preset rules uniquely can determine the plane at described virtual image place under described first reference frame by least three unique points in described virtual images for being characterized in;
When the judged result got at least three unique points characterized in the virtual images of the described pattern that described mirror is presented by physics imaging mode meet described second preset rules, at least three unique points in the virtual images of the described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame.
In the present embodiment, determine that the object of described second group of coordinate information is to determine that described pattern presents virtual image place plane by physics imaging mode under described first reference frame, and then under described first reference frame, determine described display screen place plane according to mirror-reflection principle; Therefore, when after at least three unique points that described electronic equipment gets in the virtual images of the described pattern that described mirror is presented by physics imaging mode, need at least three unique points in the virtual images judging to get whether can uniquely determine a plane, and then uniquely can determine that at least three feature point group in the described virtual image of a plane synthesize second group of coordinate information.
Step 407: the relative position relation determining described image collecting device and described display screen according to described first group of coordinate information and described second group of coordinate information;
Step 408: the spatial operation of the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
In the present embodiment, when the relative position relation of described image collecting device and described display screen determined by described electronic equipment, after the Parameter Switch relation of the reference frame that the reference frame that also namely described image collecting device is corresponding is corresponding with the display screen of described electronic equipment, described electronic equipment can according to the Parameter Switch relation of reference system by described image acquisition device to image correspond on the display screen of described electronic equipment, combine with the real world making the virtual world of described display screen and electronic equipment user live, and then lifting Consumer's Experience.
In the present embodiment, because described image collecting device supports 3D rendering collection, therefore, the image that the described mirror got by described image collecting device is corresponding is a 3-D view, is also that each coordinate in described first group of coordinate information is a three-dimensional coordinate; Therefore, after described electronic equipment gets described first group of coordinate information, the plane at the described mirror place under described first reference frame can be determined according to described first group of coordinate information.
In like manner, the described virtual image that the described pattern obtained by described image collecting device is corresponding is also a 3-D view, is also that each coordinate in described second group of coordinate information is also a three-dimensional coordinate; Therefore, after described electronic equipment gets described second group of coordinate information, the described virtual image place plane can determined under described first reference frame according to described second group of coordinate information.
And then, when the plane at the described mirror place under described first reference frame determined by described electronic equipment, and after the plane at virtual image place, the described pattern place plane under described first reference frame can be determined according to mirror-reflection principle, also be the described display screen place plane under described first reference frame, again because described first reference is the reference frame that described image collecting device is corresponding, therefore, the coordinate of described display screen under described first reference frame that described image collecting device is corresponding can be determined by the way, and then determine the relative position relation of described image collecting device and described display screen, the spatial operation of the operating body that described image collecting device can be gathered based on described relative position relation by described electronic equipment corresponds on described display screen and responds, realize real world corresponding to image collecting device to be combined with the virtual world that the display screen of described electronic equipment shows.
Uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation, a pattern can be shown on the display screen of electronic equipment, obtain by image collecting device the collection image that includes the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode; And then the relative position relation of described image collecting device and described display screen is determined according to described collection image, the spatial operation of the operating body gathered with the most described image collecting device corresponds on described display screen and responds, realize real world corresponding to image collecting device to be combined with the virtual world that the display screen of described electronic equipment shows, promote Consumer's Experience.
In addition, uncalibrated image harvester described in the embodiment of the present invention and the method for display screen relative position relation be simple, be convenient to user realizes, therefore, without the need to the image collecting device will be connected with described electronic equipment, or the described image collecting device in described electronic equipment is fixed in described electronic equipment, therefore, compared with the mode of existing fixing described image collecting device, the embodiment of the present invention uses degree of freedom higher, more can meet the different demands of user.
And, due to without the need to described image collecting device is fixed, so user can adjust described image collecting device arbitrarily according to the actual requirements, even can change the higher image collecting device of parameter configuration, therefore, meet user's multiple demands.
Embodiment four
Fig. 5 is the structural representation one of embodiment of the present invention electronic equipment; As shown in Figure 5, described electronic equipment comprises:
Display unit 51, for showing a pattern on the display screen of electronic equipment;
Image acquisition unit 52, gather image for obtaining one by image collecting device, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
Analytic unit 53, for analyzing described collection image, determines the relative position relation of described image collecting device and described display screen;
Response unit 54, the spatial operation for the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
Those skilled in the art are to be understood that, the function of each processing unit in the electronic equipment of the embodiment of the present invention, can refer to the associated description of the method for aforementioned uncalibrated image harvester and display screen relative position relation and understand, each processing unit in the electronic equipment of the embodiment of the present invention, realizing by realizing the mimic channel of the function described in the embodiment of the present invention, also can be realized by the operation of the software of the function of execution described in the embodiment of the present invention on intelligent terminal.
Embodiment five
Fig. 6 is the structural representation two of embodiment of the present invention electronic equipment; As shown in Figure 6, described electronic equipment comprises:
Display unit 51, for showing a pattern on the display screen of electronic equipment;
Image acquisition unit 52, gather image for obtaining one by image collecting device, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
Analytic unit 53, for analyzing described collection image, determines the relative position relation of described image collecting device and described display screen;
Response unit 54, the spatial operation for the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
In such scheme, described analytic unit 53, comprising:
First obtains subelement 531, for obtaining the first group coordinate information of image under the first reference frame that described in described collection image, mirror is corresponding; Described first reference is the reference frame that described image collecting device is corresponding;
Second obtains subelement 532, the second group coordinate information of virtual images under described first reference frame of the described pattern that the described mirror for obtaining in described collection image is presented by physics imaging mode.
In such scheme, described analytic unit, also comprises:
Determine subelement 533, for determining the relative position relation of described image collecting device and described display screen according to described first group of coordinate information and described second group of coordinate information.
Those skilled in the art are to be understood that, the function of each processing unit in the electronic equipment of the embodiment of the present invention, can refer to the associated description of the method for aforementioned uncalibrated image harvester and display screen relative position relation and understand, each processing unit in the electronic equipment of the embodiment of the present invention, realizing by realizing the mimic channel of the function described in the embodiment of the present invention, also can be realized by the operation of the software of the function of execution described in the embodiment of the present invention on intelligent terminal.
Embodiment six
Based on the electronic equipment described in embodiment five, in the present embodiment, described first obtains subelement, also for obtaining at least three unique points in image corresponding to described mirror in described collection image;
Also for determining first group of coordinate information under the first reference frame according at least three unique points in image corresponding to described mirror.
In the present embodiment, described first obtains subelement, also for judging whether at least three unique points in the image that described mirror is corresponding meet the first preset rules; Described first preset rules uniquely can determine mirror place plane described in for being characterized under described first reference frame according at least three unique points in image corresponding to described mirror;
When also meeting described first preset rules at least three unique points characterized when the judged result got in image corresponding to described mirror, determine first group of coordinate information under the first reference frame according at least three unique points in the image that described mirror is corresponding.
In the present embodiment, described second obtains subelement, also for obtaining at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode;
Second group of coordinate information under described first reference frame is also determined at least three unique points in the virtual images of described pattern that presented by physics imaging mode according to described mirror.
In the present embodiment, described second obtains subelement, also for judging whether at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode meet the second preset rules; Described second preset rules uniquely can determine the plane at described virtual image place under described first reference frame by least three unique points in described virtual images for being characterized in;
When also meeting described second preset rules at least three unique points characterized when the judged result got in the virtual images of the described pattern that described mirror is presented by physics imaging mode, at least three unique points in the virtual images of the described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame.
Those skilled in the art are to be understood that, the function of each processing unit in the electronic equipment of the embodiment of the present invention, can refer to the associated description of the method for aforementioned uncalibrated image harvester and display screen relative position relation and understand, each processing unit in the electronic equipment of the embodiment of the present invention, realizing by realizing the mimic channel of the function described in the embodiment of the present invention, also can be realized by the operation of the software of the function of execution described in the embodiment of the present invention on intelligent terminal.
In several embodiments that the application provides, should be understood that disclosed equipment and method can realize by another way.Apparatus embodiments described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, and as: multiple unit or assembly can be in conjunction with, maybe can be integrated into another system, or some features can be ignored, or do not perform.In addition, the coupling each other of shown or discussed each ingredient or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of equipment or unit or communication connection can be electrical, machinery or other form.
The above-mentioned unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, also can be distributed in multiple network element; Part or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in various embodiments of the present invention can all be integrated in a processing unit, also can be each unit individually as a unit, also can two or more unit in a unit integrated; Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form that hardware also can be adopted to add SFU software functional unit realizes.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that programmed instruction is relevant, aforesaid program can be stored in a computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: movable storage device, ROM (read-only memory) (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.
Or, if the above-mentioned integrated unit of the present invention using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the embodiment of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium, comprises some instructions and performs all or part of of method described in each embodiment of the present invention in order to make a computer equipment (can be personal computer, server or the network equipment etc.).And aforesaid storage medium comprises: movable storage device, ROM (read-only memory) (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.
Claims (14)
1. a method for uncalibrated image harvester and display screen relative position relation, described method comprises:
The display screen of electronic equipment shows a pattern;
Obtain one by image collecting device and gather image, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
Analyze described collection image, determine the relative position relation of described image collecting device and described display screen;
The spatial operation of the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
2. method according to claim 1, is characterized in that, the described collection image of described analysis, comprising:
Obtain the first group coordinate information of image under the first reference frame that described in described collection image, mirror is corresponding; Described first reference is the reference frame that described image collecting device is corresponding;
Obtain the second group coordinate information of virtual images under described first reference frame of the described pattern that the described mirror in described collection image is presented by physics imaging mode.
3. method according to claim 2, is characterized in that, the first group coordinate information breath of the image that described in described acquisition described collection image, mirror is corresponding under the first reference frame, comprising:
Obtain at least three unique points in image corresponding to described mirror in described collection image;
First group of coordinate information under the first reference frame is determined according at least three unique points in the image that described mirror is corresponding.
4. method according to claim 3, is characterized in that, at least three unique points in the described image corresponding according to described mirror determine first group of coordinate information under the first reference frame, comprising:
Judge whether at least three unique points in the image that described mirror is corresponding meet the first preset rules; Described first preset rules uniquely can determine mirror place plane described in for being characterized under described first reference frame according at least three unique points in image corresponding to described mirror;
When the judged result got at least three unique points characterized in image corresponding to described mirror meet described first preset rules, determine first group of coordinate information under the first reference frame according at least three unique points in the image that described mirror is corresponding.
5. method according to claim 2, is characterized in that, the second group coordinate information of virtual images under described first reference frame of the described pattern that the described mirror in described acquisition described collection image is presented by physics imaging mode, comprising:
Obtain at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode;
At least three unique points in the virtual images of the described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame.
6. method according to claim 5, is characterized in that, at least three unique points in the virtual images of the described described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame, comprising:
Judge whether at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode meet the second preset rules; Described second preset rules uniquely can determine the plane at described virtual image place under described first reference frame by least three unique points in described virtual images for being characterized in;
When the judged result got at least three unique points characterized in the virtual images of the described pattern that described mirror is presented by physics imaging mode meet described second preset rules, at least three unique points in the virtual images of the described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame.
7. method according to claim 2, is characterized in that, the described relative position relation determining described image collecting device and described display screen, comprising:
The relative position relation of described image collecting device and described display screen is determined according to described first group of coordinate information and described second group of coordinate information.
8. an electronic equipment, comprising:
Display unit, for showing a pattern on the display screen of electronic equipment;
Image acquisition unit, gather image for obtaining one by image collecting device, wherein, described collection image comprises the virtual images of the described pattern that image corresponding to mirror and described mirror are presented by physics imaging mode;
Analytic unit, for analyzing described collection image, determines the relative position relation of described image collecting device and described display screen;
Response unit, the spatial operation for the operating body gathered by described image collecting device based on described relative position relation corresponds on described display screen and responds.
9. electronic equipment according to claim 8, is characterized in that, described analytic unit, comprising:
First obtains subelement, for obtaining the first group coordinate information of image under the first reference frame that described in described collection image, mirror is corresponding; Described first reference is the reference frame that described image collecting device is corresponding;
Second obtains subelement, the second group coordinate information of virtual images under described first reference frame of the described pattern that the described mirror for obtaining in described collection image is presented by physics imaging mode.
10. electronic equipment according to claim 9, is characterized in that, described first obtains subelement, also for obtaining at least three unique points in image corresponding to described mirror in described collection image;
Also for determining first group of coordinate information under the first reference frame according at least three unique points in image corresponding to described mirror.
11. electronic equipments according to claim 10, is characterized in that, described first obtains subelement, also for judging whether at least three unique points in the image that described mirror is corresponding meet the first preset rules; Described first preset rules uniquely can determine mirror place plane described in for being characterized under described first reference frame according at least three unique points in image corresponding to described mirror;
When also meeting described first preset rules at least three unique points characterized when the judged result got in image corresponding to described mirror, determine first group of coordinate information under the first reference frame according at least three unique points in the image that described mirror is corresponding.
12. electronic equipments according to claim 9, is characterized in that, described second obtains subelement, also for obtaining at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode;
Second group of coordinate information under described first reference frame is also determined at least three unique points in the virtual images of described pattern that presented by physics imaging mode according to described mirror.
13. electronic equipments according to claim 12, it is characterized in that, described second obtains subelement, also for judging whether at least three unique points in the virtual images of the described pattern that described mirror is presented by physics imaging mode meet the second preset rules; Described second preset rules uniquely can determine the plane at described virtual image place under described first reference frame by least three unique points in described virtual images for being characterized in;
When also meeting described second preset rules at least three unique points characterized when the judged result got in the virtual images of the described pattern that described mirror is presented by physics imaging mode, at least three unique points in the virtual images of the described pattern presented by physics imaging mode according to described mirror determine second group of coordinate information under described first reference frame.
14. electronic equipments according to claim 9, is characterized in that, described analytic unit, also comprises:
Determine subelement, for determining the relative position relation of described image collecting device and described display screen according to described first group of coordinate information and described second group of coordinate information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510145995.5A CN104766315B (en) | 2015-03-30 | 2015-03-30 | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510145995.5A CN104766315B (en) | 2015-03-30 | 2015-03-30 | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104766315A true CN104766315A (en) | 2015-07-08 |
| CN104766315B CN104766315B (en) | 2019-03-29 |
Family
ID=53648124
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510145995.5A Active CN104766315B (en) | 2015-03-30 | 2015-03-30 | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104766315B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10089510B2 (en) | 2015-06-30 | 2018-10-02 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Display control methods and apparatuses |
| US10140730B2 (en) | 2015-06-30 | 2018-11-27 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Display control methods and apparatuses |
| CN110506252A (en) * | 2017-11-27 | 2019-11-26 | 华为技术有限公司 | Based on the transformational relation positioning terminal screen for indicating graphical dots coordinate in pattern |
| CN113656132A (en) * | 2021-08-17 | 2021-11-16 | 维沃移动通信（杭州）有限公司 | Display method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020036617A1 (en) * | 1998-08-21 | 2002-03-28 | Timothy R. Pryor | Novel man machine interfaces and applications |
| CN101072366A (en) * | 2007-05-24 | 2007-11-14 | 上海大学 | Free stereo display system and method based on light field and binocular vision technology |
| CN102298467A (en) * | 2010-06-24 | 2011-12-28 | 北京威亚视讯科技有限公司 | Automatic calibration method and system for display screen |
| CN104111036A (en) * | 2013-04-18 | 2014-10-22 | 中国科学院沈阳自动化研究所 | Mirror object measuring device and method based on binocular vision |
-
2015
- 2015-03-30 CN CN201510145995.5A patent/CN104766315B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020036617A1 (en) * | 1998-08-21 | 2002-03-28 | Timothy R. Pryor | Novel man machine interfaces and applications |
| CN101072366A (en) * | 2007-05-24 | 2007-11-14 | 上海大学 | Free stereo display system and method based on light field and binocular vision technology |
| CN102298467A (en) * | 2010-06-24 | 2011-12-28 | 北京威亚视讯科技有限公司 | Automatic calibration method and system for display screen |
| CN104111036A (en) * | 2013-04-18 | 2014-10-22 | 中国科学院沈阳自动化研究所 | Mirror object measuring device and method based on binocular vision |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10089510B2 (en) | 2015-06-30 | 2018-10-02 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Display control methods and apparatuses |
| US10140730B2 (en) | 2015-06-30 | 2018-11-27 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Display control methods and apparatuses |
| CN110506252A (en) * | 2017-11-27 | 2019-11-26 | 华为技术有限公司 | Based on the transformational relation positioning terminal screen for indicating graphical dots coordinate in pattern |
| CN113656132A (en) * | 2021-08-17 | 2021-11-16 | 维沃移动通信（杭州）有限公司 | Display method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104766315B (en) | 2019-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104766315A (en) | Method for calibrating relative position relation between image collection device and display screen and equipment | |
| AU2014203449B2 (en) | Information processing apparatus, and displaying method | |
| CN109525192B (en) | Method for monitoring photovoltaic power station by three-dimensional modeling | |
| EP3197147A1 (en) | Event signal processing method and apparatus | |
| WO2017127143A1 (en) | Augmented reality tools for pv solar and/or storage system site survey, installation, commissioning, and operation and maintenance | |
| EP3330928A1 (en) | Image generation device, image generation system, and image generation method | |
| CN111027407B (en) | Color image hand posture estimation method for shielding situation | |
| EP3576350A1 (en) | System and method for utilizing machine-readable codes for testing a communication network | |
| KR101473956B1 (en) | Modeling method of 3D spatial information using 2D floor plan and video surveillance system using 3D spatial model | |
| KR20190048506A (en) | Method and apparatus for providing virtual room | |
| CN113601510B (en) | Robot movement control method, device, system and equipment based on binocular vision | |
| CN111045770A (en) | Method, first terminal, device and readable storage medium for remote exhibition | |
| CN104965586A (en) | Plant growth display system and method | |
| CN112925416A (en) | User sight tracking method, device and system | |
| CN104571796A (en) | Information processing method and electronic equipment | |
| CN110631586A (en) | Map construction method based on visual SLAM, navigation system and device | |
| CN114205526B (en) | Network camera algorithm access method, system, medium and electronic terminal | |
| CN113568735B (en) | Data processing method and system | |
| CN112634439B (en) | 3D information display method and device | |
| KR20120126615A (en) | System for 3D stereo control system and providing method thereof | |
| CN110163950B (en) | Method, equipment and system for generating shadow in object | |
| CN111028611A (en) | Data processing system and method for aircraft driving parameter simulation playback | |
| Degen et al. | Stereoscopic camera-sensor model for the development of highly automated driving functions within a virtual test environment | |
| CN111445574A (en) | Video monitoring equipment deployment and control method, device and system | |
| CN111413889A (en) | Motion simulation control method and device of four-bar linkage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |