CN103700128A - Mobile equipment and enhanced display method thereof - Google Patents
Mobile equipment and enhanced display method thereof Download PDFInfo
- Publication number
- CN103700128A CN103700128A CN201310745407.2A CN201310745407A CN103700128A CN 103700128 A CN103700128 A CN 103700128A CN 201310745407 A CN201310745407 A CN 201310745407A CN 103700128 A CN103700128 A CN 103700128A
- Authority
- CN
- China
- Prior art keywords
- target identification
- collection module
- image collection
- processor
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to mobile equipment and an enhanced display method thereof. The mobile equipment comprises a display screen, a processor, an image acquisition module and an attitude sensor, wherein the image acquisition module is used for capturing a target identifier; the processor is used for superposing a display image corresponding to the target identifier on the target identifier captured by the image acquisition module, and displaying the target identifier captured by the image acquisition module and the display image corresponding to the target identifier on the display screen; the attitude sensor is used for acquiring the space attitude of the image acquisition module when the image acquisition module fails to capture the target identifier; the processor is also used for computing the position of the target identifier according to the space attitude of the image acquisition module, superposing the display image corresponding to the target identifier on the target identifier, and displaying the target identifier and the display image on the display screen. By using the mobile equipment and the enhanced display method provided by the invention, the calculated superposing position of a 3D (3-Dimensional) virtual object can be enabled to be more accurate and the 3D display effect becomes more vivid.
Description
Technical field
The present invention relates to a kind of enhancing display technique, particularly a kind of mobile device and strengthen display packing.
Background technology
Strengthen display technique, a kind of Computer Subjects such as computer vision, motion-captured, virtual reality that combine, virtual three-dimensional model animation, video, word, the real-time Overlapping display of picture digital information, in real scene, and are realized to the human-computer interaction technology of the innovation of nature interaction with real object or user.Strengthen display technique in order to realize virtual and seamless fusion reality scene, the technical matters of core is the problem that solves three dimensions registration, calculate the corresponding relation of virtual world and real-world coordinates system, realize dummy object is added to reality scene really on allocation according to correct aerial prospective relation.The wherein identification of the identification image based on computer vision, and the object of which movement tracking of use sensor is the core technology that solves three-dimensional registration problem.
At mobile platform, on smart mobile phone or panel computer, can to the realtime graphic identification of identification marking in reality scene, follow the trail of by built-in camera, and the 3D dummy object that superposes on identification marking is realized enhancing demonstration bandwagon effect; When camera cannot capture the identification marking in outdoor scene, can pass through the built-in attitude sensor of mobile platform, as gyroscope or gravity accelerometer, follow the tracks of the relative variation of camera attitude, and inverse goes out the superposed positions of 3D dummy object, the enhancing demonstration bandwagon effect combining to realize image recognition and attitude sensor.
The existing enhancing Display Realization mode based on image recognition and attitude sensor combination on mobile platform, based on a hypothesis, the coordinate system center of the camera on mobile device and built-in attitude sensor spatially overlaps, otherwise when being switched to mode sensor from camera image recognition mode, dummy object has the error of calculation in the superposed positions of realistic space.But all mobile devices substantially, due to appearance design requirement, camera and built-in attitude sensor coordinate system center do not overlap, and the relative position on distinct device is also all different.
Summary of the invention
Provide hereinafter about brief overview of the present invention, to the basic comprehension about some aspect of the present invention is provided.Should be appreciated that this general introduction is not about exhaustive general introduction of the present invention.It is not that intention is determined key of the present invention or pith, and nor is it intended to limit the scope of the present invention.Its object is only that the form of simplifying provides some concept, usings this as the preorder in greater detail of discussing after a while.
A fundamental purpose of the present invention is to provide a kind of mobile device and strengthens display packing, and the superposed positions of the 3D dummy object that it calculates is more accurate, and then 3D display effect is more true to nature.
According to an aspect of the present invention, a kind of mobile device, comprises display screen, also comprises processor, image collection module and attitude sensor;
Wherein:
Described image collection module is for captured target sign;
Described processor is for the demonstration image that on the target identification catching in described image collection module, stack is answered in contrast, and the target identification that described image collection module is caught is shown on described display screen with the demonstration image corresponding with this target identification;
Described attitude sensor is used for, when described image collection module catches described target identification failure, obtaining the spatial attitude of described image collection module;
Described processor is also used the position of calculating described target identification according to the spatial attitude of described image collection module, the demonstration image that stack is answered in contrast on described target identification, and described target identification is shown on described display screen with the demonstration image corresponding with this target identification.
According to a second aspect of the invention, a kind of enhancing display packing of mobile device, comprising:
Image collection module captured target sign;
The demonstration image that on the target identification that processor catches in image collection module, stack is answered in contrast, and described target identification is shown on display screen with the demonstration image corresponding with this target identification;
When image collection module catches described target identification failure, attitude sensor obtains the spatial attitude of image collection module;
Processor calculates the position of described target identification according to the spatial attitude of image collection module, the demonstration image that stack is answered in contrast on described target identification, and described target identification is shown on display screen with the demonstration image corresponding with this target identification.
Adopt mobile device of the present invention and strengthen display packing, can be so that the superposed positions of the 3D dummy object calculating be more accurate, and then 3D display effect is more true to nature.
Accompanying drawing explanation
Below with reference to the accompanying drawings illustrate embodiments of the invention, can understand more easily above and other objects, features and advantages of the present invention.Parts in accompanying drawing are just in order to illustrate principle of the present invention.In the accompanying drawings, same or similar technical characterictic or parts will adopt same or similar Reference numeral to represent.
Fig. 1 is the structural drawing of a kind of embodiment of mobile device of the present invention;
Fig. 2 is a kind of process flow diagram of embodiment of the enhancing display packing of mobile device of the present invention.
Embodiment
Embodiments of the invention are described with reference to the accompanying drawings.The element of describing in an accompanying drawing of the present invention or a kind of embodiment and feature can combine with element and feature shown in one or more other accompanying drawing or embodiment.It should be noted that for purposes of clarity, in accompanying drawing and explanation, omitted expression and the description of unrelated to the invention, parts known to persons of ordinary skill in the art and processing.
Shown in Figure 1, be the structural drawing of a kind of embodiment of mobile device of the present invention.
In the present embodiment, mobile device 1 comprises display screen (not shown), processor (not shown), image collection module 10 and attitude sensor 20.
Wherein, image collection module 10 identifies for captured target; The demonstration image that processor is answered in contrast for superposeing on the target identification catching in image collection module 10 (for example, show that image can be the image with 3D effect), and the target identification that image collection module is caught is shown on display screen with the demonstration image corresponding with this target identification.
For example, target identification is a flat board, and corresponding demonstration image is one to have the dinosaur of 3D effect, be shown on display screen be dull and stereotyped and this has the dinosaur of 3D effect.When treadmill exercise, this dinosaur with 3D effect is followed this treadmill exercise, and keeps the two relative tertiary location constant.
Now, mobile device 1(for example, mobile phone, panel computer etc.) image collection module 10(camera for example) catch this flat board.If acquisition success, the dinosaur with 3D effect that processor superposes and answers in contrast on this flat board, and be shown on display screen with the dinosaur with 3D effect dull and stereotyped.
Yet, because mobile device 1 not only can move, can also rotate, and image collection module 10 can not be carried out, 360 degree are omnibearing catches.Thereby image collection module 10 can not directly successfully catch target identification sometimes.Now, need to be by attitude sensor 20(for example acceleration of gravity meter and/or gyroscope) obtain the spatial attitude of image collection module 10.Then, processor calculates the position of target identification according to the spatial attitude of image collection module 10, the demonstration image that stack is answered in contrast on target identification, and target identification is shown on display screen with the demonstration image corresponding with this target identification.
In one embodiment, processor can carry out with the locus transformation matrix between image collection module 10 the demonstration image corresponding with target identification that superpose on target identification according to target identification.Locus transformation matrix that is to say take image collection module 10 as initial point, and under preset coordinates system, target identification is in the volume coordinate of this coordinate system.
Yet due in mobile device 1, often image collection module 10 is arranged on different positions from attitude sensor 20.If only mobile device 1 is considered to a particle, and calculate the spatial alternation matrix between this particle and target identification, the demonstration image with 3D effect being so finally incident upon on this target identification can not mate completely with this target identification, so, can reduce and strengthen the effect showing.
Thereby preferably, processor can be superimposed to image collection module 10 and the locus deviation of attitude sensor 20 in the transformation matrix of locus, calculates the position of target identification.
So, owing to having considered the difference of image collection module 10 with attitude sensor 20 installation sites, can be so that the position of the target identification calculating and target identification actual position be more approaching, thus can make the demonstration image with 3D effect be added to more accurately on this target identification.
Shown in Figure 2, be the process flow diagram of a kind of embodiment of the enhancing display packing of mobile device of the present invention.
In the present embodiment, the enhancing display packing of mobile device comprises:
S10: image collection module 10 captured target signs;
S20: the demonstration image that on the target identification that processor catches in image collection module 10, stack is answered in contrast, and target identification is shown on display screen with the demonstration image corresponding with this target identification;
S30: when image collection module 10 captured targets identify unsuccessfully, attitude sensor 20 obtains the spatial attitude of image collection module 10;
S40: processor calculates the position of target identification according to the spatial attitude of image collection module 10, the demonstration image that stack is answered in contrast on target identification, and target identification is shown on display screen with the demonstration image corresponding with this target identification.
As a kind of embodiment, in step S40, " processor calculates the position of described target identification according to the spatial attitude of image collection module, the demonstration image that stack is answered in contrast on target identification " can specifically comprise:
Processor carrys out with the locus transformation matrix between image collection module 10 the demonstration image corresponding with target identification that superpose on target identification according to target identification.
As a kind of embodiment, in step S40, " processor calculates the position of described target identification according to the spatial attitude of image collection module, the demonstration image that stack is answered in contrast on target identification " can also specifically comprise:
Processor is superimposed to the locus deviation of image collection module and attitude sensor in the transformation matrix of locus, calculates the position of described target identification.
Adopt mobile device of the present invention and strengthen display packing, can be so that the superposed positions of the 3D dummy object calculating be more accurate, and then 3D display effect is more true to nature.
Above some embodiments of the present invention are described in detail.As one of ordinary skill in the art can be understood, whole or any steps or the parts of method and apparatus of the present invention, can be in the network of any computing equipment (comprising processor, storage medium etc.) or computing equipment, with hardware, firmware, software or their combination, realized, this is that those of ordinary skills use their basic programming skill just can realize in the situation that understanding content of the present invention, therefore need not illustrate at this.
In addition, it is evident that, when relating to possible peripheral operation in superincumbent explanation, will use undoubtedly any display device and any input equipment, corresponding interface and the control program that are connected with any computing equipment.Generally speaking, related hardware in computing machine, computer system or computer network, software and realize hardware, firmware, software or their combination of the various operations in preceding method of the present invention, form equipment of the present invention and each building block thereof.
Therefore,, based on above-mentioned understanding, object of the present invention can also realize by move a program or batch processing on any messaging device.Described messaging device can be known common apparatus.Therefore, object of the present invention also can be only by providing the program product that comprises the program code of realizing described method or equipment to realize.That is to say, such program product also forms the present invention, and storage or the medium that transmits such program product also form the present invention.Obviously, described storage or transmission medium can be well known by persons skilled in the art, or storage or the transmission medium of any type developing in the future, therefore also there is no need at this, various storages or transmission medium to be enumerated.
In equipment of the present invention and method, obviously, each parts or each step reconfigure after can decomposing, combine and/or decomposing.These decomposition and/or reconfigure and should be considered as equivalents of the present invention.The step that also it is pointed out that the above-mentioned series of processes of execution can order naturally following the instructions be carried out in chronological order, but does not need necessarily according to time sequencing, to carry out.Some step can walk abreast or carry out independently of one another.Simultaneously, in the above in the description of the specific embodiment of the invention, the feature of describing and/or illustrating for a kind of embodiment can be used in same or similar mode in one or more other embodiment, combined with the feature in other embodiment, or substitute the feature in other embodiment.
Should emphasize, term " comprises/comprises " existence that refers to feature, key element, step or assembly while using herein, but does not get rid of the existence of one or more further feature, key element, step or assembly or add.
Although described the present invention and advantage thereof in detail, be to be understood that in the situation that do not exceed the spirit and scope of the present invention that limited by appended claim and can carry out various changes, alternative and conversion.And scope of the present invention is not limited only to the specific embodiment of the described process of instructions, equipment, means, method and step.One of ordinary skilled in the art will readily appreciate that from disclosure of the present invention, can use carry out with the essentially identical function of corresponding embodiment described herein or obtain process, equipment, means, method or step result essentially identical with it, that existing and will be developed future according to the present invention.Therefore, appended claim is intended to comprise such process, equipment, means, method or step in their scope.
Claims (8)
1. a mobile device, comprises display screen, it is characterized in that, also comprises processor, image collection module and attitude sensor;
Wherein:
Described image collection module is for captured target sign;
Described processor is for the demonstration image that on the target identification catching in described image collection module, stack is answered in contrast, and the target identification that described image collection module is caught is shown on described display screen with the demonstration image corresponding with this target identification;
Described attitude sensor is used for, when described image collection module catches described target identification failure, obtaining the spatial attitude of described image collection module;
Described processor is also for calculating the position of described target identification according to the spatial attitude of described image collection module, the demonstration image that stack is answered in contrast on described target identification, and described target identification is shown on described display screen with the demonstration image corresponding with this target identification.
2. mobile device according to claim 1, is characterized in that:
Described processor is for carrying out with the locus transformation matrix between described image collection module the demonstration image corresponding with described target identification that superpose on described target identification according to described target identification.
3. mobile device according to claim 2, is characterized in that:
Described processor is for being superimposed to described locus transformation matrix, the position of calculating described target identification by the locus deviation of described image collection module and described attitude sensor.
4. mobile device according to claim 1, is characterized in that:
Described image collection module comprises camera.
5. mobile device according to claim 1, is characterized in that:
Described attitude sensor comprises gyroscope and/or acceleration of gravity meter.
6. an enhancing display packing for mobile device, is characterized in that, comprising:
Image collection module captured target sign;
The demonstration image that on the target identification that processor catches in image collection module, stack is answered in contrast, and described target identification is shown on display screen with the demonstration image corresponding with this target identification;
When image collection module catches described target identification failure, attitude sensor obtains the spatial attitude of image collection module;
Processor calculates the position of described target identification according to the spatial attitude of image collection module, the demonstration image that stack is answered in contrast on described target identification, and described target identification is shown on display screen with the demonstration image corresponding with this target identification.
7. the enhancing display packing of mobile device according to claim 6, it is characterized in that, described " processor calculates the position of described target identification according to the spatial attitude of image collection module, the demonstration image that stack is answered in contrast on described target identification " specifically comprises:
Processor carrys out with the locus transformation matrix between image collection module the demonstration image corresponding with described target identification that superpose on described target identification according to described target identification.
8. the enhancing display packing of mobile device according to claim 7, it is characterized in that, described " processor calculates the position of described target identification according to the spatial attitude of image collection module, the demonstration image that stack is answered in contrast on described target identification " also specifically comprises:
Processor is superimposed to the locus deviation of image collection module and attitude sensor in the transformation matrix of locus, calculates the position of described target identification.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310745407.2A CN103700128B (en) | 2013-12-30 | 2013-12-30 | Mobile equipment and enhanced display method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310745407.2A CN103700128B (en) | 2013-12-30 | 2013-12-30 | Mobile equipment and enhanced display method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103700128A true CN103700128A (en) | 2014-04-02 |
| CN103700128B CN103700128B (en) | 2017-02-15 |
Family
ID=50361645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310745407.2A Active CN103700128B (en) | 2013-12-30 | 2013-12-30 | Mobile equipment and enhanced display method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103700128B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106843790A (en) * | 2017-01-25 | 2017-06-13 | 触景无限科技（北京）有限公司 | A kind of information display system and method |
| CN107992188A (en) * | 2016-10-26 | 2018-05-04 | 宏达国际电子股份有限公司 | Virtual reality exchange method, device and system |
| CN108242082A (en) * | 2016-12-26 | 2018-07-03 | 粉迷科技股份有限公司 | The scene edit methods and system of solid space |
| WO2020244576A1 (en) * | 2019-06-05 | 2020-12-10 | 北京外号信息技术有限公司 | Method for superimposing virtual object on the basis of optical communication apparatus, and corresponding electronic device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090167919A1 (en) * | 2008-01-02 | 2009-07-02 | Nokia Corporation | Method, Apparatus and Computer Program Product for Displaying an Indication of an Object Within a Current Field of View |
| CN102339579A (en) * | 2011-10-13 | 2012-02-01 | 上海旅游网旅行服务有限公司 | Guide system |
| CN102800065A (en) * | 2012-07-13 | 2012-11-28 | 苏州梦想人软件科技有限公司 | Augmented reality equipment and method based on two-dimensional code identification and tracking |
| CN102980570A (en) * | 2011-09-06 | 2013-03-20 | 上海博路信息技术有限公司 | Live-scene augmented reality navigation system |
| CN103164518A (en) * | 2013-03-06 | 2013-06-19 | 杭州九树网络科技有限公司 | Mobile terminal (MT) augmented reality application system and method |
-
2013
- 2013-12-30 CN CN201310745407.2A patent/CN103700128B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090167919A1 (en) * | 2008-01-02 | 2009-07-02 | Nokia Corporation | Method, Apparatus and Computer Program Product for Displaying an Indication of an Object Within a Current Field of View |
| CN102980570A (en) * | 2011-09-06 | 2013-03-20 | 上海博路信息技术有限公司 | Live-scene augmented reality navigation system |
| CN102339579A (en) * | 2011-10-13 | 2012-02-01 | 上海旅游网旅行服务有限公司 | Guide system |
| CN102800065A (en) * | 2012-07-13 | 2012-11-28 | 苏州梦想人软件科技有限公司 | Augmented reality equipment and method based on two-dimensional code identification and tracking |
| CN103164518A (en) * | 2013-03-06 | 2013-06-19 | 杭州九树网络科技有限公司 | Mobile terminal (MT) augmented reality application system and method |
Non-Patent Citations (2)
| Title |
|---|
| 史晓琳: "手机增强现实室内向导的研究与实现", 《计算机应用与软件》, vol. 30, no. 2, 28 February 2013 (2013-02-28), pages 320 - 323 * |
| 张静: "基于iPhone的增强现实技术的研究与应用", 《中国优秀硕士学位论文全文数据库（电子期刊）》, 15 April 2011 (2011-04-15) * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107992188A (en) * | 2016-10-26 | 2018-05-04 | 宏达国际电子股份有限公司 | Virtual reality exchange method, device and system |
| CN108242082A (en) * | 2016-12-26 | 2018-07-03 | 粉迷科技股份有限公司 | The scene edit methods and system of solid space |
| CN106843790A (en) * | 2017-01-25 | 2017-06-13 | 触景无限科技（北京）有限公司 | A kind of information display system and method |
| CN106843790B (en) * | 2017-01-25 | 2020-08-04 | 触景无限科技（北京）有限公司 | Information display system and method |
| WO2020244576A1 (en) * | 2019-06-05 | 2020-12-10 | 北京外号信息技术有限公司 | Method for superimposing virtual object on the basis of optical communication apparatus, and corresponding electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103700128B (en) | 2017-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11762475B2 (en) | AR scenario-based gesture interaction method, storage medium, and communication terminal | |
| US11887312B2 (en) | Fiducial marker patterns, their automatic detection in images, and applications thereof | |
| Devagiri et al. | Augmented Reality and Artificial Intelligence in industry: Trends, tools, and future challenges | |
| CN107820593B (en) | Virtual reality interaction method, device and system | |
| CN108028871A (en) | The more object augmented realities of unmarked multi-user in mobile equipment | |
| CN110073313A (en) | Using female equipment and at least one with equipment and environmental interaction | |
| Huang et al. | CloudRidAR: A cloud-based architecture for mobile augmented reality | |
| EP4006847A1 (en) | Virtual object processing method and apparatus, and storage medium and electronic device | |
| CN107885871A (en) | Synchronous superposition method, system, interactive system based on cloud computing | |
| CN110969687B (en) | Collision detection method, device, equipment and medium | |
| CN112346572A (en) | Method, system and electronic device for realizing virtual-real fusion | |
| Yan | Augmented reality instructions for construction toys enabled by accurate model registration and realistic object/hand occlusions | |
| CN107256082B (en) | Throwing object trajectory measuring and calculating system based on network integration and binocular vision technology | |
| CN103700128A (en) | Mobile equipment and enhanced display method thereof | |
| Kumar et al. | An improved tracking using IMU and vision fusion for mobile augmented reality applications | |
| CN110968194A (en) | Interactive object driving method, device, equipment and storage medium | |
| CN106536004A (en) | An augmented gaming platform | |
| US11595568B2 (en) | System for generating a three-dimensional scene of a physical environment | |
| Saini | Manoeuvring drone (Tello ans Tello EDU) using body poses or gestures | |
| RE | Low cost augmented reality for industrial problems | |
| AU2020404293B2 (en) | Image processing method and apparatus, electronic device and computer-readable storage medium | |
| US20230177759A1 (en) | Systems and methods for facilitating scalable shared rendering | |
| Wenkai | Integration of Finite Element Analysis with Mobile Augmented Reality | |
| Rashmi et al. | Developing Augmented Reality Application for All-in-one Interface Card | |
| CN115424714A (en) | Robot interaction method, device, equipment and storage medium based on virtual reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170413 Address after: 100000 Beijing Garden Road, No. 7202 garden hotel room, room 30, No. Patentee after: Beijing Chujiao Technology Co.,Ltd. Address before: Block A406 No. 18 national software park Wuxi District Road 214000 Jiangsu Zhenze cancer in Wuxi Province Patentee before: Wuxi Chujiao Science & Technology Co., Ltd. |