CN103164518A - Mobile terminal (MT) augmented reality application system and method - Google Patents

Mobile terminal (MT) augmented reality application system and method Download PDF

Info

Publication number
CN103164518A
CN103164518A CN2013100709333A CN201310070933A CN103164518A CN 103164518 A CN103164518 A CN 103164518A CN 2013100709333 A CN2013100709333 A CN 2013100709333A CN 201310070933 A CN201310070933 A CN 201310070933A CN 103164518 A CN103164518 A CN 103164518A
Authority
CN
China
Prior art keywords
mobile terminal
augmented reality
content
layer
data center
Prior art date
Application number
CN2013100709333A
Other languages
Chinese (zh)
Inventor
陈晓波
Original Assignee
杭州九树网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州九树网络科技有限公司 filed Critical 杭州九树网络科技有限公司
Priority to CN2013100709333A priority Critical patent/CN103164518A/en
Publication of CN103164518A publication Critical patent/CN103164518A/en

Links

Abstract

The invention relates to a mobile terminal (MT) augmented reality application system and a method. Combination of real scenes and virtual contents can be achieved through an MT, and more interaction operation methods are provided. The MT augmented reality application system is at least composed of the MT, a wireless communication network and a background data center. An MT device acquires outside data information which is transmitted to the background data center through the wireless communication network, after the data center processes received information, the received information is fed back to the MT device through the wireless communication network, and therefore augmented reality application is achieved. The MT augmented reality application system particularly provides the novel method for information display under an augmented reality mode, and the method includes real-time pushing, multi-layer augmented reality content display, and the like.

Description

Mobile terminal augmented reality application system and method

Technical field

The present invention relates to a kind of mobile terminal augmented reality application system and method, can realize real scene and virtual content combination by mobile terminal, and more interactive operation methods are provided, belong to the augmented reality field.

Background technology

Augmented reality (Augmented Reality is called for short AR) is a kind of technology of calculating in real time position and the angle of camera image and adding respective image, and the target of this technology is on screen, virtual world to be enclosed within real world and to carry out interaction.Present augmented reality is more and more in the application of mobile terminal, and the camera of user by equipment such as smart mobile phone, the flat boards thing that aims at the mark just can be seen the information such as the related text that is superimposed upon on live-action image or virtual image on screen.But there is some problems in the operation of augmented reality application at present, such as the user in the process of dollying head, virtual content a plurality of virtual contents may occur again simultaneously and superpose mutually also in continuous conversion, sometimes is difficult to find target when the user wants to check some content.

Summary of the invention

Purpose of design: avoid the weak point in background technology, design a kind of mobile terminal augmented reality application system and method that abundanter, more humane interactive operation can be arranged.

Design proposal: in order to realize above-mentioned purpose of design.The mobile terminal augmented reality application system of the present invention's design is made of mobile terminal, wireless communication networks, background data center at least; Mobile terminal is by wireless communication networks and background data center bidirectional data exchange, and background data center feeds back to mobile terminal by wireless communication networks.The purpose of doing like this is:

1, after mobile terminal enters the augmented reality pattern, the reality scene image is opened and received to the camera of mobile terminal, and as the first figure layer, processor carries out signature analysis to the first figure layer, extracts characteristics of image; Satellite positioning module is obtained the positional information of mobile terminal, the camera that gyro sensor obtains mobile terminal towards and angle information, communication module is sent to background data center simultaneously with the characteristics of image of these information and the first figure layer; Background data center is through computational analysis, according to the position of the characteristics of image of the first figure layer and mobile terminal with towards, angle information, the virtual content corresponding with the first figure layer in the database at search data center comprises the various media contents such as word, picture, voice, video, network linking address; The virtual content of storing in described background data center, each content all is accompanied with electronic mark, and this electronic mark the is clear and definite attribute of virtual content makes system to screen virtual content according to different attribute;

The virtual content that background data center searches more than inciting somebody to action, be sent to mobile terminal, mobile terminal receives this virtual content again, by the calculating of processor, this virtual content and the first figure layer is made up, formation contains the second figure layer of augmented reality content, and shows the user by display module.

2, be to check the augmented reality content according to the mobile terminal current location as reference point at above-mentioned the 1st, in fact, the user can a self-defined locality, and the augmented reality content of checking this locality; Concrete grammar is as follows: the user is by the mode of input, selection or search, determine the three unities information and be uploaded to background data center, after background data center receives this location information, this place is resolved, and the location information related with the virtual content stored in background data center compare, and searches for the virtual content corresponding with this place, and feed back to mobile terminal, form the figure layer content of augmented reality, show the user to check.

3, be the augmented reality content of checking current time at above-mentioned the 1st; In fact, the user can check the augmented reality content in the Self defined time section, concrete grammar is as follows: the user is by the mode of input, selection or search, determine the start and end time of a time period, and be uploaded to background data center, background data center receives this time period information, compare with the temporal information of background data center storage, search belongs to the interior virtual content of time period of customer requirements, and feed back to mobile terminal, form the figure layer content of augmented reality, show the user to check.

The present invention compares with background technology, a lot of brand-new operations and display packing are provided, what allow the user can be convenient in augmented reality is used checks and locks required content, and can freely check according to user intention the augmented reality content in different time, place, system is hommization and efficient more.

Description of drawings

Fig. 1 is that the system of a kind of embodiment of the present invention consists of schematic diagram.

Fig. 2 is the EM equipment module structural representation of a kind of embodiment of the present invention.

Fig. 3 is the method logical flow chart that the system of a kind of embodiment of the present invention processes augmented reality.

Fig. 4 is that the augmented reality content of a kind of embodiment of the present invention shows and the real time propelling movement schematic diagram.

Fig. 5 is gesture operation chart under the manual mode of a kind of embodiment of the present invention.

Fig. 6 is that the multilayer augmented reality content of a kind of embodiment of the present invention shows schematic diagram.

Embodiment

Embodiment 1: with reference to accompanying drawing 1-6.A kind of mobile terminal augmented reality application system is made of mobile terminal 1, wireless communication networks 2, background data center 3 at least, as shown in Figure 1.Mobile terminal 1 is by wireless communication networks 2 and background data center 3 bidirectional data exchange, and background data center 3 feeds back to mobile terminal by wireless communication networks.

Described mobile terminal 1 comprises processor 101, memory module 102, camera 103, satellite positioning module 104, gyro sensor 105, display module 106, communication module 107, power module 108; Processor 101 and memory module 102, satellite positioning module 104 and communication module 107 bidirectional data exchange, gyro sensor 105 signal output parts connect processor 101 signal input parts, processor 101 signal output parts connect respectively camera 103, display module 106 signal input parts, and power module 108 is used for mobile terminal 1 each assembly power supply.

Of the present inventionly provide a kind of embodiment, after entering the augmented reality pattern, the reality scene image is opened and received to the camera of mobile terminal 1, and as the first figure layer, 101 pairs of the first figure layers of processor carry out signature analysis, extract characteristics of image;

Satellite positioning module 104 is obtained the positional information of mobile terminal 1, the camera that gyro sensor 105 obtains mobile terminal 1 towards and angle information, communication module 107 is sent to background data center 3 simultaneously with the characteristics of image of these information and the first figure layer;

Background data center 3 is through computational analysis, according to the position of the characteristics of image of the first figure layer and mobile terminal 1 with towards, angle information, the virtual content corresponding with the first figure layer in the database at search data center comprises the various media contents such as word, picture, voice, video, network linking address;

The virtual content of storage in described background data center 3, each content all is accompanied with electronic mark, and this electronic mark the is clear and definite attribute of virtual content makes system to screen virtual content according to different attribute;

The virtual content that background data center 3 searches more than inciting somebody to action, be sent to again mobile terminal 1, mobile terminal 1 receives this virtual content, this virtual content and the first figure layer are made up in calculating by processor 101, formation contains the second figure layer of augmented reality content, and shows the user by display module 106.

Displaying contents such as Fig. 4 of augmented reality illustrate.

System can enter the augmented reality pattern automatically, its method is: processor is monitored the angle of mobile terminal 1 camera by gyro sensor, camera lifts when being certain inclination angle with horizontal direction, processor 101 is by the angle of gyro sensor 105 monitoring mobile terminal cameras 103, camera 103 lifts when being certain inclination angle with horizontal direction, processor 101 obtains this inclination data and calculates, be in the good scope of default as this inclination angle, processor 101 is that command system automatically switches to the augmented reality pattern, need not manual operation; When camera 103 inclination angles were not in the default scope, system was according to same method autoshutdown augmented reality pattern.

Embodiment 2: on the basis of embodiment 1, a kind of augmented reality application system of mobile terminal, can automatically enter lock-out state: processor 101 by gyro sensor 105 monitoring mobile terminal 1 cameras 103 towards and angle, when camera 103 towards not changing within a certain continuous period with angle, can think that camera 103 remains static, this moment, system entered lock-out state automatically.

Described lock-out state refers under this state, and system will enter that moment before lock-out state obtains and the second figure layer content of showing is stored to memory module 102, and show in display module.At this moment, no matter the position of mobile terminal 1, towards whether changing with angle, system all no longer upgrades current displaying contents.

Embodiment 3: the augmented reality application system of the described mobile terminal of the present embodiment allows the user to check the second figure layer by manual operation in manual mode.Its concrete grammar is:

mobile terminal 1 locating module 104 via satellite obtains the position location information of self, and be sent to background data center 3 by communication module 107, background data center 3 is according to the positional information that receives, inquire about corresponding whole virtual contents in this position periphery certain radius scope, and the corresponding position of each virtual content and directional information, and feed back to mobile terminal 1, mobile terminal 1 receives above-mentioned information, by calculating the second figure layer that contains the augmented reality content, should scheme layer is stored in memory module 102, and display by display module 106, system provides two control knobs 109 and 110, controlling party is to changing and variable in distance respectively, user's action button 109, can check different directions, corresponding the second figure layer content of angle, action button 110 can be checked the content of different distance in the second figure layer corresponding under a certain fixed-direction and angle.

Operation under manual mode and demonstration are as shown in Figure 5.

embodiment 4: the augmented reality application system of the described mobile terminal of the present embodiment, can be according to the mobile terminal 1 present position point active push information relevant to this position, concrete grammar is as follows: when in back-end data, 3 hearts receive the information of mobile terminal 1 transmission, the virtual content that enquiry mobile terminal 1 present position is corresponding, background data center 3 is determined its attribute according to the subsidiary electronic mark of above-mentioned virtual content, and rule predefined according to system, search the content that has Attribute Association with above-mentioned virtual content, background data center 3 feeds back to mobile terminal 1 with above-mentioned virtual content and content association, mobile terminal 1 receives and is stored in memory module 102,

When system enters the augmented reality pattern, showing outside the first figure layer and corresponding the second figure layer that generates that camera 103 catches, also can show above-mentioned virtual content and the content association of mobile terminal 1 current present position;

Described content association provides from the trend user for system, such as mobile terminal 1 present position is cinema, content association can be film play timetable, booking link etc., directly obtain effective related information when being user-friendly to, the rule of above-mentioned content association and logic can be by default and adjustment.

Embodiment 5: the augmented reality application system of the described mobile terminal of the present embodiment, can realize the demonstration of multilayer augmented reality content, concrete grammar is: the virtual content of background data center 1 is according to hierarchical storage, indicate by electronic mark each child level that this content comprises, each child level is indicated more child level virtual contents that it comprises equally in electronic mark; When the user checks virtual content in the second figure layer, acquiescence can not show its child level content, but control knob 111 can appear, click this button, can continue to check the virtual content of child level, this moment, actual scene and ground floor virtual content remained unchanged, and the child level virtual content is activated, show according to the method identical with the second figure layer, form the 3rd figure layer; Same, virtual content in the 3rd figure layer has child level, also can check by control knob 111, form the 4th figure layer, by that analogy, above process is the more virtual content subgraphs of repeated load layer constantly, thereby greatly improves the quantity of information of virtual content under the augmented reality pattern and represent level.

Multi-level augmented reality content shows as shown in Figure 6.

Embodiment 6: the augmented reality application system of the described mobile terminal of the present embodiment, and can be according to the position of current mobile terminal 1 with towards, real time propelling movement virtual content.In a single day virtual content or its related information of background data center 3 storages have renewal, as reward voucher, sales promotion information etc., system can detect the current virtual content that has which mobile terminal 1 user checking above-mentioned generation renewal in real time, and initiatively this information updating is pushed to mobile terminal 1, inform that the user checks, and do not need the user to send any request or carry out any operation.

The real time propelling movement content shows as shown in red word in Fig. 1.

Embodiment 7: the augmented reality application system of the described mobile terminal of the present embodiment allows User Defined locality and the augmented reality content of checking this locality.The user is by the mode of input, selection or search, determine the three unities information and be uploaded to background data center 3, after background data center 3 receives this location information, this place is resolved, and with background data center 3 in the related location information of virtual content of storage compare, search for the virtual content corresponding with this place, and feed back to mobile terminal 1, form the figure layer content of augmented reality, show the user to check.

Embodiment 8: the augmented reality application system of the described mobile terminal of the present embodiment, the user checks the augmented reality content in the Self defined time section.The user is by the mode of input, selection or search, determine the start and end time of a time period, and be uploaded to background data center 3, background data center 3 receives this time period information, compare with the temporal information of background data center 3 storages, search belongs to the interior virtual content of time period of customer requirements, and feeds back to mobile terminal 1, form the figure layer content of augmented reality, show the user to check.

In above method, the user can also check according to different modes and comprise augmented reality content in the fixed time section: 1 according to actual time speed check augmented reality content in the fixed time section; 2 check according to the speed different from actual time, this moment the user can specify faster or slower than actual time, thereby can fast browsing or finer augmented reality content of checking in the fixed time section; 3 navigate to any time in this time period fast, thereby switch to immediately the augmented reality content in this moment.

What need to understand is: although above-described embodiment is to the mentality of designing of the present invention detailed text description of contrasting; but these text descriptions; just the simple text of mentality of designing of the present invention is described; rather than to the restriction of mentality of designing of the present invention; any combination, increase or modification that does not exceed mentality of designing of the present invention all falls within the scope of protection of the present invention.

Claims (14)

1. mobile terminal augmented reality application system, it is characterized in that: consisted of by mobile terminal (1), wireless communication networks (2), background data center (3) at least, mobile terminal (1) is by wireless communication networks (2) and background data center (3) bidirectional data exchange, and background data center (3) feeds back to mobile terminal by wireless communication networks.
2. mobile terminal augmented reality application system according to claim 1, it is characterized in that: described mobile terminal (1) comprises processor (101), memory module (102), camera (103), satellite positioning module (104), gyro sensor (105), display module (106), communication module (107), power module (108); Processor (101) and memory module (102), satellite positioning module (104) and communication module (107) bidirectional data exchange, gyro sensor (105) signal output part connects processor (101) signal input part, processor (101) signal output part connects respectively camera (103), display module (106) signal input part, and power module (108) is used for each assembly power supply of mobile terminal (1).
3. the operation method of a mobile terminal augmented reality application system is characterized in that:
After mobile terminal entered the augmented reality pattern, the reality scene image is opened and received to the camera of mobile terminal (1), and as the first figure layer, processor (101) carries out signature analysis to the first figure layer, extracts characteristics of image;
Satellite positioning module (104) is obtained the positional information of mobile terminal (1), the camera that gyro sensor (105) obtains mobile terminal (1) towards and angle information, communication module (107) is sent to background data center (3) simultaneously with the characteristics of image of these information and the first figure layer;
Background data center (3) is through computational analysis, according to the position of the characteristics of image of the first figure layer and mobile terminal (1) with towards, angle information, the virtual content corresponding with the first figure layer in the database at search data center comprises the various media contents such as word, picture, voice, video, network linking address;
The virtual content of storage in described background data center (3), each content all is accompanied with electronic mark, and this electronic mark the is clear and definite attribute of virtual content makes system to screen virtual content according to different attribute;
The virtual content that background data center (3) searches more than inciting somebody to action, be sent to again mobile terminal (1), mobile terminal (1) receives this virtual content, this virtual content and the first figure layer are made up in calculating by processor (101), formation contains the second figure layer of augmented reality content, and shows the user by display module (106).
4. the operation method of mobile terminal augmented reality application system according to claim 3, it is characterized in that: the described system augmented reality pattern that can automatically switch, processor (101) is by the angle of gyro sensor (105) monitoring mobile terminal (1) camera (103), camera (103) lifts when being certain inclination angle with horizontal direction, processor (101) obtains this inclination data and calculates, be in the good scope of default as this inclination angle, processor (101) is that command system automatically switches to the augmented reality pattern, need not manual operation; When camera (103) inclination angle was not in the default scope, system was according to same method autoshutdown augmented reality pattern.
5. the operation method of mobile terminal augmented reality application system according to claim 3, it is characterized in that: described system can enter lock-out state automatically, processor (101) by gyro sensor (105) monitoring mobile terminal (1) camera (103) towards and angle, when camera (103) towards not changing within a certain continuous period with angle, can think that camera (103) remains static, this moment, system entered lock-out state automatically.
6. the operation method of mobile terminal augmented reality application system according to claim 5, it is characterized in that: the lock-out state of described augmented reality system, refer under this state, system will enter that moment before lock-out state obtains and the second figure layer content of showing is stored to memory module (102), and show in display module, at this moment, no matter the position of mobile terminal (1), towards whether changing with angle, system all no longer upgrades current displaying contents.
7. the operation method of mobile terminal augmented reality application system according to claim 3, it is characterized in that: system is provided with manual mode in the augmented reality pattern, allow the user to check the second figure layer by manual operation, concrete grammar is: mobile terminal (1) locating module (104) via satellite obtains the position location information of self, and be sent to background data center (3) by communication module (107), background data center (3) is according to the positional information that receives, inquire about corresponding whole virtual contents in this position periphery certain radius scope, and the corresponding position of each virtual content and directional information, and feed back to mobile terminal (1), mobile terminal (1) receives above-mentioned information, by calculating the second figure layer that contains the augmented reality content, should scheme layer is stored in memory module (102), and display by display module (106), system provides two control knobs (109, 110), controlling party is to changing and variable in distance respectively, user's action button (109), can check different directions, corresponding the second figure layer content of angle, action button (110) can be checked the content of different distance in the second figure layer corresponding under a certain fixed-direction and angle.
8. the operation method of mobile terminal augmented reality application system according to claim 7, it is characterized in that: the display module (106) of mobile terminal (1), can use the display device of supporting the touch gestures operation, at this moment, control knob 109 described in claim 7,110 can omit, and reach same purpose by gesture operation, specifically, the gesture operation that level, vertical direction are slided is consistent with the function of button 109, can check different directions, corresponding the second figure layer content of angle; The gesture operation of two finger convergent-divergents is consistent with the function of button 110, can check the content of different distance in the second figure layer corresponding under a certain fixed-direction and angle.
9. the operation method of mobile terminal augmented reality application system according to claim 3, it is characterized in that: background data center (3) is completed described in claim 3 in processing procedure, system can judge according to mobile terminal (1) present position point, and concrete grammar is as follows:
When in back-end data, (3) heart receives the information of mobile terminal (1) transmission, virtual content corresponding to enquiry mobile terminal (1) present position, background data center (3) is determined its attribute according to the subsidiary electronic mark of above-mentioned virtual content, and rule predefined according to system, search the content that has Attribute Association with above-mentioned virtual content, background data center (3) feeds back to mobile terminal (1) with above-mentioned virtual content and content association, and mobile terminal (1) receives and is stored in memory module (102);
When system enters the augmented reality pattern, showing outside the first figure layer and corresponding the second figure layer that generates that camera (103) catches, also can show above-mentioned virtual content and the content association of the current present position of mobile terminal (1);
Described content association provides from the trend user for system, such as mobile terminal (1) present position is cinema, content association can be film play timetable, booking link etc., directly obtain effective related information when being user-friendly to, the rule of above-mentioned content association and logic can be by default and adjustment.
10. the operation method of mobile terminal augmented reality application system according to claim 3, it is characterized in that: described augmented reality system is on the basis of above-mentioned the second figure layer, can also load a plurality of subgraph layers that contain the augmented reality content, concrete grammar is more:
The virtual content of background data center (1) indicates by electronic mark each child level that this content comprises according to hierarchical storage, and each child level is indicated more child level virtual contents that it comprises equally in electronic mark; When the user checks virtual content in the second figure layer, acquiescence can not show its child level content, but control knob (111) can appear, click this button, can continue to check the virtual content of child level, this moment, actual scene and ground floor virtual content remained unchanged, and the child level virtual content is activated, show according to the method identical with the second figure layer, form the 3rd figure layer; Same, virtual content in the 3rd figure layer has child level, also can check by control knob (111), form the 4th figure layer, by that analogy, above process is the more virtual content subgraphs of repeated load layer constantly, thereby greatly improves the quantity of information of virtual content under the augmented reality pattern and represent level.
11. the operation method of mobile terminal augmented reality application system according to claim 3 is characterized in that: under the augmented reality pattern, system can be according to the position of current mobile terminal (1) with towards, real time propelling movement virtual content, and concrete grammar is as follows:
In a single day virtual content or its related information of background data center (3) storage have renewal, as reward voucher, sales promotion information etc., system can detect the current virtual content that has which mobile terminal (1) user checking above-mentioned generation renewal in real time, and initiatively this information updating is pushed to mobile terminal (1), inform that the user checks, and do not need the user to send any request or carry out any operation.
12. the operation method of a mobile terminal augmented reality application system, it is characterized in that: in method described in the claims 3, to check the augmented reality content according to mobile terminal (1) current location as reference point, in fact, the user can a self-defined locality, and the augmented reality content of checking this locality; Concrete grammar is as follows:
The user is by the mode of input, selection or search, determine the three unities information and be uploaded to background data center (3), after background data center (3) receives this location information, this place is resolved, and with background data center (3) in the related location information of virtual content of storage compare, search for the virtual content corresponding with this place, and feed back to mobile terminal (1), form the figure layer content of augmented reality, show the user to check.
13. the operation method of a mobile terminal augmented reality application system is characterized in that: in method described in the claims 3, be the augmented reality content of checking current time; In fact, the user can check the augmented reality content in the Self defined time section, and concrete grammar is as follows:
The user is by the mode of input, selection or search, determine the start and end time of a time period, and be uploaded to background data center (3), background data center (3) receives this time period information, compare with the temporal information of background data center (3) storage, search belongs to the interior virtual content of time period of customer requirements, and feeds back to mobile terminal (1), form the figure layer content of augmented reality, show the user to check.
14. the operation method of mobile terminal augmented reality application system according to claim 13 is characterized in that: the user can check according to different modes and comprise augmented reality content in the fixed time section:
(1) according to actual time speed check augmented reality content in the fixed time section;
(2) check according to the speed different from actual time, this moment the user can specify faster or slower than actual time, thereby can fast browsing or finer augmented reality content of checking in the fixed time section;
(3) navigate to fast any time in this time period, thereby switch to immediately the augmented reality content in this moment.
CN2013100709333A 2013-03-06 2013-03-06 Mobile terminal (MT) augmented reality application system and method CN103164518A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013100709333A CN103164518A (en) 2013-03-06 2013-03-06 Mobile terminal (MT) augmented reality application system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013100709333A CN103164518A (en) 2013-03-06 2013-03-06 Mobile terminal (MT) augmented reality application system and method

Publications (1)

Publication Number Publication Date
CN103164518A true CN103164518A (en) 2013-06-19

Family

ID=48587606

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013100709333A CN103164518A (en) 2013-03-06 2013-03-06 Mobile terminal (MT) augmented reality application system and method

Country Status (1)

Country Link
CN (1) CN103164518A (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561065A (en) * 2013-10-22 2014-02-05 深圳市优逸电子科技有限公司 System and method for achieving 3D virtual advertisement with mobile terminal
CN103700128A (en) * 2013-12-30 2014-04-02 无锡触角科技有限公司 Mobile equipment and enhanced display method thereof
CN103826201A (en) * 2014-02-13 2014-05-28 夷希数码科技(上海)有限公司 Geographical position-based virtual interaction method and system thereof
CN104202520A (en) * 2014-08-28 2014-12-10 苏州佳世达电通有限公司 Information transmitting method and information transmitting system
WO2014201957A1 (en) * 2013-06-21 2014-12-24 腾讯科技（深圳）有限公司 Information recommendation method and terminal and system related thereto
CN104243807A (en) * 2013-06-20 2014-12-24 卡西欧计算机株式会社 Image processing device and computer readable medium
CN104735614A (en) * 2013-12-18 2015-06-24 国际商业机器公司 Method and mobile equipment for LOCATION-BASED MOBILE APPLICATION AND SERVICE SELECTION
CN105208458A (en) * 2015-09-24 2015-12-30 广州酷狗计算机科技有限公司 Virtual frame display method and device
CN105608934A (en) * 2015-12-21 2016-05-25 大连新锐天地传媒有限公司 AR children's story early education stage play system
CN105677178A (en) * 2015-12-30 2016-06-15 广东欧珀移动通信有限公司 Method for adjusting layer of control and mobile terminal
CN105719350A (en) * 2014-11-20 2016-06-29 财团法人资讯工业策进会 Mobile Device And Operating Method
CN105933500A (en) * 2015-07-09 2016-09-07 中国银联股份有限公司 Mobile terminal, remote server, and communication method and system based on augmented reality
CN106101574A (en) * 2016-06-28 2016-11-09 广东欧珀移动通信有限公司 Control method, device and the mobile terminal of a kind of image enhaucament reality
CN106230920A (en) * 2016-07-27 2016-12-14 吴东辉 A kind of method and system of AR
CN106254848A (en) * 2016-07-29 2016-12-21 宇龙计算机通信科技(深圳)有限公司 A kind of learning method based on augmented reality and terminal
CN106302444A (en) * 2016-08-16 2017-01-04 深圳市巴古科技有限公司 Intelligent cloud recognition methods
CN106372260A (en) * 2016-10-25 2017-02-01 广州卓能信息科技有限公司 Method, device and system for information exchange
CN106373197A (en) * 2016-09-06 2017-02-01 广州视源电子科技股份有限公司 Augmented reality method and augmented reality device
CN106681881A (en) * 2015-11-05 2017-05-17 中兴通讯股份有限公司 Data center routing inspection method and data center routing inspection device
CN106713840A (en) * 2016-06-28 2017-05-24 腾讯科技（深圳）有限公司 Virtual information display method and device
CN107295361A (en) * 2017-06-22 2017-10-24 腾讯科技（深圳）有限公司 A kind of content delivery method
CN107408026A (en) * 2015-03-31 2017-11-28 索尼公司 Message processing device, information processing method and computer program
CN107493228A (en) * 2017-08-29 2017-12-19 北京易讯理想科技有限公司 A kind of social interaction method and system based on augmented reality
CN107678538A (en) * 2017-09-05 2018-02-09 北京原力创新科技有限公司 Augmented reality system and information processing method therein, storage medium, processor
CN107817897A (en) * 2017-10-30 2018-03-20 努比亚技术有限公司 A kind of information intelligent display methods and mobile terminal
CN107948956A (en) * 2017-11-07 2018-04-20 北京小米移动软件有限公司 Localization method and device
CN107979628A (en) * 2016-10-24 2018-05-01 腾讯科技（深圳）有限公司 Obtain the method, apparatus and system of virtual objects
CN108507541A (en) * 2018-03-01 2018-09-07 广东欧珀移动通信有限公司 Building recognition method and system and mobile terminal
CN108604175A (en) * 2016-02-10 2018-09-28 诺基亚技术有限公司 Device and correlating method
CN109714290A (en) * 2017-10-22 2019-05-03 黑龙江省德鸿科技有限责任公司 A kind of AR technology mobile terminal imaging method

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102194007A (en) * 2011-05-31 2011-09-21 中国电信股份有限公司 System and method for acquiring mobile augmented reality information
CN102375741A (en) * 2010-08-12 2012-03-14 株式会社泛泰 User equipment and method for displaying augmented reality window
CN102402460A (en) * 2011-10-24 2012-04-04 广东威创视讯科技股份有限公司 Switching method and device for user interface of AR (Augmented Reality) software based on smart mobile device
CN102457617A (en) * 2010-10-18 2012-05-16 Lg电子株式会社 Mobile terminal and method of managing object related information therein
CN102566893A (en) * 2010-10-22 2012-07-11 株式会社泛泰 Apparatus and method for providing augmented reality user interface
CN102625993A (en) * 2009-07-30 2012-08-01 Sk普兰尼特有限公司 Method for providing augmented reality, server for same, and portable terminal
CN102754097A (en) * 2009-12-11 2012-10-24 诺基亚公司 Method and apparatus for presenting a first-person world view of content
US20120314942A1 (en) * 2011-06-10 2012-12-13 Microsoft Corporation Determining foreground regions and background regions in an image
US20120327117A1 (en) * 2011-06-23 2012-12-27 Limitless Computing, Inc. Digitally encoded marker-based augmented reality (ar)
CN102891915A (en) * 2011-07-18 2013-01-23 上海盛畅网络科技有限公司 Actual and virtual interactive entertainment system and method for mobile terminal

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102625993A (en) * 2009-07-30 2012-08-01 Sk普兰尼特有限公司 Method for providing augmented reality, server for same, and portable terminal
CN102754097A (en) * 2009-12-11 2012-10-24 诺基亚公司 Method and apparatus for presenting a first-person world view of content
CN102375741A (en) * 2010-08-12 2012-03-14 株式会社泛泰 User equipment and method for displaying augmented reality window
CN102457617A (en) * 2010-10-18 2012-05-16 Lg电子株式会社 Mobile terminal and method of managing object related information therein
CN102566893A (en) * 2010-10-22 2012-07-11 株式会社泛泰 Apparatus and method for providing augmented reality user interface
CN102194007A (en) * 2011-05-31 2011-09-21 中国电信股份有限公司 System and method for acquiring mobile augmented reality information
US20120314942A1 (en) * 2011-06-10 2012-12-13 Microsoft Corporation Determining foreground regions and background regions in an image
US20120327117A1 (en) * 2011-06-23 2012-12-27 Limitless Computing, Inc. Digitally encoded marker-based augmented reality (ar)
CN102891915A (en) * 2011-07-18 2013-01-23 上海盛畅网络科技有限公司 Actual and virtual interactive entertainment system and method for mobile terminal
CN102402460A (en) * 2011-10-24 2012-04-04 广东威创视讯科技股份有限公司 Switching method and device for user interface of AR (Augmented Reality) software based on smart mobile device

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243807B (en) * 2013-06-20 2018-01-26 卡西欧计算机株式会社 Image processing apparatus and image processing method
CN104243807A (en) * 2013-06-20 2014-12-24 卡西欧计算机株式会社 Image processing device and computer readable medium
WO2014201957A1 (en) * 2013-06-21 2014-12-24 腾讯科技（深圳）有限公司 Information recommendation method and terminal and system related thereto
CN103561065A (en) * 2013-10-22 2014-02-05 深圳市优逸电子科技有限公司 System and method for achieving 3D virtual advertisement with mobile terminal
CN103561065B (en) * 2013-10-22 2017-05-24 深圳市优逸电子科技有限公司 System and method for achieving 3D virtual advertisement with mobile terminal
CN104735614B (en) * 2013-12-18 2019-04-23 国际商业机器公司 Method and mobile device for location-based mobile application and services selection
CN104735614A (en) * 2013-12-18 2015-06-24 国际商业机器公司 Method and mobile equipment for LOCATION-BASED MOBILE APPLICATION AND SERVICE SELECTION
CN103700128A (en) * 2013-12-30 2014-04-02 无锡触角科技有限公司 Mobile equipment and enhanced display method thereof
CN103700128B (en) * 2013-12-30 2017-02-15 无锡触角科技有限公司 Mobile equipment and enhanced display method thereof
CN103826201A (en) * 2014-02-13 2014-05-28 夷希数码科技(上海)有限公司 Geographical position-based virtual interaction method and system thereof
CN104202520A (en) * 2014-08-28 2014-12-10 苏州佳世达电通有限公司 Information transmitting method and information transmitting system
CN105719350A (en) * 2014-11-20 2016-06-29 财团法人资讯工业策进会 Mobile Device And Operating Method
CN107408026A (en) * 2015-03-31 2017-11-28 索尼公司 Message processing device, information processing method and computer program
CN105933500A (en) * 2015-07-09 2016-09-07 中国银联股份有限公司 Mobile terminal, remote server, and communication method and system based on augmented reality
CN105208458A (en) * 2015-09-24 2015-12-30 广州酷狗计算机科技有限公司 Virtual frame display method and device
CN105208458B (en) * 2015-09-24 2018-10-02 广州酷狗计算机科技有限公司 Virtual screen methods of exhibiting and device
CN106681881A (en) * 2015-11-05 2017-05-17 中兴通讯股份有限公司 Data center routing inspection method and data center routing inspection device
CN105608934A (en) * 2015-12-21 2016-05-25 大连新锐天地传媒有限公司 AR children's story early education stage play system
CN105677178A (en) * 2015-12-30 2016-06-15 广东欧珀移动通信有限公司 Method for adjusting layer of control and mobile terminal
CN105677178B (en) * 2015-12-30 2019-02-05 Oppo广东移动通信有限公司 A kind of method and mobile terminal adjusting the affiliated figure layer of control
CN108604175A (en) * 2016-02-10 2018-09-28 诺基亚技术有限公司 Device and correlating method
CN106101574A (en) * 2016-06-28 2016-11-09 广东欧珀移动通信有限公司 Control method, device and the mobile terminal of a kind of image enhaucament reality
CN106713840B (en) * 2016-06-28 2018-09-04 腾讯科技（深圳）有限公司 Virtual information display methods and device
CN106101574B (en) * 2016-06-28 2019-04-23 Oppo广东移动通信有限公司 A kind of control method, device and the mobile terminal of image enhancement reality
CN106713840A (en) * 2016-06-28 2017-05-24 腾讯科技（深圳）有限公司 Virtual information display method and device
CN106230920A (en) * 2016-07-27 2016-12-14 吴东辉 A kind of method and system of AR
CN106254848A (en) * 2016-07-29 2016-12-21 宇龙计算机通信科技(深圳)有限公司 A kind of learning method based on augmented reality and terminal
CN106302444A (en) * 2016-08-16 2017-01-04 深圳市巴古科技有限公司 Intelligent cloud recognition methods
CN106373197A (en) * 2016-09-06 2017-02-01 广州视源电子科技股份有限公司 Augmented reality method and augmented reality device
CN106373197B (en) * 2016-09-06 2020-08-07 广州视源电子科技股份有限公司 Augmented reality method and augmented reality device
CN107979628B (en) * 2016-10-24 2020-04-21 腾讯科技（深圳）有限公司 Method, device and system for acquiring virtual article
CN107979628A (en) * 2016-10-24 2018-05-01 腾讯科技（深圳）有限公司 Obtain the method, apparatus and system of virtual objects
WO2018076975A1 (en) * 2016-10-24 2018-05-03 腾讯科技（深圳）有限公司 Method, device and system for acquiring virtual item, and storage medium
US10854009B2 (en) 2016-10-24 2020-12-01 Tencent Technology (Shenzhen) Company Limited Method, apparatus, and system for obtaining virtual object, and storage medium
CN106372260A (en) * 2016-10-25 2017-02-01 广州卓能信息科技有限公司 Method, device and system for information exchange
CN107295361A (en) * 2017-06-22 2017-10-24 腾讯科技（深圳）有限公司 A kind of content delivery method
CN107493228A (en) * 2017-08-29 2017-12-19 北京易讯理想科技有限公司 A kind of social interaction method and system based on augmented reality
CN107678538A (en) * 2017-09-05 2018-02-09 北京原力创新科技有限公司 Augmented reality system and information processing method therein, storage medium, processor
CN109714290A (en) * 2017-10-22 2019-05-03 黑龙江省德鸿科技有限责任公司 A kind of AR technology mobile terminal imaging method
CN107817897A (en) * 2017-10-30 2018-03-20 努比亚技术有限公司 A kind of information intelligent display methods and mobile terminal
US10582338B2 (en) 2017-11-07 2020-03-03 Beijing Xiaomi Mobile Software Co., Ltd. Positioning method and device
CN107948956A (en) * 2017-11-07 2018-04-20 北京小米移动软件有限公司 Localization method and device
CN108507541A (en) * 2018-03-01 2018-09-07 广东欧珀移动通信有限公司 Building recognition method and system and mobile terminal

Similar Documents

Publication Publication Date Title
JP6479142B2 (en) Image identification and organization according to layout without user intervention
US10565288B2 (en) Video streaming in a web browser
KR101872751B1 (en) Method and apparatus for displaying application interface, and electronic device
US9645720B2 (en) Data sharing
US9983592B2 (en) Moving robot, user terminal apparatus and control method thereof
CN104756475B (en) Camera zoom designator in mobile device
RU2633367C2 (en) Method and device for operating and controlling intelligent device
US20180088780A1 (en) Graphical user interface and data transfer methods in a controlling device
CN104219791B (en) general environment expander
RU2678482C2 (en) Electronic device and method for controlling screen display using temperature and humidity
KR102067278B1 (en) Method and server for recommending friends, and terminal thereof
US20200334291A1 (en) Play control of content on a display device
CA2823542C (en) Methods and systems for displaying content on multiple networked devices with a simple command
US10817243B2 (en) Controlling a user interface based on change in output destination of an application
US10585553B2 (en) Display device and method of controlling the same
US9565238B2 (en) Method for controlling electronic apparatus, handheld electronic apparatus and monitoring system
EP2391093B1 (en) Electronic device and method of controlling the same
US8225191B1 (en) Synchronizing web browsers
CN104050621B (en) Electronic equipment and method for image procossing
US10854013B2 (en) Systems and methods for presenting building information
EP2464084B1 (en) Mobile terminal and displaying method thereof
US10066958B2 (en) User terminal device for displaying map and method thereof
CN104298427B (en) result interface display method and device
EP2739015B1 (en) Method and apparatus for sharing data between different network devices
RU2541125C2 (en) Information processing device, information processing method and programme

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 310012 HANGZHOU, ZHEJIANG PROVINCE TO: 311121 HANGZHOU, ZHEJIANG PROVINCE

TA01 Transfer of patent application right

Effective date of registration: 20140514

Address after: Yuhang District, Hangzhou City, Zhejiang Province, 311121 West No. 1500 Building 1 room 532

Applicant after: Hangzhou Luzhao Network Technology Co., Ltd.

Address before: 310012, room 50, No. 1-502, Xihu District, Zhejiang, Hangzhou, Xueyuan Road

Applicant before: Hangzhou Jiushu Network Technology Co., Ltd.

C41 Transfer of patent application or patent right or utility model
ASS Succession or assignment of patent right

Owner name: HANGZHOU LUZHAO NETWORK TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: HANGZHOU JIUSHU NETWORK TECHNOLOGY CO., LTD.

Effective date: 20140514

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20161009

Address after: 310012, room 50, No. 1-502, Xihu District, Zhejiang, Hangzhou, Xueyuan Road

Applicant after: Hangzhou Jiushu Network Technology Co., Ltd.

Address before: Yuhang District, Hangzhou City, Zhejiang Province, 311121 West No. 1500 Building 1 room 532

Applicant before: Hangzhou Luzhao Network Technology Co., Ltd.

AD01 Patent right deemed abandoned

Effective date of abandoning: 20171103

AD01 Patent right deemed abandoned