CN107170046A

CN107170046A - A kind of augmented reality device and augmented reality picture display process

Info

Publication number: CN107170046A
Application number: CN201710203806.4A
Authority: CN
Inventors: 周颖; 陈鹏飞
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-03-30
Filing date: 2017-03-30
Publication date: 2017-09-15
Anticipated expiration: 2037-03-30
Also published as: CN107170046B

Abstract

The invention discloses a kind of augmented reality device and augmented reality picture display process, specific mark mode is determined first, in augmented reality picture, using operable area and each operable area corresponding operable mode of the specific mark mode to real world object information, the corresponding operable mode in the operable area of dummy object information and each operable area is marked, so user is based on the mark in augmented reality picture and conventional resolution capability, it just can quickly tell entity picture and virtual screen, solve the problem of user is difficult to differentiate the entity picture and virtual screen in augmented reality picture, enhance the usage experience of user.

Description

A kind of augmented reality device and augmented reality picture display process

Technical field

Shown the present invention relates to augmented reality application field, more particularly to a kind of augmented reality device and augmented reality picture Method.

Background technology

AR (Augmented Reality, augmented reality) technology is a kind of by real world information and virtual world information " seamless " integrated new technology, be script in the certain time spatial dimension of real world be difficult experience entity letter Breath, such as visual information, sound, taste, tactile etc., by science and technology such as computers, it is superimposed again after analog simulation, by virtual letter Breath is applied to real world, is perceived by human sensory, so as to reach the sensory experience of exceeding reality, real environment and virtual Object be added to same picture in real time or space exists simultaneously.

Because augmented reality not only presents the information of real world, and virtual information is shown simultaneously Come, two kinds of information are complementary to one another, are superimposed, therefore, user be difficult to differentiate those pictures in seen picture be it is real, which It is virtual, user's identification can be caused to perplex.

The content of the invention

It is a primary object of the present invention to propose a kind of augmented reality device and augmented reality picture display process, it is intended to solve The problem of certainly user is difficult to differentiate the entity picture and virtual screen in augmented reality picture.

To achieve the above object, the present invention proposes a kind of augmented reality device, including：Acquisition module, virtual module, analysis Module, reconstructed module and display module, wherein,

Acquisition module is used for the real world object information for catching reality scene；

Virtual module is used for according to real world object information, determines corresponding dummy object information；

Analysis module be used for real world object information carry out signature analysis, obtain real world object information operable area and The corresponding operable mode in each operable area, signature analysis is carried out to dummy object information, and obtain dummy object information can The corresponding operable mode of operating area and each operable area；

Reconstructed module is used to real world object information and dummy object information is reconstructed, and generates picture to be shown, is treating In display picture, using default mark mode to the operable area of real world object information and each operable area is corresponding can Mode of operation, the corresponding operable mode in the operable area of dummy object information and each operable area are marked, generation Augmented reality picture；

Display module is used to show augmented reality picture.

In certain embodiments, in addition to memory module, memory module is used to store object features signature library, object features Signature library includes multiple real world object information and the corresponding operable area of each real world object information, each operable area correspondence Operable mode；Analysis module is used to call object features signature library, according to object features signature library to real world object information Signature analysis is carried out, the corresponding operable mode in operable area and each operable area of real world object information is obtained.

In certain embodiments, in addition to update module, update module be used for the real world object information of external world's input and The corresponding operable area of real world object information, the corresponding operable mode in each operable area, are updated to object features mark Storehouse, and/or, analysis module is carried out what signature analysis was obtained to real world object information, the operable area of real world object information And the corresponding operable mode in each operable area, correspondence storage, which updates, arrives object features signature library.

In certain embodiments, mark mode includes the marker color and mark lines of mark, default mark mode bag The first mark mode and the second mark mode are included, the first mark mode is different mark modes from the second mark mode；Reconstruct Module be used for using the first mark mode to the operable area of the real world object information and each operable area is corresponding can Mode of operation is marked, using operable area and each operable area of second mark mode to the dummy object information Corresponding operable mode is marked, and regard the picture to be shown comprising mark as augmented reality picture.

In certain embodiments, mark mode also includes the identifier of mark, and different identifier correspondences is different Coefficient of performance；Analysis module is additionally operable to determine the coefficient of performance of each mode of operation in picture to be shown according to preset rules, according to The coefficient of performance of each mode of operation determines the corresponding identifier of each mode of operation.

Meanwhile, the invention provides a kind of augmented reality picture display process, including：

Catch the real world object information of reality scene；

According to real world object information, corresponding dummy object information is determined；

Signature analysis is carried out to real world object information, the operable area and each operable area of real world object information is obtained Corresponding operable mode；

Signature analysis is carried out to dummy object information, the operable area and each operable area of dummy object information is obtained Corresponding operable mode；

Real world object information and dummy object information are reconstructed, picture to be shown is generated；

In picture to be shown, using default mark mode to the operable area of real world object information and each operable The corresponding operable mode in region, the corresponding operable mode in the operable area of dummy object information and each operable area are entered Line flag, generates augmented reality picture；

Show augmented reality picture.

In certain embodiments, signature analysis is carried out to real world object information, obtains the operable area of real world object information The corresponding operable mode in domain and each operable area includes：

Object features signature library is called, object features signature library includes multiple real world object information and each real world object is believed Cease corresponding operable area, the corresponding operable mode in each operable area；

Signature analysis is carried out to real world object information according to object features signature library, the operable of real world object information is obtained The corresponding operable mode in region and each operable area.

In certain embodiments, in addition to：

Before object features signature library is called, by the real world object information of external world's input and real world object information correspondence Operable area, the corresponding operable mode in each operable area, be updated to object features signature library；

And/or,

After object features signature library is called, analysis module is carried out what signature analysis was obtained to real world object information, The corresponding operable mode in the operable area of real world object information and each operable area, correspondence storage, which updates, arrives object features Signature library.

In certain embodiments, mark mode includes the marker color and mark lines of mark, default mark mode bag The first mark mode and the second mark mode are included, the first mark mode is different mark modes from the second mark mode；Using Operable area and each operable area corresponding operable mode, virtual object of the default mark mode to real world object information The corresponding operable mode in the operable area of body information and each operable area is marked, and generates augmented reality picture bag Include：

It is corresponding operable to the operable area and each operable area of real world object information using the first mark mode Mode is marked；

It is corresponding operable to the operable area and each operable area of dummy object information using the second mark mode Mode is marked；

It regard the picture to be shown comprising mark as augmented reality picture.

In certain embodiments, mark mode also includes the identifier of mark, and different identifier correspondences is different Coefficient of performance；Before generation augmented reality picture, in addition to：

The coefficient of performance of each mode of operation in picture to be shown is determined according to preset rules；

The corresponding identifier of each mode of operation is determined according to the coefficient of performance of each mode of operation.

A kind of augmented reality device and augmented reality picture display process that the embodiment of the present invention is proposed, this method is first It is determined that specific mark mode, in augmented reality picture, using specific mark mode to the operable of real world object information The corresponding operable mode in region and each operable area, the operable area of dummy object information and each operable area correspondence Operable mode be marked, such user is based on the mark in augmented reality picture and conventional resolution capability (in reality The objects such as obvious non-existent outman, are exactly dummy object), it is possible to entity picture and virtual screen quickly are told, The problem of user is difficult to differentiate the entity picture and virtual screen in augmented reality picture is solved, the use body of user is enhanced Test.

Brief description of the drawings

Fig. 1 is the hardware architecture diagram for realizing the optional mobile terminal of each embodiment one of the invention；

Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；

Fig. 3 is the structural representation of augmented reality device of the present invention；

Fig. 4 is a kind of structural representation of terminal of the present invention；

Fig. 5 is the flow chart of augmented reality picture display process first embodiment of the present invention；

Fig. 6 is the flow chart of augmented reality picture display process second embodiment of the present invention；

Fig. 7 be the present embodiments relate to augmented reality picture the first schematic diagram；

Fig. 8 be the present embodiments relate to augmented reality picture second of schematic diagram；

Fig. 9 be the present embodiments relate to augmented reality picture the third schematic diagram；

Figure 10 be the present embodiments relate to augmented reality picture the 4th kind of schematic diagram；

Figure 11 be the present embodiments relate to augmented reality picture the 5th kind of schematic diagram；

Figure 12 be the present embodiments relate to augmented reality picture the 6th kind of schematic diagram.

The realization, functional characteristics and advantage of the object of the invention will be described further referring to the drawings in conjunction with the embodiments.

Embodiment

It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.

Describe to realize the mobile terminal of each embodiment of the invention referring now to accompanying drawing.In follow-up description, use For represent element such as " module ", " part " or " unit " suffix only for be conducive to the present invention explanation, itself Not specific meaning.Therefore, " module " can be used mixedly with " part ".

Augmented reality device of the present invention can be various equipment, and such as headset equipment, mobile phone are mobile The fixed terminal such as terminal or computer, its construction module is identical, and operation principle is identical, only the form of expression it is different and , hereafter illustrated so that augmented reality device is the mobile terminal such as mobile phone as an example.

Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet personal computer), PMP The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.

Fig. 1 is the hardware architecture diagram for realizing the optional mobile terminal of each embodiment one of the invention.

Mobile terminal 1 00 can include wireless communication unit 110, user input unit 120, output unit 130, memory 140th, controller 150 and power subsystem 160 etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that It is, it is not required that implement all components shown, can alternatively implement more or less components, will be discussed in more detail below The element of mobile terminal.

Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system Or the radio communication between network with download using etc..For example, wireless communication unit can include mobile communication module 111, At least one in wireless Internet module 112.

Mobile communication module 111 sends radio signals to base station (for example, access point, node B etc.), exterior terminal And in server at least one and/or receive from it radio signal.Such radio signal can be logical including voice Talk about signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.

Wireless Internet module 112 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..

The order that user input unit 120 can be inputted according to user generates key input data to control each of mobile terminal Plant operation.User input unit 120 allows user to input various types of information, and can include keyboard, metal dome, touch Plate (for example, detection due to being touched caused by resistance, pressure, electric capacity etc. change sensitive component), roller, rocking bar, Collector (such as camera of the present invention, external data read in interface) etc..Especially, when touch pad in the form of layer When being superimposed upon on display module 131, touch-screen can be formed.

Output unit 130 can include display module 131 etc..Display module 131, which may be displayed in mobile terminal 1 00, to be located The information of reason.For example, when mobile terminal 1 00 is in telephone calling model, display module 131 can show and converse or be other The user interface (UI) or graphic user interface (GUI) for communicating related.When mobile terminal 1 00 is in video calling pattern or figure During as acquisition mode, display module 131 can show the image of capture and/or the image of reception, video or image are shown and UI or GUI of correlation function etc..

Meanwhile, when display module 131 and touch pad in the form of layer it is superposed on one another to form touch-screen when, display module 131 may be used as input unit and output device.Display module 131 can include liquid crystal display (LCD), thin film transistor (TFT) In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least It is a kind of.Some in these displays may be constructed such that transparence to allow user to be watched from outside, and this is properly termed as transparent Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific Desired embodiment, mobile terminal 1 00 can include two or more display modules (or other display devices), for example, moving Dynamic terminal can include outside display module (not shown) and internal display module (not shown).Touch-screen can be used for detection to touch Input pressure and touch input position and touch input area.

Memory 140 can store software program of the processing performed by controller 150 and control operation etc., Huo Zheke Temporarily to store oneself data through exporting or will export.Moreover, memory 140 can store on when touch be applied to it is tactile Touch vibration and the data of audio signal of the various modes exported during screen.

Memory 140 can include the storage medium of at least one type, and storage medium includes flash memory, hard disk, multimedia Card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access memory (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc..Moreover, mobile terminal 1 00 can be with performing memory by network connection The network storage device cooperation of 140 store function.

The overall operation of the generally control mobile terminal of controller 150.For example, controller 150 is performed and voice call, data Network, video calling etc. related control and processing.In addition, controller 150 can include being used to reproduce (or playback) many matchmakers The multi-media module 151 of volume data, multi-media module 151 can be constructed in controller 150, or can be structured as and control Device 150 is separated.Controller 150 can be with execution pattern identifying processing, by the handwriting input performed on the touchscreen or picture Draw input and be identified as character or image.

Power subsystem 160 receives external power or internal power and provides operation each member under control of the controller 150 Appropriate electric power needed for part and component.

Various embodiments described herein can be with use such as computer software, hardware or its any combination of calculating Machine computer-readable recording medium is implemented.Implement for hardware, embodiment described herein can be by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein At least one of electronic unit is implemented, and in some cases, such embodiment can be implemented in controller 150. For software implementation, the embodiment of such as process or function can be with allowing to perform the single of at least one function or operation Software module is implemented.Software code can by the software application (or program) write with any appropriate programming language Lai Implement, software code can be stored in memory 140 and be performed by controller 150.

So far, oneself according to its function through describing mobile terminal.Below, for the sake of brevity, will description such as folded form, Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is as showing Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.

Mobile terminal 1 00 as shown in Figure 1 may be constructed such that using via frame or packet transmission data it is all if any Line and wireless communication system and satellite-based communication system are operated.

The communication system for describing wherein be operated according to the mobile terminal of the present invention referring now to Fig. 2.

Such communication system can use different air interfaces and/or physical layer.For example, used by communication system Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications system System (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc..As non-limiting example, under The description in face is related to cdma communication system, but such teaching is equally applicable to other types of system.

With reference to Fig. 2, cdma wireless communication system can include multiple mobile terminal 1s 00, multiple base stations (BS) 270, base station Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN) 290 form interface.MSC280 is also structured to the BSC275 formation interfaces with that can be couple to base station 270 via back haul link. If any of interface that back haul link can be known according to Ganji is constructed, interface includes such as E1/T1, ATM, IP, PPP, Frame relay, HDSL, ADSL or xDSL.It will be appreciated that system can include multiple BSC275 as shown in Figure 2.

Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of sensing specific direction Each subregion of line covering is radially away from BS270.Or, each subregion can be by two or more for diversity reception Antenna is covered.Each BS270 may be constructed such that the multiple frequency distribution of support, and each frequency distribution has specific frequency spectrum (for example, 1.25MHz, 5MHz etc.).

What subregion and frequency were distributed, which intersects, can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver System (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly representing single BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, specific BS270 each subregion can be claimed For multiple cellular stations.

As shown in Figure 2, broadcast singal is sent to the mobile terminal operated in system by broadcsting transmitter (BT) 295 100.Broadcasting reception module 111 as shown in Figure 1 is arranged at mobile terminal 1 00 to receive the broadcast sent by BT295 Signal.In fig. 2 it is shown that several global positioning system (GPS) satellites 300.Satellite 300 helps to position multiple mobile terminals At least one in 100.

In fig. 2, multiple satellites 300 are depicted, it is understood that be, it is possible to use any number of satellite obtains useful Location information.GPS module 115 as shown in Figure 1 is generally configured to coordinate with satellite 300 to obtain desired positioning letter Breath.GPS tracking techniques or outside GPS tracking techniques are substituted, the other of the position that can track mobile terminal can be used Technology.In addition, at least one gps satellite 300 can optionally or additionally handle satellite dmb transmission.

As a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminal 1s 00 Signal.Mobile terminal 1 00 generally participates in call, information receiving and transmitting and other types of communication.It is each anti-that certain base station 270 is received Handled to link signal in specific BS270.The data of acquisition are forwarded to the BSC275 of correlation.BSC provides call Resource allocation and the mobile management function of coordination including the soft switching process between BS270.BSC275 is also by the number received According to MSC280 is routed to, it is provided for the extra route service with PSTN290 formation interfaces.Similarly, PSTN290 with MSC280 formation interfaces, MSC and BSC275 formation interface, and BSC275 correspondingly control BS270 with by forward link signals It is sent to mobile terminal 1 00.

Based on above-mentioned mobile terminal hardware configuration and communication system, each embodiment of the inventive method is proposed.

As shown in figure 3, based on above-mentioned mobile terminal hardware configuration and communication system, proposing the augmented reality dress of the present invention The embodiment put, specifically, the augmented reality device that the present invention is provided includes：Acquisition module 31, virtual module 32, analysis module 33rd, reconstructed module 34 and display module 35, wherein,

Acquisition module 31 is used for the real world object information for catching reality scene；In actual applications, acquisition module 31 can be with By the rear camera of the mobile terminals such as the front camera of headset equipment, mobile phone, the reality of reality scene is directly caught Object information, can also read the real world object information for the reality scene that External memory equipment is provided by data-interface；

Virtual module 32 is used for according to real world object information, determines corresponding dummy object information；Virtual module 32 can be with It is to possess unit/chip of augmented reality function etc., it can determine suitable dummy object information based on real world object information, For example, when real world object information is vacant room, dummy object information can include bed, pet dog etc., when real world object information During for static mountain, dummy object information can include water, cloud, bird etc., when real world object information is kitchen, dummy object letter Breath can include boiled water, knife etc., and when real world object information is gas tank, dummy object information can include setting for aerating Standby, kitchen range top etc.；

Analysis module 33 is used to carry out signature analysis to real world object information, obtains the operable area of real world object information And the corresponding operable mode in each operable area, signature analysis is carried out to dummy object information, dummy object information is obtained The corresponding operable mode in operable area and each operable area；Operable area refers to real world object information or virtual object The region that can be operated of body information, such as door handle, corresponding operable mode includes rotation, switch etc.；

Reconstructed module 34 is used to real world object information and dummy object information is reconstructed, and generates picture to be shown, It is corresponding to the operable area and each operable area of real world object information using default mark mode in picture to be shown Operable mode, the corresponding operable mode in the operable area of dummy object information and each operable area are marked, raw Into augmented reality picture；Reconstructed module 34 can be realized using existing augmented reality, be repeated no more；

Display module 35 is used to show augmented reality picture, in actual applications, is set using augmented reality equipment as wear-type Exemplified by standby, when headset equipment includes independent display screen, display module is display screen, when headset equipment needs hand of arranging in pairs or groups During machine, display module is mobile phone, so that augmented reality equipment is the mobile terminal such as mobile phone as an example, and display module is mobile phone/flat board etc. The display screen of equipment.

In actual applications, as shown in Figure 7 to 9, mark mode includes the marker color and mark lines of mark, presets Mark mode include the first mark mode and the second mark mode, the first mark mode and the second mark mode are different marks Note mode, specifically, the marker color of the first mark mode is different from the marker color of the second mark mode, the first mark mode Mark lines it is identical with the mark lines of the second mark mode；Or first mark mode marker color and the second mark side The marker color of formula is identical, and the mark lines of the first mark mode are different from the mark lines of the second mark mode；Or first The marker color of mark mode is different from the marker color of the second mark mode, the mark lines of the first mark mode and the second mark The mark lines of note mode are different.Now, reconstructed module be used for using the first mark mode to the real world object information can The corresponding operable mode of operating area and each operable area is marked, using the second mark mode to the dummy object The corresponding operable mode in the operable area of information and each operable area is marked, by the picture to be shown comprising mark It is used as augmented reality picture.

Specifically, the first mark mode and the second mark mode can use identical label symbol, such as square frame, circle Deng；The marker color of first mark mode is different from the marker color of the second mark mode, as shown in fig. 7, the first mark mode Marker color for red, and the marker color of the second mark mode for green, due to that can not be entered in the accompanying drawings with true colors Row is distinguished, so illustrated in fig. 7 with word；Or first mark mode mark lines and second mark mode Mark lines different, as shown in figure 8, the mark lines of the first mark mode are solid line, the mark lines of the second mark mode are Dotted line；Or first mark mode marker color it is different from the marker color of the second mark mode, the mark of the first mark mode Remember that lines are different from the mark lines of the second mark mode, as shown in figure 9, the marker color of the first mark mode is red, mark Note lines are solid line, and the marker color of the second mark mode is green, marks lines to be dotted line.Carried out in conjunction with Fig. 7 to Fig. 9 detailed Describe in detail bright.

In the embodiment shown in Fig. 7 to Fig. 9, real world object information is all a door with door handle, and virtual object Body information is all provided in the light switch on a side, and the embodiment is used to the present invention is briefly described, rather than is used for The form of expression and content of dummy object information are limited, for real world object information, its operable area is door handle, Ke Yicao It is rotation to make mode, for dummy object information, and its operable area is shift knob, can be operatively pressing；

As shown in fig. 7, the marker color of the first mark mode is different from the marker color of the second mark mode, the first mark The mark lines of mode are identical with the mark lines of the second mark mode, are specially：The marker color of first mark mode is red Color, and the marker color of the second mark mode is green, the mark lines and the mark of the second mark mode of the first mark mode Lines are identical, are all solid lines；

As shown in figure 8, the marker color of the first mark mode is identical with the marker color of the second mark mode, the first mark The mark lines of mode are different from the mark lines of the second mark mode, are specially：The marker color of first mark mode and The marker color of two mark modes is identical, is red, the mark lines of the first mark mode are solid line, the second mark mode Mark lines are dotted line；

As shown in figure 9, the marker color of the first mark mode is different from the marker color of the second mark mode, the first mark The mark lines of mode are different from the mark lines of the second mark mode, are specially：The marker color of first mark mode is red Color, and the marker color of the second mark mode is green, the mark lines of the first mark mode are solid line, the second mark mode Mark lines are dotted line.

In actual applications, mark mode also includes the identifier of mark, the different behaviour of different identifier correspondences Make coefficient；Analysis module is additionally operable to determine the coefficient of performance of each mode of operation in picture to be shown according to preset rules, according to each The coefficient of performance of mode of operation determines the corresponding identifier of each mode of operation.Coefficient of performance can include operation difficulty degree And/or operational hazards coefficient, for example divided according to operation difficulty degree, can be divided into and operate dangerous, the potential danger of operation Danger, operation are divided without danger etc. according to operation difficulty degree, can be divided into and be operated highly difficult, operation more difficulty, operation More easily, operate very light etc..Preset rules can system default or user set, or terminal from What study was determined, for example preset rules can be：When operation is related to the hazards such as electricity, fire, thunder, corresponding coefficient of performance is behaviour Make dangerous, when operation is related to the hazards such as boiling water, corresponding coefficient of performance is operation potential danger, is operated without reference to danger During dangerous factor, corresponding coefficient of performance is operation without danger；Corresponding, preset rules can also be：Operation is directed to use with multiple During external items compounding practice (such as coded lock), corresponding coefficient of performance is highly difficult to operate, and operation is directed to use with an external world During article compounding practice (such as access card), corresponding coefficient of performance is more difficult for operation, operation without reference to external items but (key unlocking is such as used when needing two steps and above step number to operate), and corresponding coefficient of performance is more light to operate, and operation does not have Relate to external items and only need (such as to turn on door handle) during single stepping, corresponding coefficient of performance is very light to operate.

When coefficient of performance is operational hazards coefficient, the corresponding relation such as following table of preset rules-coefficient of performance-identifier Shown in 1：

Preset rules	Operational hazards coefficient	Identifier
			The hazards such as electricity, fire, thunder	Operation is dangerous	！！！
The hazards such as boiling water	Operate potential danger	！！
			Be safe from danger factor	Operation is without danger	！

Table 1

When coefficient of performance is operation difficulty degree, the corresponding relation such as following table of preset rules-coefficient of performance-identifier Shown in 2：

Preset rules	Operation difficulty degree	Identifier
			Use multiple external items compounding practices	Operation is highly difficult	****
Use an external items compounding practice	Operation is more difficult	***
			Two steps and above step number is needed to operate	Operation is more light	**
Only need single stepping	Operation is very light	*

Table 2

In conjunction with specifically being illustrated with example, augmented reality picture includes：It is door handle, power outlet, kettle, close Code lock etc., wherein, door handle is real world object information with power outlet, and kettle is dummy object information with coded lock, for When coefficient of performance is operational hazards coefficient, power outlet is because be related to electricity, and corresponding coefficient of performance is dangerous, the kettle of operation Because being related to boiling water, corresponding coefficient of performance is operation potential danger, and door handle and coded lock due to without reference to it is dangerous because Element, corresponding coefficient of performance is operates without danger, and during for coefficient of performance for operation difficulty degree, coded lock is since it is desired that use Multiple external items compounding practices, corresponding coefficient of performance is highly difficult to operate, and kettle is since it is desired that use multiple foreign objects Product compounding practice, corresponding coefficient of performance is more difficult for operation, and power outlet is since it is desired that two steps and the operation of above step number, right The coefficient of performance answered is more light to operate, and door handle is because only need single stepping, and corresponding coefficient of performance is very light to operate Pine.

Specifically, in Figure 10 into Figure 12, the marker color of the marker color of the first mark mode and the second mark mode Identical, the mark lines of the first mark mode are different from the mark lines of the second mark mode, are specially：First mark mode Marker color is identical with the marker color of the second mark mode, is that (in Figure 10 into Figure 12, lines are exactly black to black, no Special marking again), the mark lines of the first mark mode are solid line, and the mark lines of the second mark mode are dotted line；

So that the label symbol in mark mode only includes the corresponding label symbol of operational hazards coefficient as an example, such as Figure 10 institutes Show, power outlet is because be related to electricity, and corresponding coefficient of performance is dangerous to operate, label symbol for "！！！", kettle is because relate to And boiling water, corresponding coefficient of performance for operation potential danger, label symbol for "！！", and door handle and coded lock be not due to relating to And hazards, corresponding coefficient of performance is operation without danger, label symbol for "！”；So user is in augmented reality picture It just can intuitively see the operational hazards coefficient of each operable area respective operations；

So that the label symbol in mark mode only includes the corresponding label symbol of operation difficulty degree as an example, such as Figure 11 institutes Show, coded lock is since it is desired that using multiple external items compounding practices, corresponding coefficient of performance is highly difficult, the label symbol of operation For " * * * * ", kettle since it is desired that using multiple external items compounding practices, corresponding coefficient of performance is more difficult for operation, Label symbol is " * * * ", power outlet are since it is desired that two steps and the operation of above step number, corresponding coefficient of performance are more light to operate Pine, label symbol is ", because only needing single stepping, corresponding coefficient of performance is very light, the marker character of operation by * * ", door handle Number be " * "；So user just can intuitively see that the operation of each operable area respective operations is difficult in augmented reality picture Spend coefficient；

With the label symbol in mark mode simultaneously including the corresponding label symbol of operation difficulty degree and operational hazards system Exemplified by the corresponding label symbols of number, as shown in figure 12, coded lock is corresponding since it is desired that using multiple external items compounding practices Coefficient of performance is highly difficult to operate, label symbol for " * * * * ", simultaneously as without reference to hazards, corresponding operation system Number is operation without danger, label symbol for "！", kettle is since it is desired that use multiple external items compounding practices, corresponding behaviour Make coefficient more difficult for operation, label symbol is " * * * ", due to being related to boiling water this hazards, corresponding coefficient of performance For operation potential danger, label symbol for "！！", power outlet is since it is desired that two steps and the operation of above step number, corresponding operation system Number is more light to operate, and label symbol is " * * ", due to being related to this electric hazards, corresponding coefficient of performance has for operation Danger, label symbol for "！！！", door handle is because only need single stepping, and corresponding coefficient of performance is very light to operate, mark Symbol is " * ", simultaneously as without reference to hazards, and corresponding coefficient of performance is operation without danger, label symbol for "！”； So user just can intuitively see in augmented reality picture each operable area respective operations operation difficulty degree and Operational hazards coefficient.

In actual applications, the augmented reality device shown in Fig. 3 also includes memory module, and memory module is used to store object Signature storehouse, object features signature library includes multiple real world object information and the corresponding operable area of each real world object information Domain, the corresponding operable mode in each operable area；Analysis module 33 is used to call object features signature library, according to object features Signature library carries out signature analysis to real world object information, obtains the operable area and each operable area pair of real world object information The operable mode answered.The present embodiment presets an object storehouse, wherein the object in a large amount of real worlds is contained, and it is right The controllable positions of these objects carries out signature, on this basis, in the object information and object storehouse that are read in environment Controllable region and mode feature carry out the matching analysis, when the similarity of matching reaches predetermined threshold value, then by the region Assign characteristic value and operating area and mode are marked according to characteristic value.

In actual applications, the augmented reality device shown in Fig. 3 also includes update module 36, and update module 36 is used for will be outer The real world object information of boundary's input and the corresponding operable area of real world object information, each operable area are corresponding operable Mode, is updated to object features signature library, and/or, analysis module is carried out what signature analysis was obtained to real world object information, it is existing The corresponding operable mode in the operable area of real object information and each operable area, correspondence storage, which updates, arrives object features mark Remember storehouse.Renewal can be kept by present embodiments providing the marker characteristic in self-study mechanism, object storehouse：A part is updated from exploitation Personnel increase material database and marker characteristic, the active flag of another part then during user's use and remove mark, that is, increase Plus or cancel some inaccurate marks, so, with the extension of user's use time, mark accuracy is higher.

In summary, the present embodiment proposes a kind of augmented reality device, it is first determined specific mark mode, is increasing It is corresponding to the operable area and each operable area of real world object information using specific mark mode in strong reality picture Operable mode, the corresponding operable mode in the operable area of dummy object information and each operable area are marked, this Sample user is based on the mark in augmented reality picture and conventional resolution capability (obvious non-existent outman's thing such as in reality Body, is exactly dummy object), it is possible to entity picture and virtual screen quickly are told, user is solved and is difficult to differentiate enhancing The problem of entity picture and virtual screen in real picture, enhance the usage experience of user.

In an embodiment of the present invention, the institute that the controller 150 in Fig. 1 can be included in embodiment illustrated in fig. 3 is functional The function of module.Now, above-described embodiment can be：

First, controller 150 catches the real world object information of reality scene, according to real world object information, determines corresponding Dummy object information；Signature analysis is carried out to real world object information, the operable area of real world object information is obtained and can respectively grasp Make the corresponding operable mode in region, signature analysis is carried out to dummy object information, obtain the operable area of dummy object information The corresponding operable mode in domain and each operable area；Real world object information and dummy object information are reconstructed, generation is treated Display picture；In picture to be shown, using the first mark mode to the operable area of real world object information and each operable The corresponding operable mode in region is marked, using the second mark mode is to the operable area of dummy object information and respectively may be used The corresponding operable mode of operating area is marked, and generates augmented reality picture；First mark mode and the second mark mode For different mark modes；Show augmented reality picture.

A kind of equipment is present embodiments provided, it is first determined specific mark mode, in augmented reality picture, using spy Operable area and each operable area corresponding operable mode of the fixed mark mode to real world object information, dummy object The corresponding operable mode in the operable area of information and each operable area is marked, and such user is drawn based on augmented reality Mark and conventional resolution capability in face (obvious non-existent outman's object, is exactly dummy object such as in reality), so that it may Quickly to tell entity picture and virtual screen, solve user be difficult to differentiate augmented reality picture in entity picture and The problem of virtual screen, enhance the usage experience of user.

Fig. 4 is a kind of structural representation of terminal of the present invention, as shown in figure 4, the terminal that the present embodiment is provided at least includes： Input and output (IO) bus 41, processor 42, RAM 43, internal memory 44, camera 45 and display screen 46.Wherein,

Input and output (IO) bus 41 is (processor 42, memory 43, interior with other parts of the terminal belonging to itself respectively Deposit 44, camera 45 and display screen 46) connection, and provide transmission lines for other parts.

Processor 42 generally controls the overall operation of the server belonging to itself.Calculated and true for example, processor 42 is performed The operation such as recognize.Wherein, processor 42 can be central processing unit (CPU).In the present embodiment, processor 42 at least needs to have Such function：The real world object information of reality scene is caught by camera 45, according to real world object information, is determined corresponding Dummy object information；Signature analysis is carried out to real world object information, the operable area of real world object information is obtained and can respectively grasp Make the corresponding operable mode in region, signature analysis is carried out to dummy object information, obtain the operable area of dummy object information The corresponding operable mode in domain and each operable area；Real world object information and dummy object information are reconstructed, generation is treated Display picture；In picture to be shown, using the first mark mode to the operable area of real world object information and each operable The corresponding operable mode in region is marked, using the second mark mode is to the operable area of dummy object information and respectively may be used The corresponding operable mode of operating area is marked, and generates augmented reality picture；First mark mode and the second mark mode For different mark modes；Display screen 46 is provided and shows augmented reality picture.

The storage processors of RAM 43 are readable, the software code that processor is executable, and it includes and held for control processor 42 The instruction (i.e. software perform function) of row functions described herein.In the present embodiment, RAM 43 at least needs the realization that is stored with Processor 42 performs the program that above-mentioned functions need.

Wherein, in the data network switching device that the present invention is provided, realizing the software code of all functions of modules of Fig. 3 can deposit Storage in memory 43, and by processor 42 perform or compile after execution.

Internal memory 44, typically using semiconductor memory cell, including random access memory (RAM), read-only storage (ROM), with And cache (CACHE), RAM is most important of which memory.Internal memory 44 is one of important part in computer, and it is The operation of all programs is all carried out in internal memory in the bridge linked up with CPU, computer, and it is to be used for temporarily that it, which is acted on, The operational data in CPU, and the data exchanged with the external memory storage such as hard disk are deposited, as long as computer is in operation, CPU is just Computing can be carried out needing the data of computing to be transferred in internal memory, CPU again sends out result after the completion of computing, the fortune of internal memory Row also determines the stable operation of computer.

Camera 45, for catching real world object information, and is transferred to processor 42.

On the basis of the terminal member shown in Fig. 4, the terminal that the present embodiment is provided can so work：

The real world object information of reality scene is caught by camera 45, according to real world object information, corresponding void is determined Intend object information；Signature analysis is carried out to real world object information, the operable area of real world object information is obtained and each operable The corresponding operable mode in region, signature analysis is carried out to dummy object information, obtains the operable area of dummy object information And the corresponding operable mode in each operable area；Real world object information and dummy object information are reconstructed, generates and waits to show Show picture；In picture to be shown, using operable area and each operable area of first mark mode to real world object information The corresponding operable mode in domain is marked, using the second mark mode is to the operable area of dummy object information and can respectively grasp Make the corresponding operable mode in region to be marked, generate augmented reality picture；First mark mode is with the second mark mode Different mark modes；Display screen 46 is provided and shows augmented reality picture.

The terminal that the present embodiment is provided, it is first determined specific mark mode, in augmented reality picture, using specific Operable area and each operable area corresponding operable mode, dummy object information of the mark mode to real world object information The corresponding operable mode in operable area and each operable area be marked, such user be based on augmented reality picture in Mark and conventional resolution capability (such as in reality substantially non-existent outman's object, be exactly dummy object), it is possible to soon Speed tells entity picture and virtual screen, solves user and is difficult to differentiate entity picture in augmented reality picture and virtual The problem of picture, enhance the usage experience of user.

As shown in figure 5, augmented reality picture display process first embodiment of the present invention is proposed, and in the present embodiment, enhancing Real picture display process comprises the following steps：

S501：Catch the real world object information of reality scene；

In actual applications, can be by the rearmounted shootings of the mobile terminals such as front camera, the mobile phone of headset equipment Head, directly catches the real world object information of reality scene, can also read showing for External memory equipment offer by data-interface The real world object information of real field scape.

S502：According to real world object information, corresponding dummy object information is determined；

In actual applications, unit/chip that can be by possessing augmented reality function etc. realizes that it can be based on existing Real object information determines suitable dummy object information, for example, when real world object information is vacant room, dummy object information can So that including bed, pet dog etc., when real world object information is static mountain, dummy object information can include water, cloud, bird etc., When real world object information is kitchen, dummy object information can include boiled water, knife etc., when real world object information is coal gas During tank, dummy object information can include equipment, kitchen range top of aerating etc..

S503：Signature analysis is carried out to real world object information, the operable area of real world object information is obtained and can respectively grasp Make the corresponding operable mode in region；

Operable area refers to the region that can be operated of real world object information or dummy object information, such as door handle Deng, corresponding operable mode includes rotation, switched etc..

In actual applications, this step includes：

The present embodiment presets an object storehouse, wherein the object in a large amount of real worlds is contained, and to these things The controllable position of body carries out signature, on this basis, to grasping in the object information and object storehouse that are read in environment The feature for controlling region and mode carries out the matching analysis, when the similarity of matching reaches predetermined threshold value, then assigns the region special Simultaneously operating area and mode are marked according to characteristic value for value indicative.

S504：Signature analysis is carried out to dummy object information, the operable area of dummy object information is obtained and can respectively grasp Make the corresponding operable mode in region；

S505：Real world object information and dummy object information are reconstructed, picture to be shown is generated；

S506：In picture to be shown, using default mark mode to the operable area of real world object information and respectively The corresponding operable mode in operable area, the operable area of dummy object information and each operable area are corresponding operable Mode is marked, and generates augmented reality picture；

In actual applications, mark mode includes the marker color and mark lines of mark, and default mark mode includes First mark mode and the second mark mode, the first mark mode are different mark modes from the second mark mode, for example, the The marker color of one mark mode is different from the marker color of the second mark mode, the mark lines of the first mark mode and second The mark lines of mark mode are identical；Or first mark mode marker color and the second mark mode marker color phase Together, the mark lines of the first mark mode are different from the mark lines of the second mark mode；Or first mark mode mark Color is different from the marker color of the second mark mode, the mark lines and the mark line of the second mark mode of the first mark mode Bar is different.Now, this step S506 includes：

It regard the picture to be shown comprising mark as augmented reality picture.

When coefficient of performance is operational hazards coefficient, the corresponding relation such as table 1 of preset rules-coefficient of performance-identifier It is shown.

When coefficient of performance is operation difficulty degree, the corresponding relation such as table 2 of preset rules-coefficient of performance-identifier It is shown.

Specifically, in Figure 10 into Figure 12, the marker color of the marker color of the first mark mode and the second mark mode Identical, the mark lines of the first mark mode are different from the mark lines of the second mark mode, are specially：First mark mode Marker color is identical with the marker color of the second mark mode, is black, the mark lines of the first mark mode are solid line, the The mark lines of two mark modes are dotted line；

S507：Show augmented reality picture；

In actual applications, so that augmented reality equipment is headset equipment as an example, when headset equipment includes independent show During display screen, augmented reality picture is shown by display screen, when headset equipment needs collocation mobile phone, being shown by mobile phone strengthens Real picture, so that augmented reality equipment is the mobile terminal such as mobile phone as an example, is shown by the display screen of the equipment such as mobile phone/flat board and increased Strong reality picture.

In actual applications, the method shown in Fig. 5 also includes：

And/or,

After object features signature library is called, analysis module is carried out what signature analysis was obtained to real world object information, The corresponding operable mode in the operable area of real world object information and each operable area, correspondence storage, which updates, arrives object features Signature library；

Renewal can be kept by present embodiments providing the marker characteristic in self-study mechanism, object storehouse：A part, which updates, to be come from Developer increases material database and marker characteristic, the active flag of another part then during user's use and removes mark, Increase or cancel some inaccurate marks, so, with the extension of user's use time, mark accuracy is higher.

In summary, the present embodiment proposes a kind of augmented reality picture display process, and this method determines specific first Mark mode, in augmented reality picture, using specific mark mode to the operable area of real world object information and each The corresponding operable mode in operable area, the operable area of dummy object information and each operable area are corresponding operable Mode is marked, and such user is based on the mark in augmented reality picture and conventional resolution capability (as substantially do not deposited in reality The object such as outman, be exactly dummy object), it is possible to quickly tell entity picture and virtual screen, solve use The problem of family is difficult to differentiate the entity picture and virtual screen in augmented reality picture, enhance the usage experience of user.

As shown in fig. 6, augmented reality picture display process second embodiment of the present invention is proposed, and in the present embodiment, enhancing Real picture display process comprises the following steps：

S601：The parameters such as the first mark mode, the second mark mode, label symbol are set；

In the present embodiment, set the marker color of the first mark mode identical with the marker color of the second mark mode, The mark lines of first mark mode are different from the mark lines of the second mark mode, are specially：The mark of first mark mode Color is identical with the marker color of the second mark mode, is black, the mark lines of the first mark mode are solid line, the second mark The mark lines of note mode are dotted line.

In the present embodiment, set label symbol simultaneously including the corresponding label symbol of operation difficulty degree and operational hazards The corresponding label symbol of coefficient.

S602：Catch the real world object information of reality scene；

In the present embodiment, real world object information includes the door handle shown in Figure 12 and power outlet.

S603：According to real world object information, corresponding dummy object information is determined；

In the present embodiment, real world object information includes the kettle and coded lock shown in Figure 12.

S604：Reconstruct augmented reality picture；

In picture to be shown, using operable area and each operable area of first mark mode to real world object information The corresponding operable mode in domain is marked, using the second mark mode is to the operable area of dummy object information and can respectively grasp Make the corresponding operable mode in region to be marked, generate augmented reality picture；First mark mode is with the second mark mode Different mark modes；

As shown in figure 12, the marker color of the first mark mode is identical with the marker color of the second mark mode, the first mark The mark lines of note mode are different from the mark lines of the second mark mode, are specially：The marker color of first mark mode with The marker color of second mark mode is identical, is black, the mark lines of the first mark mode are solid line, the second mark mode Mark lines be dotted line；

As shown in figure 12, coded lock is since it is desired that using multiple external items compounding practices, corresponding coefficient of performance is behaviour Make highly difficult, label symbol is " * * * * ", simultaneously as without reference to hazards, corresponding coefficient of performance is operation without danger Danger, label symbol for "！", kettle is since it is desired that using multiple external items compounding practices, corresponding coefficient of performance is operation More difficult, label symbol is " * * * ", due to being related to boiling water this hazards, corresponding coefficient of performance is operates potential danger Danger, label symbol for "！！", power outlet is since it is desired that two steps and the operation of above step number, corresponding coefficient of performance is to operate more Easily, label symbol is " * * ", due to being related to this electric hazards, corresponding coefficient of performance is dangerous, the marker character of operation Number for "！！！", door handle is because only need single stepping, and corresponding coefficient of performance is very light to operate, and label symbol is " * ", Simultaneously as without reference to hazards, corresponding coefficient of performance is operation without danger, label symbol for "！”.

S605：Show augmented reality picture；

The present embodiment proposes a kind of augmented reality picture display process, and this method determines the first mark mode and first Both different mark modes of two mark modes, in augmented reality picture, are believed real world object using the first mark mode The corresponding operable mode in the operable area of breath and each operable area is marked, using the second mark mode to virtual object The corresponding operable mode in the operable area of body information and each operable area is marked, and such user is according to different marks Note mode just can quickly tell entity picture and the virtual screen in augmented reality picture, solve user and be difficult to differentiate The problem of entity picture and virtual screen in augmented reality picture, enhance the usage experience of user.

It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and And also including other key elements being not expressly set out, or also include for this process, method, article or device institute inherently Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this Also there is other identical element in process, method, article or the device of key element.

The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.

Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Understood based on such, technical scheme is substantially done to prior art in other words Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium In (such as ROM/RAM, magnetic disc, CD), including some instructions are to cause a station terminal equipment (can be mobile phone, computer, clothes It is engaged in device, air conditioner, or network equipment etc.) method that performs each embodiment of the invention.

The preferred embodiments of the present invention are these are only, are not intended to limit the scope of the invention, it is every to utilize this hair Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims

1. a kind of augmented reality device, it is characterised in that including：Acquisition module, virtual module, analysis module, reconstructed module and Display module, wherein,

The acquisition module is used for the real world object information for catching reality scene；

The virtual module is used for according to the real world object information, determines corresponding dummy object information；

The analysis module is used to carry out signature analysis to the real world object information, obtains grasping for the real world object information Make the corresponding operable mode in region and each operable area, signature analysis is carried out to the dummy object information, obtain described The corresponding operable mode in the operable area of dummy object information and each operable area；

The reconstructed module is used to the real world object information and the dummy object information is reconstructed, and generates to be shown draw Face, in the picture to be shown, using default mark mode is to the operable area of the real world object information and respectively may be used The corresponding operable mode of operating area, the operable area of the dummy object information and each operable area is corresponding grasps It is marked as mode, generates augmented reality picture；

The display module is used to show the augmented reality picture.

2. augmented reality device as claimed in claim 1, it is characterised in that also including memory module, the memory module is used In storage object features signature library, the object features signature library includes multiple real world object information and each real world object information Corresponding operable area, the corresponding operable mode in each operable area；The analysis module is used to call the object special Signature library is levied, signature analysis is carried out to the real world object information according to the object features signature library, the real thing is obtained The corresponding operable mode in the operable area of body information and each operable area.

3. augmented reality device as claimed in claim 2, it is characterised in that also including update module, the update module is used It is corresponding in the real world object information and the corresponding operable area of real world object information, each operable area for inputting the external world Operable mode, is updated to the object features signature library, and/or, the analysis module is entered to the real world object information Row signature analysis is obtained, the corresponding operable mode in operable area and each operable area of the real world object information, Correspondence storage, which updates, arrives the object features signature library.

4. the augmented reality device as described in any one of claims 1 to 3, it is characterised in that mark mode includes the mark of mark Remember color and mark lines, the default mark mode includes the first mark mode and the second mark mode, first mark Note mode is different mark modes from second mark mode；The reconstructed module is used to use first mark mode The corresponding operable mode in operable area and each operable area to the real world object information is marked, using described Second mark mode is carried out to the corresponding operable mode in operable area and each operable area of the dummy object information Mark, regard the picture to be shown comprising mark as the augmented reality picture.

5. augmented reality device as claimed in claim 4, it is characterised in that the mark mode also includes the identifier of mark Number, the different coefficient of performance of different identifier correspondences；The analysis module is additionally operable to treat according to being determined preset rules The coefficient of performance of each mode of operation in display picture, the corresponding mark of each mode of operation is determined according to the coefficient of performance of each mode of operation Know symbol.

6. a kind of augmented reality picture display process, it is characterised in that including：

Catch the real world object information of reality scene；

According to the real world object information, corresponding dummy object information is determined；

Signature analysis is carried out to the real world object information, the operable area of the real world object information is obtained and each operable The corresponding operable mode in region；

Signature analysis is carried out to the dummy object information, the operable area of the dummy object information is obtained and each operable The corresponding operable mode in region；

The real world object information and the dummy object information are reconstructed, picture to be shown is generated；

In the picture to be shown, using default mark mode is to the operable area of the real world object information and respectively may be used The corresponding operable mode of operating area, the operable area of the dummy object information and each operable area is corresponding grasps It is marked as mode, generates augmented reality picture；

Show the augmented reality picture.

7. augmented reality picture display process as claimed in claim 6, it is characterised in that described to the real world object information Signature analysis is carried out, the corresponding operable mode bag in operable area and each operable area of the real world object information is obtained Include：

Object features signature library is called, the object features signature library includes multiple real world object information and each real world object is believed Cease corresponding operable area, the corresponding operable mode in each operable area；

Signature analysis is carried out to the real world object information according to the object features signature library, the real world object information is obtained The corresponding operable mode in operable area and each operable area.

8. augmented reality picture display process as claimed in claim 7, it is characterised in that also include：

Before object features signature library is called, by the external world input real world object information and real world object information is corresponding can Operating area, the corresponding operable mode in each operable area, are updated to the object features signature library；

And/or,

After object features signature library is called, the analysis module is subjected to signature analysis to the real world object information and obtained , the corresponding operable mode in operable area and each operable area of the real world object information, correspondence storage renewal is arrived The object features signature library.

9. the augmented reality picture display process as described in any one of claim 6 to 8, it is characterised in that mark mode includes The marker color and mark lines of mark, the default mark mode include the first mark mode and the second mark mode, institute It is different mark modes that the first mark mode, which is stated, from second mark mode；It is described to use default mark mode to described The operable area of real world object information and each operable area corresponding operable mode, the dummy object information are grasped Make the corresponding operable mode in region and each operable area to be marked, generation augmented reality picture includes：

Using first mark mode to the operable area of the real world object information and each operable area is corresponding can Mode of operation is marked；

Using second mark mode to the operable area of the dummy object information and each operable area is corresponding can Mode of operation is marked；

It regard the picture to be shown comprising mark as the augmented reality picture.

10. augmented reality picture display process as claimed in claim 9, it is characterised in that the mark mode also includes mark The identifier of note, the different coefficient of performance of different identifier correspondences；Before generation augmented reality picture, in addition to：

The coefficient of performance of each mode of operation in the picture to be shown is determined according to preset rules；