CN105353878A

CN105353878A - Augmented reality information processing method, device and system

Info

Publication number: CN105353878A
Application number: CN201510761119.5A
Authority: CN
Inventors: 李柯材; 冷园园; 陈义军
Original assignee: Huaqin Telecom Technology Co Ltd
Current assignee: Huaqin Technology Co Ltd
Priority date: 2015-11-10
Filing date: 2015-11-10
Publication date: 2016-02-24
Anticipated expiration: 2035-11-10
Also published as: CN105353878B

Abstract

The invention discloses an augmented reality information processing method, device and system. The method is applied to an augmented reality system, wherein the augmented reality system comprises intelligent wearing equipment and a mobile terminal. The method comprises the following steps: the intelligent wearing equipment obtains an image; the mobile terminal judges whether augmented reality processing can be carried out or not according to the image; the mobile terminal generates the augmented reality response information of the image according to a judgment result; the mobile terminal sends the augmented reality response information of the image to the intelligent wearing equipment; and the intelligent wearing equipment outputs the augmented reality information of the image. Through interaction between the intelligent wearing equipment and the mobile equipment, a user can determine whether the detected image can be subjected to the AR (Augmented Reality) processing without frequently taking out the mobile terminal. The method, the device and the system reduce the ineffective frequent operation of the user, improve the use efficiency of the AR processing and greatly improve the friendly experience of user operation.

Description

Reality strengthens information processing method, Apparatus and system

Technical field

The present invention relates to communication technical field, particularly relate to a kind of reality and strengthen information processing method, Apparatus and system.

Background technology

The world around us is very abundant, and waiting to understand on object has much numerical information, and available diverse ways visits the information of this object, such as: the title of query object or the descriptor by this object of search engine inquiry.Along with popularizing of mobile device, the mobile device had at present has kind of a function visit object information, this function is that reality strengthens (AugmentedReality is called for short AR) function.AR utilizes virtual information to carry out the technology of reality enhancing to real scene.The actual physical situation that AR collects based on the first-class sampler of shooting, by by the object of the information labeling of the virtual generations such as text, X-Y scheme, three-dimensional model in the actual physical situation shown by display screen, thus realize annotation, the explanation of the display physical environment that user is in, or strengthen, emphasize some effect of actual environment.

In prior art; this function carries out the acquisition of real information and the implementation procedure of AR function based on the mobile device of user usually; user needs to take out mobile device frequently, and then the environment around continuous sweep, thus determines whether detected object can carry out AR process.Thus cause and invalidly to operate frequently, reduce the service efficiency of AR process.

Summary of the invention

The technical problem to be solved in the present invention is that the real Enhancement Method in order to overcome prior art can not notify that real object around user whether can the defect that strengthens of reality automatically, provides a kind of reality to strengthen information processing method, Apparatus and system.

The present invention solves above-mentioned technical matters by following technical proposals:

A kind of reality strengthens information processing method, and its feature is, described method is applied to Intelligent worn device, and described method comprises the steps:

Described Intelligent worn device obtains image;

Described image is sent to mobile terminal by described Intelligent worn device;

The reality that described Intelligent worn device receives the described image that described mobile terminal sends strengthens response message, and the reality that the reality enhancing response message of described image comprises described image strengthens information;

The reality that described Intelligent worn device exports described image strengthens information.

Preferably, the reality enhancing packets of information of described image contains: reality strengthens result indication information;

When described reality strengthen result indication information strengthen for reality can be carried out time, then the reality that described Intelligent worn device exports described image strengthens information and specifically comprises: described Intelligent worn device exports the described indication information that can carry out real enhancing; Or,

When described reality strengthen result indication information export for parameter can be carried out time, then the reality that described Intelligent worn device exports described image strengthens information and specifically comprises: described Intelligent worn device exports the described indication information that can carry out reality enhancing; Or,

When described reality strengthen result indication information for cannot carry out reality and strengthen and cannot carry out parameter export time, then the reality that described Intelligent worn device exports described image strengthens information and specifically comprises: described Intelligent worn device exports the failed indication information of enhancing.

Preferably, after described Intelligent worn device obtains image, also comprise:

The characteristic information of described Intelligent worn device image according to described Image Acquisition;

Described image is sent to mobile terminal by described Intelligent worn device, comprising:

The characteristic information of described image is sent to described mobile terminal by described Intelligent worn device.

Preferably, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

Described Intelligent worn device is according to described image and obtained the characteristic information of described image by SURF method and FAST method.

Preferably, described image comprises: at least one secondary picture or video data.

When described image is described at least one secondary picture, described Intelligent worn device obtains the characteristic information of described at least one secondary picture according to described at least one secondary picture;

The characteristic information of described image is sent to described mobile terminal by described Intelligent worn device, comprising:

The characteristic information of described at least one secondary picture is sent to described mobile terminal by described Intelligent worn device.

When described image is described video data, described Intelligent worn device obtains the characteristic information of described video data according to described video data;

The characteristic information of described video data is sent to described mobile terminal by described Intelligent worn device.

Preferably, the reality that described Intelligent worn device exports described image strengthens information, comprising:

The reality that described Intelligent worn device shows described image by display screen strengthens information; And/or,

The reality that described Intelligent worn device plays described image by microphone strengthens information; And/or,

The reality that described Intelligent worn device exports described image by Vib. strengthens information.

Preferably, before described Intelligent worn device obtains image, also comprise any one step following:

Described Intelligent worn device receives the first image acquisition operations instruction that user sends; Or,

Described Intelligent worn device receives the second image acquisition operations instruction that described mobile terminal sends.

Another technical scheme of the present invention is: a kind of reality strengthens information processing method, and its feature is, described method is applied to mobile terminal, and described method comprises the steps:

Described mobile terminal receives the described image that Intelligent worn device sends;

According to described image, described mobile terminal judges whether that can carry out reality strengthens process;

The reality that described mobile terminal generates described image according to judged result strengthens response message;

The reality that described mobile terminal sends described image to described Intelligent worn device strengthens response message, and the reality that the reality enhancing response message of described image comprises described image strengthens information.

Preferably, according to described image, described mobile terminal judges whether that can carry out reality strengthens process, then also comprise:

Described mobile terminal carries out reality to described image and strengthens display.

Preferably, according to described image, described mobile terminal judges whether that can carry out reality strengthens process, comprising:

Described mobile terminal searches whether there is the virtual information corresponding with described image according to described image in virtual information database;

If there is the virtual information that described image is corresponding, then described mobile terminal determines that can carry out reality strengthens process;

If there is not the virtual information that described image is corresponding, then described mobile terminal searches whether there is the parameter corresponding with described image according to described image in parameter database;

If there is the parameter that described image is corresponding, then described mobile terminal is determined to carry out parameter output;

If there is not the parameter that described image is corresponding, then described mobile terminal determines that cannot carry out reality strengthens and cannot carry out parameter output.

When described mobile terminal determines that can carry out reality strengthens process, then described reality strengthens result indication information is can carry out reality to strengthen;

When described mobile terminal is determined to carry out parameter output, then described reality strengthens result indication information for carrying out reality enhancing;

When described mobile terminal determines that cannot carry out reality strengthens and cannot carry out parameter output, then described reality strengthens result indication information for cannot carrying out reality enhancing and cannot carrying out parameter output.

Preferably, described mobile terminal searches whether there is the virtual information corresponding with described image according to described image in virtual information database, comprising:

Described mobile terminal view-based access control model is searched technology and physical feature track algorithm and in virtual information database, is searched whether there is the virtual information corresponding with described image according to described image.

Preferably, described mobile terminal searches whether there is the parameter corresponding with described image according to described image in parameter database, comprising:

Described mobile terminal view-based access control model is searched technology and physical feature track algorithm and in parameter database, is searched whether there is the parameter corresponding with described image according to described image.

Preferably, described mobile terminal receives the described image that Intelligent worn device sends, and comprising:

Described mobile terminal receives the characteristic information of the described image that described Intelligent worn device sends.

According to described image, described mobile terminal judges whether that can carry out reality strengthens process, comprising:

According to the characteristic information of described image, described mobile terminal judges whether that can carry out reality strengthens process.

Preferably, when described image is described at least one secondary picture, the characteristic information of described image is the characteristic information of described at least one secondary picture;

When described image is described video data, the characteristic information of described image is the characteristic information of described video data.

Preferably, described mobile terminal carries out reality to described image and strengthens display, comprising:

When described image is described at least one secondary picture, then described mobile terminal carries out reality to described at least one secondary picture and strengthens display;

When described image is described video data, then described mobile terminal carries out reality to described video data and strengthens display.

Preferably, receive the described image of Intelligent worn device transmission at described mobile terminal before, also comprise:

Described mobile terminal receives the reality enhancing operation instruction that user sends;

Described mobile terminal strengthens operation instruction according to described reality, sends image acquisition operations instruction to described Intelligent worn device.

Another technical scheme of the present invention is: a kind of reality strengthens information processing method, and its feature is, described method is applied to real enhancing system, and described real enhancing system, comprise Intelligent worn device and mobile terminal, described method comprises the steps:

Described Intelligent worn device obtains image;

The reality that described mobile terminal sends described image to described Intelligent worn device strengthens response message, and the reality that the reality enhancing response message of described image comprises described image strengthens information;

The characteristic information of described image is sent to described mobile terminal by described Intelligent worn device;

Described mobile terminal receives the characteristic information of described image.

Preferably, according to the characteristic information of described image, described mobile terminal judges whether that can carry out reality strengthens process, comprising:

Described mobile terminal searches whether there is virtual information corresponding to described image according to the characteristic information of described image in virtual information database;

If there is not the virtual information that described image is corresponding, then described mobile terminal searches whether be present in parameter corresponding to described image according to the characteristic information of described image in parameter database;

Preferably, described mobile terminal searches whether there is the virtual information corresponding with described image according to the characteristic information of described image in virtual information database, comprising:

Described mobile terminal view-based access control model searches technology and physical feature track algorithm searches whether there is the virtual information corresponding with described image in virtual information database.

Preferably, described mobile terminal searches whether there is the parameter corresponding with described image according to the characteristic information of described image in parameter database, comprising:

Described mobile terminal view-based access control model searches technology and physical feature track algorithm searches whether there is the parameter corresponding with described image in parameter database.

When described mobile terminal determines that cannot carry out reality strengthens and cannot carry out parameter output, then described reality strengthens result indication information for carrying out reality enhancing.

Preferably, after described Intelligent worn device exports the reality enhancing information of described image, also comprise any one step following:

Described mobile terminal strengthens operation instruction according to described reality, carries out reality strengthen display to described image.

The present invention also comprises the Intelligent worn device that a kind of reality strengthens, and its feature is, described Intelligent worn device comprises:

Acquisition module, for obtaining image;

Sending module, for sending to mobile terminal by described image;

Receiver module, strengthens response message for the reality receiving the described image that described mobile terminal sends, and the reality that the reality enhancing response message of described image comprises described image strengthens information;

Output module, strengthens information for the reality exporting described image.

When described reality strengthens result indication information for carrying out reality enhancing, described output module is for exporting the described indication information that can carry out reality and strengthen; Or,

When described reality strengthens result indication information for carrying out parameter output, described output module is for exporting the described indication information that can carry out reality and strengthen; Or,

When described reality strengthens result indication information for cannot carrying out reality enhancing and cannot carrying out parameter output, described output module strengthens failed indication information for exporting.

Preferably, also comprise in described Intelligent worn device: characteristic information acquisition module, for the characteristic information of image according to described Image Acquisition;

Described sending module is also for sending to described mobile terminal by the characteristic information of described image.

Preferably, described characteristic information acquisition module obtains the characteristic information of described image according to described image by SURF method and FAST method.

Preferably, when described image is described at least one secondary picture, described characteristic information acquisition module is used for the characteristic information obtaining described at least one secondary picture according to described at least one secondary picture;

Described sending module is used for the characteristic information of described at least one secondary picture to send to described mobile terminal.

Preferably, when described image is described video data, described characteristic information acquisition module is used for the characteristic information obtaining described video data according to described video data;

Described sending module is used for the characteristic information of described video data to send to described mobile terminal.

Preferably, described output module is display screen, and described display screen strengthens information for the reality showing described image; And/or,

Described output module is microphone, and described microphone strengthens information for the reality playing described image; And/or,

Described output module is Vib., and described Vib. strengthens information for the reality exporting described image.

Preferably, before described acquisition module obtains image, described receiver module is also for receiving the first image acquisition operations instruction that user sends; Or,

Described receiver module is also for receiving the second image acquisition operations instruction that described mobile terminal sends.

The present invention also comprises the mobile terminal that a kind of reality strengthens, and its feature is, described mobile terminal comprises:

Receiver module, for receiving the image that Intelligent worn device sends;

Judge module, for judging whether that according to described image can carry out reality strengthens process;

Reality strengthens response message generation module, strengthens response message for the reality generating described image according to judged result;

Sending module, strengthens response message for the reality sending described image to described Intelligent worn device, and the reality that the reality enhancing response message of described image comprises described image strengthens information.

Preferably, described mobile terminal also comprises display module, strengthens display for carrying out reality according to the judged result of described judge module to described image.

Preferably, it is characterized in that, described judge module also comprises searches module, is the virtual information corresponding with described image for searching in virtual information database according to described image;

If there is the virtual information that described image is corresponding, described judge module determines that can carry out reality strengthens process;

If there is not the virtual information that described image is corresponding, described in search module also for searching the parameter corresponding with described image according to described image in parameter database;

If there is the parameter that described image is corresponding, described judge module is determined to carry out parameter output;

If there is not the parameter that described image is corresponding, described judge module determines that cannot carry out reality strengthens and cannot carry out parameter output.

When described judge module determines that can carry out reality strengthens process, described reality strengthens result indication information and strengthens for carrying out reality;

When described judge module is determined to carry out parameter output, described reality strengthens result indication information and strengthens for carrying out reality;

When described judge module determines that cannot carry out reality strengthens and cannot carry out parameter output, described reality strengthens result indication information and strengthens for carrying out reality and cannot carry out parameter output.

Preferably, search module view-based access control model described in search technology and physical feature track algorithm and in virtual information database, search the virtual information corresponding with described image according to described image.

Preferably, search module view-based access control model described in search technology and physical feature track algorithm and in parameter database, search the parameter corresponding with described image according to described image.

Preferably, described receiver module is also for receiving the characteristic information of the described image that described Intelligent worn device sends;

Described judge module is also for judging whether that according to the characteristic information of described image can carry out reality strengthens process.

Preferably, when described image is described at least one secondary picture, described display module is used for carrying out reality to described at least one secondary picture and strengthens display;

When described image is described video data, described display module is used for carrying out reality to described video data and strengthens display.

Preferably, receive the described image of described Intelligent worn device transmission at described receiver module before, the reality that described receiver module also sends for receiving user strengthens operation instruction;

Described sending module also sends image acquisition operations instruction for strengthening operation instruction according to described reality to described Intelligent worn device.

The present invention also comprises a kind of real enhancing system, and its feature is, described real enhancing system comprises Intelligent worn device and mobile terminal;

Described Intelligent worn device comprises: acquisition module, for obtaining image;

Described mobile terminal comprises: judge module, reality strengthen response message generation module, the first sending module;

Described judge module is used for judging whether that can carry out reality strengthens process according to described image; Described reality strengthens the reality enhancing response message that response message generation module is used for generating according to judged result described image; The reality that described first sending module is used for sending to described Intelligent worn device described image strengthens response message, and the reality that the reality enhancing response message of described image comprises described image strengthens information;

Described Intelligent worn device also comprises: output module, for exporting described real enhancing information.

Preferably, described Intelligent worn device also comprises: characteristic information acquisition module, the second sending module;

Described characteristic information acquisition module is used for the characteristic information of image according to described Image Acquisition; Described second sending module is used for the characteristic information of described image to send to described mobile terminal;

Described mobile terminal also comprises receiver module, for receiving the characteristic information of described image.

Preferably, when described image is described at least one secondary picture, described characteristic information acquisition module obtains the characteristic information of described at least one secondary picture according to described at least one secondary picture;

Described second sending module is used for the characteristic information of described at least one secondary picture to send to described mobile terminal.

Preferably, when described image is described video data, described characteristic information acquisition module obtains the characteristic information of described video data according to described video data;

Described second sending module is used for the characteristic information of described video data to send to described mobile terminal.

Preferably, described judge module also comprises searches module, searches the virtual information corresponding with described image for the characteristic information according to described image in virtual information database;

If there is the virtual information that described image is corresponding, then described judge module determines that can carry out reality strengthens process;

If there is not the virtual information that described image is corresponding, then search module described in also for searching the parameter corresponding with described image according to the characteristic information of described image in parameter database;

If there is the parameter that described image is corresponding, then described judge module is determined to carry out parameter output;

If there is not the parameter that described image is corresponding, then described judge module determines that cannot carry out reality strengthens and cannot carry out parameter output.

Preferably, search module view-based access control model described in and search technology and physical feature track algorithm searches the virtual information corresponding with described image in virtual information database.

Preferably, search module view-based access control model described in and search technology and physical feature track algorithm searches the parameter corresponding with described image in parameter database.

When described judge module determines that can carry out reality strengthens process, then described reality strengthens result indication information is can carry out reality to strengthen;

When described judge module is determined to carry out parameter output, then described reality strengthens result indication information for carrying out reality enhancing;

When described judge module determines that cannot carry out reality strengthens and cannot carry out parameter output, then described reality strengthens result indication information for carrying out reality enhancing.

Preferably, after described output module exports the reality enhancing information of described image,

Described receiver module, the reality also sent for receiving user strengthens operation instruction;

Described display module, strengthens display for carrying out reality to described image.

Preferably, when described image is described at least one secondary picture, then described display module carries out reality to described at least one secondary picture and strengthens display;

When described image is described video data, then display module carries out reality to described video data and strengthens display.

Positive progressive effect of the present invention is: in the present invention, image spontaneously can be sent to mobile terminal by Intelligent worn device to interested object acquisition image by user, mobile terminal judges whether reality to strengthen process according to the image received, and judged result is spontaneously fed back to Intelligent wearable equipment, the judged result that user exports according to Intelligent worn device, can decide in its sole discretion and whether carry out reality enhancing display to image.In this process, mutual by Intelligent worn device and mobile terminal, user does not need frequently to take out mobile terminal, just can determine whether the image detected can carry out AR process.Method of the present invention, Apparatus and system, decrease that user is invalid to be operated frequently, improves the service efficiency of AR process, and the close friend substantially increasing user operation experiences.

Accompanying drawing explanation

Fig. 1 is the process flow diagram of the information processing method of the embodiment of the present invention 1.

Fig. 2 is the process flow diagram of the information processing method of the embodiment of the present invention 2.

Fig. 3 is the process flow diagram of the information processing method of the embodiment of the present invention 3.

Fig. 4 is the process flow diagram of the information processing method of the embodiment of the present invention 5.

Fig. 5 is the process flow diagram of the information processing method of the embodiment of the present invention 6.

Fig. 6 is the process flow diagram of the information processing method of the embodiment of the present invention 8.

Fig. 7 is the process flow diagram of the information processing method of the embodiment of the present invention 9.

Fig. 8 is the process flow diagram of the information processing method of the embodiment of the present invention 10.

Fig. 9 is the structural representation of the reality enhancing system of the embodiment of the present invention 12.

Figure 10 is the structural representation of the reality enhancing system of the embodiment of the present invention 13.

Figure 11 is the structural representation that the reality of the embodiment of the present invention 13 strengthens in the intelligent watch of system and mobile phone.

Figure 12 is the structural representation of the Intelligent worn device of the embodiment of the present invention 14.

Figure 13 is the structural representation of the Intelligent worn device of the embodiment of the present invention 15.

Figure 14 is the structural representation of the mobile terminal of the embodiment of the present invention 16.

Figure 15 is the structural representation of the mobile terminal of the embodiment of the present invention 17.

Embodiment

Mode below by embodiment further illustrates the present invention, but does not therefore limit the present invention among described scope of embodiments.

Embodiment 1

Fig. 1 shows a kind of reality and strengthens information processing method, and the method is applied to real enhancing system, and described real enhancing system, comprise Intelligent worn device and mobile terminal, described method comprises the steps:

Step S100, Intelligent worn device obtains image;

Step S101, the image of acquisition is sent to mobile terminal by Intelligent worn device;

Step S102, according to image, mobile terminal judges whether that can carry out reality strengthens process;

Step S103, mobile terminal strengthens response message according to the reality of judged result synthetic image;

Step S104, the reality that mobile terminal sends image to described Intelligent worn device strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information;

Step S105, the reality of Intelligent worn device output image strengthens information.

Intelligent worn device mentioned here can for having wrist-watch, the bracelet or glasses etc. of shoot function, and mobile terminal is mobile phone or the flat board with the information processing function.And the information transmission of Intelligent worn device and mobile terminal can be realized by wireless, bluetooth, the mode such as zigbee (wireless communication technology of a kind of short distance, low-power consumption), WPAN (a kind of adopt the PAN (Personal Area Network) of wireless connections).

Image in the present embodiment is also the object in the interested true environment of user, image spontaneously can be sent to mobile terminal by Intelligent worn device to interested object acquisition image by user, mobile terminal judges whether reality to strengthen process according to the image received, and judged result is spontaneously fed back to Intelligent wearable equipment, the judged result that user exports according to Intelligent worn device, can decide in its sole discretion and whether carry out reality enhancing display to image.In this process, mutual by Intelligent worn device and mobile terminal, user does not need frequently to take out mobile terminal, just can determine whether the image detected can carry out AR process.Visible, this embodiment reduces that user is invalid to be operated frequently, improve the service efficiency of AR process.

Embodiment 2

Embodiment 2 is substantially the same manner as Example 1, and as shown in Figure 2, difference is that reality strengthens information processing method and also comprises: step S106, mobile terminal carries out reality to image and strengthens display.When by step S105, user learns that image really can strengthen process, user can take out mobile terminal and carry out reality enhancing display to image, to learn some relevant information of oneself interested object, such as user is interested is a strain plant, strengthen process by reality, user can learn kind, age, growing environment etc. the relevant information of this strain plant.

Preferably, Intelligent worn device exports real enhancing information can by multiple implementation, provide several possible implementation below to be exemplarily illustrated: in step S105, Intelligent worn device can show the reality enhancing information of image by display screen, information can be strengthened by the reality of microphone playing image, information can be strengthened by the reality of Vib. output image, can also, by the array mode of above-mentioned three kinds of modes, can certainly be that the mode that other can realize informs whether user images can carry out reality and strengthen display.

Further, according to the processing power of Intelligent worn device, it can be that reality strengthens result indication information or reality strengthens result data that the reality of described image strengthens information; Wherein, when Intelligent worn device does not possess the ability of directly display reality enhancing effect, may be used for exporting and strengthen relevant reality strengthen result indication information with real, such as, when mobile terminal can carry out reality enhancing process, by the simple reality of Intelligent worn device display strengthen result indication information as, " reality strengthens successfully " or " real strengthen unsuccessfully " etc.; When Intelligent worn device possesses the ability of directly display reality enhancing effect, Intelligent worn device directly can show reality and strengthen result data; Such as, Intelligent worn device by obtaining image, and carries out reality enhancing process on the basis of this image, and is shown by the display device of result by Intelligent worn device.Wherein, concrete reality strengthens process and can be realized by mobile terminal, and Intelligent worn device is only as acquisition equipment and the final display device of reality enhancing of image; Or this reality is strengthened process and also can be realized by Intelligent worn device self.It should be noted that, in order to realize above-mentioned functions, need to carry out particular design and improvement to the hardware of Intelligent worn device, the present embodiment will not limit for its specific implementation.

Wherein, when Intelligent worn device does not possess directly display reality enhancing effect, it is that reality strengthens result indication information that the reality of described image strengthens information, and optionally, in this step S105, the reality enhancing packets of information of image strengthens result indication information and tracking configuration information containing reality.Reality strengthens result indication information and is the judged result whether figure can carry out real enhancing display, is divided into two kinds, namely can carry out reality and strengthens and can not carry out reality enhancing.Follow the tracks of configuration information and comprise the latitude and longitude information of true environment residing for mobile terminal, positional information or parameter information, following the tracks of configuration information can be obtained by the GPS in mobile terminal.Follow the tracks of configuration information and can inform the actual environment geographic position that user is in, user can select display according to demand voluntarily and not show.

In addition, whether step S106 can realize will according to the judged result of step S103.

In virtual information database, whether can find the virtual information corresponding with image according to mobile terminal, the judged result of step S103 is divided into three kinds:

If 1 exists the virtual information corresponding with image, then mobile terminal determines that can carry out reality to this image strengthens process, and reality enhancing result indication information strengthens for carrying out reality.

If 2 do not exist the virtual information corresponding with image, then mobile terminal searches whether there is the parameter corresponding with image according to image in parameter database, if there is the parameter corresponding with image, then mobile terminal is determined to carry out parameter output; Reality strengthens instruction result and strengthens for carrying out reality.

If 3 do not exist the parameter corresponding with image, then mobile terminal determines that this image cannot carry out reality and strengthens and cannot carry out parameter output.Reality strengthens instruction result and strengthens for carrying out reality.

Wherein, virtual information can be the information such as stereo-picture, three-dimensional information, motion graphics, and the parameter that image is corresponding can be data message, simple graphical information etc.

Further, mobile terminal needs maintenance virtual information database and parameter database; Wherein, virtual information database is used for the relevant information of storage figure picture and corresponding virtual information; Parameter database is used for the relevant information of storage figure picture and corresponding parameter; For these two kinds of databases, corresponding relation wherein can be one to one, one-to-many or multi-to-multi.

Optionally, for virtual information database and parameter database, the database had in existing mobile phone can be utilized, also can increase new database; Two databases can be the Different Logic subregion of a database; Or, also can be completely independently two databases; The present embodiment will not limit.

Further, the virtual information lookup method of image and the parameter information lookup method of image, can search technology and physical feature track algorithm for view-based access control model, but be not limited thereto method.Image recognition and the advantage of tracking aspect combine with the powerful performance of current cloud computing by Visual search technology (CVS, ContinuousVisualSearch), can realize retrieval and the tracking of mass picture.Physical feature track algorithm needs to carry out physical feature to image and extracts and another image that coupling is identical with above-mentioned physical feature in a database, and another image can as the virtual information of initial pictures.

It should be noted that, if Intelligent worn device directly can show real enhancing information, then step S103 also can be performed by this Intelligent worn device.

Embodiment 3

Embodiment 3 is substantially the same manner as Example 2, as shown in Figure 3, after difference is step S100, also comprises: step S1011, and Intelligent worn device is according to the characteristic information of Image Acquisition image.

Concrete, image mentioned here can be at least one width picture or video data.After Intelligent worn device obtains image, do not need directly complete for image to be sent to mobile terminal; For mobile terminal, some characteristic informations only by image both can judge whether that can carry out reality strengthened process.

Acquisition methods based on SURF method and FAST method, but can be not limited to the method.Utilize FAST algorithm to extract feature and there is fireballing advantage but robustness is poor, and the high robust of SURF algorithm compensate for the instability of FAST algorithm, in this programme, image is calculated possible feature angle point by FAST algorithm, bring SURF algorithm into the feature angle point extracted to calculate, the characteristic dimension information of angle point can be extracted like this.The benefit done so only on feature angle point, carries out complicated convolutional calculation, reduce the calculated amount in a large amount of non-unique point, thus greatly accelerate and detect and the speed of matching process, be particularly suitable for responding and resource-constrained mobile terminal on carry out image procossing.

Step S1012, the characteristic information of image is sent to mobile terminal by Intelligent worn device.

Step S1013, mobile terminal receives the characteristic information of image.

According to the characteristic information of the image received, step S102 mobile terminal can judge whether that can carry out reality strengthens display.Processing mobile terminal information is generally based on number language, the characteristic information of image is sent to mobile terminal by Intelligent worn device, eliminate mobile terminal and image is converted into numerical information, improve the information processing efficiency of mobile terminal, improve the judgement speed of mobile terminal.And the data payload reduced between Intelligent worn device and mobile terminal.

When image is at least one secondary picture, in step S1011, Intelligent worn device obtains its characteristic information according at least one secondary picture, and meanwhile, in step S1012, this characteristic information is sent to mobile terminal by Intelligent worn device.

Concrete, if image is a secondary picture, then by extracting the characteristic information in this picture, as the characteristic etc. in facial image, and these characteristic informations can be sent to mobile terminal.

When image is video data, in step S1011, Intelligent worn device obtains its characteristic information according to video data, and meanwhile, in step S1012, this characteristic information is sent to mobile terminal by Intelligent worn device.

Concrete, if image is one section of video data, can pass through to extract some frame wherein, as key frame etc.; A frame or certain several frame data are sent to mobile terminal.

Transmission between Intelligent worn device and mobile terminal, reception information can carry out information transmission by wireless, bluetooth, zigbee, WPAN etc.

Embodiment 4

At Intelligent worn device and mobile terminal for after whether can carrying out judgement that reality strengthens, based on the result judged, mobile terminal can carry out further interactive operation with user, concrete, the present embodiment 4 provides a kind of feasible implementation: after step S105, also comprises any one step following:

Mobile terminal receives the reality enhancing operation instruction that user sends;

Mobile terminal strengthens operation instruction according to reality, carries out reality strengthen display to image.

If by Intelligent worn device, user learns that image can carry out reality and strengthen, then can take out mobile terminal and find out this image, also can obtain image separately by mobile terminal, and to mobile terminal transmit operation instruction, then mobile terminal realizes strengthening display to the reality of above-mentioned image.

Concrete, the reality that user sends strengthen operation instruction can but be not defined as following any one or combination: user by the touch-screen of mobile terminal to slide and/or the specific region of clicking operation, thus the reality formed strengthens operation instruction; Or user also can input speech-controlled information by Mike, mobile terminal identification speech-controlled information, and carry out reality enhancing display based on the image that the execution of this speech-controlled information is corresponding.

Wherein, mobile terminal carries out reality to image and strengthens display, comprising:

When image is described at least one secondary picture, then mobile terminal carries out reality at least one secondary picture and strengthens display; When image is video data, then mobile terminal carries out reality to video data and strengthens display.

Take Intelligent worn device as intelligent watch, mobile terminal is mobile phone is example, when intelligent watch photographed a NBA picture, this picture is sent to mobile phone, and mobile phone judges whether this picture can carry out reality and strengthen.And judged result is fed back to intelligent watch, if result is reality to strengthen, then user can take out mobile phone, finds this NBA picture and send reality by interactive interface to mobile phone to strengthen operation instruction.Mobile phone carries out reality to this NBA picture and strengthens display, such as, by ball match information corresponding to NBA picture, soccer star's information superposition on this NBA picture; Also can trigger and play the video corresponding with this NBA picture; And on this video Overlapping display relevant information.

Embodiment 5

After the description of above-described embodiment, below by specific embodiment, the Intelligent worn device in above-mentioned real enhancing system is described.

As shown in Figure 4, the method for the present embodiment comprises the steps:

Step S201, Intelligent worn device obtains image;

Step S202, image is sent to mobile terminal by Intelligent worn device;

Step S203, the reality of the image that Intelligent worn device mobile terminal receive sends strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information;

Step S204, the reality of Intelligent worn device output image strengthens information.

The reality that the present embodiment provides strengthens information processing method, user can send to mobile terminal by Intelligent worn device to interested object acquisition image and by image, the reality of the image of Intelligent worn device mobile terminal receive transmission afterwards strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information; The reality of final Intelligent worn device output image strengthens information.In this process, mutual by Intelligent worn device and mobile terminal, user does not need frequently to take out mobile terminal, just can determine whether the image detected can carry out AR process.Visible, this embodiment reduces that user is invalid to be operated frequently, improve the service efficiency of AR process.

Further, the reality of the image in step S203 strengthens information and can comprise: reality strengthens result indication information or display strengthens result data.For the application scenarios of the two, be described in detail above, repeated no more herein.

Concrete, when reality strengthens result indication information for carrying out reality enhancing, then in step S204, Intelligent worn device exports the indication information that can carry out reality and strengthen; When reality strengthens result indication information for carrying out parameter output, then step S204 Intelligent worn device exports the indication information that can carry out reality and strengthen; When reality strengthens result indication information for cannot carrying out reality enhancing and cannot carrying out parameter output, then step S204 Intelligent worn device exports and strengthens failed indication information.

The reality of step S204 Intelligent worn device output image strengthens information, the reality enhancing information of image can be shown by display screen, information can be strengthened by the reality of microphone playing image, information can be strengthened by the reality of Vib. output image, can also, by the array mode of above-mentioned three kinds of modes, can certainly be the mode that other can realize.

Intelligent worn device send image and receive real enhancing information can by wireless, bluetooth, zigbee, WPAN etc. are spontaneous carries out, and without the need to user's manual operation, decrease that user is invalid to be operated frequently.

Embodiment 6

Embodiment 6 is substantially the same manner as Example 5, and as shown in Figure 5, difference is, step S201 Intelligent worn device also comprises the characteristic information of step S2011 Intelligent worn device according to Image Acquisition image after obtaining image.Image is sent to mobile terminal by step S202 Intelligent worn device, comprises step S2021 Intelligent worn device and the characteristic information of image is sent to mobile terminal.

Intelligent worn device obtains the characteristic information of image and this characteristic information is sent to mobile terminal, eliminates mobile terminal and image is converted into numerical information, improve the operational efficiency of mobile terminal.And the data payload reduced between Intelligent worn device and mobile terminal.

Wherein, step S2011 can be, but not limited to the characteristic information being obtained image by SURF method and FAST method.

In addition, image can be at least one secondary picture or video data.

When image is at least one secondary picture, step S2011 Intelligent worn device obtains the characteristic information of at least one secondary picture, and the characteristic information of at least one secondary picture is sent to mobile terminal by step S2021 Intelligent worn device.

When image is video data, step S2011 Intelligent worn device obtains the characteristic information of video data, and the characteristic information of video data is sent to mobile terminal by step S2021 Intelligent worn device.

Embodiment 7

For obtaining the trigger mechanism of image, its implementation is diversified, below the present embodiment provide several possible implementation to be described the trigger mechanism obtaining image: before step S201, also comprise any one step following:

Mode one: Intelligent worn device receives the first image acquisition operations instruction that user sends;

Mode two: the second image acquisition operations instruction that Intelligent worn device mobile terminal receive sends.

Concrete, mode one difference main with mode two is that in the present embodiment, this main body can think that Intelligent worn device also can be mobile terminal by which equipment as the main body receiving user operation and indicate; When main body is Intelligent worn device, then adopt mode one, namely user inputs the first image acquisition operations instruction by input equipments such as the button of Intelligent worn device, touch-screen or Mikes to this Intelligent worn device; When main body is mobile terminal, then adopt mode two, namely user strengthens operation instruction by input equipments such as the button of mobile terminal, touch-screen or Mikes to this mobile terminal input reality, and strengthen operation instruction by this mobile terminal according to this reality, send the second image acquisition operations instruction to Intelligent worn device.

Further, if user is to the subject interests in actual environment, want that carrying out reality to this object strengthens, then directly can send to Intelligent worn device the operation instruction obtaining image, be exactly generally utilize Intelligent worn device to take pictures to interested object or photograph.Also can pass through mobile terminal, namely user takes out mobile terminal and Intelligent worn device is sent to the operation instruction obtaining image, and Intelligent worn device obtains image according to this operation instruction.

Embodiment 8

After the description of above-described embodiment, below by specific embodiment, the mobile terminal in above-mentioned real enhancing system is described.As shown in Figure 6, the method for the present embodiment comprises the steps:

Step S301, mobile terminal receives the image that Intelligent worn device sends;

Step S302, according to image, mobile terminal judges whether that can carry out reality strengthens process;

Step S303, mobile terminal strengthens response message according to the reality of judged result synthetic image;

Step S304, the reality that mobile terminal sends image to Intelligent worn device strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information.

Reality that the present embodiment provides strengthens information processing method, and user is by Intelligent worn device to interested object acquisition image and by image and after sending to mobile terminal, and mobile terminal judges whether to carry out reality according to image to be strengthened and process; Mobile terminal strengthens response message according to the reality of judged result synthetic image; The reality that final mobile terminal sends image to Intelligent worn device strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information.In this process, mutual by Intelligent worn device and mobile terminal, user does not need frequently to take out mobile terminal, just can determine whether the image detected can carry out AR process.Visible, this embodiment reduces that user is invalid to be operated frequently, improve the service efficiency of AR process.

Optionally, the reality of the image in step S304 strengthens packets of information and contains: reality strengthens result indication information or reality strengthens result data.For the application scenarios of the two, be described in detail above, repeated no more herein.

When step S302 judges that image can carry out reality and strengthen process, then reality strengthens result indication information is can carry out reality to strengthen; When step S302 judges that image can carry out parameter output, then reality strengthens result indication information for can carry out parameter output; When step S302 judges that image cannot carry out reality and strengthens and cannot carry out parameter output, then reality strengthens result indication information for cannot carrying out reality enhancing and cannot carrying out parameter output.

Embodiment 9

Embodiment 9 is substantially the same manner as Example 8, and as shown in Figure 7, difference is, also comprises after step S304: step S305 mobile terminal carries out reality to image and strengthens display.

User sends real enhancing information according to mobile terminal to Intelligent worn device, can learn that can image carry out reality and strengthen display, if can, then user can take out mobile terminal, and carries out reality enhancing display to image.

Concrete, when step S302 judges that image can carry out reality and strengthen process, mobile terminal carries out reality to image and strengthens process, and the result after process is shown by the display screen of mobile terminal; Or the result after process is sent to Intelligent worn device by mobile terminal, is shown by Intelligent worn device; Or mobile terminal informs that Intelligent worn device can be carried out reality and be strengthened, and then carries out reality enhancing by Intelligent worn device to this image, and is shown by the display screen of result by Intelligent worn device.

Embodiment 10

Further, for " mobile terminal judges whether to carry out reality according to image and strengthens process " in step S302, it can have multiple implementation, below by specific embodiment, step 302 is described, as shown in Figure 8, step S302 comprises step S3021 mobile terminal and in virtual information database, searches whether there is the virtual information corresponding with image and parameter according to image.According to the virtual information and parameter that whether there is image, step S302 judges whether image can carry out reality and strengthen process.

If there is the virtual information corresponding with image, then mobile terminal determines that can carry out reality strengthens process; If there is not the virtual information that described image is corresponding, then mobile terminal searches whether there is the parameter corresponding with image according to image in parameter database; If there is the parameter that described image is corresponding, then described mobile terminal is determined to carry out parameter output; If there is not the parameter that described image is corresponding, then mobile terminal determines that cannot carry out reality strengthens and cannot carry out parameter output.

Wherein, the virtual information of image is searched and the parameter of image is searched and can be searched technology and physical feature track algorithm by view-based access control model, but is not limited to the method.

If there is the characteristic information of image, step S301 also comprises the characteristic information that mobile terminal receives the image that Intelligent worn device sends; Step S302 comprises mobile terminal and judges whether that can carry out reality strengthens process according to the characteristic information of image.

Wherein image can comprise: at least one secondary picture or video data.

When described image is at least one secondary picture, step S301 receives the characteristic information of at least one secondary picture that Intelligent worn device sends; According to the characteristic information of at least one secondary picture, step S302 judges whether that can carry out reality strengthens process.

When image is video data, step S301 receives the characteristic information of the video data that Intelligent worn device sends; According to the characteristic information of video data, step S302 judges whether that can carry out reality strengthens process.

Judge that can carry out reality strengthens process, improves judging efficiency and accuracy by the characteristic information of image.

It should be noted that, for the processing mode of picture or video, be described in detail in above-described embodiment, repeated no more herein.

Embodiment 11

For obtaining the trigger mechanism of image, its implementation is diversified, below the present embodiment provide a kind of possible implementation to be described the trigger mechanism obtaining image: before step S301, also comprise:

Mobile terminal strengthens operation instruction according to reality, sends image acquisition operations instruction to Intelligent worn device.

It should be noted that, this acquisition operation instruction is the second image acquisition operations instruction mentioned above.

If user wants that carrying out reality to the object in actual environment strengthens display, then can take out mobile terminal and send reality enhancing operation instruction, correspondingly mobile terminal sends image acquisition operations instruction according to this instruction to Intelligent worn device, thus Intelligent worn device obtains the interested image of user.

Embodiment 12

Above embodiment described a kind of reality and strengthen information processing method, the method strengthens information handling system by reality and performs, and this system can comprise Intelligent worn device and mobile terminal, namely relates to Intelligent worn device and mobile terminal in method above; Further, in order to realize the mutual of data, access network equipment (such as, hotspot device, base station, little base station, trunking etc.), equipment of the core network (such as, gateway device, server etc.) also may can be related to; Given this, the equipment that subordinate's embodiment may relate to for this programme does not describe one by one, is only exemplarily described with an Intelligent worn device and a mobile terminal, and for the equipment that other are relevant, the present embodiment will not limit.

Further, Fig. 9 shows a kind of real enhancing system, comprises Intelligent worn device 1 and mobile terminal 2.Wherein Intelligent worn device 1 comprises acquisition module 11, output module 12; Mobile terminal 2 comprises judge module 21, reality strengthens response message generation module 22, first sending module 23.

Concrete, the Intelligent worn device 1 shown in Fig. 9 can perform the method step that in each embodiment of the method above, Intelligent worn device performs as executive agent, realizes the technique effect of correspondence; Mobile terminal 2 can perform the method step that in each embodiment of the method above, mobile terminal performs as executive agent, realizes corresponding technique effect.

Acquisition module 22 is for obtaining image; Judge module 21 is for judging whether that according to image can carry out reality strengthens process; Reality strengthens response message generation module 22 and strengthens response message for the reality generating described image according to judged result; First sending module 23 strengthens response message for the reality sending image to Intelligent worn device 1, and the reality that the reality enhancing response message of image comprises image strengthens information; Output module 12, the reality for output image strengthens information.

In the present embodiment, mutual by Intelligent worn device 1 and mobile terminal 2, user is easy to just to know whether the image oneself obtained can carry out reality and strengthen, without the need to frequently taking out mobile terminal 2, improve the service efficiency of AR process, the close friend substantially increasing user operation experiences.

Embodiment 13

Embodiment 13 is substantially the same manner as Example 12, on the basis of Fig. 9, Figure 10 provides the way of realization of another kind of real enhancing system, as shown in Figure 10, mobile terminal also comprises display module 24, receiver module 25, judge module 21 in mobile terminal comprises searches module 211, and Intelligent worn device 1 also comprises characteristic information acquisition module 13, second sending module 14.Characteristic information acquisition module 13 is for the characteristic information according to Image Acquisition image.Second sending module 14 is for sending to mobile terminal 2 by the characteristic information of image.Receiver module 25 is for receiving the characteristic information of described image, and the reality also sent for receiving user strengthens operation instruction.Search module 211 and in associated databases, search the virtual information corresponding with image and parameter for basis.Display module 24 strengthens display for carrying out reality according to the judged result of judge module to image.

The image that Intelligent worn device 1 obtains comprises at least one secondary picture or video data.When image is at least one secondary picture, characteristic information acquisition module 13 obtains the characteristic information of at least one secondary picture according at least one secondary picture, the characteristic information of at least one secondary picture is sent to the receiver module 25 of mobile terminal 2 by the second sending module 14, and receiver module 25 receives the characteristic information of at least one secondary picture.When image is video data, characteristic information acquisition module 13 obtains the characteristic information of video data according to video data, second sending module 14 is for sending to the receiver module 25 of mobile terminal 2, the characteristic information of receiver module 25 receiving video data by the characteristic information of video data.Wherein characteristic information acquisition module 13 obtains the characteristic information of image by SURF method and FAST method.

The characteristic information searched module 211 and provide according to receiver module 25 of mobile terminal 3 searches the virtual information corresponding with image in virtual information database; If there is the virtual information corresponding with image, then judge module 21 determines that can carry out reality strengthens process; If there is not the virtual information corresponding with image, then search the characteristic information of module 211 according to image in parameter database, search the parameter corresponding with image; If there is the parameter corresponding with image, then judge module 21 is determined to carry out parameter output; If there is not the parameter corresponding with image, then judge module 21 determines that cannot carry out reality strengthens and cannot carry out parameter output.Wherein, search module 211 view-based access control model and search technology and physical feature track algorithm searches the virtual information corresponding with described image and parameter in virtual information database.Reality strengthens response message generation module 22 and strengthens response message according to the reality of judged result synthetic image, the reality that first sending module 23 sends this image to Intelligent worn device 1 strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information.

Wherein the reality enhancing packets of information of image contains: reality strengthens result indication information; When judge module 21 determines that can carry out reality strengthens process, then reality strengthens result indication information is can carry out reality to strengthen; When judge module 21 is determined to carry out parameter output, then reality strengthens result indication information for carrying out reality enhancing; When judge module determines that 21 cannot carry out reality enhancing and cannot carry out parameter output, then reality strengthens result indication information for carrying out reality enhancing.

Intelligent worn device 1 exports reality by output module 12 and strengthens result indication information.Output module 12 can be display screen, strengthens information by the reality of display screen display image; Output module 12 can be microphone, strengthens information by the reality of microphone playing image; Output module 12 can be Vib., and the reality being exported described image by Vib. strengthens information.Certainly, output module 12 can be also the mode that other can realize, and is not limited to above-mentioned three kinds.

User according to judged result, can decide in its sole discretion and whether will carry out reality enhancing to image.Strengthen if user needs to carry out reality to image, then can take out mobile terminal 2, carry out reality by display module 24 pairs of images and strengthen display.If Intelligent worn device 1 itself has reality strengthen function, then user directly can carry out reality to image and strengthen display in Intelligent worn device 1.

It should be noted that, any attainable communication modes between Intelligent worn device 1 and mobile terminal 2, can be adopted to carry out the transmission of data, such as wireless, bluetooth, zigbee, WPAN etc.

Intelligent worn device 1 can for having intelligent watch, the Intelligent worn device such as bracelet and glasses of shoot function.Mobile terminal 2 can for comprising the terminal devices such as mobile phone, panel computer, PDA (PersonalDigitalAssistant, personal digital assistant), POS (PointofSales, point-of-sale terminal), vehicle-mounted computer.

With Intelligent worn device 1 for intelligent watch, mobile terminal 2 for mobile phone be example.Figure 11 shows the schematic diagram of another kind of real enhancing system, and in this system, intelligent watch have employed a kind of universal architecture; Mobile phone have employed a kind of universal architecture.

Concrete, intelligent watch can comprise camera module 15, processor 16, transceiver 17, communication interface 18, display screen 19 and storer 20.Acquisition module 11 in the present embodiment can have the camera module 15 comprising camera, to carry out taking pictures or making a video recording; Second sending module 14 can have the function of transceiver 17 and communication interface 18, to realize the transmission of data; Output module 12 can have the function of display screen 19; Characteristic information acquisition module 13 is by the function of processor 16 realization character acquisition of information.Processor 16 is control centers of intelligent watch, utilize the various piece of various interface and connection intelligent watch, software program in storer 20 and/or module is stored in by running or performing, and call the data be stored in storer 20, perform various function and the process data of intelligent watch, thus integral monitoring is carried out to intelligent watch.In an embodiment, after the transceiver 17 of intelligent watch and communication interface 18 receive the shooting instruction of user, controlled the startup of the camera in camera module 15 by processor 16, thus perform the shooting of image.After intelligent watch is taken, processor 16 performs the operation of the characteristic information obtaining image and controls transceiver 17 and the characteristic information of the image of acquisition is sent to mobile phone by communication interface 18.

Mobile phone can comprise controller 26, transceiver 27, communication interface 28, display screen 29 and storer 30.Receiver module 27 in the present embodiment and the first sending module 24 can have the function of transceiver 27 and communication interface 28; Display module 24 can have the function of display screen 29; Judge module 21 realizes arbitration functions by controller 26, searches module 211 and realizes arbitration functions locating function by controller 26, and reality strengthens response message generation module 22 realizes response message production function by controller 26.Controller 26 is control centers of mobile phone, utilize the various piece of various interface and connection mobile phone, software program in storer 30 and/or module is stored in by running or performing, and call the data be stored in storer 30, perform various function and the process data of mobile phone, thus integral monitoring is carried out to mobile phone.In an embodiment, the characteristic information of the image that intelligent watch sends is received at the transceiver 27 of mobile phone and communication interface 28, judge whether image can carry out reality and strengthen by controller 26, and generate reality enhancing response message, control transceiver 27 and communication interface 28 with Time Controller 26 and this generation reality is strengthened response message, send to intelligent watch.Wherein reality enhancing response message can comprise reality enhancing result indication information, virtual information, parameter etc.

Intelligent watch receives reality and strengthens response message, and reality strengthens result indication information by the mode reminding user of voice, Vib. or display screen 19, arranges voluntarily be as the criterion with user.If image can carry out augmented reality, and intelligent watch has the function of image being carried out to reality enhancing display, then user directly can find out the image of acquisition and carry out reality enhancing display to image on intelligent watch.

If intelligent watch does not possess the function of real augmented reality, then user can take out mobile phone, finds the image of acquisition and carry out reality to image to strengthen display from mobile phone.

It will be appreciated by those skilled in the art that, intelligent watch shown in Figure 11 and mobile phone only do the citing of implementation, do not form the restriction to mobile phone and intelligent watch, can comprise the parts more more or less than diagram, or combine some parts, or different parts are arranged.

Embodiment 14

Under the Intelligent worn device regarded in real enhancing system provided above be specifically described, this Intelligent worn device can to perform in real Enhancement Method above Intelligent worn device as each step of executive agent, and realize corresponding technique effect, Figure 12 shows the Intelligent worn device 3 that a kind of reality strengthens, and comprises acquisition module 31, sending module 32, receiver module 33, output module 34.Acquisition module 31 is for obtaining image; Sending module 32 is for sending to mobile terminal by image; The reality of the image that receiver module 33 sends for mobile terminal receive strengthens response message, and the reality that the reality enhancing response message of image comprises image strengthens information; Output module 34 strengthens information for the reality of output image.

In the present embodiment, the image that user obtains spontaneously can be sent to mobile terminal by Intelligent worn device 3, and the judged result of mobile terminal receive, by the output module 34 of Intelligent worn device 3, user determines whether the image obtained can carry out reality and strengthen, thus user is without the need to frequently taking out mobile terminal, improve the service efficiency of AR process, the close friend substantially increasing user operation experiences.

Embodiment 15

Embodiment 15 is substantially the same manner as Example 14, and as shown in figure 13, difference is, Intelligent worn device 3 also comprises characteristic information acquisition module 35, for the characteristic information according to Image Acquisition image.The characteristic information of image can be sent to mobile terminal by sending module 32.

In the present embodiment, characteristic information acquisition module 35 also obtains the characteristic information of image by SURF method and FAST method according to image.SURF method and FAST method are prior aries, and utilize the fast advantage of FAST algorithm extraction characteristic velocity to improve the real-time of system, the high robust of SURF algorithm also compensate for the instability of FAST algorithm simultaneously, improves the accuracy of system.By FAST and SURF algorithm by off-line with effectively combine online, robustness and the real-time of augmented reality system can be improved.

The image that acquisition module 31 obtains comprises at least one secondary picture or video data.When image is at least one secondary picture, characteristic information acquisition module 35 obtains the characteristic information of at least one secondary picture according at least one secondary picture, and the characteristic information of at least one secondary picture is sent to mobile terminal by sending module.When image is video data, characteristic information acquisition module 35 obtains the characteristic information of video data according to video data, and the characteristic information of video data is sent to mobile terminal by sending module.

The receiver module 33 of Intelligent worn device 3 reality of mobile terminal receive can strengthen information.Wherein, the reality of image strengthens packets of information and strengthens result indication information containing reality.When reality strengthens result indication information for carrying out reality enhancing, output module 34 exports the indication information that can carry out reality and strengthen; When reality strengthens result indication information for carrying out parameter output, output module 34 exports the indication information that can carry out reality and strengthen; When reality strengthens result indication information for cannot carrying out reality enhancing and cannot carrying out parameter output, output module 34 exports and strengthens failed indication information.

Output module 34 can be display screen, strengthens information by the reality of display screen display image; Output module 34 can be microphone, strengthens information by the reality of microphone playing image; Output module 34 also can be Vib., strengthens information by the reality of Vib. output image.Certainly, output module 34 also can be other forms that can realize, and is not limited to above-mentioned three kinds.

In the present embodiment, before acquisition module 31 obtains image, receiver module 33 can also receive the second image acquisition operations instruction that the first image acquisition operations indicates or mobile terminal receive sends that user sends.If namely user is to the subject interests in true environment, then the acquisition module 31 that can directly trigger in Intelligent worn device 3 obtains image; User also can take out mobile terminal, sends the operation instruction of acquisition image to Intelligent worn device 3 by mobile terminal, obtains image to trigger Intelligent worn device 3 according to instruction.

Embodiment 16

Under the mobile terminal regarded in real enhancing system provided above be specifically described, this mobile terminal can to perform in real Enhancement Method above mobile terminal as each step of executive agent, and realize corresponding technique effect, Figure 14 shows the mobile terminal 4 that a kind of reality strengthens, and described mobile terminal 4 comprises receiver module 41, judge module 42, reality enhancing response message generation module 43, sending module 44.The image that receiver module 41 sends for receiving Intelligent worn device; Judge module 42 is for judging whether that according to image can carry out reality strengthens process; Reality strengthens response message generation module 43 and strengthens response message for the reality according to judged result synthetic image; Sending module 44 strengthens response message for the reality sending image to Intelligent worn device.

According to the image received, mobile terminal 4 judges whether this image can carry out reality and strengthen display, reality strengthens response message generation module 43 and strengthens response message according to judged result generation reality.The reality that the reality enhancing response message of image comprises described image strengthens information.The reality of image strengthens packets of information and contains: reality strengthens result indication information; When judge module 42 determines that can carry out reality strengthens process, reality strengthens result indication information and strengthens for carrying out reality; When judge module 42 is determined to carry out parameter output, reality strengthens result indication information and strengthens for carrying out reality; When judge module 42 determines that cannot carry out reality strengthens and cannot carry out parameter output, reality strengthens result indication information and strengthens for carrying out reality and cannot carry out parameter output.

Mobile terminal 4 reality is strengthened response message spontaneous send to Intelligent worn device.By the spontaneous reception of this mobile terminal 4, judgement and send judged result, user without the need to frequently taking out mobile terminal 4, by Intelligent worn device just known image whether can carry out reality enhancing and show.

Embodiment 17

Embodiment 17 is substantially the same manner as Example 16, and as shown in figure 15, difference is, mobile terminal 4 also comprises display module 45, and judge module 42 comprises searches module 421.Display module 45 strengthens display for carrying out reality according to the judged result of judge module 42 to image.

The receiver module 41 of mobile terminal 4 can receive image that Intelligent worn device sends and characteristic information, characteristic information can be at least one secondary picture or video data.When image is at least one secondary picture, the characteristic information of image is the characteristic information of at least one secondary picture; When image is video data, the characteristic information of image is the characteristic information of video data.

According to the characteristic information of image, judge module 42 can judge whether that can carry out reality strengthens process.Wherein search module 421 according to the characteristic information of image and view-based access control model searches technology and physical feature track algorithm searches the virtual information corresponding with described image in virtual information database; If there is the virtual information corresponding with image, judge module 42 determines that can carry out reality strengthens process; If there is not the virtual information corresponding with image, search module 421 according to the characteristic information of image and view-based access control model searches technology and physical feature track algorithm searches the parameter corresponding with image in parameter database; If there is the parameter corresponding with image, judge module 42 is determined to carry out parameter output; If there is not the parameter corresponding with image, judge module 42 determines that cannot carry out reality strengthens and cannot carry out parameter output.Wherein, Visual search technology and physical feature track algorithm are prior art, 2 kinds of combine with technique are carried out physical feature extraction and are conducive to improving accuracy rate and efficiency.

In the present embodiment, receive the image of Intelligent worn device transmission at receiver module 41 before, receiver module 41 can also receive the reality enhancing operation instruction that user sends; Sending module 44 can strengthen operation instruction according to reality and send image acquisition operations instruction to Intelligent worn device.If namely user wants that carrying out reality to the object in actual environment strengthens, then send the operation instruction of acquisition image to Intelligent worn device by mobile terminal 4, the characteristic information of the image that mobile terminal 4 sends according to Intelligent worn device judges that this image can carry out real augmented reality, then user can send reality enhancing operation instruction, and mobile terminal 4 carries out reality according to the instruction obtained to corresponding image and strengthens display.

It should be noted that, above provide multiple embodiment, can combine between these embodiments, the embodiment after combination can realize the technique effect above described; Or, also can being technical scheme arranged side by side between different embodiments, in order to realize same or similar technique effect, can replacing each other; Or these embodiments can realize under different trigger conditions.

Although the foregoing describe the specific embodiment of the present invention, it will be understood by those of skill in the art that these only illustrate, protection scope of the present invention is defined by the appended claims.Those skilled in the art, under the prerequisite not deviating from principle of the present invention and essence, can make various changes or modifications to these embodiments, but these change and amendment all falls into protection scope of the present invention.

Claims

1. reality strengthens an information processing method, and it is characterized in that, described method is applied to Intelligent worn device, and described method comprises the steps:

Described Intelligent worn device obtains image;

2. reality according to claim 1 strengthens information processing method, it is characterized in that, the reality of described image strengthens packets of information and contains: reality strengthens result indication information;

3. reality according to claim 1 and 2 strengthens information processing method, it is characterized in that, after described Intelligent worn device obtains image, also comprises:

4. reality according to claim 3 strengthens information processing method, and it is characterized in that, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

5. reality according to claim 3 strengthens information processing method, and it is characterized in that, described image comprises: at least one secondary picture or video data.

6. reality according to claim 5 strengthens information processing method, and it is characterized in that, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

7. reality according to claim 5 strengthens information processing method, and it is characterized in that, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

8. strengthen information processing method according to the reality in claim 4-7 described in any one, it is characterized in that, the reality that described Intelligent worn device exports described image strengthens information, comprising:

9. reality according to claim 7 strengthens information processing method, it is characterized in that, before described Intelligent worn device obtains image, also comprises any one step following:

10. reality strengthens an information processing method, and it is characterized in that, described method is applied to mobile terminal, and described method comprises the steps:

Described mobile terminal receives the image that Intelligent worn device sends;

11. reality according to claim 10 strengthen information processing method, it is characterized in that, according to described image, described mobile terminal judges whether that can carry out reality strengthens process, then also comprise:

12. reality according to claim 10 or 11 strengthen information processing method, it is characterized in that, described mobile terminal judges whether to carry out reality according to described image to be strengthened and process, and comprising:

If there is the virtual information corresponding with described image, then described mobile terminal determines that can carry out reality strengthens process;

If there is not the virtual information corresponding with described image, then described mobile terminal searches whether there is the parameter corresponding with described image according to described image in parameter database;

If there is the parameter corresponding with described image, then described mobile terminal is determined to carry out parameter output;

If there is not the parameter corresponding with described image, then described mobile terminal determines that cannot carry out reality strengthens and cannot carry out parameter output.

13. reality according to claim 12 strengthen information processing method, it is characterized in that, the reality of described image strengthens packets of information and contains: reality strengthens result indication information;

14. reality according to claim 12 strengthen information processing method, and it is characterized in that, described mobile terminal searches whether there is the virtual information corresponding with described image according to described image in virtual information database, comprising:

15. reality according to claim 12 strengthen information processing method, and it is characterized in that, described mobile terminal searches whether there is the parameter corresponding with described image according to described image in parameter database, comprising:

16. reality according to claim 10 strengthen information processing method, and it is characterized in that, described mobile terminal receives the described image that Intelligent worn device sends, and comprising:

Described mobile terminal receives the characteristic information of the described image that described Intelligent worn device sends;

17. reality according to claim 16 strengthen information processing method, and it is characterized in that, described image comprises: at least one secondary picture or video data.

18. reality according to claim 16 strengthen information processing method, and it is characterized in that, when described image is described at least one secondary picture, the characteristic information of described image is the characteristic information of described at least one secondary picture;

19. reality according to claim 18 strengthen information processing method, it is characterized in that, described mobile terminal carries out reality to described image and strengthens display, comprising:

20. reality according to claim 13-19 any one strengthen information processing method, it is characterized in that, before described mobile terminal receives the described image that described Intelligent worn device sends, also comprise:

21. 1 kinds of reality strengthen information processing method, and it is characterized in that, described method is applied to real enhancing system, and described real enhancing system, comprise Intelligent worn device and mobile terminal, described method comprises the steps:

Described Intelligent worn device obtains image;

22. reality according to claim 21 strengthen information processing method, it is characterized in that, according to described image, described mobile terminal judges whether that can carry out reality strengthens process, then also comprise:

23. reality according to claim 21 strengthen information processing method, it is characterized in that, after described Intelligent worn device obtains image, also comprise:

24. reality according to claim 23 strengthen information processing method, and it is characterized in that, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

25. reality according to claim 23 strengthen information processing method, and it is characterized in that, described image comprises: at least one secondary picture or video data.

26. reality according to claim 25 strengthen information processing method, and it is characterized in that, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

27. reality according to claim 25 strengthen information processing method, and it is characterized in that, the characteristic information of described Intelligent worn device image according to described Image Acquisition, comprising:

28. reality according to claim 27 strengthen information processing method, it is characterized in that, according to the characteristic information of described image, described mobile terminal judges whether that can carry out reality strengthens process, comprising:

Described mobile terminal searches whether there is the virtual information corresponding with described image according to the characteristic information of described image in virtual information database;

If there is not the virtual information corresponding with described image, then described mobile terminal searches whether there is the parameter corresponding with described image according to the characteristic information of described image in parameter database;

29. reality according to claim 28 strengthen information processing method, and it is characterized in that, described mobile terminal searches whether there is the virtual information corresponding with described image according to the characteristic information of described image in virtual information database, comprising:

30. reality according to claim 28 strengthen information processing method, and it is characterized in that, described mobile terminal searches whether there is the parameter corresponding with described image according to the characteristic information of described image in parameter database, comprising:

31. reality according to claim 28 strengthen information processing method, it is characterized in that, the reality of described image strengthens packets of information and contains: reality strengthens result indication information;

32. reality according to claim 31 strengthen information processing method, it is characterized in that, the reality that described Intelligent worn device exports described image strengthens information, comprising:

33. reality according to claim 32 strengthen information processing method, it is characterized in that, after described Intelligent worn device exports the reality enhancing information of described image, also comprise any one step following:

34. reality according to claim 33 strengthen information processing method, it is characterized in that, described mobile terminal carries out reality to described image and strengthens display, comprising:

The Intelligent worn device that 35. 1 kinds of reality strengthens, it is characterized in that, described Intelligent worn device comprises:

Acquisition module, for obtaining image;

Sending module, for sending to mobile terminal by described image;

The Intelligent worn device that 36. reality according to claim 35 strengthen, is characterized in that, the reality of described image strengthens packets of information and contains: reality strengthens result indication information;

The Intelligent worn device that 37. reality according to claim 35 or 36 strengthen, is characterized in that, also comprise in described Intelligent worn device: characteristic information acquisition module, for the characteristic information of image according to described Image Acquisition;

38. Intelligent worn device strengthened according to reality according to claim 37, is characterized in that, described characteristic information acquisition module is according to described image and obtained the characteristic information of described image by SURF method and FAST method.

39. Intelligent worn device strengthened according to reality according to claim 37, it is characterized in that, described image comprises: at least one secondary picture or video data.

40. Intelligent worn device strengthened according to reality according to claim 39, it is characterized in that, when described image is described at least one secondary picture, described characteristic information acquisition module is used for the characteristic information obtaining described at least one secondary picture according to described at least one secondary picture;

41. Intelligent worn device strengthened according to reality according to claim 39, is characterized in that, when described image is described video data, described characteristic information acquisition module is used for the characteristic information obtaining described video data according to described video data;

42. Intelligent worn device strengthened according to the reality in claim 38-41 described in any one, it is characterized in that, described output module is display screen, and described display screen strengthens information for the reality showing described image; And/or,

The Intelligent worn device that 43. reality according to claim 41 strengthen, is characterized in that, before described acquisition module obtains image, described receiver module is also for receiving the first image acquisition operations instruction that user sends; Or,

The mobile terminal that 44. 1 kinds of reality strengthens, it is characterized in that, described mobile terminal comprises:

Receiver module, for receiving the image that Intelligent worn device sends;

The mobile terminal that 45. reality according to claim 44 strengthen, it is characterized in that, described mobile terminal also comprises display module, strengthens display for carrying out reality according to the judged result of described judge module to described image.

The mobile terminal that 46. reality according to claim 44 or 45 strengthen, it is characterized in that, described judge module also comprises searches module, for searching the virtual information corresponding with described image according to described image in virtual information database;

If there is the virtual information corresponding with described image, described judge module determines that can carry out reality strengthens process;

If there is not the virtual information corresponding with described image, described in search module also for searching the parameter corresponding with described image according to described image in parameter database;

If there is the parameter corresponding with described image, described judge module is determined to carry out parameter output;

If there is not the parameter corresponding with described image, described judge module determines that cannot carry out reality strengthens and cannot carry out parameter output.

The mobile terminal that 47. reality according to claim 46 strengthen, is characterized in that, the reality of described image strengthens packets of information and contains: reality strengthens result indication information;

The mobile terminal that 48. reality according to claim 46 strengthen, it is characterized in that, described in search module view-based access control model and search technology and physical feature track algorithm and in virtual information database, search the virtual information corresponding with described image according to described image.

The mobile terminals that 49. reality according to claim 46 strengthen, is characterized in that, described in search module view-based access control model and search technology and physical feature track algorithm and in parameter database, search the parameter corresponding with described image according to described image.

The mobile terminal that 50. reality according to claim 44 strengthen, is characterized in that, described receiver module is also for receiving the characteristic information of the described image that described Intelligent worn device sends;

The mobile terminal that 51. reality according to claim 50 strengthen, it is characterized in that, described image comprises: at least one secondary picture or video data.

The mobile terminal that 52. reality according to claim 50 strengthen, it is characterized in that, when described image is described at least one secondary picture, the characteristic information of described image is the characteristic information of described at least one secondary picture;

The mobile terminal that 53. reality according to claim 52 strengthen, is characterized in that, when described image is described at least one secondary picture, described display module is used for carrying out reality to described at least one secondary picture and strengthens display;

The mobile terminal that 54. reality according to claim 47-53 any one strengthen, it is characterized in that, receive the described image of described Intelligent worn device transmission at described receiver module before, the reality that described receiver module also sends for receiving user strengthens operation instruction;

55. 1 kinds of real enhancing systems, is characterized in that, described real enhancing system comprises Intelligent worn device and mobile terminal;

Described Intelligent worn device comprises: acquisition module, and acquisition module is for obtaining image;

56. real enhancing systems according to claim 55, it is characterized in that, described mobile terminal also comprises display module, strengthens display for carrying out reality according to the judged result of described judge module to described image.

57. real enhancing systems according to claim 55, it is characterized in that, described Intelligent worn device also comprises: characteristic information acquisition module, the second sending module;

58. real enhancing systems according to claim 57, is characterized in that, described characteristic information acquisition module is according to described image and obtained the characteristic information of described image by SURF method and FAST method.

59. real enhancing systems according to claim 57, it is characterized in that, described image comprises: at least one secondary picture or video data.

60. real enhancing systems according to claim 59, is characterized in that, when described image is described at least one secondary picture, described characteristic information acquisition module obtains the characteristic information of described at least one secondary picture according to described at least one secondary picture;

61. real enhancing systems according to claim 59, is characterized in that, when described image is described video data, described characteristic information acquisition module obtains the characteristic information of described video data according to described video data;

62. real enhancing systems according to claim 61, is characterized in that, described judge module also comprises searches module, searches the virtual information corresponding with described image for the characteristic information according to described image in virtual information database;

If there is the virtual information corresponding with described image, then described judge module determines that can carry out reality strengthens process;

If there is not the virtual information corresponding with described image, then search module described in also for searching the parameter corresponding with described image according to the characteristic information of described image in parameter database;

If there is the parameter corresponding with described image, then described judge module is determined to carry out parameter output;

If there is not the parameter corresponding with described image, then described judge module determines that cannot carry out reality strengthens and cannot carry out parameter output.

63. real enhancing systems according to claim 62, is characterized in that, described in search module view-based access control model and search technology and physical feature track algorithm searches the virtual information corresponding with described image in virtual information database.

64. real enhancing systems according to claim 62, is characterized in that, described in search module view-based access control model and search technology and physical feature track algorithm searches the parameter corresponding with described image in parameter database.

65. real enhancing systems according to claim 62, is characterized in that, the reality of described image strengthens packets of information and contains: reality strengthens result indication information;

66. real enhancing systems according to claim 65, it is characterized in that, described output module is display screen, and described display screen strengthens information for the reality showing described image; And/or,

67. real enhancing systems according to claim 66, is characterized in that, after described output module exports the reality enhancing information of described image,

68. real enhancing systems according to claim 67, is characterized in that, when described image is described at least one secondary picture, then described display module carries out reality to described at least one secondary picture and strengthens display;