CN103677631A - Information interaction method and information interaction device - Google Patents

Information interaction method and information interaction device Download PDF

Info

Publication number
CN103677631A
CN103677631A CN201310574246.5A CN201310574246A CN103677631A CN 103677631 A CN103677631 A CN 103677631A CN 201310574246 A CN201310574246 A CN 201310574246A CN 103677631 A CN103677631 A CN 103677631A
Authority
CN
China
Prior art keywords
input message
image
equipment
identification information
user
Prior art date
Application number
CN201310574246.5A
Other languages
Chinese (zh)
Inventor
杜琳
于魁飞
Original Assignee
北京智谷睿拓技术服务有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京智谷睿拓技术服务有限公司 filed Critical 北京智谷睿拓技术服务有限公司
Priority to CN201310574246.5A priority Critical patent/CN103677631A/en
Publication of CN103677631A publication Critical patent/CN103677631A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00597Acquiring or recognising eyes, e.g. iris verification
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Abstract

The invention discloses an information interaction method and device. The method includes the steps that at a second equipment end, an image relevant to first equipment is acquired, the image at least contains identification information, the identification information in the image is acquired, the identification information contains equipment input information corresponding to the first equipment, and the acquired identification information is provided for a server; at the server end, identification information provided by second equipment is acquired, equipment input information which is relevant to the first equipment and contained in the identification information is acquired, and the equipment input information is provided for the first equipment; at the first equipment end, the identification information is embedded into the image relevant to the first equipment, the image is provided for the outside, the equipment input information provided by the outside is received, and operation corresponding to the equipment input information is carried out. With the information interaction method and device, corresponding operation can be carried out on the equipment by a user if needed while the equipment input information does not need to be memorized by the user, and user experience is improved.

Description

Information interacting method and information interactive device
Technical field
The present invention relates to equipment interaction technique field, relate in particular to a kind of information interacting method and device.
Background technology
Mobile or wearable equipment is based on the energy-conservation reason with preventing maloperation, conventionally all screen locking can be set, and unlocking screen can be encrypted or do not encrypt, when being carried out to release, the screen of encrypting conventionally all need user to remember some special passwords, pattern, action etc., although can guarantee security, but the situation that is easy to forget, makes troubles to user.Certainly, except the occasion of above-mentioned unlocking screen, other need to input the information such as password to carry out, under the occasion of further operation, also having above-mentioned problem.
By digital watermark technology, some identification informations (being digital watermarking) directly can be embedded in digital carrier, and not affect the use of original vector, also be not easy to be found out and revise.Digital watermark technology is applied to a lot of aspects, such as copyright protection, false proof, authentication, Information hiding etc.If can help user to carry out the inputs such as password to obtain corresponding mandate for safe and out of sight digital watermark technology, can solve above-mentionedly because user forgets the problem that cannot carry out authentication, improve user's experience.
Summary of the invention
The technical problem to be solved in the present invention is: a kind of information interacting method and device are provided, to help convenient the completing using the input information of equipment of user, improve user and experience.
For achieving the above object, first aspect, the invention provides a kind of information interacting method, comprising:
Image acquisition step, obtains and an one first device-dependent image, and described image comprises at least one identification information;
Identification information obtaining step, obtains the described identification information in described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
Identification information provides step, the identification information obtaining described in providing to a server.
Second aspect, the invention provides a kind of server info exchange method, comprising:
Identification information obtaining step, obtains the identification information that one second equipment provides;
Input message obtaining step, obtain in described identification information, comprise with one first device-dependent at least one equipment input message;
Input message provides step, to described the first equipment, provides described equipment input message.
The third aspect, the invention provides a kind of information interacting method, comprising:
Identification information embeds step, with an one first device-dependent image in embed at least one identification information, in described identification information, include the equipment input message corresponding with described the first equipment;
Image provides step, and described image is provided to outside;
Input information step, the outside described equipment input message providing is provided;
Execution step, carries out the operation corresponding with described equipment input message.
Fourth aspect, the invention provides a kind of information interactive device, comprising:
One image collection module, for obtaining and an one first device-dependent image, described image comprises at least one identification information;
One identification information acquisition module, for obtaining the described identification information of described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
One identification information provides module, for the identification information obtaining described in providing to a server.The 5th aspect, the invention provides a kind of wearable device, and described wearable device comprises the information interactive device described in the above-mentioned third aspect.
The 6th aspect, the invention provides a kind of server, comprising:
One identification information acquisition module, the identification information providing for obtaining one second equipment;
One input message acquisition module, for obtain that described identification information comprises with one first device-dependent at least one equipment input message;
One input message provides module, for providing described equipment input message to described the first equipment.
The 7th aspect, the invention provides a kind of information interactive device, comprising:
One identification information merge module, embeds at least one identification information for the image relevant to described information interactive device, includes the equipment input message corresponding with described information interactive device in described identification information;
One image provides module, for described image is provided to outside;
One MIM message input module, the described equipment input message providing for receiving outside;
One execution module, carries out corresponding operation for the equipment input message according to described reception.
The equipment input message that the technique scheme of the embodiment of the present invention is obtained with a device-dependent image and obtained comprising in this image, automatically this equipment input message is offered to equipment again, thereby do not need these equipment input messages of user oneself memory just can when user needs, to equipment, carry out corresponding operation, greatly facilitate user, improve user and experience.
Accompanying drawing explanation
Fig. 1 is the flow chart of steps of a kind of information interacting method of the embodiment of the present invention;
Fig. 2 a is the schematic diagram of image corresponding in a kind of information interacting method of the embodiment of the present invention;
Fig. 2 b is the schematic diagram of image corresponding in a kind of information interacting method of the embodiment of the present invention;
Fig. 3 is the flow chart of steps of the another kind of information interacting method of the embodiment of the present invention;
Fig. 4 a is the schematic diagram of the spot pattern that uses of a kind of information interacting method of the embodiment of the present invention;
Fig. 4 b is the schematic diagram of the pattern on the eyeground that obtains of a kind of information interacting method of the embodiment of the present invention;
Fig. 5 is the structured flowchart of a kind of first information interactive device of the embodiment of the present invention;
Fig. 6 a is the structured flowchart of the another kind of first information interactive device of the embodiment of the present invention;
Fig. 6 b is the structured flowchart of another first information interactive device of the embodiment of the present invention;
Fig. 7 a is the structured flowchart of the position detecting module in a kind of first information interactive device of the embodiment of the present invention;
Fig. 7 b is the structured flowchart of the position detecting module in the another kind of first information interactive device of the embodiment of the present invention;
Fig. 7 c and 7d are the position detecting module of embodiment of the present invention respective optical path schematic diagram while carrying out position probing;
Fig. 8 is that a kind of first information interactive device of the embodiment of the present invention is applied in the schematic diagram on glasses;
Fig. 9 is that the another kind of first information interactive device of the embodiment of the present invention is applied in the schematic diagram on glasses;
Figure 10 is that another first information interactive device of the embodiment of the present invention is applied in the schematic diagram on glasses;
Figure 11 is the structured flowchart of the another kind of information interactive device of the embodiment of the present invention;
Figure 12 is the schematic diagram of a kind of wearable device of the embodiment of the present invention;
Figure 13 is the flow chart of steps of a kind of server info exchange method of the embodiment of the present invention;
Figure 14 a is the flow chart of steps of a kind of server info exchange method of the embodiment of the present invention;
Figure 14 b is the flow chart of steps of a kind of server info exchange method of the embodiment of the present invention;
Figure 15 is the structural representation block diagram of a kind of server of the embodiment of the present invention;
Figure 16 a-16c is the structural representation block diagram of another several servers of the embodiment of the present invention;
Figure 17 is the schematic flow sheet of a kind of information interacting method of the embodiment of the present invention;
Figure 18 is the structured flowchart of the second information interactive device of the embodiment of the present invention;
Figure 19 is the structured flowchart of a kind of electric terminal of the embodiment of the present invention;
Figure 20 is the structured flowchart of another kind second information interactive device of the embodiment of the present invention;
Figure 21 is the application scenarios schematic diagram of the information interactive device of the embodiment of the present invention.
Embodiment
Method of the present invention and device by reference to the accompanying drawings and embodiment be described in detail as follows.
User often need to use wide variety of equipment input message in daily life, equipment input message described here is for being input in equipment to complete the information of a certain operation, the various user authentication information such as encrypted message that the user cipher that need to input in the locking screen interface of each electronic equipment such as user or certain gestures, the user cipher that need to use when the account of login number of site or application or need in some access control equipments used.User need to remember these various equipment input messages, otherwise can bring very large inconvenience to user.The technical scheme providing in following embodiment of the present invention can help user not need memory just can obtain these equipment input messages, and automatically completes corresponding operation.
In the following description of the embodiment of the present invention, described " user environment " is and user-dependent environment for use, after user's login interface login such as user by electric terminals such as mobile phone, computers, the environment for use of the electric terminal system entering into, in the environment for use of this electric terminal system, generally comprise a plurality of application, for example, after the locking screen interface of user by mobile phone enters the environment for use of cell phone system, just can start application corresponding to each functional module in this system, application such as phone, mail, information, camera; Or, for example described " user environment " can also be for after the login interface login of user by certain application, the environment for use of this application entering into, in the environment for use of this application, likely also comprise the application of a plurality of next stage, for example, phone application in above-mentioned cell phone system, after startup, in described phone application, likely also comprise make a phone call, the application of the next stage such as contact person, message registration.
As shown in Figure 1, the embodiment of the present invention provides a kind of information interacting method, comprising:
S120 image acquisition step, obtains and an one first device-dependent image, and described image comprises at least one identification information;
S140 identification information obtaining step, obtains the described identification information in described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
S160 identification information provides step, the identification information obtaining described in providing to a server.
The embodiment of the present invention obtain with one first device-dependent image the identification information that obtains comprising in this image after offer a server, make server can extract that equipment input message in described identification information is carried out and described the first equipment between information interaction, user friendly operation.
The embodiment of the present invention conducts further description each step by following embodiment below:
S120 image acquisition step, obtains and an one first device-dependent image.
In embodiments of the present invention, described and one first device-dependent image can be for example the image that this first equipment shows, as the image showing in the electric terminal screens such as mobile phone, computer.In one embodiment, described image is the login interface of a user environment of described the first equipment demonstration.Now, the log-on message that described equipment input message is described user environment.
As shown in Figure 2 a and 2 b, in further embodiment, described image is the locking screen interface 110 that described equipment shows.Now, the release information that described equipment input message is described locking screen interface.
In other embodiment of the embodiment of the present invention, the image that described image for example can also show for miscellaneous equipment be for example printed on paper or the first-class object of wall on static image, now this image is relevant to the first equipment recited above.For example, described image is the image showing near the picture being posted in Yishanmen, and electronic access equipment that described the first equipment is this fan comprises the equipment input message (as door-opening password information etc.) of this electronic access equipment in the eletric watermark of described image.
Because digital watermark technology can directly embed some identification informations (being digital watermarking) in digital carrier, and do not affect the use of original vector, be not easy to be found out and revise yet, therefore in embodiments of the present invention, preferably, described identification information can be digital watermarking.Certainly, those skilled in the art can know, described identification information can also can be embedded in image or the information of individualism for other.
The mode that the embodiment of the present invention is obtained described image has multiple, for example:
1) by the mode of taking, obtain described image.
In embodiments of the present invention, preferably, can pass through an intelligent glasses equipment, take the object that user sees, for example, when user sees described image, described intelligent glasses equipment photographs described image.
2) by the mode receiving, obtain described image.
In a kind of possible embodiment of the embodiment of the present invention, can also obtain described image by miscellaneous equipment, or by and the equipment of this image of demonstration between obtain alternately described image.
S140 identification information obtaining step, obtains the described identification information in described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information.
In described step S140, by image is carried out to corresponding processing, extract the described identification information in described image.Take described identification information as digital watermarking be example, in a kind of possible embodiment, can be by the RGBA(Red(of each pixel of image is red) Green(is green) Blue(is blue) and the color space of Alpha) minimum two taking-ups synthesize afterwards that to obtain described digital watermarking (be least significant bit (LSB) method, least significant bits, LSB method).
S160 identification information provides step, the identification information obtaining described in providing to a server.
In embodiments of the present invention, generally the mode by data transmission by the described identification information obtaining direct or indirect offer a server.Its presentation mode can be local to server transmission, can be also that server obtains from this locality.
By the method for the embodiment of the present invention, can obtain naturally, easily the identification information comprising in one first equipment drawing picture and offer a server, and then can without manual operation, just can open easily the corresponding function of described the first equipment by the user that makes alternately between server and described the first equipment.
Except providing described equipment input message to described equipment to carry out corresponding operation, for make user can be secret see described equipment input message, as shown in Figure 3, in certain embodiments, described method also comprises:
S170 input message obtaining step, obtains the described equipment input message that described server provides;
S180 projects step, the eyeground projection by described equipment input message to respective user.
Described step S170 generally obtains described equipment input message by the mode of data transmission from described server, then by described step S180, described information is arrived by user awareness.
Like this, allow user can know corresponding information on the one hand, on the other hand, at some equipment, cannot receive the occasion (for example, while there is communication issue) of described equipment input message, user can manually input in described equipment according to the described equipment input message obtaining.Certainly, in eyeground when projection by described equipment input message to described user, need to displaying contents corresponding to described equipment input message convert to.
In embodiments of the present invention, in order to make user can obtain described equipment input message under secret occasion, by the mode that described equipment input message is projected to user eyeground, make user obtain corresponding described equipment input message.
In a kind of possible embodiment, this projection can be that described equipment input message is directly projected to user's eyeground by projection module.
In the possible embodiment of another kind, this projection can also be that described equipment input message is presented to the position (for example, on the display surface of an intelligent glasses) of only having user to see, by this display surface, described equipment input message is projected to user eyeground.
Wherein, first kind of way shows equipment input message owing to not needing by centre, but directly arrives user eyeground, so its privacy is higher.Further illustrate present embodiment below, described projection step comprises:
Information projection step, projects described equipment input message;
Parameter adjustment step, adjusts at least one projection imaging parameter of light path between described launching position and described user's eyes, until described equipment input message is at described user's eyeground blur-free imaging.
In a kind of possible embodiment of the embodiment of the present invention, described parameter adjustment step comprises:
Regulate at least one imaging parameters of at least one optical device of light path between described launching position and described user's eyes and/or the position in light path.
Imaging parameters described here comprises focal length, optical axis direction of optical device etc.By this, regulate, can be so that described equipment input message be incident upon user's eyeground suitably, for example, by regulating the focal length of described optical device to make described equipment input message clearly at user's fundus imaging.Or in the embodiment of mentioning below, in the time of need to carrying out stereo display, except directly generating the left-and right-eye images with parallax when generating described equipment input message, by being had to certain deviation, identical equipment input message is projected to respectively the stereo display effect that two eyes also can be realized described equipment input message, now, for example can regulate the optical axis parameter of described optical device to reach this effect.
While watching described equipment input message due to user, the direction of visual lines of eyes may change, need to when the direction of visual lines difference of eyes of user, described equipment input message can be projected preferably to user's eyeground, therefore, in a kind of possible embodiment of the embodiment of the present invention, described projection step S180 also comprises:
The position of pupil when corresponding described eyes optical axis direction is different respectively, transmits described equipment input message to described user's eyeground.
In a kind of possible embodiment of the embodiment of the present invention, may need to realize by curved surface optical device such as curved surface spectroscopes the function of described above-mentioned steps, but after transmitting by curved surface optical device, content to be shown generally can deform, therefore, in a kind of possible embodiment of the embodiment of the present invention, described projection step S180 also comprises:
Described equipment input message is carried out to reversible deformation corresponding to the position of pupil when different from described eyes optical axis direction and process, the described equipment input message that eyeground is received need to present.
For example: the equipment input message to projection is carried out pre-service, make the equipment input message projecting there is the reversible deformation contrary with described distortion, this reversible deformation effect is again after above-mentioned curved surface optical device, offset with the deformation effect of curved surface optical device, thereby the equipment input message that user eyeground receives is the effect that need to present.
In a kind of possible embodiment, the equipment input message projecting in eyes of user does not need to align with described image, for example, in the input frame that needs user to show in certain sequence, input one group of encrypted message in described image, during as " 1234 ", the eyeground that only this group information need to be incident upon to user is seen by user.But, in some cases, for example, when described equipment input message is one when ad-hoc location completes the information that specific action produces, for example, while need to the ad-hoc location on showing the screen of described image drawing the information that particular track produces, need demonstration that described equipment input message is alignd with described image.Therefore, in a kind of possible embodiment of the embodiment of the present invention, in described projection step S180, the projection of the backward described user's of image alignment that described equipment input message and described user are seen eyeground.
In order to realize above-mentioned alignment function, in a kind of possible embodiment, described method also comprises:
Position probing step, detects described user's blinkpunkt with respect to described user's position;
Described projection step S180, the image of with respect to described user's described position, the equipment input message of described projection being seen with described user according to described user's blinkpunkt aligns on described user's eyeground.
Here, because user is now seeing described image, user's mobile phone locking screen interface for example, therefore, the position that user's blinkpunkt is corresponding is the position at described image place.
In present embodiment, the mode that detects described user's blinkpunkt position has multiple, for example, comprise following one or more:
I) adopt a pupil direction detector detect eyes optical axis direction, by a depth transducer (as infrared distance measurement), obtain again the degree of depth of eye gaze scene, obtain the blinkpunkt position of eye sight line, this technology is prior art, in present embodiment, repeats no more.
Ii) detect respectively the optical axis direction of two, then obtain user's two an eye line directions according to described two eye direction of principal axis, obtain the blinkpunkt position of eye sight line by the intersection point of described two an eye line directions, this technology is also prior art, repeats no more herein.
Iii) according to the imaging surface that collects eyes, present picture rich in detail time image capture position and eyes between the optical parametric of light path and the optical parametric of eyes, obtain the blinkpunkt position of described eye sight line, the invention process regular meeting provides the detailed process of the method below, repeats no more herein.
Certainly, those skilled in the art can know, except the method for viewing points detecting of above-mentioned several forms, other can for detection of the method for eyes of user blinkpunkt also can the method for the embodiment of the present invention in.
Wherein, by the step that iii) kind method detects the current blinkpunkt position of user, comprise:
Eye fundus image acquisition step, gathers the image on user eyeground described in;
Adjustable image-forming step, carries out the adjusting of at least one imaging parameters of light path between described eye fundus image collection position and described eyes of user until collect an image the most clearly;
Image processing step, image to the described eyeground collecting is analyzed, obtain the described imaging parameters of light path and at least one optical parametric of described eyes between the described eye fundus image collection position corresponding with described image the most clearly and described eyes, and calculate the current blinkpunkt of described user with respect to described user's position.
By the image at the bottom of eye, carry out analyzing and processing, the optical parametric of eyes while obtaining collecting picture rich in detail, thereby calculate the current focusing position of sight line, for the further position based on this accurate focusing observer's observed behavior being detected basis is provided.
Here the image that " eyeground " presents is mainly the image presenting on retina, and it can be the image on eyeground self, or can be for projecting the image of other object on eyeground, for example spot pattern cited below.
In adjustable image-forming step, can regulate by the focal length of the optical device in the light path between eyes and collection position and/or the position in light path, can obtain at this optical device eyeground image the most clearly during at some positions or state.This adjusting can be real-time continuously.
In a kind of possible embodiment of embodiment of the present invention method, this optical device can be focal length adjustable lens, for by adjusting the refractive index of this optical device self and/or the adjustment that shape completes its focal length.Be specially: 1) by least curvature of one side of the adjustable lens of focusing, focus, for example, in the cavity that Double-layered transparent layer forms, increase or reduce the focus curvature of adjustable lens of liquid medium; 2) by changing the refractive index of focal length adjustable lens, focus, for example in focal length adjustable lens, be filled with particular fluid crystalline medium, by the voltage of adjustable liquid crystal display medium counter electrode, adjust the arrangement mode of liquid crystal media, thereby change the refractive index of focal length adjustable lens.
In the possible embodiment of the another kind of the method for the embodiment of the present invention, this optical device can be: lens combination, and for by regulating relative position between lens combination lens to complete the adjustment of lens combination self focal length.Or one or more pieces lens in described lens combination are focal length adjustable lens recited above.
Except above-mentioned two kinds of characteristics by optical device self change the light path parameter of system, can also be by regulating the position of optical device in light path to change the light path parameter of system.
In addition,, in the method for the embodiment of the present invention, described image processing step further comprises:
The image collecting in eye fundus image acquisition step is analyzed, found image the most clearly;
Known imaging parameters calculates the optical parametric of eyes during picture rich in detail according to described image the most clearly and described in obtaining.
Adjustment in described adjustable image-forming step makes it possible to collect image the most clearly, but need to find this image the most clearly by described image processing step, just can be by calculating the optical parametric of eyes according to described image the most clearly and known light path parameter.
In the method for the embodiment of the present invention, in described image processing step, also can comprise:
To eyeground projected spot.The hot spot projecting can not have specific pattern only for illuminating eyeground.The hot spot projecting also can comprise the pattern of feature rich.The feature rich of pattern can be so that detect raising accuracy of detection.The exemplary plot of a spot pattern P as shown in Figure 4 a, this pattern can be formed by spot pattern maker, for example frosted glass; Fig. 4 b is depicted as the image on the eyeground collecting when having spot pattern P projection.
In order not affect normally watching of eyes, preferred, described hot spot is the sightless infrared light spot of eyes.Now, in order to reduce the interference of other spectrum: can filtering the light outside eyes invisible light in the hot spot of projection.
Correspondingly, method of the invention process also can comprise step:
The result that analysis obtains according to above-mentioned steps, controls projected spot brightness.The characteristic of the image collecting described in this analysis result for example comprises, comprises the contrast of characteristics of image and textural characteristics etc.
It should be noted that, control a kind of special situation of projected spot brightness for starting or stop projection, for example observer continues to watch attentively when some and can periodically stop projection; Observer eyeground can stop projection while enough becoming clear, and utilizes eyeground information to detect the current sight line focusing of eyes to the distance of eyes.
In addition, can also control projected spot brightness according to surround lighting.
Preferably, in the method for the embodiment of the present invention, described image processing step also comprises:
Carry out the calibration of eye fundus image, obtain the benchmark image that at least one image presenting with eyeground is corresponding.Tool is sayed it, and the image collecting and described benchmark image are carried out to comparing calculation, image the most clearly described in acquisition.Here, described image the most clearly can be that obtain and image described benchmark image difference minimum.In the method for present embodiment, can by existing image processing algorithm, calculate the difference of image and the benchmark image of current acquisition, for example use the automatic focus algorithm of classical phase difference value.
The optical parametric of described eyes can comprise the eyes optical axis direction according to the feature of eyes obtains during picture rich in detail described in collecting.Here the feature of eyes can be obtained from described picture rich in detail, or also can obtain in addition.According to the optical axis direction of described eyes, can obtain the direction of gaze of eyes of user sight line.Tool is sayed it, can according to described in obtaining during picture rich in detail the feature on eyeground obtain eyes optical axis direction, and determine that by the feature on eyeground eyes optical axis direction degree of accuracy is higher.
When to eyeground projected spot pattern, the size of spot pattern is likely greater than viewing area, eyeground or is less than viewing area, eyeground, wherein:
When the area of spot pattern is less than or equal to viewing area, eyeground, can utilize classical Feature Points Matching algorithm (for example yardstick invariant features conversion (Scale Invariant Feature Transform, SIFT) algorithm) with respect to position, eyeground, to determine eyes optical axis direction by the spot pattern in detected image.
When the area of spot pattern is more than or equal to viewing area, eyeground, can with respect to the position of former spot pattern (obtaining by image calibration), determine that eyes optical axis direction determines observer's direction of visual lines by the spot pattern on the image obtaining.
In the possible embodiment of the another kind of the method for the embodiment of the present invention, also can according to described in obtaining during picture rich in detail the feature of eye pupil obtain eyes optical axis direction.Here the feature of eye pupil can be obtained from described picture rich in detail, also can obtain in addition.By eye pupil feature, obtaining eyes optical axis direction is prior art, repeats no more herein.
In addition, in the method for the embodiment of the present invention, also can comprise the calibration steps to eyes optical axis direction, to carry out more accurately determining of above-mentioned eyes optical axis direction.
In the method for the embodiment of the present invention, described known imaging parameters comprises fixing imaging parameters and real time imagery parameter, wherein real time imagery parameter be while obtaining picture rich in detail described in the parameter information of optical device, this parameter information can described in obtaining during picture rich in detail real time record obtain.
After obtaining the current optical parametric of eyes, just can in conjunction with the eyes focusing calculating, arrive the distance (detailed process describes in detail in connection with device part) of eyes, obtain the position of eye gaze point.
In order to allow the equipment input message that user sees there is stereo display effect, truer, in a kind of possible embodiment of the embodiment of the present invention, can, in described projection step S180, described equipment input message three-dimensionally be projected to described user's eyeground.
As described above, in a kind of possible embodiment, the demonstration of this solid can be by identical information, and by the adjustment of projection step launching position, the information with parallax that two eyes of user are seen, forms stereo display effect.
In the possible embodiment of another kind, described equipment input message comprises corresponding with two of described user respectively steric information, and in described projection step, two to described user project corresponding equipment input messages respectively.That is: described equipment input message comprises the left eye information corresponding with user's left eye and the right eye information corresponding with user's right eye, during projection, described left eye information is projected to user's left eye, right eye information is projected to user's right eye, make the equipment input message that user sees there is applicable stereo display effect, bring better user to experience.In addition, while containing three-dimensional spatial information in to the equipment input message of user's input, by above-mentioned solid, project, make user can see described three-dimensional spatial information.For example: when the described equipment input message of the correct input of specific gesture ability is done in needs user specific position in three dimensions, said method by the embodiment of the present invention makes user see three-dimensional equipment input message, know described specific position and specific gesture, and then make user can do at described ad-hoc location the gesture of described equipment input message prompting, even if now other people sees the gesture motion that user carries out, but owing to cannot knowing described spatial information, make the secret better effects if of described equipment input message.
As shown in Figure 5, the embodiment of the present invention provides a kind of first information interactive device 500, comprising:
One image collection module 510, for obtaining and the one one device-dependent image, described image comprises at least one identification information;
One identification information acquisition module 520, for obtaining the described identification information of described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
One identification information provides module 530, for the identification information obtaining described in providing to a server.
The embodiment of the present invention obtain with one first device-dependent image the identification information that obtains comprising in this image after offer a server, make server can extract that equipment input message in described identification information is carried out and described the first equipment between information interaction, user friendly operation.
The embodiment of the present invention conducts further description each module of described first information interactive device 500 by following embodiment below:
In the embodiment of the embodiment of the present invention, the form of described image collection module 510 can have multiple, for example:
As shown in Figure 6 a, described image collection module 510 comprises an image acquisition submodule 511, for obtaining described image by the mode of taking.
Wherein said image acquisition submodule 511, for example, can be the camera of an intelligent glasses, for the image that user is seen, takes.
As shown in Figure 6 b, in another embodiment of the embodiment of the present invention, described image collection module 510 comprises:
One first communicator module 512, for obtaining described image by the mode receiving.
In the present embodiment, can obtain described image by miscellaneous equipment, then be sent to the device of the embodiment of the present invention; Or by and show and to obtain alternately described image (being that described the first equipment sends the image information of demonstration in the device of the embodiment of the present invention) between the first equipment of this image.
In the embodiment of the present invention, except providing described equipment input message to described equipment to carry out corresponding operation, for make user can be secret see described equipment input message, as shown in Figure 6 b, described device 500 also comprises:
One input message acquisition module 550, the described equipment input message providing for obtaining described server;
One projection module 560, for the eyeground projection to described user by described equipment input message.
Wherein, in one embodiment, described input message acquisition module 550 can be a communication module, for receiving the described equipment input message of returning from described server.The function of this communication module and described the first communicator module 512 also can realize by same equipment.
Like this, allow user can know corresponding information on the one hand, on the other hand, at some equipment, cannot receive the occasion (for example, while there is communication issue) of described equipment input message, user can manually input in described equipment according to the described equipment input message obtaining.
As shown in Figure 6 b, in the present embodiment, described projection module 560 comprises:
One information projection submodule 561, for projecting described equipment input message;
One parameter adjustment submodule 562, for adjusting at least one projection imaging parameter of light path between described launching position and described user's eyes, until described equipment input message is at described user's eyeground blur-free imaging.
In one embodiment, described parameter adjustment submodule 562 comprises:
At least one adjustable lens device, himself focal length position adjustable and/or in light path between described launching position and described user's eyes is adjustable.
As shown in Figure 6 b, in one embodiment, described projection module 560 comprises:
One curved surface light-splitting device 563, when different for the corresponding described eyes optical axis direction of difference, the position of pupil, transmits described equipment input message to described user's eyeground.
In one embodiment, described projection module 560 comprises:
Submodule 564 is processed in one reversible deformation, for described equipment input message being carried out to the reversible deformation corresponding to position of pupil when different from described eyes optical axis direction, processes, the described equipment input message that eyeground is received need to present.
In one embodiment, described projection module 560 comprises:
Submodule 565 is adjusted in one alignment, for the image that the equipment input message of described projection is seen with described user, on described user's eyeground, aligns.
In one embodiment, described device 500 also comprises:
One position detecting module 540, the position for detection of described user's blinkpunkt with respect to described user;
Submodule 565 is adjusted in described alignment, for the image of with respect to described user's described position, the equipment input message of described projection being seen with described user according to described user's blinkpunkt, on described user's eyeground, aligns.
The function of each submodule of above-mentioned projection module is referring to the description of corresponding step in embodiment of the method above, and Fig. 7 a-7d below, in the embodiment shown in Fig. 8 and Fig. 9, also can provide example.
In the embodiment of the present invention, described position detecting module 540 can have multiple implementation, for example the i of embodiment of the method)-iii) plant device corresponding to described method.The embodiment of the present invention further illustrates by Fig. 7 a-Fig. 7 d, Fig. 8 and embodiment corresponding to Fig. 9 and iii) plants position detecting module corresponding to method:
As shown in Figure 7a, in a kind of possible embodiment of the embodiment of the present invention, described position detecting module 700 comprises:
One eye fundus image gathers submodule 710, for gathering the image on user eyeground described in;
One adjustable imaging submodule 720, for carrying out the adjusting of at least one imaging parameters of light path between described eye fundus image collection position and described eyes of user until collect an image the most clearly;
One image is processed submodule 730, for the image on the described eyeground collecting is analyzed, obtain the described imaging parameters of light path and at least one optical parametric of described eyes between the described eye fundus image collection position corresponding with described image the most clearly and described eyes, and calculate the current blinkpunkt of described user with respect to described user's position.
This position detecting module 700 is carried out analyzing and processing by the image at the bottom of eye, and when obtaining described eye fundus image and gathering submodule and obtain picture rich in detail, the optical parametric of eyes, just can calculate the current blinkpunkt position of eyes.
Here the image that " eyeground " presents is mainly the image presenting on retina, and it can be the image on eyeground self, or can be for projecting the image of other object on eyeground.The eyes here can be human eye, can be also the eyes of other animal.
As shown in Figure 7b, in a kind of possible embodiment of the embodiment of the present invention, it is minisize pick-up head that described eye fundus image gathers submodule 710, in the possible embodiment of the another kind of the embodiment of the present invention, described eye fundus image gathers directly use sense photoimaging device of submodule 710, as devices such as CCD or CMOS.
In a kind of possible embodiment of the embodiment of the present invention, described adjustable imaging submodule 720 comprises: adjustable lens device 721, at eyes and described eye fundus image, gather in the light path between submodule 710, self focal length position adjustable and/or in light path is adjustable.By this adjustable lens device 721, make from eyes adjustable to the system equivalent focal length described eye fundus image collection submodule 710, by the adjusting of adjustable lens device 721, make described eye fundus image gather submodule 710 in some positions of adjustable lens device 721 or obtain eyeground image the most clearly during state.In the present embodiment, described adjustable lens device 721 real-time adjusting continuously in testing process.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described adjustable lens device 721 is: focal length adjustable lens, and for by regulating self refractive index and/or the shape adjustment that completes self focal length.Be specially: 1) by least curvature of one side of the adjustable lens of focusing, focus, for example, in the cavity that Double-layered transparent layer forms, increase or reduce the focus curvature of adjustable lens of liquid medium; 2) by changing the refractive index of focal length adjustable lens, focus, for example in focal length adjustable lens, be filled with particular fluid crystalline medium, by the voltage of adjustable liquid crystal display medium counter electrode, adjust the arrangement mode of liquid crystal media, thereby change the refractive index of focal length adjustable lens.
In the possible embodiment of the another kind of the embodiment of the present invention, described adjustable lens device 721 comprises: the lens combination that multi-disc lens form, and for regulating relative position between lens combination lens to complete the adjustment of lens combination self focal length.In described lens combination, also can comprise the adjustable lens of imaging parameters such as self focal length.
Except above-mentioned two kinds by regulating the characteristic of adjustable lens device 721 self to change the light path parameter of system, can also be by regulating the position of described adjustable lens device 721 in light path to change the light path parameter of system.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, in order not affect the viewing experience of user to the object of observation, and for make system can portable application on Wearable equipment, described adjustable imaging submodule 720 also comprises: spectrophotometric unit 722, is used to form between eyes and the object of observation and eyes and eye fundus image gather the light bang path between submodule 710.Can fold light path like this, reduce the volume of system, not affect as far as possible other visual experience of user simultaneously.
Preferably, in the present embodiment, described spectrophotometric unit comprises: the first spectrophotometric unit, between eyes and the object of observation, the light for viewed in transmittance object to eyes, transmits eyes and to eye fundus image, gather the light of submodule.
Described the first spectrophotometric unit can be spectroscope, light splitting optical waveguide (comprising optical fiber) or other applicable light-dividing device.
In a kind of possible embodiment of the embodiment of the present invention, the image of described system is processed submodule 730 and is comprised light path alignment unit, calibrates, such as the alignment etc. of carrying out light path light axis, with the precision that guarantees to measure for the light path to system.
In a kind of possible embodiment of the embodiment of the present invention, described image is processed submodule 730 and is comprised:
Image analyzing unit 731, analyzes for the image that described eye fundus image collection submodule is obtained, and finds image the most clearly;
Parameter calculation unit 732, for according to described image the most clearly and described in obtaining during picture rich in detail the known imaging parameters of system calculate the optical parametric of eyes.
In the present embodiment, by adjustable imaging submodule 720, make described eye fundus image gather submodule 710 and can obtain image the most clearly, but need to find this image the most clearly by described image analyzing unit 731, now just can be by calculating the optical parametric of eyes according to described image the most clearly and the known light path parameter of system.Here the optical parametric of eyes can comprise the optical axis direction of eyes.
In a kind of possible embodiment of the embodiment of the present invention, preferably, described system also comprises: projection submodule 740, and for to eyeground projected spot.In a possible embodiment, can carry out by micro projector the function of this projection submodule of sight line.
Here the hot spot of projection can not have specific pattern only for illuminating eyeground.
In the preferred a kind of embodiment of the embodiment of the present invention, the hot spot of described projection comprises the pattern of feature rich.The feature rich of pattern can be so that detect raising accuracy of detection.The exemplary plot of a spot pattern P as shown in Figure 4 a, this pattern can be formed by spot pattern maker, for example frosted glass; Fig. 4 b is depicted as the image on the eyeground photographing when having spot pattern P projection.
In order not affect normally watching of eyes, preferred, described hot spot is the sightless infrared light spot of eyes.
Now, in order to reduce the interference of other spectrum:
The exit facet of described projection submodule can be provided with eyes invisible light transmission filter.
The plane of incidence that described eye fundus image gathers submodule is provided with eyes invisible light transmission filter.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image is processed submodule 730 and is also comprised:
Projection control unit 734, for the result obtaining according to image analyzing unit 731, controls the projected spot brightness of described projection submodule 740.
The characteristic self-adaptation that for example described projection control unit 734 can gather the image that submodule 710 obtains according to eye fundus image is adjusted brightness.Here the characteristic of image comprises the contrast of characteristics of image and textural characteristics etc.
Here, control a kind of special situation of projected spot brightness of described projection submodule 740 for opening or closing projection submodule 740, for example user continues to watch attentively when some and can periodically close described projection submodule 740; When enough become clear in user eyeground, can close light emitting source only utilizes eyeground information to detect the current sight line blinkpunkt of eyes to the distance of eyes.
In addition, described projection control unit 734 can also be controlled according to surround lighting the projected spot brightness of projection submodule 740.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image is processed submodule 730 and is also comprised: image calibration unit 733, for carrying out the calibration of eye fundus image, obtains the benchmark image that at least one image presenting with eyeground is corresponding.
Described image analyzing unit 731 gathers by eye fundus image image and the described benchmark image that submodule 730 obtains and carries out comparing calculation, image the most clearly described in acquisition.Here, described image the most clearly can be that obtain and image described benchmark image difference minimum.In the present embodiment, by existing image processing algorithm, calculate the difference of image and the benchmark image of current acquisition, for example, use the automatic focus algorithm of classical phase difference value.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described parameter calculation unit 732 comprises:
Eyes optical axis direction is determined subelement 7321, for according to described in obtaining during picture rich in detail the feature of eyes obtain eyes optical axis direction.
Here the feature of eyes can be obtained from described picture rich in detail, or also can obtain in addition.According to eyes optical axis direction, can obtain the direction that eyes of user sight line is watched attentively.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described eyes optical axis direction determines that subelement 7321 comprises: first determines subelement, for according to described in obtaining during picture rich in detail the feature on eyeground obtain eyes optical axis direction.Obtain eyes optical axis direction with feature by pupil and eyeball surface and compare, by the feature on eyeground, determine that eyes optical axis direction degree of accuracy is higher.
When to eyeground projected spot pattern, the size of spot pattern is likely greater than viewing area, eyeground or is less than viewing area, eyeground, wherein:
When the area of spot pattern is less than or equal to viewing area, eyeground, can utilize classical Feature Points Matching algorithm (for example yardstick invariant features conversion (Scale Invariant Feature Transform, SIFT) algorithm) with respect to position, eyeground, to determine eyes optical axis direction by the spot pattern in detected image;
When the area of spot pattern is more than or equal to viewing area, eyeground, can with respect to the position of former spot pattern (obtaining by image calibration unit), determine that eyes optical axis direction determines user's direction of visual lines by the spot pattern on the image obtaining.
In the possible embodiment of the another kind of the embodiment of the present invention, described eyes optical axis direction determines that subelement 7321 comprises: second determines subelement, for according to described in obtaining during picture rich in detail the feature of eye pupil obtain eyes optical axis direction.Here the feature of eye pupil can be obtained from described picture rich in detail, also can obtain in addition.By eye pupil feature, obtaining eyes optical axis direction is prior art, repeats no more herein.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image is processed submodule 730 and is also comprised: eyes optical axis direction alignment unit 735, and for carrying out the calibration of eyes optical axis direction, to carry out more accurately determining of above-mentioned eyes optical axis direction.
In the present embodiment, the known imaging parameters of described system comprises fixing imaging parameters and real time imagery parameter, wherein real time imagery parameter be while obtaining picture rich in detail described in the parameter information of adjustable lens device, this parameter information can described in obtaining during picture rich in detail real time record obtain.
Calculate again the distance that eye gaze is put eyes below, be specially:
Fig. 7 c is depicted as eye imaging schematic diagram, in conjunction with the lens imaging formula in classical optical theory, by Fig. 7 c, can obtain formula (1):
1 d o + 1 d e = 1 f e - - - ( 1 )
Its neutralization is respectively real image on the current object of observation 7010 of eyes and retina 7020 to the distance of eyes equivalent lens 7030, is the equivalent focal length of eyes equivalent lens 7030, the direction of visual lines that X is eyes (can be obtained by the optical axis direction of described eyes).
Fig. 7 d is depicted as according to the optical parametric of system known optical parameter and eyes and obtains the schematic diagram that eye gaze is put the distance of eyes, in Fig. 7 d, hot spot 7040 can become a virtual image (not shown in Fig. 7 d) by adjustable lens device 721, suppose that this virtual image is (not shown in Fig. 7 d) apart from lens distance, can obtain following system of equations in conjunction with formula (1):
1 d p - 1 x = 1 f p 1 d i + x + 1 d e = 1 f e - - - ( 2 )
Be wherein that hot spot 7040 is to the optical equivalence distance of adjustable lens device 721, for the optical equivalence distance of adjustable lens device 721 to eyes equivalent lens 7030, for the focal length value of adjustable lens device 721, be the distance of described eyes equivalent lens 7030 to adjustable lens device 721.
By (1) and (2), can draw current object of observation 7010(eye gaze point) to the distance of eyes equivalent lens 7030 as shown in formula (3):
d o = d i + d p · f p f p - d p - - - ( 3 )
Distance according to the above-mentioned object of observation calculating 7010 to eyes, because record before can obtain eyes optical axis direction, can obtain the blinkpunkt position of eyes again easily, is follow-up further alternately provide the foundation relevant to eyes.
The position detecting module 800 that is illustrated in figure 8 a kind of possible embodiment of the embodiment of the present invention is applied in the embodiment on glasses G, it comprises the content of the record of Fig. 7 b illustrated embodiment, be specially: as seen from Figure 8, in the present embodiment, the integrated module 800 of present embodiment on glasses G right side (being not limited to this), it comprises:
Minisize pick-up head 810, its effect is identical with the eye fundus image collection submodule of recording in Fig. 7 b embodiment, the sight line of normally watching object in order not affect user, it is arranged at the right outside side of glasses G;
The first spectroscope 820, its effect is identical with the first spectrophotometric unit of recording in Fig. 7 b embodiment, with certain inclination angle, be arranged at the intersection point place of eyes A direction of gaze and camera 810 incident directions, viewed in transmittance object enters the light of eyes A and reflects eyes to the light of camera 810;
Focal length adjustable lens 830, its effect is identical with the focal length adjustable lens of recording in Fig. 7 b embodiment, between described the first spectroscope 820 and camera 810, carries out in real time the adjustment of focal length value, make when certain focal length value, described camera 810 can photograph eyeground image the most clearly.
In the present embodiment, described image is processed submodule and is not expressed in Fig. 8, and its function is identical with the image processing submodule shown in Fig. 7 b.
Due to generally, the brightness on eyeground is inadequate, therefore, is preferably thrown light in eyeground, in the present embodiment, by a light emitting source 840, is thrown light in eyeground.In order not affect user's experience, preferred light emitting source 840 be eyes invisible light here, preferably on eyes A impact not quite and camera 810 again than more sensitive near infrared light light emitting source.
In the present embodiment, described light emitting source 840 is positioned at the spectacle frame outside on right side, therefore need to complete by second spectroscope 850 light that described light emitting source 840 sends to the transmission on eyeground together with described the first spectroscope 820.In present embodiment, before described the second spectroscope 850 is positioned at again the plane of incidence of camera 810, so it also needs transmission eyeground to the light of the second spectroscope 850.
Can find out, in the present embodiment, experience and improve the collection sharpness of camera 810 in order to improve user, described the first spectroscope 820 preferably can have high to infrared reflectivity, high to transmission of visible light characteristic.For example can towards a side of eyes A, infrared reflection film be set at the first spectroscope 820 and realize above-mentioned characteristic.
As seen from Figure 8, due in the present embodiment, described position detecting module 800 is positioned at the eyeglass of glasses G away from a side of eyes A, therefore carries out eyes optical parametric while calculating, eyeglass also can be regarded as to a part of eyes A, now do not needed to know the optical characteristics of eyeglass.
In other embodiment of the embodiment of the present invention, described position detecting module 800 may be positioned at the eyeglass of glasses G near a side of eyes A, now, need to obtain in advance the optical property parameter of eyeglass, and calculate blinkpunkt apart from time, consider the influence factor of eyeglass.
The light that in the present embodiment, light emitting source 840 sends by the reflection of the reflection of the second spectroscope 850, the projection of focal length adjustable lens 830 and the first spectroscope 820 after again the eyeglass of transmitted through glasses G enter eyes of user, and finally arrive on the retina on eyeground; The light path that camera 810 forms through described the first spectroscope 820, focal length adjustable lens 830 and the second spectroscope 850 photographs the image on eyeground through the pupil of eyes A.
In a kind of possible embodiment, the other parts of the device of the embodiment of the present invention also realize on described glasses G, and, because described position detecting module and described projection module likely comprise simultaneously: the equipment (information of projection module projection submodule, and the projection submodule of described position detecting module as described above) with projection function; And the adjustable imaging device of imaging parameters (the parameter adjustment submodule of projection module as described above, and the adjustable imaging submodule of described position detecting module) etc., therefore in a kind of possible embodiment of the embodiment of the present invention, the function of described position detecting module and described projection module is realized by same equipment.
As shown in Figure 8, in a kind of possible embodiment of the embodiment of the present invention, described light emitting source 840, can also be as equipment input message described in the light source auxiliary projection of the information projection submodule of described projection module except can the illumination for described position detecting module.In a kind of possible embodiment, described light emitting source 840 can project respectively a sightless light for the illumination of described position detecting module simultaneously; And a visible ray, for equipment input message described in auxiliary projection; In the possible embodiment of another kind, described light emitting source 840 can also switch the described invisible light of projection and described visible ray in timesharing ground; In another possible embodiment, described position detecting module can complete the function that illuminates eyeground by described equipment input message.
In a kind of possible embodiment of the embodiment of the present invention, described the first spectroscope 820, the second spectroscope 850 and described focal length adjustable lens 830, can also be as the adjustable imaging submodules of described position detecting module except can be used as the parameter adjustment submodule of described projection module.Here, described focal length adjustable lens 830 is in a kind of possible embodiment, and its focal length can subregionally regulate, and different regions corresponds respectively to described position detecting module and described projection module, and focal length also may be different.Or, the focal length of described focal length adjustable lens 830 is integrally-regulated, but the front end of the photosensitive unit of the minisize pick-up head of described position detecting module 810 (as CCD etc.) is also provided with other optical device, for realizing the imaging parameters auxiliary adjustment of described position detecting module.In addition, in the possible embodiment of another kind, can configure the light-emitting area (being that equipment input message is launched position) making from described light emitting source 840 identical to the light path of described minisize pick-up head 810 with described eyes to the light path of eyes, when described focal length adjustable lens 830 is adjusted to described minisize pick-up head 810 and receives the most clearly eye fundus image, the just in time clearly imaging on eyeground of equipment input message of described light emitting source 840 projections.
By above-mentioned, can be found out, the position detecting module of embodiment of the present invention first information interactive device and the function of projection module can be realized by a set of equipment, make that whole system is simple in structure, volume is little, be more easy to carry.
Be illustrated in figure 9 the structural representation of the another kind of embodiment position detecting module 900 of the embodiment of the present invention.As seen from Figure 9, present embodiment is similar to the embodiment shown in Fig. 8, comprise minisize pick-up head 910, the second spectroscope 920, focal length adjustable lens 930, difference is, projection submodule 940 is in the present embodiment the projection submodule 940 of projected spot pattern, and as curved surface light-splitting device, has replaced the first spectroscope in Fig. 8 embodiment by a curved surface spectroscope 950.
The position of pupil while having adopted the respectively corresponding eyes optical axis direction of curved surface spectroscope 950 different here, the image transfer that eyeground is presented gathers submodule to eye fundus image.Camera can photograph the imaging that eyeball all angles are mixed stack like this, but due to only have eyeground part by pupil can be on camera blur-free imaging, other parts can be out of focus and cannot blur-free imaging, thereby can not form severe jamming to the imaging of eyeground part, the feature of eyeground part still can detect.Therefore, compare with the embodiment shown in Fig. 8, present embodiment can well obtain the image on eyeground when eye gaze different directions, makes the position detecting module scope of application of present embodiment wider, and accuracy of detection is higher.
In a kind of possible embodiment of the embodiment of the present invention, the other parts of the first information interactive device of the embodiment of the present invention also realize on described glasses G.In the present embodiment, described position detecting module and described projection module also can be multiplexing.With the embodiment shown in Fig. 8 similarly, now described projection submodule 940 can be simultaneously or timesharing switch ground projected spot pattern and described equipment input message; Or described position detecting module detects the equipment input message of projection as described spot pattern.With the embodiment shown in Fig. 8 similarly, in a kind of possible embodiment of the embodiment of the present invention, described the first spectroscope 920, the second spectroscope 950 and described focal length adjustable lens 930, can also be as the adjustable imaging submodules of described position detecting module except can be used as the parameter adjustment submodule of described projection module.
Now, described the second spectroscope 950 is the position of pupil when respectively corresponding eyes optical axis direction is different also, carries out the light path transmission between described projection module and eyeground.The second spectroscope 950 that passes through described curved surface due to the equipment input message of described projection submodule 940 projections can deform afterwards, and therefore in the present embodiment, described projection module comprises:
Reversible deformation processing module (not shown in Fig. 9), for the equipment input message of described equipment input message being carried out to the reversible deformation processing corresponding with described curved surface light-splitting device, eyeground is received presenting.
In one embodiment, described projection module is for three-dimensionally projecting described equipment input message to described user's eyeground.
Described equipment input message comprises corresponding with two of described user respectively steric information, described projection module, and two to described user project corresponding equipment input messages respectively.
As shown in figure 10, in the situation that needs carry out stereo display, described first information interactive device 1000 need respectively two eyes with user corresponding two cover projection module are set, comprising:
First projection module corresponding with user's left eye; And
Second projection module corresponding with user's right eye.
Wherein, the structure that is compounded with position detecting module function of recording in the structure of described the second projection module and the embodiment of Figure 10 is similar, also for can realize the structure of position detecting module function and projection module function simultaneously, comprise the minisize pick-up head 1021 identical with described function embodiment illustrated in fig. 10, the second spectroscope 1022, the second focal length adjustable lens 1023, it is not shown in Figure 10 that described in the first spectroscope 1024(, the image of position detecting module is processed submodule), difference is, projection submodule is in the present embodiment for projecting the second projection submodule 1025 of the equipment input message that right eye is corresponding.It simultaneously can be for detection of the blinkpunkt position of eyes of user, and equipment input message clear be projected to a right eye eyeground corresponding with right eye.
The structure of the structure of described the first projection module and described the second projection module 1020 is similar, but it does not have minisize pick-up head, and there is no the function of recombination site detection module.As shown in figure 10, described the first projection module comprises:
The first projection submodule 1011, for projecting the equipment input message corresponding with left eye to left eye eyeground;
The first focal length adjustable lens 1013, for the imaging parameters between described the first projection submodule 1011 and eyeground, regulate, make corresponding equipment input message can clearly be presented on left eye eyeground and user can be seen to be presented on the described equipment input message on described image;
The 3rd spectroscope 1012, for carrying out light path transmission between described the first projection submodule 1011 and described the first focal length adjustable lens 1013;
The 4th spectroscope 1014, for carrying out light path transmission between described the first focal length adjustable lens 1013 and described left eye eyeground.
By the present embodiment, make the equipment input message that user sees there is applicable stereo display effect, bring better user to experience.In addition, while containing three-dimensional spatial information in to the equipment input message of user's input, by above-mentioned solid, project, make user can see described three-dimensional spatial information.For example: when the described equipment input message of the correct input of specific gesture ability is done in needs user specific position in three dimensions, said method by the embodiment of the present invention makes user see three-dimensional equipment input message, know described specific position and specific gesture, and then make user can do at described ad-hoc location the gesture of described equipment input message prompting, even if now other people sees the gesture motion that user carries out, but owing to cannot knowing described spatial information, make the secret better effects if of described equipment input message.
The structural representation of another first information interactive device 1100 that Figure 11 provides for the embodiment of the present invention, the specific embodiment of the invention does not limit the specific implementation of first information interactive device 1100.As shown in figure 11, this first information interactive device 1100 can comprise:
Processor (processor) 1110, communication interface (Communications Interface) 1120, storer (memory) 1130 and communication bus 1140.Wherein:
Processor 1110, communication interface 1120 and storer 1130 complete mutual communication by communication bus 1140.
Communication interface 1120, for the net element communication with such as client etc.
Processor 1110, for executive routine 1132, specifically can carry out the correlation step in said method embodiment.
Particularly, program 1132 can comprise program code, and described program code comprises computer-managed instruction.
Processor 1110 may be a central processor CPU, or specific integrated circuit ASIC(Application Specific Integrated Circuit), or be configured to implement one or more integrated circuit of the embodiment of the present invention.
Storer 1130, for depositing program 1132.Storer 1130 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 1132 specifically can be for making described first information interactive device 1100 carry out following steps:
Image acquisition step, obtains and an one first device-dependent image, and described image comprises at least one identification information;
Identification information obtaining step, obtains the described identification information in described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
Identification information provides step, the identification information obtaining described in providing to a server.
In program 1132, the specific implementation of each step can, referring to description corresponding in the corresponding steps in above-described embodiment and unit, be not repeated herein.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the corresponding process in preceding method embodiment, does not repeat them here.
As shown in figure 12, the embodiment of the present invention also provides a kind of wearable device 1200, comprises the described first information interactive device 1210 of recording in described embodiment above.
Preferably, described wearable device is glasses.In some embodiments, these glasses can be for example the structure of Fig. 8-Figure 10.
As shown in figure 13, the embodiment of the present invention also provides a kind of server info exchange method, comprising:
S1320 identification information obtaining step, obtains the identification information that one second equipment provides;
S1340 input message obtaining step, obtain in described identification information, comprise with one first device-dependent at least one equipment input message;
S1360 input message provides step, to described the first equipment, provides described equipment input message.
The identification information that the embodiment of the present invention is obtained from one second equipment, obtain equipment input message, and described equipment input message is transferred to the first corresponding equipment, make the first equipment can carry out the function corresponding with described equipment input message, and then do not need these equipment input messages of user oneself memory just can when user needs, to the first equipment, carry out corresponding operation, greatly facilitate user, improve user and experience.
In the embodiment of the present invention, the mode that described step S1340 obtains described equipment input message from described identification information comprises multiple:
1) extract the described equipment input message comprising in described identification information.
Take described identification information as digital watermarking be example, in the present embodiment, for example, can analyze described digital watermarking by individual private key and open or privately owned watermark extracting method, extract described equipment input message.
2) to outside, send described identification information; From outside, receive the described equipment input message comprising described identification information.
In the present embodiment, described identification information can be sent to outside, for example be sent to other server and/or a third party authoritative institution, by described other server or described third party authoritative institution, extract the described equipment input message in described identification information.
In the present embodiment, when image corresponding to described identification information is the login interface of the user environment that shows of described equipment, the log-on message that described equipment input message is described user environment.For example, described image is the login page of a website showing of an electronic equipment, and described equipment input message is the log-on messages such as the user name corresponding with this website, password.
In the present embodiment, when described image is the equipment locking screen interface shown in Fig. 2 a or Fig. 2 b, the release information that described equipment input message is described locking screen interface.Be the locking screen interface of a touch-screen mobile phone equipment as shown in Figure 2 a, in prior art, needing user on the screen of mobile phone, to draw corresponding track just can release mobile phone, user can be entered in the user environment of cell phone system further to be operated, and in the present embodiment, in described locking screen interface, embed and have described digital watermarking, present embodiment obtains corresponding release information by described digital watermarking, send to again described equipment, make described equipment receive automatic unlocking after this release information.
As shown in Figure 14 a, in some possible embodiments, except the step shown in Figure 13, for the security that raising equipment is used, described method also comprises:
S1330 authorizes determining step, judges whether active user is an authorized user, and just carries out described input message obtaining step when described active user is authorized user.
Tool is sayed it, and, when described active user is described authorized user, described method is just carried out obtaining of described equipment input message.In present embodiment, after server has obtained described identification information, in order to ensure that user information safety need to authenticate user, make to only have authorized user just can carry out respective operations to described the first equipment, do not have authorized user can not to described the first equipment, carry out respective operations by the method for the embodiment of the present invention.This mandate determining step S1330 can for example, carry out at far-end (other server), is about to corresponding user profile etc. and is sent to far-end, after far-end judgement, the result of judgement is sent back to this locality; Also can directly at home server, carry out.
In other possible embodiments, described mandate determining step can also be arranged on before described input message provides step.As shown in Figure 14 b, in the present embodiment, described method also comprises:
S1350 authorizes determining step, judges whether active user is an authorized user, and described active user, just carries out described input message during for authorized user step is provided.
In the embodiment of the present invention, after having extracted by described identification information the equipment input message that described the first equipment is corresponding, need to authenticate user, only make during for authorized user, just described equipment input message to be offered to described the first equipment user.Similar to Figure 14 a illustrated embodiment, in the present embodiment, described mandate determining step also can carry out at far-end or this locality.
In a kind of possible embodiment of the embodiment of the present invention, manually to use when making user also can know described equipment input message to need, described method also comprises:
To described the second equipment, provide described equipment input message.
As shown in figure 15, the embodiment of the present invention also provides a kind of server 1500, comprising:
One identification information acquisition module 1510, the identification information providing for obtaining one second equipment;
One input message acquisition module 1520, for obtain that described identification information comprises with one first device-dependent at least one equipment input message;
One input message provides module 1530, for providing described equipment input message to described the first equipment.
The identification information that the embodiment of the present invention is obtained from one second equipment, obtain equipment input message, and described equipment input message is transferred to the first corresponding equipment, make the first equipment can carry out the function corresponding with described equipment input message, and then do not need these equipment input messages of user oneself memory just can when user needs, to the first equipment, carry out corresponding operation, greatly facilitate user, improve user and experience.
In embodiments of the present invention, the form of described input message acquisition module 1520 also can have multiple, for example:
As shown in Figure 16 a, described input message acquisition module 1520 comprises:
One information extraction submodule 1521, the described equipment input message comprising for extracting described identification information.
In the present embodiment, described identification information can be for example digital watermarking, and described information extraction submodule 1521 for example can be analyzed described digital watermarking by individual private key and open or privately owned watermark extracting method, extracts described equipment input message.
As shown in Figure 16 b, in another embodiment of the embodiment of the present invention, described input message acquisition module 1520 comprises:
One second communication submodule 1522, for:
To outside, send described identification information;
From outside, receive the described equipment input message comprising described identification information.
In the present embodiment, described identification information can be sent to outside, for example be sent to other server and/or a third party authoritative institution, by described other server or described third party authoritative institution, extract after the described equipment input message in described identification information, then postback the described second communication submodule 1522 to the embodiment of the present invention.
In embodiments of the present invention, it can be also communication module that described identification information acquisition module 1510 and/or described input message provide module 1530, and the function of itself and described second communication submodule 1522 also can realize by same equipment.
As shown in Figure 16 a, in a kind of possible embodiment of the embodiment of the present invention, described server 1500 also comprises:
Authorize judge module 1550, for judging whether active user is an authorized user, and described user, just start described input message acquisition module 1520 during for authorized user and carry out respective operations.Tool is sayed it, and, when described active user is described authorized user, described input message acquisition module 1520 just carries out obtaining of described equipment input message.
In present embodiment, after server has obtained described identification information, in order to ensure that user information safety need to authenticate user, make to only have authorized user just can carry out respective operations to described the first equipment, do not have authorized user can not to described the first equipment, carry out respective operations by the method for the embodiment of the present invention.
As shown in Figure 16 b, in other possible embodiments of the embodiment of the present invention, described mandate judge module 1550 judges whether active user is an authorized user, and described active user, just starts described input message during for described authorized user and provide module to carry out respective operations.
In the embodiment of the present invention, after having extracted by described identification information the equipment input message that described the first equipment is corresponding, need to authenticate user, only make during for authorized user, just described equipment input message to be offered to described the first equipment user.
In the embodiment of the present invention, by described mandate judge module 1550, authorize judgement for example, at far-end (other server), to carry out, be about to corresponding user profile etc. and be sent to far-end, after far-end judgement, the result of judgement is sent back to this locality.Now, as shown in Figure 16 b, described mandate judge module 1550 comprises:
Third communication submodule 1551, for:
Send active user's corresponding informance;
Whether receive described active user is the result of an authorized user.
Described third communication submodule 1551 can be independent communication interface device, can be also by same equipment, to realize its function with described second communication submodule 1522.
Certainly, those skilled in the art can know, when not needing user to carry out authorization identifying, described device can not comprise described mandate judge module.
In a kind of possible embodiment of the embodiment of the present invention, manually use when making user also can know described equipment input message to need, described input message provide module 1530 also for:
To described the second equipment, provide described equipment input message.
Figure 16 c is depicted as the structural representation of another server 1600 that the embodiment of the present invention provides, and the specific embodiment of the invention does not limit the specific implementation of the second information interactive device 1600.As shown in Figure 16 c, this second information interactive device 1600 can comprise:
Processor (processor) 1610, communication interface (Communications Interface) 1620, storer (memory) 1630 and communication bus 1640.Wherein:
Processor 1610, communication interface 1620 and storer 1630 complete mutual communication by communication bus 1640.
Communication interface 1620, for the net element communication with such as client etc.
Processor 1610, for executive routine 1632, specifically can carry out the correlation step in embodiment of the method shown in Figure 13.
Particularly, program 1632 can comprise program code, and described program code comprises computer-managed instruction.
Processor 1610 may be a central processor CPU, or specific integrated circuit ASIC(Application Specific Integrated Circuit), or be configured to implement one or more integrated circuit of the embodiment of the present invention.
Storer 1630, for depositing program 1632.Storer 1630 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 1632 specifically can be for making described the second information interactive device 1600 carry out following steps:
Identification information obtaining step, obtains the identification information that one second equipment provides;
Input message obtaining step, obtain in described identification information, comprise with one first device-dependent at least one equipment input message;
Input message provides step, to described the first equipment, provides described equipment input message.
In program 1632, the specific implementation of each step can, referring to description corresponding in the corresponding steps in above-described embodiment and unit, be not repeated herein.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the corresponding process in preceding method embodiment, does not repeat them here.
As shown in figure 17, the embodiment of the present invention provides a kind of information interacting method, comprising:
S1710 identification information embeds step, with an one first device-dependent image in embed at least one identification information, in described identification information, include the equipment input message corresponding with described the first equipment;
S1720 image provides step, and described image is provided to outside;
S1730 input information step, the outside described equipment input message providing is provided;
S1740 execution step, carries out the operation corresponding with described equipment input message.
The method of the embodiment of the present invention provides to outside after described identification information is embedded in image, making external unit to obtain corresponding equipment input message according to described image turns back to method of the present invention again, the input information step of the inventive method is carried out corresponding operation after receiving the equipment input message that described outside provides automatically, without user, manually operate, user-friendly.
In embodiments of the present invention, described identification information can be described digital watermarking.Described digital watermarking can be divided into two kinds of symmetrical expression and asymmetric watermarks according to symmetry.It is identical with the key detecting that traditional symmetric watermark embeds, once disclose like this method and the key that detect, watermark will be easy to remove from digital carrier.And Asymmetric Watermarking Schemes technology is by carry out embed watermark with private key, use public-key to extract and verify watermark, assailant is just difficult to destroy or remove by PKI the watermark that utilizes private key to embed like this.Therefore,, in the embodiment of the present invention, preferably, use described asymmetric digital watermarking.
In embodiments of the present invention, the described equipment input message being embedded in described identification information that need to be included in can be that user is predefined according to the individual demand of oneself, can be also that system is initiatively user configured.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described step S1720 comprises:
Show described image.
Certainly, in other embodiment of the embodiment of the present invention, described step S1720 can also pass through the mutual mode of equipment room for the method for the embodiment of the present invention, and described image is sent to corresponding equipment.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image is the login interface of a user environment;
Corresponding being operating as of described and described equipment input message: the operation of logining described user environment according to described equipment input message.
For example, the login interface of described image Wei Yi user e-bank account, described equipment input message is name in an account book and the password of described e-bank account, after having received described equipment input message, carry out the operation of the described e-bank account of login user, make user can enter the user environment of this e-bank's account and and then use corresponding function.
Further, in a kind of possible embodiment of the embodiment of the present invention, described image is a locking screen interface;
Corresponding being operating as of described and described equipment input message: according to screen corresponding to described equipment input message release.
The locking screen interface that the described image of take is the mobile phone shown in Fig. 2 a is example, described equipment input message is the release information corresponding with described locking screen interface, after having received described equipment input message, the screen of mobile phone is unlocked, and user can use the corresponding function in the user environment of described cell phone system.
In a kind of possible embodiment of the embodiment of the present invention, described method also comprises before described execution step S1740:
Authorize determining step, judge whether active user is an authorized user, and just carry out described execution step when described active user is described authorized user.
Tool is sayed it, and the equipment input message that not all equipment receives all can trigger carries out corresponding operation, while only having active user to be authorized user, just can carry out corresponding operation.Have a kind of special situation to be, equipment is current is set to the described equipment input message of any reception not carry out the execution of respective operations, and now, all users are not authorized users.
As shown in figure 18, the embodiment of the present invention provides a kind of the second information interactive device 1800, comprising:
Identification information merge module 1810, embeds at least one identification information for the image relevant to described the second information interactive device 1800, includes the equipment input message corresponding with described the second information interactive device 1800 in described identification information;
Image provides module 1820, for described image is provided to outside;
MIM message input module 1830, the described equipment input message providing for receiving outside;
Execution module 1840, carries out corresponding operation for the equipment input message according to described reception.
The device of the embodiment of the present invention provides to outside after described Digital ID information is embedded, make external unit to obtain corresponding equipment input message according to described image and turn back to again the device to the embodiment of the present invention, the device of the embodiment of the present invention carries out corresponding operation automatically by described execution module 1840 after receiving the equipment input message that described outside provides, without user, manually operate, user-friendly.
Corresponding with the description in the embodiment of the method shown in Figure 17, image described in the embodiment of the present invention provides module 1820 to comprise:
Display sub-module 1821, for showing described image.
Corresponding with the method shown in Figure 17, it can also be for example an interactive interface that described image provides module 1820, by mutual mode by described image transfer for example, to miscellaneous equipment (first information interactive device recited above).
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image is the login interface of a user environment;
Described execution module 1840, for logining described user environment according to described equipment input message.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image is a locking screen interface;
Described execution module 1840, for according to screen corresponding to described equipment input message release.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described device 1800 also comprises:
Authorize judge module 1850, for judging whether active user is an authorized user, and when described active user is described authorized user, just trigger described execution module and carry out corresponding operation.
The correspondence realizing in embodiment of the method shown in Figure 17 of above-mentioned each functions of modules is described, and repeats no more here.
As shown in figure 19, the embodiment of the present invention also provides a kind of electric terminal 1900, comprises the second above-mentioned information interactive device 1910.
In a kind of possible embodiment of the embodiment of the present invention, shown in electric terminal 1900 be the electronic equipments such as mobile phone, panel computer, computer, electronic access, vehicle electronic device.
The structural representation of another the second information interactive device 2000 that Figure 20 provides for the embodiment of the present invention, the specific embodiment of the invention does not limit the specific implementation of the second information interactive device 2000.As shown in figure 20, this second information interactive device 2000 can comprise:
Processor (processor) 2010, communication interface (Communications Interface) 2020, storer (memory) 2030 and communication bus 2040.Wherein:
Processor 2010, communication interface 2020 and storer 2030 complete mutual communication by communication bus 2040.
Communication interface 2020, for the net element communication with such as client etc.
Processor 2010, for executive routine 2032, specifically can carry out the correlation step in embodiment of the method shown in Figure 17.
Particularly, program 2032 can comprise program code, and described program code comprises computer-managed instruction.
Processor 2010 may be a central processor CPU, or specific integrated circuit ASIC(Application Specific Integrated Circuit), or be configured to implement one or more integrated circuit of the embodiment of the present invention.
Storer 2030, for depositing program 2032.Storer 2030 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 2032 specifically can be for making described the second information interactive device 2000 carry out following steps:
Identification information embeds step, with an one first device-dependent image in embed at least one identification information, in described identification information, include the equipment input message corresponding with described the first equipment;
Image provides step, and described image is provided to outside;
Input information step, the outside described equipment input message providing is provided;
Execution step, carries out the operation corresponding with the equipment input message of described reception.
In program 2032, the specific implementation of each step can, referring to description corresponding in the corresponding steps in above-described embodiment and unit, be not repeated herein.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the corresponding process in preceding method embodiment, does not repeat them here.
Figure 21 is depicted as the application example schematic diagram of the first and second information interactive devices of the embodiment of the present invention.The server 2130 of the electronic equipment that comprises in embodiments of the present invention, record embodiment illustrated in fig. 19---wearable device of cell phone apparatus 2110, record embodiment illustrated in fig. 12---intelligent glasses 2120 and record embodiment illustrated in fig. 15.
In embodiments of the present invention, described intelligent glasses 2120 comprises the first information interactive device described in the embodiment of Fig. 5 to Figure 11, the function of the image collection module of described first information interactive device (being mainly image acquisition submodule) is realized by the camera 2121 on described intelligent glasses 2120, the identification information acquisition module of described information interactive device (not shown in Figure 21) and identification information provide module (not shown in Figure 21) can be integrated in the original processing module of described intelligent glasses 2120 and realize, the framework that also can be arranged in addition described intelligent glasses 2120 (is for example arranged on leg of spectacles, or become a part for framework) on.
In embodiments of the present invention, described cell phone apparatus 2110 comprises the second information interactive device in embodiment illustrated in fig. 18.Wherein, the function of the display sub-module of described the second information interactive device is realized by the display module of described cell phone apparatus 2110; Described identification information merge module, MIM message input module and execution module also can be integrated in the existing processing module of described cell phone apparatus 2110 and communication module and realize its function, or are arranged in cell phone apparatus 2110 as independent module.In embodiments of the present invention, described image is that the locking screen interface 2111(of described cell phone apparatus 2110 is for example the image showing in Fig. 2 a), described equipment input message is corresponding release information.
In embodiments of the present invention, described identification information is digital watermarking.
In the present embodiment, by described identification information merge module, in advance the digital watermarking that comprises release information is embedded in described cell phone apparatus 2110 locking screen interfaces 2111, and when user need to use described cell phone apparatus 2110, the display module for example, by specific operation (pressing the power key of cell phone apparatus 2110) by described cell phone apparatus 2110 shows.Generally, now, user can see to the display screen of described cell phone apparatus 2110, thereby the camera 2121 that makes described intelligent glasses 2120 can get the image of the locking screen interface 2111 of described demonstration, identification information acquisition module by described the second information interactive device arrives after described digital watermarking according to described image automatic acquisition again, more for example, by described identification information generator (being the wireless communication interface of equipment room) described identification information is sent to described server 2130.Described server extracts after the described release information in described digital watermarking by corresponding watermark extracting method, and the input message by described server provides module to send to described cell phone apparatus 2110.Described cell phone apparatus 2110, after receiving described release information, carries out corresponding unlocking operation by execution module, makes user not need to carry out any other action and just can untie the released state of cell phone apparatus 2110, enters in the user environment of cell phone system.
As seen from the above, by information interactive device and the method for the embodiment of the present invention, make user can carry out very natural and easily corresponding operation (the locking screen interface mobile phone that user has a look at mobile phone is automatic unlocking just), provide user to experience.
Those of ordinary skills can recognize, unit and the method step of each example of describing in conjunction with embodiment disclosed herein, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds scope of the present invention.
If described function usings that the form of SFU software functional unit realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium.Understanding based on such, the part that technical scheme of the present invention contributes to prior art in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CDs.
Above embodiment is only for illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.

Claims (41)

1. an information interacting method, is characterized in that, comprising:
Image acquisition step, obtains and an one first device-dependent image, and described image comprises at least one identification information;
Identification information obtaining step, obtains the described identification information in described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
Identification information provides step, the identification information obtaining described in providing to a server.
2. the method for claim 1, is characterized in that, described image is a login interface of a user environment of described the first equipment demonstration.
3. method as claimed in claim 2, is characterized in that,
The log-on message that described equipment input message is described user environment.
4. method as claimed in claim 2, is characterized in that, described image is the locking screen interface that described the first equipment shows.
5. method as claimed in claim 4, is characterized in that,
The release information that described equipment input message is described locking screen interface.
6. the method for claim 1, is characterized in that, described image acquisition step comprises:
By the mode of taking, obtain described image.
7. the method for claim 1, is characterized in that, described image acquisition step comprises:
By the mode receiving, obtain described image.
8. the method for claim 1, is characterized in that, described identification information is digital watermarking.
9. the method for claim 1, is characterized in that, described method also comprises:
Input message obtaining step, obtains the described equipment input message that described server provides;
Projection step, the eyeground projection by described equipment input message to respective user.
10. method as claimed in claim 9, is characterized in that, in described projection step, and the projection of the backward described user's of image alignment that described equipment input message and described user are seen eyeground.
11. 1 kinds of server info exchange methods, is characterized in that, comprising:
Identification information obtaining step, obtains the identification information that one second equipment provides;
Input message obtaining step, obtain in described identification information, comprise with one first device-dependent at least one equipment input message;
Input message provides step, to described the first equipment, provides described equipment input message.
12. methods as claimed in claim 11, is characterized in that, described input message obtaining step comprises:
Extract the described equipment input message comprising in described identification information.
13. methods as claimed in claim 11, is characterized in that, described input message obtaining step comprises:
To outside, send described identification information;
From outside, receive the described equipment input message comprising described identification information.
14. methods as claimed in claim 11, is characterized in that, described method also comprises:
Authorize determining step, judge whether active user is an authorized user, and described active user, just carry out described input message obtaining step during for authorized user or described input message provides step.
15. methods as claimed in claim 11, is characterized in that, described identification information is digital watermarking.
16. methods as claimed in claim 11, is characterized in that, described method also comprises:
To described the second equipment, provide described equipment input message.
17. 1 kinds of information interacting methods, is characterized in that, comprising:
Identification information embeds step, with an one first device-dependent image in embed at least one identification information, in described identification information, include the equipment input message corresponding with described the first equipment;
Image provides step, and described image is provided to outside;
Input information step, the outside described equipment input message providing is provided;
Execution step, carries out the operation corresponding with the equipment input message of described reception.
18. methods as claimed in claim 17, is characterized in that, described image provides step to comprise:
Show described image.
19. methods as claimed in claim 18, is characterized in that, described image is a login interface of a user environment;
Corresponding being operating as of described and described equipment input message: the operation of logining described user environment according to described equipment input message.
20. methods as claimed in claim 19, is characterized in that, described image is a locking screen interface;
Corresponding being operating as of described and described equipment input message: according to screen corresponding to described equipment input message release.
21. methods as claimed in claim 17, is characterized in that, described identification information is digital watermarking.
22. methods as claimed in claim 17, is characterized in that, described method also comprised before described execution step:
Authorize determining step, judge whether active user is an authorized user, and just carry out described execution step when described active user is described authorized user.
23. 1 kinds of information interactive devices, is characterized in that, comprising:
One image collection module, for obtaining and an one first device-dependent image, described image comprises at least one identification information;
One identification information acquisition module, for obtaining the described identification information of described image, comprises the equipment input message that at least one and described the first equipment is corresponding in described identification information;
One identification information provides module, for the identification information obtaining described in providing to a server.
24. devices as claimed in claim 23, is characterized in that, described image collection module comprises:
One image acquisition submodule, for obtaining described image by the mode of taking.
25. devices as claimed in claim 23, is characterized in that, described image collection module comprises:
One first communicator module, for obtaining described image by the mode receiving.
26. devices as claimed in claim 23, is characterized in that, described device also comprises:
One input message acquisition module, the described equipment input message providing for obtaining described server;
One projection module, for the eyeground projection to described user by described equipment input message.
27. devices as claimed in claim 26, is characterized in that, described projection module comprises:
Submodule is adjusted in one alignment, for the image that the equipment input message of described projection is seen with described user, on described user's eyeground, aligns.
28. 1 kinds of wearable devices, is characterized in that, described wearable device comprises the information interactive device described in claim 23.
29. wearable devices as claimed in claim 28, is characterized in that, described wearable device is glasses.
30. 1 kinds of servers, is characterized in that, comprising:
One identification information acquisition module, the identification information providing for obtaining one second equipment;
One input message acquisition module, for obtain that described identification information comprises with one first device-dependent at least one equipment input message;
One input message provides module, for providing described equipment input message to described the first equipment.
31. servers as claimed in claim 30, is characterized in that, described input message acquisition module comprises:
One information extraction submodule, the described equipment input message comprising for extracting described identification information.
32. servers as claimed in claim 30, is characterized in that, described input message acquisition module comprises:
One second communication submodule, for:
To outside, send described identification information;
From outside, receive the described equipment input message comprising described identification information.
33. servers as claimed in claim 30, is characterized in that, described server also comprises:
One authorizes judge module, for judging whether active user is an authorized user, and described active user, just triggers described input message acquisition module during for authorized user or described input message provides module to carry out corresponding operation.
34. servers as claimed in claim 30, is characterized in that, described identification information is digital watermarking;
Described information extraction submodule, the described equipment input message comprising for extracting described digital watermarking.
35. servers as claimed in claim 30, is characterized in that, described input message provide module also for:
To described the second equipment, provide described equipment input message.
36. 1 kinds of information interactive devices, is characterized in that, comprising:
One identification information merge module, embeds at least one identification information for the image relevant to described information interactive device, includes the equipment input message corresponding with described information interactive device in described identification information;
One image provides module, for described image is provided to outside;
One MIM message input module, the described equipment input message providing for receiving outside;
One execution module, carries out corresponding operation for the equipment input message according to described reception.
37. devices as claimed in claim 36, is characterized in that, described image provides module to comprise:
One display sub-module, for showing described image.
38. devices as claimed in claim 37, is characterized in that, described image is the login interface of a user environment;
Described execution module, for logining described user environment according to described equipment input message.
39. devices as claimed in claim 38, is characterized in that, described image is a locking screen interface;
Described execution module, for according to screen corresponding to described equipment input message release.
40. devices as claimed in claim 36, is characterized in that, described device also comprises:
Authorize judge module, for judging whether active user is an authorized user, and when described active user is described authorized user, just trigger described execution module and carry out corresponding operation.
41. devices as claimed in claim 36, is characterized in that, described device is an electric terminal.
CN201310574246.5A 2013-11-15 2013-11-15 Information interaction method and information interaction device CN103677631A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310574246.5A CN103677631A (en) 2013-11-15 2013-11-15 Information interaction method and information interaction device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310574246.5A CN103677631A (en) 2013-11-15 2013-11-15 Information interaction method and information interaction device
PCT/CN2014/081495 WO2015070624A1 (en) 2013-11-15 2014-07-02 Information interaction

Publications (1)

Publication Number Publication Date
CN103677631A true CN103677631A (en) 2014-03-26

Family

ID=50315346

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310574246.5A CN103677631A (en) 2013-11-15 2013-11-15 Information interaction method and information interaction device

Country Status (2)

Country Link
CN (1) CN103677631A (en)
WO (1) WO2015070624A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015070624A1 (en) * 2013-11-15 2015-05-21 Beijing Zhigu Rui Tuo Tech Co., Ltd Information interaction
CN107003739A (en) * 2014-10-06 2017-08-01 皇家飞利浦有限公司 Docking system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200846922A (en) * 2007-03-05 2008-12-01 Microsoft Corp Simplified electronic messaging system
CN101321066A (en) * 2008-05-20 2008-12-10 北京深思洛克数据保护中心 Information safety device for internetwork communication
CN101729256A (en) * 2008-10-24 2010-06-09 深圳宝嘉电子设备有限公司 Security certificate method based on fingerprint, cryptographic technology and fragile digital watermark
US8117458B2 (en) * 2006-05-24 2012-02-14 Vidoop Llc Methods and systems for graphical image authentication
CN102970307A (en) * 2012-12-21 2013-03-13 网秦无限(北京)科技有限公司 Password safety system and password safety method
CN103116717A (en) * 2013-01-25 2013-05-22 东莞宇龙通信科技有限公司 User login method and system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101075868B (en) * 2006-05-19 2010-05-12 华为技术有限公司 Long-distance identity-certifying system, terminal, server and method
CN103631503B (en) * 2013-11-15 2017-12-22 北京智谷睿拓技术服务有限公司 Information interacting method and information interactive device
CN103677631A (en) * 2013-11-15 2014-03-26 北京智谷睿拓技术服务有限公司 Information interaction method and information interaction device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8117458B2 (en) * 2006-05-24 2012-02-14 Vidoop Llc Methods and systems for graphical image authentication
TW200846922A (en) * 2007-03-05 2008-12-01 Microsoft Corp Simplified electronic messaging system
CN101321066A (en) * 2008-05-20 2008-12-10 北京深思洛克数据保护中心 Information safety device for internetwork communication
CN101729256A (en) * 2008-10-24 2010-06-09 深圳宝嘉电子设备有限公司 Security certificate method based on fingerprint, cryptographic technology and fragile digital watermark
CN102970307A (en) * 2012-12-21 2013-03-13 网秦无限(北京)科技有限公司 Password safety system and password safety method
CN103116717A (en) * 2013-01-25 2013-05-22 东莞宇龙通信科技有限公司 User login method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015070624A1 (en) * 2013-11-15 2015-05-21 Beijing Zhigu Rui Tuo Tech Co., Ltd Information interaction
CN107003739A (en) * 2014-10-06 2017-08-01 皇家飞利浦有限公司 Docking system
CN107003739B (en) * 2014-10-06 2020-10-27 皇家飞利浦有限公司 Docking system

Also Published As

Publication number Publication date
WO2015070624A1 (en) 2015-05-21

Similar Documents

Publication Publication Date Title
Boulkenafet et al. OULU-NPU: A mobile face presentation attack database with real-world variations
CN106662989B (en) The management of content in 3D hologram environment
CN106687885B (en) Wearable device for messenger processing and method of use thereof
CN105934730B (en) Automated content rolls
US20180198986A1 (en) Preview Image Presentation Method and Apparatus, and Terminal
US10341113B2 (en) Password management
US20210072822A1 (en) Visual communications methods, systems and software
CN107113415B (en) The method and apparatus for obtaining and merging for more technology depth maps
JP6632979B2 (en) Methods and systems for augmented reality
US10235560B2 (en) Image processing apparatus, image processing method, and image communication system
CN106797423B (en) Sight line detection device
US10607230B2 (en) Augmented reality dynamic authentication for electronic transactions
US9330272B2 (en) Head-mounted display apparatus with enhanced security and method for accessing encrypted information by the apparatus
US9813095B2 (en) Glasses-type communications apparatus, system, and method
CN103106401B (en) Mobile terminal iris recognition device with human-computer interaction mechanism
Negin et al. An iris biometric system for public and personal use
US9749619B2 (en) Systems and methods for generating stereoscopic images
US9804395B2 (en) Range calibration of a binocular optical augmented reality system
US8224041B2 (en) Media data processing apparatus and media data processing method
CN102682520B (en) Messaging device, information processing method and terminal device
BR112017004427B1 (en) method for analyzing liveliness
CN103557859B (en) Image acquisition localization method and image acquisition positioning system
US9544574B2 (en) Selecting camera pairs for stereoscopic imaging
CN106797460A (en) The reconstruction of 3 D video
WO2015172124A1 (en) Systems and methods for using eye signals with secure mobile communications

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140326