CN103513753B - Information processing method and electronic equipment - Google Patents
Information processing method and electronic equipment Download PDFInfo
- Publication number
- CN103513753B CN103513753B CN201210206764.7A CN201210206764A CN103513753B CN 103513753 B CN103513753 B CN 103513753B CN 201210206764 A CN201210206764 A CN 201210206764A CN 103513753 B CN103513753 B CN 103513753B
- Authority
- CN
- China
- Prior art keywords
- image
- predetermined
- electronic equipment
- virtualization
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of information processing method and electronic equipment.Methods described is applied to electronic equipment, and the electronic equipment at least has display unit and image acquisition units.Methods described includes：Image is caught using described image collecting unit；When the image for being caught includes the first predetermined image information, virtualization image corresponding with first predetermined image information is shown on the display unit；Operation of the detection user to the virtualization image；Judge whether the operation meets the first predetermined condition, and obtain the first judged result；And when first judged result shows that the operation meets first predetermined condition, perform an operational order.Therefore, in the present invention it is possible to augmented reality is applied in the interaction of user and electronic equipment, so as to expand the information content produced by the interaction, and the interactive and interest of the interaction is improved, Consumer's Experience is significantly improved.
Description
Technical field
The present invention relates to field of computer technology, more particularly it relates to a kind of information processing method and electronics set
It is standby.
Background technology
Augmented reality（AR）Also it is referred to as mixed reality.It is a kind of computer graphics techniques and visualization technique.Increase
Strong reality is different from existing only for virtual objects or the virtual reality of virtual information（VR）.Specifically, strengthen existing
Can produce in fact in actual environment and non-existent virtual objects, and by sensing technology by virtual objects accurate " placement " true
On ad-hoc location in real environment, virtual objects are combined together with true environment by the display unit of electronic equipment, so that
The virtual objects are obtained seemingly to be truly present in the true environment equally.
In addition, continuing to develop with computer technology, human-computer interaction technology also arises at the historic moment.It is a kind of by input
Unit, output unit etc., in an efficient way come realize user and electronic equipment dialogue technology.
However, it is at present that augmented reality is little with the application that human-computer interaction technology is combined, so as to cause in user
It is extremely limited with the information content produced in the interaction of electronic equipment, and the interaction interactive and entertaining of shortage between the two
Property.
It is then desired to a kind of new information processing method and electronic equipment solve the above problems, to provide a user with
Interactive mode with superior users experience.
The content of the invention
In order to solve the above-mentioned technical problem, according to an aspect of the invention, there is provided a kind of information processing method, application
In electronic equipment, the electronic equipment at least has display unit and image acquisition units, it is characterised in that methods described bag
Include：Image is caught using described image collecting unit；When the image for being caught includes the first predetermined image information, described aobvious
Show and shown on unit virtualization image corresponding with first predetermined image information；Detection user is to the virtualization image
Operation；Judge whether the operation meets the first predetermined condition, and obtain the first judged result；And when the described first judgement knot
When fruit shows that the operation meets first predetermined condition, an operational order is performed.
Additionally, according to another aspect of the present invention, there is provided a kind of electronic equipment, it is characterised in that the electronic equipment
Including：Image acquisition units, for catching image；Display unit, when the image for being caught includes the first predetermined image information,
Display virtualization image corresponding with first predetermined image information；Detection unit, for detecting user to the virtualization
The operation of image；First judging unit, for judging whether the operation meets the first predetermined condition, and obtains the first judgement knot
Really；And execution unit, for when first judged result shows that the operation meets first predetermined condition, performing
One operational order.
Compared with prior art, using information processing method of the invention and electronic equipment, can be in user and electricity
In the interaction of sub- equipment, an image for true environment is caught, it is true at this when the image includes predetermined image information
One virtualization image being associated with the predetermined image information of display is added on the image of real environment, detection user is virtual to this
Whether the operation for changing image meets predetermined interactive operation, if it is, so that electronic equipment is completed and the predetermined interactive operation
Associated specific function.Therefore, in the present invention it is possible to which augmented reality is applied into interacting in user and electronic equipment
During, so as to expand the information content produced by the interaction, and improve the interactive and entertaining of the interaction
Property, significantly improve Consumer's Experience.
Other features and advantages of the present invention will be illustrated in the following description, also, the partly change from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for specification, with reality of the invention
Applying example is used to explain the present invention together, is not construed as limiting the invention.In the accompanying drawings：
Fig. 1 illustrates information processing method of the invention.
Fig. 2 illustrates electronic equipment of the invention.
Fig. 3 illustrates information processing method according to a first embodiment of the present invention.
Fig. 4 illustrates electronic equipment according to a first embodiment of the present invention.
Fig. 5 a to Fig. 5 e illustrate the display content of display unit according to a first embodiment of the present invention.
Fig. 6 illustrates information processing method according to a second embodiment of the present invention.
Fig. 7 illustrates electronic equipment according to a second embodiment of the present invention.
Fig. 8 a to Fig. 8 f illustrate the display content of display unit according to a second embodiment of the present invention.
Fig. 9 illustrates information processing method according to a third embodiment of the present invention.
Figure 10 illustrates electronic equipment according to a third embodiment of the present invention.
Figure 11 a to Figure 11 d illustrate the display content of display unit according to a third embodiment of the present invention.
Figure 12 illustrates information processing method according to a fourth embodiment of the present invention.
Figure 13 illustrates electronic equipment according to a fourth embodiment of the present invention.
Figure 14 a to Figure 14 e illustrate the display content of display unit according to a fourth embodiment of the present invention.
Specific embodiment
Will be described in detail with reference to the accompanying drawings each embodiment of the invention.Here it is to be noted that it in the accompanying drawings,
The substantially part with same or like 26S Proteasome Structure and Function is assigned by identical reference, and will be omitted on it
Repeated description.
Hereinafter, information processing method of the invention and electronic equipment will be described with reference to Fig. 1 and Fig. 2.
Fig. 1 illustrates information processing method of the invention, and Fig. 2 illustrates electronic equipment of the invention.
Information processing method illustrated in Fig. 1 can apply to the electronic equipment illustrated in Fig. 2.Specifically, the electronics
Equipment 100 includes：Image acquisition units 110, display unit 120, detection unit 130, the first judging unit 140 and perform list
Unit 150.
As illustrated in figure 1, the electronic equipment customization includes：
In step s 110, image is caught using described image collecting unit 110；
In the step s 120, when the image for being caught includes the first predetermined image information, on the display unit 120
Display virtualization image corresponding with first predetermined image information；
In step s 130, operation of the detection user of detection unit 130 to the virtualization image；
In step S140, the first judging unit 140 judges whether the operation meets the first predetermined condition, and obtains the
One judged result；And
In step S150, when first judged result shows that the operation meets first predetermined condition, hold
Row unit 150 performs an operational order.
As can be seen here, using information processing method of the invention and electronic equipment, can be in user and electronic equipment
Interaction in, catch an image for true environment, when the image includes predetermined image information, in the true environment
Image on add display one virtualization image being associated with the predetermined image information, detect user to the virtualization image
Operation whether meet predetermined interactive operation, if it is, so that electronic equipment complete be associated with the predetermined interactive operation
Specific function.Therefore, in the present invention it is possible to which augmented reality is applied the interaction in user and electronic equipment
In, so as to expand the information content produced by the interaction, and the interactive and interest of the interaction is improved, show
Work improves Consumer's Experience.
Hereinafter, reference Fig. 3, Fig. 4 and Fig. 5 a to Fig. 5 e are described at information according to a first embodiment of the present invention
Reason method and electronic equipment.
In recent years, such as personal computer（PC）, panel computer（PAD）, mobile phone, multimedia player, individual number
Word assistant（PDA）Etc electronic equipment popularize all the more.By taking mobile phone as an example, in life, user generally can be by moving
Mobile phone carrys out dialing/receiving telephone, sends short message（SMS）, multi-media SMS breath（MMS）, browse internet（Internet）
Or carry out the operation such as online chatting using JICQ.Thus, user is in order to ensure various data in the mobile phone
Safety and secret, prevent unauthorized user from using the mobile phone of oneself, and he/her often sets screen to the mobile phone of oneself
Curtain locking so that mobile phone carries out lock-out state automatically after idle a period of time.However, in the prior art, user
Can only be unlocked by being simply input the unlocking pattern of 9 points of password or drafting connection.Obviously, the entertaining of this process
Property is not strong, it is impossible to bring fully sense of participation to user.
In addition, with the development of face recognition technology, developing another unlocking method, it utilizes the shooting of mobile phone
Head shoots the face of user and carries out recognition of face, with compare the user face characteristic area whether with authorized user
The characteristic area of face is consistent, and is mobile phone unblock when both are consistent.However, this method the disadvantage is that,
In releasing process, simple recognition of face and comparison are only performed, when the face of for example hand-held authorized user of unauthorized user
When photo is to be verified, the occurrence of misreading lock is easily caused.
Therefore, it is contemplated by the invention that go out can user to mobile phone perform releasing process in using the present invention, so as to
While enhancing unblock security, interactive and interest of the lifting user in releasing process.
Below, in the first embodiment of the present invention, using mobile phone as the example of electronic equipment and by information
Reason method is applied during mobile phone is unlocked to illustrate.
Although it should be noted that here by by information processing method of the invention and electronic apparatus application in shifting
The unblock of mobile phone operates to illustrate the present invention, but, it will be appreciated to those of skill in the art that the invention is not restricted to this.
But, the invention applies also to user and other electronic equipments（For example, personal computer, panel computer, multimedia are broadcast
Put device, personal digital assistant etc.）Various interactions in.
Fig. 3 illustrates information processing method according to a first embodiment of the present invention, and Fig. 4 illustrates real according to the present invention first
The electronic equipment 100 of example is applied, and Fig. 5 a to Fig. 5 e illustrate the display content of display unit according to a first embodiment of the present invention.
Information processing method according to a first embodiment of the present invention illustrated in Fig. 3 can apply to the electricity illustrated in Fig. 4
Sub- equipment 100.As described above, electronic equipment 100 according to a first embodiment of the present invention is, for example, mobile phone.With phase in Fig. 1
As, the electronic equipment 100 at least includes：Image acquisition units 110, display unit 120, detection unit 130, first judge single
Unit 140 and execution unit 150.Additionally, the electronic equipment 100 also includes：First recognition unit 160.
As illustrated in fig. 3, information processing method according to a first embodiment of the present invention includes：
In step S210, image is caught using image acquisition units.
Specifically, if user is to the electronic equipment 100 of oneself（For example, mobile phone）Locking protection is performed, is then existed
After the electronic equipment idle a period of time, the electronic equipment 100 enters lock-out state.At this moment, for example in the electronic equipment 100
Display unit 120 on show locking picture, as depicted in fig.5 a.Certainly, when in a locked condition, the electronic equipment
100 display unit 120 can also be in black state, to save electric power.
When user wishes to reuse electronic equipment 100, user is needed first to the electronics in being in the lock state
Equipment is unlocked.Now, user can operate the electronic equipment 100 so that catch a certain spy using image acquisition units 110
Region is levied, to carry out the comparison and checking of characteristic area.
For example, the camera that user will be located at the front of mobile phone is directed at such as face of oneself, face is included to catch
The image in portion.At this moment, for example the face image of captured user is shown on the display unit 120 of the electronic equipment 100,
As illustrated in Fig. 5 b.Wherein, the capturing motion can for example include：Found a view just with camera, without by pressing
Pressure shutter carrys out shooting image；Or by pressing shutter come actual photographed image.Here, gone on to say as a example by the former.
Then, the image including characteristic area that image acquisition units 110 will be captured is sent to the first recognition unit
160, to carry out subsequent operation.
In step S220, the first predetermined image information is recognized.
Specifically, after the image including characteristic area is received from image acquisition units 110, the first recognition unit
Whether characteristic area in 160 pairs of images is identified, to determine believe including the first predetermined image in the image for being caught
Breath.
For example, the first recognition unit 160 can using it is existing or in the future any Face datection that develop and/
Or Face tracking algorithm, to detect human face region in the original image that image acquisition units 110 are captured, determine the face
The position in region, and the human face region is extracted, as the first image information to be compared.
Then, the first recognition unit 160 is by first image information to be compared（The facial image for being identified）With depositing
Reservoir（It is not shown）First predetermined image information of middle preservation（The facial image of authorized user）Compare, so that it is determined that in institute
Whether include the first predetermined image information in the image of seizure.
If for example, the facial image for being identified is the facial image of authorized user, the method carries out step S230.
If identified facial image is the facial image of unauthorized user, the display that the first recognition unit 160 passes through electronic equipment
Unit 120 prompts the user with denied access, and the method terminates.
In step S230, when the image for being caught include the first predetermined image information when, on the display unit display with
The corresponding virtualization image of first predetermined image information.
Specifically, when determine caught image include the first predetermined image information（The facial image of authorized user）
When, the first recognition unit 160 notifies this situation to display unit 120.Display unit 120 is in memory（It is not shown）Middle acquisition
One or more virtualization images corresponding with first predetermined image information, and acquired virtualization is being shown with
Image.
For example, work as determining that the virtualization image corresponding with oneself face that user pre-sets is a head for cartoon cat
During picture, the display unit 120 shows cartoon cat head picture to user, as illustrated in Fig. 5 c.In fig. 5 c, the cartoon cat head picture is folded
Plus be displayed at any position on the image including user face for being captured.Alternatively, it is also possible to only show
The head portrait of the cartoon cat, without in display user's head portrait.
In step S240, operation of the detection user to the virtualization image.
Specifically, after display unit 120 is to user's display virtualization image, detection unit 130 detects user to institute
State the interactive operation of virtualization image.
For example, the display unit 120 and the detection unit 130 preferably can by the touch-screen of electronic equipment 100 come
Realize.Now, after display unit 120 shows cartoon cat image on screen, detection unit 130 is being touched according to user
Touch operation on screen is come to detect user be to right rotation by the cartoon cat head picture for the interactive operation of the cartoon cat head picture
Three circles.
Then, the result of the interactive operation is sent to the first judging unit 140 by the detection unit 130, follow-up to carry out
Operation.
In step s 250, judge whether the operation meets the first predetermined condition, and obtain the first judged result.
Specifically, after interactive operation of the user for the virtualization image is received from detection unit 130, first sentences
Disconnected unit 140 judges whether the operation meets the first predetermined condition, and obtains the first judged result.
For example, the first judging unit 140 searches whether user preset with the cartoon cat head picture to dextrorotation in memory
The corresponding interactive operation of three circles is turned.If the first judging unit 140 judges that the interactive operation corresponds to electronic equipment 100
Normal operating state is returned to from lock-out state, then it generates and indicates that interactive operation satisfaction is held with to electronic equipment 100
First judged result of corresponding first predetermined condition of row unblock operation.Or, if the first judging unit 140 judges the friendship
Interoperability corresponds to shuts down electronic equipment 100, then it generates and indicates that interactive operation satisfaction is performed with to electronic equipment 100
First judged result of corresponding first predetermined condition of power-off operation.Then, the method proceeds to step S260.
If also or, the first judging unit 140 judges that the interactive operation is corresponding any for electronic equipment 100
Operation, then its generation indicates that the interactive operation is unsatisfactory for the first judged result of the first predetermined condition, and by electronic equipment
Display unit 120 prompt the user with denied access, and the method terminates.
In step S260, when first judged result shows that the operation meets first predetermined condition, hold
The operational order of row one.
Specifically, after the first judged result is received from the first judging unit 140, execution unit 150 is from memory
It is middle to obtain the operational order of operation corresponding with first judged result, and run the operational order.
If for example, the first judged result indicates that the interactive operation meets to correspond to performs unblock to electronic equipment 100
First predetermined condition of operation, then execution unit 150 obtains the corresponding operating instruction for performing unblock operation, and performs the operation
Instruction.Now, execution unit 150 performs unblock operation to electronic equipment 100, and so that after the display unblock of display unit 120
Display picture, as illustrated in Fig. 5 e.Then, user can carry out subsequent operation using the electronic equipment 100 after unblock.
As can be seen here, using information processing method and electronic equipment according to a first embodiment of the present invention, can be in user
In the interaction of electronic equipment, image is caught, recognize whether caught image includes characteristic area, when included, shown
Show virtualization image corresponding with this feature region, and detect interactive operation of the user for the virtualization image, when the friendship
When interoperability meets predetermined condition, operational order corresponding with the predetermined condition is performed.Therefore, in the first embodiment of the present invention
In, augmented reality can be applied during such as user operates for electronic equipment, in recognition of face
On the basis of, further interact the identification of operation, it is to avoid when the facial photo of the hand-held authorized user of unauthorized user is led to
The maloperation situation that causes when crossing checking, so as to while processing safety is strengthened, lifting user in operation mutual
Dynamic property and interest.
Although it should be noted that the detection unit 130 is embodied as into touch-screen in the first embodiment of the present invention
Illustrate.But, the invention is not restricted to this.But, it is also possible to by mouse, keyboard, gravity sensor, microphone etc.
Other input blocks realize the detection unit 130.For example, in the case of mouse or keyboard, the detection user of detection unit 130
Operated for the click performed by virtualization image and/or dilatory grade；In the case of gravity sensor, detection unit 130 is examined
User is surveyed for operations such as the whipping performed by virtualization image and/or upsets；In the case of a microphone, detection unit 130
Detect the sound that user is sent while the virtualization image is shown（Such as, mewing is learned）Deng operation, so as to finally determine
Whether the operation meets the first predetermined condition.
Hereinafter, reference Fig. 6, Fig. 7 and Fig. 8 a to Fig. 8 f are described at information according to a second embodiment of the present invention
Reason method and electronic equipment.In the second embodiment of the present invention, still using mobile phone as the example of electronic equipment and
Information processing method is applied during mobile phone is unlocked to illustrate.
Fig. 6 illustrates information processing method according to a second embodiment of the present invention, and Fig. 7 illustrates real according to the present invention second
The electronic equipment 100 of example is applied, and Fig. 8 a to Fig. 8 f illustrate the display content of display unit according to a second embodiment of the present invention.
Information processing method according to a second embodiment of the present invention illustrated in Fig. 6 can apply to the electricity illustrated in Fig. 7
Sub- equipment 100.As illustrated in figure 7, in addition to the unit that first embodiment includes, the electronic equipment 100 is at least
Also include：Second judging unit 170.
As illustrated in FIG. 6, information processing method according to a second embodiment of the present invention includes：
In step S310, image is caught using image acquisition units.
In step s 320, the first predetermined image information is recognized.
In step S330, when the image for being caught include the first predetermined image information when, on the display unit display with
The corresponding virtualization image of first predetermined image information.
Step S310-S330 is identical with the step S210-S230 in first embodiment, and thus omit its detailed description.
In step S340, operation of the detection user to the virtualization image.
Specifically, after display unit 120 is to user's display virtualization image, detection unit 130 detects user to institute
State the interactive operation of virtualization image.
For example, the display unit 120 and the detection unit 130 preferably can by the touch-screen of electronic equipment 100 come
Realize.Now, after display unit 120 shows cartoon cat image on screen, detection unit 130 is being touched according to user
Touch operation on screen is click on the cartoon cat head picture detecting user for the interactive operation of the cartoon cat head picture, and will
The cartoon cat head picture is moved to the human face region of the authorized user for being identified by the first recognition unit 160 in step s 320, such as
Illustrated in Fig. 8 d.
Then, the result of the interactive operation is sent to the first judging unit 140 by the detection unit 130, follow-up to carry out
Operation.
In step S350, judge whether the operation meets the first predetermined condition, and obtain the first judged result.
Specifically, after interactive operation of the user for the virtualization image is received from detection unit 130, first sentences
Disconnected unit 140 judges whether the operation meets the first predetermined condition, and obtains the first judged result.
For example, the first judging unit 140 search whether in memory user preset with by the cartoon cat head picture to
The interactive operation of family human face region movement.If there is the interactive operation, then its generation indicates that the interactive operation meets first
First judged result of predetermined condition, and the method carries out step S360.Otherwise, first judging unit 140 passes through electronics
The display unit 120 of equipment prompts the user with denied access, and the method terminates.
In step S360, when first judged result shows that the operation meets first predetermined condition, enter
One step judges whether at least part of position relationship of at least part of and image of the seizure of the virtualization image meets
Second predetermined condition, and obtain the second judged result.
Specifically, after the first judging unit 140 judges that the interactive operation of user meets the first predetermined condition, this
Two judging units 170 are determined whether by after interactive operation, at least part of figure with the seizure of the virtualization image
Whether at least part of position relationship of picture meets the second predetermined condition, and obtains the second judged result.
For example, detection unit 130 is detecting user and the cartoon cat head picture being moved to human face region and most at last should
The head portrait of cartoon cat is moved and rested on human face region（As illustrated in Fig. 8 e）Afterwards, it is the new testing result is further
It is sent to the second judging unit 170.If the second judging unit 170 searches whether user has preset and the cartoon in memory
The interactive operation corresponding with the position relationship that human face region is overlapped of cat head picture.If the second judging unit 170 judges the position
Corresponding to electronic equipment 100 is returned into normal operating state from lock-out state, then it generates and indicates that the position is closed relation
System meets the second judged result of second predetermined condition corresponding with unblock operation is performed to electronic equipment 100.
Preferably due to it is three-dimensional that face shows in display unit 120（3D）, as the virtualization image
Cartoon cat head picture can also be 3-D view.
In step S370, when second judged result shows at least part of and seizure of the virtualization image
At least part of position relationship of image when meeting second predetermined condition, perform an operational order.
Specifically, after the second judged result is received from the second judging unit 170, execution unit 150 is from memory
It is middle to obtain the operational order of operation corresponding with first judged result, and run the operational order.
For example, execution unit 150 performs unblock operation to electronic equipment 100, and cause the display unblock of display unit 120
Display picture afterwards, as illustrated in Figure 8.Then, user can subsequently be grasped using the electronic equipment 100 after unblock
Make.
As can be seen here, using information processing method and electronic equipment according to a second embodiment of the present invention, can be in user
In the interaction of electronic equipment, image is caught, recognize whether caught image includes characteristic area, when included, shown
Show virtualization image corresponding with this feature region, and detect interactive operation of the user for the virtualization image, when the friendship
When interoperability meets predetermined condition, at least part of and institute's seizure figure of virtualization image caused by the interactive operation is determined whether
Whether at least part of position relationship of picture meets another predetermined condition, when all two conditions all meet, performs corresponding
Operational order.Therefore, in the second embodiment of the present invention, augmented reality can be applied in such as user for electronics
During equipment is operated, on the basis of recognition of face and interactive operation identification, further increase location recognition, so that
Substantially increasing the security of operation, and for user provides stronger joy with interacting for electronic equipment in operation
Happy property.
Hereinafter, letter according to a third embodiment of the present invention is described into reference Fig. 9, Figure 10 and Figure 11 a to Figure 11 d
Breath processing method and electronic equipment.In the third embodiment of the present invention, using mobile phone as the example of electronic equipment and
Illustrated during applying the entrance guard device outside to mobile phone to unlock information processing method.
Fig. 9 illustrates information processing method according to a third embodiment of the present invention, and Figure 10 is illustrated according to the present invention the 3rd
The electronic equipment 100 of embodiment, and Figure 11 a to Figure 11 d illustrate the display of display unit according to a third embodiment of the present invention
Content.
Information processing method according to a third embodiment of the present invention illustrated in Fig. 9 can apply to the electricity illustrated in Figure 10
Sub- equipment 100.As illustrated in Figure 10, in addition to the unit that first embodiment includes, the electronic equipment 100 is at least
Also include：Second recognition unit 180.
As illustrated in fig. 9, information processing method according to a third embodiment of the present invention includes：
In step S410, image is caught using image acquisition units.
Specifically, in an embodiment of the present invention, should except by information processing method of the invention and electronic equipment
For to should electronic equipment itself perform operation outside, can be also used for other any electronic equipments to electronic device exterior
Perform operation.As described above, the present invention is applied below to as the entrance guard device outside the mobile phone of electronic equipment 100
Illustrated during being unlocked.The entrance guard device is arranged on each door of such as company, so as to door
Switch and/or work attendance etc. be controlled.
Now, user can operate the electronic equipment 100 so that catch certain several feature using image acquisition units 110
Region, to carry out the comparison and checking of characteristic area.For example, user will be located at the camera alignment in the front of mobile phone for example
The face of oneself and the entrance guard device of company, the image of face and entrance guard device is included to catch.At this moment, for example set in the electronics
The face image and gate inhibition's image of the captured user of display on standby 100 display unit 120.Preferably, the electronic equipment
100 can also be connected with entrance guard device foundation, the state current to read the entrance guard device.If the current entrance guard device is in
During lock-out state, the face image and the gate inhibition's image for being marked with lock token, such as Figure 11 a of the display unit 120 display user
Illustrated.
In the step s 420, the first predetermined image information and the second predetermined image information are recognized.
Specifically, after the image including characteristic area is received from image acquisition units 110, the first recognition unit
Whether fisrt feature region in 160 pairs of images is identified, to determine include the first predetermined figure in the image for being caught
As information.With this concurrently or sequentially, the second feature region in the second recognition unit 180 pairs image is identified,
To determine whether include the second predetermined image information in the image for being caught.
As described above, the first recognition unit 160 can be extracted in the original image that image acquisition units 110 are captured
Human face region, as the first image information to be compared.Then, the first recognition unit 160 is by first image information to be compared
（The facial image of active user）With in memory（It is not shown）First predetermined image information of middle preservation（The face of authorized user
Image）Compare, so that it is determined that whether including the first predetermined image information in the image for being caught.
In addition, the second recognition unit 180 can be extracted in the original image that image acquisition units 110 are captured on
The characteristic area of entrance guard device, as the second image information to be compared.For example, being preferably provided with bar code on the entrance guard device
And/or transmitter.Second recognition unit 180 can by electronic equipment 100 according to bar code reader（It is not shown）
Make a return journey and read the bar code；Also or, second recognition unit 180 can be sensor, the wireless communication for receiving transmitter transmitting
Number, to determine the identifier of the inhibiting apparatus（ID）And the image that this includes the entrance guard device is defined as the second figure to be compared
As information.Then, the second recognition unit 160 is by second image information to be compared（The image of current entrance guard device）With storage
Device（It is not shown）Second predetermined image information of middle preservation（The image of the entrance guard device stored in electronic equipment 100）Compared
It is right, so that it is determined that whether including the second predetermined image information in the image for being caught.
If the facial image that the first recognition unit 160 is identified is to authorize second recognition unit 180 that comes in and goes out to be recognized
The facial image of the user of the entrance guard device for going out, then the method carry out step S430.Otherwise, by the display unit of electronic equipment
120 prompt the user with denied access, and the method terminates.
In step S430, when the image for being caught include the first predetermined image information when, on the display unit display with
The corresponding virtualization image of first predetermined image information.
Specifically, when determining that caught image includes the first predetermined image information, the first recognition unit 160 is to aobvious
Show that unit 120 notifies this situation.Display unit 120 is in memory（It is not shown）Middle acquisition and first predetermined image information pair
One or more the virtualization images answered, and it is acquired virtual being shown with second predetermined image information with simultaneously
Change image.Alternatively, the facial image now can also no longer be shown.
For example, work as determining that the virtualization image corresponding with oneself face that user pre-sets is a head for cartoon cat
During picture, the display unit 120 is shown corresponding to face to user（First is taken main body）Cartoon cat head picture and corresponding to door
Prohibit device（Second is taken main body）Image, as illustrated in Figure 11 b.
In step S440, operation of the detection user to the virtualization image.
In step S450, judge whether the operation meets the first predetermined condition, and obtain the first judged result.
In step S460, when first judged result shows that the operation meets first predetermined condition, hold
The operational order of row one.
In step S440 to step S460, when detection unit 130 detects interaction of the user for the cartoon cat head picture
Operation is that the cartoon cat head picture is moved to entrance guard device（As illustrated in Figure 11 c）When, and if the first judging unit 140
Judge that the interactive operation corresponds to change to mode of operation is opened entrance guard device from lock-out state, then it generates and indicates
The interactive operation meets the first judged result of the first predetermined condition corresponding with unlocking operation is performed to entrance guard device.Finally,
Execution unit 150 obtains the corresponding operating instruction for performing the unlocking operation, and performs the operational order.For example, execution unit
150 wirelessly send coding of unlocking to entrance guard device so that user can open the gate controlled by the entrance guard device,
As illustrated in Figure 11 d.
Wherein it is preferred to, first predetermined condition can be different depending on second image information.For example, not
Same entrance guard device likely corresponds to the second different image informations.When the gate inhibition that second image information corresponds to office fills
When putting, the interactive behaviour that first predetermined condition may show user should be that the cartoon cat head picture is moved to entrance guard device；
When second image information corresponds to the entrance guard device of computer room, the interaction behaviour that first predetermined condition may show user should
This is click on the cartoon cat head picture；And when second image information corresponds to the entrance guard device in laboratory, the first predetermined bar
The interactive behaviour that part may show user should be by cartoon cat head picture triple turn etc. to the right.
As can be seen here, using information processing method and electronic equipment according to a third embodiment of the present invention, can be in user
In the interaction of electronic equipment, it is taken main body and the second image for being taken main body while catching and at least include first,
Whether the caught image of identification includes at least two characteristic area corresponding with the main body that is taken, when included, display
Virtualization image corresponding with one of them main body that is taken, and interactive operation of the user for the virtualization image is detected,
When the interactive operation meets predetermined condition, by the electronic equipment initiate for pair with second be taken main body it is corresponding other
Electronic equipment performs the operational order of operation.Therefore, in the third embodiment of the present invention, can be by augmented reality application
In the operating process of other electronic equipments outside such as user is for the electronic equipment that is operating, enhancing user is utilizing
Electronic equipment controls the interactive and interest during other electronic equipments.
Hereinafter, letter according to a fourth embodiment of the present invention is described into reference Figure 12, Figure 13 and Figure 14 a to Figure 14 e
Breath processing method and electronic equipment.In the fourth embodiment of the present invention, still using mobile phone as electronic equipment example,
And illustrated during applying the entrance guard device outside to mobile phone to unlock information processing method.
Figure 12 illustrates information processing method according to a fourth embodiment of the present invention, and Figure 13 is illustrated according to the present invention the 4th
The electronic equipment 100 of embodiment, and Figure 14 a to Figure 14 e illustrate the display of display unit according to a fourth embodiment of the present invention
Content.
Information processing method according to a fourth embodiment of the present invention illustrated in Figure 12 can apply to illustrated in Figure 13
Electronic equipment 100.As illustrated in figure 13, fourth embodiment at least includes：Image acquisition units 110, the first recognition unit
160th, display unit 120, the second recognition unit 180, detection unit 130, the first judging unit 140, the second judging unit 170,
With execution unit 150.
As illustrated in Figure 12, information processing method according to a fourth embodiment of the present invention includes：
In step S510, image is caught using image acquisition units.
Now, for example, the camera that user will be located at the front of mobile phone first is directed at such as face of oneself, to catch
Catch the image including face.At this moment, for example show captured user's on the display unit 120 of the electronic equipment 100
Face image, as illustrated in Figure 14 a.
In step S520, the first predetermined image information is recognized.
First recognition unit 160 can extract human face region in the original image that image acquisition units 110 are captured,
As the first image information to be compared.Then, the first recognition unit 160 is by first image information to be compared and in memory
（It is not shown）Whether first predetermined image information of middle preservation is compared, so that it is determined that including first in the image for being caught
Predetermined image information.
In step S530, when the image for being caught include the first predetermined image information when, on the display unit display with
The corresponding virtualization image of first predetermined image information.
Specifically, when determining that caught image includes the first predetermined image information, display unit 120 is aobvious to user
Show corresponding to face（First is taken main body）Cartoon cat full-length picture image, as illustrated in Figure 14 b.
In step S540, reuse image acquisition units and catch image.
Now, be maintained on display unit 120 show it is described virtualization image while, for example, user is again by position
Camera in the front of mobile phone is directed at such as entrance guard device oneself to be opened, and the figure of entrance guard device is included to catch
Picture.At this moment, the virtualization image and the door in locking main body are for example shown on the display unit 120 of the electronic equipment 100
Prohibit image, as illustrated in Figure 14 c.Wherein, because camera is not directed at facial image now, so in Figure 14 a and figure
The facial image illustrated in 14b has not existed.
In step S550, the second predetermined image information is recognized.
Second recognition unit 180 can be extracted on gate inhibition in the original image that image acquisition units 110 are captured
The characteristic area of device, as the second image information to be compared.Then, the second recognition unit 160 is by second figure to be compared
As information and in memory（It is not shown）Second predetermined image information of middle preservation is compared, so that it is determined that in the figure for being caught
Whether include the second predetermined image information as in.
In step S560, operation of the detection user to the virtualization image.
In step S570, judge whether the operation meets the first predetermined condition, and obtain the first judged result.
In step S580, when first judged result shows that the operation meets first predetermined condition, enter
One step judges whether at least part of position relationship of at least part of and image of the seizure of the virtualization image meets
Second predetermined condition, and obtain the second judged result.
In step S590, when second judged result shows at least part of and seizure of the virtualization image
At least part of position relationship of image when meeting second predetermined condition, perform an operational order.
In step S560 to step S590, when detection unit 130 detects friendship of the user for the cartoon cat full-length picture
Interoperability is that the hand of the cartoon cat is moved to including the lockset on entrance guard device（As illustrated in Figure 11 d）When, and
If the first judging unit 140 judges there is the interactive operation in memory, it generates and indicates that the interactive operation is expired
First judged result of the first predetermined condition of foot.It is then detected that unit 130 continues to detect user by the hand of the cartoon cat
Moved to lockset region and most the hand of the cartoon cat is moved and discharged on lockset region at last（As illustrated in Figure 14 e
's）Afterwards, the new testing result is further transmitted to the second judging unit 170.If the second judging unit 170 is judged
Corresponding to changing entrance guard device from lock-out state to mode of operation is opened, then it generates and indicates the interaction position relationship
Operation meets the second judged result of the second predetermined condition corresponding with unlocking operation is performed to entrance guard device.Finally, list is performed
Unit 150 obtains the corresponding operating instruction for performing the unlocking operation, and allows that user opens what is controlled by the entrance guard device
Gate, as illustrated in Figure 14 e.
As can be seen here, using information processing method and electronic equipment according to a fourth embodiment of the present invention, can be in user
In the interaction of electronic equipment, catch includes the first image for being taken main body first, and whether the caught image of identification
Including being taken the corresponding characteristic area of main body with described first, when included, display is corresponding with first main body that is taken
Virtualization image, then while the virtualization image is shown, catch includes the second image for being taken main body again, recognizes
Whether the image for being caught includes being taken the corresponding characteristic area of main body with second, when included, and detect user for
The interactive operation of the virtualization image and locality condition, when the interactive operation and locality condition all meet predetermined condition, pass through
The electronic equipment is initiated for pair performing the operational order of operation with second corresponding other electronic equipments of main body that are taken.Cause
This, in the fourth embodiment of the present invention, can realize that user is controlling other electricity using electronic equipment with optimal effect
Interactive and interest during sub- equipment.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can be by
Realized in the mode of software plus required hardware platform, naturally it is also possible to all implemented by software or hardware.Based on this
The understanding of sample, what technical scheme contributed to background technology in whole or in part can be in the form of software product
Embody, the computer software product can be stored in storage medium, such as ROM/RAM, disk, CD, including it is some
Instruction is used to so that a computer equipment（Can be personal computer, server, or network equipment etc.）Perform the present invention
Method described in some parts of each embodiment or embodiment.
Each embodiment of the invention has been described in detail above.However, it should be appreciated by those skilled in the art that not taking off
In the case of principle of the invention and spirit, these embodiments can be carried out with various modifications, combination or sub-portfolio, and so
Modification should fall within the scope of the present invention.
Claims (10)
1. a kind of information processing method, is applied to electronic equipment, and the electronic equipment at least has display unit and IMAQ
Unit, it is characterised in that methods described includes：
Image is caught using described image collecting unit；
When the image for being caught includes the first predetermined image information, shown on the display unit and the described first predetermined figure
As the corresponding virtualization image of information；
Detection user is on the touchscreen to the operation of the virtualization image；
Judge whether the operation meets the first predetermined condition, and obtain the first judged result；And
When first judged result shows that the operation meets first predetermined condition, an operational order is performed；
Wherein, before the step of performing an operational order, methods described also includes：
Judge whether at least part of position relationship of at least part of and image of the seizure of the virtualization image meets
Second predetermined condition, and obtain the second judged result；And
When second judged result shows at least part of at least part of with the image of the seizure of the virtualization image
Position relationship when meeting second predetermined condition, perform the operational order.
2. method according to claim 1, it is characterised in that
Shown when the image for being caught includes the first predetermined image information, on the display unit and the described first predetermined figure
The step of virtualization image corresponding as information, includes：
When the image for being caught includes the first predetermined image information and the second predetermined image information, show on the display unit
Show virtualization image corresponding with first predetermined image information, wherein first predetermined image information corresponds to the first quilt
Main body is shot, second predetermined image information is taken main body corresponding to second, and
The step of performing an operational order includes：
Perform and be taken the operational order that main body is associated with described second.
3. method according to claim 2, it is characterised in that
First predetermined condition is different depending on second predetermined image information.
4. method according to claim 1, it is characterised in that the step of detection user is to the operation of the virtualization image is wrapped
Include：
Be maintained on the display unit show it is described virtualization image while, reuse described image collecting unit and catch
Catch image；And when the image for being caught includes the second predetermined image information, behaviour of the detection user to the virtualization image
Make, wherein first predetermined image information corresponds to first be taken main body, second predetermined image information is corresponding to the
Two are taken main body, and
The step of performing an operational order includes：
Perform and be taken the operational order that main body is associated with described second.
5. method according to claim 1, it is characterised in that the virtualization image is 3-D view.
6. a kind of electronic equipment, it is characterised in that the electronic equipment includes：
Image acquisition units, for catching image；
Display unit, when the image for being caught includes the first predetermined image information, shows and first predetermined image information
Corresponding virtualization image；
Detection unit, for detecting user on the touchscreen to the operation of the virtualization image；
First judging unit, for judging whether the operation meets the first predetermined condition, and obtains the first judged result；And
Execution unit, for when first judged result shows that the operation meets first predetermined condition, performing one
Operational order；
Second judging unit, for before the execution unit performs the operational order, determining whether the virtualization
Whether at least part of position relationship of at least part of and image of the seizure of image meets the second predetermined condition, and obtains
Second judged result, and
When second judged result shows at least part of at least part of with the image of the seizure of the virtualization image
Position relationship when meeting second predetermined condition, the execution unit performs the operational order.
7. electronic equipment according to claim 6, it is characterised in that
When the image for being caught include the first predetermined image information and the second predetermined image information when, the display unit show and
The corresponding virtualization image of first predetermined image information, wherein first predetermined image information is taken corresponding to first
Main body, second predetermined image information is taken main body corresponding to second, and
The execution unit is performed and is taken the operational order that main body is associated with described second.
8. electronic equipment according to claim 7, it is characterised in that first predetermined condition depends on the described second predetermined figure
It is different as information.
9. electronic equipment according to claim 6, it is characterised in that
While the display unit keeps showing the virtualization image, described image collecting unit catches image again,
When the image for being caught includes the second predetermined image information, the detection unit detects user to the virtualization image
Operation, wherein first predetermined image information is taken main body corresponding to first, the second predetermined image information correspondence
It is taken main body in second, and
The execution unit is performed and is taken the operational order that main body is associated with described second.
10. electronic equipment according to claim 6, it is characterised in that the virtualization image is 3-D view.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210206764.7A CN103513753B (en) | 2012-06-18 | 2012-06-18 | Information processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210206764.7A CN103513753B (en) | 2012-06-18 | 2012-06-18 | Information processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103513753A CN103513753A (en) | 2014-01-15 |
| CN103513753B true CN103513753B (en) | 2017-06-27 |
Family
ID=49896622
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210206764.7A Active CN103513753B (en) | 2012-06-18 | 2012-06-18 | Information processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103513753B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105518582B (en) * | 2015-06-30 | 2018-02-02 | 北京旷视科技有限公司 | Biopsy method and equipment |
| CN106682468A (en) * | 2016-12-30 | 2017-05-17 | 百度在线网络技术（北京）有限公司 | Method of unlocking electronic device and electronic device |
| CN106933349A (en) * | 2017-02-06 | 2017-07-07 | 歌尔科技有限公司 | Unlocking method, device and virtual reality device for virtual reality device |
| CN107132769B (en) * | 2017-04-21 | 2020-09-01 | 北京小米移动软件有限公司 | Intelligent equipment control method and device |
| CN109756672A (en) * | 2018-11-13 | 2019-05-14 | 深圳艺达文化传媒有限公司 | Short-sighted frequency animal model stacking method and Related product |
| CN110211265B (en) * | 2019-05-28 | 2024-05-07 | 韦勇 | AR-based household intelligent door lock interaction method, storage medium and electronic equipment |
| CN110716641B (en) * | 2019-08-28 | 2021-07-23 | 北京市商汤科技开发有限公司 | Interaction method, device, equipment and storage medium |
| CN111143799A (en) * | 2019-12-31 | 2020-05-12 | 维沃移动通信有限公司 | Unlocking method and electronic equipment |
| CN111104656A (en) * | 2019-12-31 | 2020-05-05 | 维沃移动通信有限公司 | Unlocking method and electronic equipment |
| CN112684889B (en) * | 2020-12-29 | 2023-06-30 | 上海掌门科技有限公司 | User interaction method and device |
| CN113031898B (en) * | 2021-05-25 | 2021-08-27 | 佛山宜视智联科技有限公司 | Image updating method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101371258A (en) * | 2005-12-23 | 2009-02-18 | 苹果公司 | Unlocking a device by performing gestures on an unlock image |
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
| CN102411854A (en) * | 2011-09-01 | 2012-04-11 | 苏州梦想人软件科技有限公司 | Classroom teaching mixing technology application system based on enhanced reality and method thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4243248B2 (en) * | 2002-11-20 | 2009-03-25 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | User interface system based on pointing device |
-
2012
- 2012-06-18 CN CN201210206764.7A patent/CN103513753B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101371258A (en) * | 2005-12-23 | 2009-02-18 | 苹果公司 | Unlocking a device by performing gestures on an unlock image |
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
| CN102411854A (en) * | 2011-09-01 | 2012-04-11 | 苏州梦想人软件科技有限公司 | Classroom teaching mixing technology application system based on enhanced reality and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103513753A (en) | 2014-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103513753B (en) | Information processing method and electronic equipment | |
| CN107134053B (en) | Intelligence is sold goods shops | |
| CN105320251B (en) | Eye-controlled password input device, method and computer readable recording medium thereof | |
| CN103797752B (en) | For providing certification to control the access of method and computer to(for) computer system | |
| CN107844748A (en) | Auth method, device, storage medium and computer equipment | |
| CN103634107B (en) | Authentication method, password setting method and authentication system for electronic device | |
| CN108108012B (en) | Information interaction method and device | |
| US20140347479A1 (en) | Methods, Systems, Apparatuses, Circuits and Associated Computer Executable Code for Video Based Subject Characterization, Categorization, Identification, Tracking, Monitoring and/or Presence Response | |
| CN104573479B (en) | A kind of use control method and device of user equipment | |
| US20140165187A1 (en) | Method, Apparatus, and Computer-Readable Recording Medium for Authenticating a User | |
| EP2605172A2 (en) | Multi-person gestural authentication and authorization system and method of operation thereof | |
| CN107622188A (en) | Verification method, device, system and equipment based on biological characteristic | |
| CN107016270A (en) | Dynamic graphic eye movement authentication system and method combining face authentication or hand authentication | |
| US10846514B2 (en) | Processing images from an electronic mirror | |
| KR101497762B1 (en) | Unlocking method, and terminal and recording medium for the same method | |
| CN104350446A (en) | Contextual user interface | |
| CN107066862A (en) | Embedded authentication systems in electronic equipment | |
| CN108734838B (en) | Intelligent lock with video-based biological feature verification device | |
| CN111240482B (en) | Special effect display method and device | |
| US11762966B2 (en) | Methods and devices for operational access grants using facial features and facial gestures | |
| CN105847243A (en) | Method and device for accessing smart camera | |
| CN107424266A (en) | The method and apparatus of recognition of face unblock | |
| TWI754964B (en) | Authentication system, authentication device, authentication method, and program product | |
| CN109032406A (en) | A kind of control method and mobile terminal | |
| CN106682468A (en) | Method of unlocking electronic device and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |