CN108369480B - Man-machine interaction method and electronic equipment - Google Patents
Man-machine interaction method and electronic equipment Download PDFInfo
- Publication number
- CN108369480B CN108369480B CN201580085438.7A CN201580085438A CN108369480B CN 108369480 B CN108369480 B CN 108369480B CN 201580085438 A CN201580085438 A CN 201580085438A CN 108369480 B CN108369480 B CN 108369480B
- Authority
- CN
- China
- Prior art keywords
- image
- red
- module
- user
- eye effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Image Processing (AREA)
Abstract
A man-machine interaction method and electronic equipment relate to the technical field of electronics, and can achieve exclusive interaction between the electronic equipment and a specific user while preventing false triggering of the user. The method comprises the following steps: a control module in the electronic equipment acquires an image (201) by controlling an image acquisition module added in the electronic equipment; acquiring image parameters (202) corresponding to image areas with red-eye effect in an image; and if the image parameter corresponding to the image area with the red-eye effect meets the preset condition, determining that the user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user (203). The method is applied to human-computer interaction.
Description
Technical Field
The invention relates to the technical field of electronics, in particular to a human-computer interaction method and electronic equipment.
Background
With the development of electronic information technology, most electronic products are equipped with various human-computer interaction devices (e.g., keyboard, mouse, touch screen, electronic whiteboard, sound detector, etc.). Generally, interaction between a human and a machine is generally performed through a human-computer interaction device, but in the existing design, most of the human-computer interaction devices in the electronic devices are selected by default, that is, after the human-computer interaction devices detect an input instruction, the input instruction is determined by default as an instruction sent by a user, and the electronic device corresponding to the human-computer interaction device does not determine whether an interaction object of the user is itself, for example, when a keyboard of a computer is pressed down, the computer does not determine whether the user is touched by mistake or really wants to operate the computer.
In order to solve the above problems, the prior art provides a human-computer interaction process based on gesture recognition to prevent a user from false triggering operation, that is, determining whether the user points to the electronic device by detecting a specific gesture motion of the user, and responding to the operation of the user if it is determined that the user points to the electronic device. However, the above-mentioned human-computer interaction process based on gesture recognition requires a human-computer interaction device or a user to remember a large number of predefined actions to execute the interaction process, which results in a complicated application program development process and inconvenience for the user.
Disclosure of Invention
Embodiments of the present invention provide a human-computer interaction method and an electronic device, which can prevent false triggering of a user, and simultaneously implement exclusive interaction between the electronic device and a specific user, thereby improving user experience.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
in a first aspect of the embodiments of the present invention, a human-computer interaction method is provided, which is applied to an electronic device, where the electronic device includes an image acquisition module, a control module, and an interaction module, and the method includes:
the control module controls the image acquisition module to acquire images;
acquiring image parameters corresponding to an image area with a red-eye effect in the image;
and if the image parameter corresponding to the image area with the red-eye effect meets the preset condition, determining that the user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user.
According to the man-machine interaction method provided by the embodiment of the invention, an image acquisition module added in the electronic equipment is controlled to acquire an image, then an image parameter corresponding to an image area with a red-eye effect in the image is acquired, when the image parameter corresponding to the image area with the red-eye effect meets a preset condition is judged, the user is determined to generate directional operation on the electronic equipment, and finally, the interaction module is controlled to focus on the user, so that the user and the interaction module are interacted.
Therefore, according to the scheme, interactive response can be carried out when the user is detected to obviously point to the electronic equipment through the directional detection of the red eye reflection of the user, and the whole detection process does not need user intervention, so that the exclusive interaction between the electronic equipment and a specific user is realized while the false triggering of the user is prevented, and the user experience is improved.
With reference to the first aspect, in a first implementation manner, the image parameter corresponding to the image region with the red-eye effect includes region shape information of the image region and a color value of a red pixel in the image region;
if it is determined that the image parameter corresponding to the image region with the red-eye effect meets a predetermined condition, determining that the user performs directional operation on the electronic device, and controlling the interaction module to focus on the user specifically includes:
and if the area shape of the image area with the red-eye effect is matched with a preset shape and the color value of the red pixel in the image area with the red-eye effect is higher than a first threshold value, determining that the user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user.
With reference to the first aspect and the first implementation manner, in a second implementation manner, the electronic device in an embodiment of the present invention further includes a detection light generator, so that before the control module controls the image acquisition module to acquire an image, the method further includes: and controlling the detection light generator to emit detection light.
The detection light may be infrared light. Generally, since the image acquisition module is most sensitive to infrared light, when the detection light generator emits infrared light to the surroundings of the electronic device, the red-eye effect generated by the image acquired by the image acquisition module in the detection light environment is enhanced, so that the accuracy of the electronic device in detecting the directionality of the user is enhanced.
With reference to the first aspect, the first implementation manner, and the second implementation manner, in a third implementation manner, if it is determined that the image parameter corresponding to the image region with the red-eye effect satisfies a predetermined condition, it is determined that the user performs directional operation on the electronic device, and after the interaction module is controlled to focus on the user, the method further includes:
and if the image parameters corresponding to the image area with the red-eye effect in the image acquired by the image acquisition module within the preset time period do not meet the preset conditions, controlling the interactive module to pause or close, so that when the user does not perform directional detection on the electronic equipment, the control on the interactive module is closed, and the power consumption of the electronic equipment is saved.
With reference to the first aspect and any one of the first to third implementation manners, in a fourth implementation manner, the controlling the image acquisition module to acquire an image specifically includes:
and periodically or aperiodically controlling the image acquisition module to acquire images.
In a second aspect of the embodiments of the present invention, an electronic device is provided, where the electronic device includes an image acquisition module, an interaction module, and a control module, where:
the image acquisition module is used for acquiring images;
the control module is used for controlling the image acquisition module to acquire images; and the system is used for acquiring the image parameters corresponding to the image area with the red-eye effect in the image, determining that the user generates directional operation on the electronic equipment when judging that the image parameters corresponding to the image area with the red-eye effect meet a preset condition, and controlling the interaction module to focus on the user.
According to the electronic device provided by the embodiment of the invention, the image acquisition module added in the electronic device is controlled to acquire the image, then the image parameter corresponding to the image area with the red-eye effect in the image is acquired, when the image parameter corresponding to the image area with the red-eye effect is judged to meet the preset condition, the user is determined to generate directional operation on the electronic device, and finally, the interaction module is controlled to focus on the user, so that the user and the interaction module realize interaction.
Therefore, according to the scheme, interactive response can be carried out when the user is detected to obviously point to the electronic equipment through the directional detection of the red eye reflection of the user, and the whole detection process does not need user intervention, so that the exclusive interaction between the electronic equipment and a specific user is realized while the false triggering of the user is prevented, and the user experience is improved.
With reference to the second aspect, in a first implementation manner, the image parameter corresponding to the image region with the red-eye effect includes region shape information of the image region and a color value of a red pixel in the image region;
if the control module determines that the image parameter corresponding to the image region with the red-eye effect meets a predetermined condition, the control module determines that the user generates directional operation on the electronic device, and controls the interaction module to be specifically used for:
and if the area shape of the image area with the red-eye effect is matched with a preset shape and the color value of the red pixel in the image area with the red-eye effect is higher than a first threshold value, determining that the user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user.
With reference to the second aspect and the first implementation aspect, in a second implementation manner of the second aspect, the electronic device further includes a detection light generator, so that before the control module controls the image acquisition module to acquire the image, the method further includes: and controlling the detection light generator to emit detection light. The detection light may be infrared light. Generally, since the image acquisition module is most sensitive to infrared light, when the detection light generator emits infrared light to the surroundings of the electronic device, the red-eye effect generated by the image acquired by the image acquisition module in the detection light environment is enhanced, so that the accuracy of the electronic device in detecting the directionality of the user is enhanced.
With reference to the second aspect, the first implementation manner, and the second implementation manner, in a third implementation manner, the control module is further configured to control the interaction module to pause or close if none of the image parameters corresponding to the image region with the red-eye effect in the image acquired by the image acquisition module within the predetermined time period meets the predetermined condition.
With reference to the second aspect and any one of the first to third implementation manners, in a fourth implementation manner, when controlling the image acquisition module to acquire an image, the control module is specifically configured to: and periodically or aperiodically controlling the image acquisition module to acquire images.
With reference to the second aspect and any one of the first to fourth implementation manners, in a fifth implementation manner, the image acquisition module includes a light filtering unit and a camera unit, the light filtering unit is disposed in front of the camera unit, and the light filtering unit is configured to filter visible light.
According to the scheme, the electronic equipment filters visible light by arranging the light filtering unit (for example, a light filter) in front of the camera unit, so that the red eye effect is increased.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of another electronic device according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a human-computer interaction method according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The electronic device provided by the embodiment of the invention can be an electronic device such as a smart phone, a tablet Computer, a notebook Computer, a super mobile Personal Computer (UMPC), a netbook, a Personal Digital Assistant (PDA) and the like, and is not limited thereto.
The man-machine interaction method and the electronic equipment for implementing the man-machine interaction method provided by the invention mainly realize the judgment of the directional operation of the user based on the red-eye effect.
The "red-eye effect" refers to a phenomenon that when a color patch is shot by using an electronic flash, the retina in the inner back area of an eyeball reflects external light, so that the pupil of the eye of a person becomes red or red dots appear in the pupil, and the phenomenon is the "red-eye effect".
The red eye effect has high directionality to red eye reflection of the user. Generally, when a user is facing a camera (i.e., an image acquisition module in the present invention), red-eye reflection of the user is strongest (i.e., color value of red pixel in the pupil region is highest), i.e., the stronger red-eye effect the user presents to the image acquisition module of the electronic device, the stronger the directionality of the user to the electronic device is reflected.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
An embodiment of the present invention provides an electronic device, as shown in fig. 1, the electronic device 1 includes an optional detection light generator 11, an image acquisition module 12, an interaction module 13, and a control module 14, where:
and a detection light generator 11 for generating detection light.
And the image acquisition module 12 is used for acquiring images. If the electronic device includes the detection light generator 11, the image acquisition module 12 is configured to acquire an image in the detection light environment.
A control module 14 for controlling the image acquisition module 12 to acquire images; and the image parameter acquiring module is used for acquiring the image parameter corresponding to the image area with the red-eye effect in the image, determining that the user generates directional operation on the electronic device when judging that the image parameter corresponding to the image area with the red-eye effect meets a preset condition, and controlling the interaction module 13 to focus on the user.
The detection light generator 11 in this embodiment is a light source capable of emitting detection light, for example, a ring-shaped connected light emitting diode, and the central wavelength of the light emitted by the light emitting diode may be the light sensitive to the image acquisition module 12 in this embodiment. Generally, a typical detection unit is most sensitive to infrared light, and the wavelength of the infrared light is 800-900nm, such as 800nm, 820nm, 880nm, 900nm, etc. Therefore, preferably, the detection light generator 11 in the present embodiment can emit infrared light with a wavelength of 800-900nm to the periphery of the electronic device.
After the image acquisition module 12 in this embodiment acquires an image in an environment of detecting light, the image acquisition module may pre-process the image, so as to enhance a pupil portion with a red-eye effect in the image, thereby avoiding a problem of an unobvious red-eye effect caused by insufficient exposure. For example, after the image acquisition module 12 acquires the image in the detection light environment, the image may be subjected to difference processing, the obtained difference image may highlight the pupil part with the red-eye effect, and then the image after difference is subjected to image filtering and image enhancement operation, so as to improve the visual effect of the image and highlight the interested region, that is, the pupil part of the eye region.
Illustratively, as shown in fig. 2, the image capturing module 12 in the present embodiment includes a camera unit 12a and a light filtering unit 12 b. The camera unit 12a may be a camera sensitive to infrared rays, i.e. a camera with high sensitivity at 800-. The light filtering unit 12b may be a filter, and in general, the filter may be placed in front of the lens of the camera, so as to collect the image filtered by the filter.
The interaction device 13 in this embodiment may be an input/output device, such as a camera or a microphone, provided in the electronic device itself or connected to the electronic device.
The control module 14 in this embodiment is responsible for performing image processing and analysis after receiving the image input by the image acquisition module 12, and is responsible for setting the interaction module 13, for example, configuring the interaction module 13 to start and close. In addition, it should be noted that the image processing and analyzing process of the control module 14 can also be implemented by the image obtaining module 12, after the analysis, the image processing module 12 can directly feed back the judgment result to the control module 14 (i.e. whether the user performs directional operation on the electronic device), and the control module 14 only needs to be responsible for setting the interaction module 13. Of course, in practice, the image processing module 12 and the control module 14 may be implemented by using the same physical processor, or may be implemented by using two physical processors.
For example, when the image parameter corresponding to the image region with red-eye effect in this embodiment includes region shape information of the image region and a color value of a red pixel in the image region, if it is determined that the image parameter corresponding to the image region with red-eye effect satisfies a predetermined condition, the control module 14 determines that the user performs directional operation on the electronic device, and controls the interaction module 13 to focus on the user, and specifically is configured to:
if the region shape of the image region with red-eye effect matches a predetermined shape and the color value of the red pixel in the image region with red-eye effect is higher than a first threshold, it is determined that the user generates directional operation on the electronic device, and the interaction module 13 is controlled to focus on the user.
The first threshold value may be set by field debugging or based on an empirical value. For example, when determining whether the corresponding image parameter of the image region with red-eye effect satisfies the predetermined condition, the control module may determine a region shape of the image region with red-eye effect and a color value of a red pixel in the image region, and when the region shape of the image region with red-eye effect is similar to a predefined shape (for example, two red regions are adjacent) and the color value of the red pixel in the image region is greater than a first threshold value, determine that there is an obvious directional operation on the electronic device by the user.
For example, the present embodiment determines whether the user points significantly to the electronic device by detecting whether the image parameter in the image region with the red-eye effect in the image satisfies a predetermined condition. When it is determined that the user points significantly to the presence of the electronic device, the control module 14 controls the interaction module to focus on the user, so as to realize exclusive interaction between the interaction module 13 and the user, that is, to control the interaction module 13 to move along with the movement of the user.
In order to ensure that the interaction module 13 is able to achieve real-time focusing with the user when the user controls the electronic device.
The control module 14 in this embodiment is specifically configured to control the image acquisition module 12 to acquire an image: the image acquisition module 12 is controlled to acquire images periodically or aperiodically.
In this way, when none of the image parameters corresponding to the image region with the red-eye effect in the image acquired by the image acquiring module 12 in the detection light environment within the predetermined time period satisfies the predetermined condition, that is, when the user does not perform directional operation on the electronic device for a long time, the control module 14 is further configured to control the interactive module 13 to pause or close, so as to save power consumption.
In addition, the focusing process mentioned in this embodiment is a real-time changing process, and even if the user changes the position or does not look at the electronic device any more during the interaction with the electronic device, the image capturing module 12 can detect the change and notify the control module 14. The control module 14 notifies the interaction module 13 to perform corresponding processing according to the change of the user's directivity and the change of the position. For example: if the user moves away from the original position but still looks at the electronic device, the control module 14 controls the interaction module 13 to focus to a new user position; if the user is no longer looking at the electronic device, the control module 14 controls the interaction module 13 to continue or no longer respond to the user's interaction. It should be noted that the specific control of the interaction module 13 by the control module 14 depends on the deviation setting of the electronic device for the directional action of the user, such as: if the setting is within 1 minute, the user continues to interact even though he is no longer looking at the device, and the interaction module 14 will still focus on the user even though he is no longer looking at the device within the 1 minute.
According to the electronic device provided by the embodiment of the invention, the image acquisition module added in the electronic device is controlled to acquire the image, then the image parameter corresponding to the image area with the red-eye effect in the image is acquired, when the image parameter corresponding to the image area with the red-eye effect is judged to meet the preset condition, the user is determined to generate directional operation on the electronic device, and finally, the interaction module is controlled to focus on the user, so that the user and the interaction module realize interaction.
Therefore, according to the scheme, interactive response can be carried out when the user is detected to obviously point to the electronic equipment through the directional detection of the red eye reflection of the user, and the whole detection process does not need user intervention, so that the exclusive interaction between the electronic equipment and a specific user is realized while the false triggering of the user is prevented, and the user experience is improved.
The man-machine interaction method provided by the embodiment of the invention will be described based on the functional description of each module in the electronic device shown in fig. 1. Technical terms, concepts and the like related to the above embodiments in the following embodiments may refer to the above embodiments, and are not described in detail herein.
An embodiment of the present invention provides a human-computer interaction method, as shown in fig. 3, the method includes the following steps:
201. the control module of the electronic equipment controls the image acquisition module to acquire images.
Optionally, before step 201, the method further includes:
201a, a control module of the electronic device controls a detection light generator to emit detection light.
For example, the electronic device controls the detection light generator to emit the detection light and controls the image acquisition module to acquire the image periodically according to a predetermined time period, or controls the detection light generator to emit the detection light and controls the image acquisition module to acquire the image non-periodically according to a specific trigger condition. The specific trigger condition may be that the interaction module detects the approach of the user, or that the electronic device detects the instruction input.
The detection light in this embodiment may be infrared light.
202. A control module of the electronic device acquires image parameters corresponding to an image area with a red-eye effect in an image.
203. If the image parameter corresponding to the image area with the red-eye effect meets the preset condition, the control module of the electronic device determines that the user generates directional operation on the electronic device, and controls the interaction module to focus on the user.
Illustratively, the image parameter corresponding to the image region with the red-eye effect in this embodiment includes region shape information of the image region and a color value of a red pixel in the image region. Based on this, step 203 specifically includes the following:
203a, if the shape of the region of the image region with the red-eye effect is matched with the preset shape and the color value of the red pixel in the image region with the red-eye effect is higher than a first threshold value, determining that the user generates directional operation on the electronic device by a control module of the electronic device, and controlling an interaction module to focus on the user.
For example, in order to ensure that the interaction module can realize real-time focusing with the user when the user controls the electronic device, the embodiment may control the image acquisition module to acquire an image in real time, and determine an image parameter corresponding to an image region with a red-eye effect in the image, so that when none of the image parameters corresponding to the image region with the red-eye effect in the image acquired by the image acquisition module within a predetermined time period meets a predetermined condition, the interaction module is controlled to pause or close, thereby avoiding unnecessary energy consumption.
Further, when the electronic device does not determine whether the user has a significant direction to the electronic device, an implementation manner is that the electronic device may close an interaction module of the electronic device, and only when the electronic device determines that an image parameter corresponding to an image region with a red-eye effect in an image acquired by the image acquisition module satisfies a predetermined condition, the interaction module is opened, and correspondingly, when image parameters corresponding to image regions with a red-eye effect in an image acquired by the image acquisition module of the electronic device within a predetermined time period do not satisfy the predetermined condition, and the interaction module has been opened before, the electronic device may close the interaction device.
According to the man-machine interaction method provided by the embodiment of the invention, an image acquisition module added in the electronic equipment is controlled to acquire an image, then an image parameter corresponding to an image area with a red-eye effect in the image is acquired, when the image parameter corresponding to the image area with the red-eye effect meets a preset condition is judged, the user is determined to generate directional operation on the electronic equipment, and finally, the interaction module is controlled to focus on the user, so that the user and the interaction module are interacted.
Therefore, according to the scheme, interactive response can be carried out when the user is detected to obviously point to the electronic equipment through the directional detection of the red eye reflection of the user, and the whole detection process does not need user intervention, so that the exclusive interaction between the electronic equipment and a specific user is realized while the false triggering of the user is prevented, and the user experience is improved.
Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the electronic device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the modules and units in the electronic device described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.
In the embodiments provided in the present application, it should be understood that the disclosed electronic device and man-machine interaction method may be implemented in other ways. For example, the above-described apparatus embodiments corresponding to the electronic device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when the actual implementation is performed, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (9)
1. A human-computer interaction method is applied to electronic equipment, the electronic equipment comprises an image acquisition module, a control module and an interaction module, and the method comprises the following steps:
the control module controls the image acquisition module to acquire images;
acquiring image parameters corresponding to an image area with a red-eye effect in the image;
if the image parameter corresponding to the image area with the red-eye effect meets the preset condition, determining that a user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user;
the image parameter corresponding to the image area with the red-eye effect comprises area shape information of the image area and a color value of a red pixel in the image area;
if it is determined that the image parameter corresponding to the image region with the red-eye effect meets a predetermined condition, determining that the user performs directional operation on the electronic device, and controlling the interaction module to focus on the user specifically includes:
and if the area shape of the image area with the red-eye effect is matched with a preset shape and the color value of the red pixel in the image area with the red-eye effect is higher than a first threshold value, determining that the user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user.
2. The method of claim 1, wherein the electronic device further comprises a detection light generator; before the control module controls the image acquisition module to acquire the image, the method further comprises:
and controlling the detection light generator to emit detection light.
3. The method according to any one of claims 1-2, wherein if it is determined that the image parameter corresponding to the image region with red-eye effect satisfies a predetermined condition, it is determined that the user performs directional operation on the electronic device, and the method further includes, after controlling the interaction module to focus on the user:
and if the image parameters corresponding to the image area with the red-eye effect in the image acquired by the image acquisition module within the preset time period do not meet the preset conditions, controlling the interactive module to pause or close.
4. The method according to any one of claims 1 to 3, wherein the controlling the image acquisition module to acquire the image specifically comprises:
and periodically or aperiodically controlling the image acquisition module to acquire images.
5. An electronic device, comprising an image acquisition module, an interaction module, and a control module, wherein:
the image acquisition module is used for acquiring images;
the control module is used for controlling the image acquisition module to acquire images; the system comprises an interaction module, a display module and a display module, wherein the interaction module is used for acquiring an image parameter corresponding to an image area with a red-eye effect in the image, determining that a user generates directional operation on the electronic equipment and controlling the interaction module to focus on the user when judging that the image parameter corresponding to the image area with the red-eye effect meets a preset condition;
the image parameter corresponding to the image area with the red-eye effect comprises area shape information of the image area and a color value of a red pixel in the image area;
if the control module determines that the image parameter corresponding to the image region with the red-eye effect meets a predetermined condition, the control module determines that the user generates directional operation on the electronic device, and controls the interaction module to be specifically used for:
and if the area shape of the image area with the red-eye effect is matched with a preset shape and the color value of the red pixel in the image area with the red-eye effect is higher than a first threshold value, determining that the user generates directional operation on the electronic equipment, and controlling the interaction module to focus on the user.
6. The electronic device of claim 5, further comprising a detection light generator;
the detection light generator is used for emitting detection light.
7. The electronic device according to any one of claims 5 to 6, wherein the control module is further configured to control the interaction module to pause or close if none of the image parameters corresponding to the image region with the red-eye effect in the image acquired by the image acquisition module within a predetermined time period satisfies the predetermined condition.
8. The electronic device according to any one of claims 5 to 7, wherein the control module, when controlling the image acquisition module to acquire the image, is specifically configured to:
and periodically or aperiodically controlling the image acquisition module to acquire images.
9. The electronic device according to any one of claims 5 to 8, wherein the image capturing module includes a light filtering unit and a camera unit, the light filtering unit is disposed in front of the camera unit, and the light filtering unit is configured to filter visible light.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2015/098833 WO2017107171A1 (en) | 2015-12-25 | 2015-12-25 | Human-machine interaction method, and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108369480A CN108369480A (en) | 2018-08-03 |
| CN108369480B true CN108369480B (en) | 2020-09-11 |
Family
ID=59088750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201580085438.7A Active CN108369480B (en) | 2015-12-25 | 2015-12-25 | Man-machine interaction method and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108369480B (en) |
| WO (1) | WO2017107171A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114616533A (en) * | 2019-10-30 | 2022-06-10 | 艾梅崔克斯持株公司株式会社 | Eye alternating current detection device |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4549997B2 (en) * | 2006-03-30 | 2010-09-22 | 富士フイルム株式会社 | Red-eye detection device, red-eye detection method, and red-eye detection program |
| US8149210B2 (en) * | 2007-12-31 | 2012-04-03 | Microsoft International Holdings B.V. | Pointing device and method |
| US8295593B2 (en) * | 2009-01-07 | 2012-10-23 | Seiko Epson Corporation | Method of detecting red-eye objects in digital images using color, structural, and geometric characteristics |
| US8913056B2 (en) * | 2010-08-04 | 2014-12-16 | Apple Inc. | Three dimensional user interface effects on a display by using properties of motion |
| CN103226690B (en) * | 2012-01-30 | 2016-03-02 | 展讯通信（上海）有限公司 | Detect blood-shot eye illness method and device, removal blood-shot eye illness method and device |
| CN103246865B (en) * | 2012-02-03 | 2016-05-04 | 展讯通信（上海）有限公司 | Method and the device of the method for detection blood-shot eye illness and device, removal blood-shot eye illness |
| AU2013205535B2 (en) * | 2012-05-02 | 2018-03-15 | Samsung Electronics Co., Ltd. | Apparatus and method of controlling mobile terminal based on analysis of user's face |
| US9984441B2 (en) * | 2014-06-18 | 2018-05-29 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Unobtrusive sizing and placement of pop-ups |
| CN104318237A (en) * | 2014-10-28 | 2015-01-28 | 厦门大学 | Fatigue driving warning method based on face identification |
-
2015
- 2015-12-25 CN CN201580085438.7A patent/CN108369480B/en active Active
- 2015-12-25 WO PCT/CN2015/098833 patent/WO2017107171A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN108369480A (en) | 2018-08-03 |
| WO2017107171A1 (en) | 2017-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220385804A1 (en) | Adjusting Motion Capture Based on the Distance Between Tracked Objects | |
| US9268412B2 (en) | Input apparatus having an input recognition unit and input recognition method by using the same | |
| US9207771B2 (en) | Gesture based user interface | |
| US8837780B2 (en) | Gesture based human interfaces | |
| US20200249751A1 (en) | User input processing with eye tracking | |
| US9329680B2 (en) | Terminal and method for iris scanning and proximity sensing | |
| US20190294870A1 (en) | Gesture tracing device, gesture recognition device and non-transitory computer-readable storage medium | |
| US11782514B2 (en) | Wearable device and control method thereof, gesture recognition method, and control system | |
| US10424116B2 (en) | Display apparatus and controlling method thereof | |
| US10579870B2 (en) | Operating method for function of iris recognition and electronic device supporting the same | |
| KR20160108388A (en) | Eye gaze detection with multiple light sources and sensors | |
| US20170150898A1 (en) | Methods and apparatuses for electrooculogram detection, and corresponding portable devices | |
| CN106020454B (en) | A kind of intelligent terminal touch screen operating method and system based on eye control technology | |
| JP2019164842A (en) | Human body action analysis method, human body action analysis device, equipment, and computer-readable storage medium | |
| CN109101110A (en) | A kind of method for executing operating instructions, device, user terminal and storage medium | |
| CN107479710A (en) | Smart mirror and its control method, device, equipment and storage medium | |
| US10078396B2 (en) | Optical touch sensing device and touch signal determination method thereof | |
| CN108369480B (en) | Man-machine interaction method and electronic equipment | |
| US10423249B2 (en) | Information processing method and electronic device | |
| KR101071864B1 (en) | Touch and Touch Gesture Recognition System | |
| CN104063041A (en) | Information processing method and electronic equipment | |
| JP2016066975A (en) | Image processing system, image processing system control method, and program | |
| CN105528198B (en) | Operation interface recognition methods and device | |
| CN106445380A (en) | Multi-viewing-angle picture operating method and system and mobile terminal | |
| CN105824462B (en) | Detection method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |