CN107566643B - Information processing method, information processing apparatus, storage medium, and electronic device - Google Patents
Information processing method, information processing apparatus, storage medium, and electronic device Download PDFInfo
- Publication number
- CN107566643B CN107566643B CN201710775584.3A CN201710775584A CN107566643B CN 107566643 B CN107566643 B CN 107566643B CN 201710775584 A CN201710775584 A CN 201710775584A CN 107566643 B CN107566643 B CN 107566643B
- Authority
- CN
- China
- Prior art keywords
- screen
- incoming call
- state
- information processing
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Telephone Function (AREA)
Abstract
The application discloses an information processing method, an information processing device, a storage medium and an electronic device, wherein the information processing method is applied to the electronic device and comprises the following steps: when an incoming call event is monitored, shooting an image and acquiring shot image information; detecting whether the image information has human eye images or not; if the eye size information exists, acquiring the eye size information in the eye image, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state; and if not, controlling the screen to be in a screen-off state. The information processing method can accurately estimate the user intention by only shooting the image in the call or incoming call process, and automatically controls the screen to be turned on or off according to the user intention, and is simple, beneficial to reducing power consumption and good in control effect.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an information processing method, an information processing apparatus, a storage medium, and an electronic device.
Background
In the information-oriented society, mobile terminals such as mobile phones are becoming indispensable communication tools for people.
At present, common mobile terminal all embeds in the market has apart from the inductor usually, and mainly used is whether there is the shielding thing in the sensing of conversation in-process to the terminal is according to extinguishing and lighting of the detection condition control screen of shielding thing, for example, if detect that shielding thing is nearer from the screen (for example the people ear is close to the screen), extinguish the screen, detect that shielding thing is far away from the screen (for example the people ear is far away from the screen), light the screen, thereby realize the intelligent control of conversation in-process terminal screen, save the electric quantity. However, because everyone has different habits of grasping the terminal in the process of answering the call, for example, some people like to make the terminal close to the ear, and some people like to separate a distance, if the distance is judged by using the same judgment standard, the screen cannot be turned on or off according to the real intention of the user, so that the error control rate of the screen is high, and the control effect is poor.
Disclosure of Invention
The embodiment of the application provides an information processing method, an information processing device, a storage medium and electronic equipment, which can accurately control the on/off of a terminal screen in a call process and have a good control effect.
The embodiment of the application provides an information processing method, which is applied to electronic equipment and comprises the following steps:
when an incoming call event is monitored, acquiring currently shot image information;
detecting whether a human eye image exists in the image information;
if the eye size information exists, acquiring the eye size information in the eye image, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state;
and if not, controlling the screen to be in a screen-off state.
An embodiment of the present application further provides an information processing apparatus, which is applied to an electronic device, and includes:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for shooting images and acquiring shot image information when an incoming call event is monitored;
the detection module is used for detecting whether a human eye image exists in the image information;
the first control module is used for acquiring the size information of eyeballs in the human eye image if the eye balls exist, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state;
and the second control module is used for controlling the screen to be in a screen-off state if the screen does not exist.
Further, the size information includes a radius value, and the first control module specifically includes:
the judging unit is used for judging whether the radius value is smaller than a preset radius;
the first control unit is used for controlling the screen to be in a screen-off state if the radius value is smaller than a preset radius;
and the second control unit is used for controlling the screen to be in a bright screen state if the radius value is larger than or equal to a preset radius.
Further, the first control unit is specifically configured to:
acquiring color parameters of each pixel point in the image information;
determining the ambient light brightness of the environment where the electronic equipment is located according to the color parameters;
determining a corresponding screen brightness value according to the ambient light brightness;
and controlling the screen to be in a bright screen state by using the screen brightness value.
Further, the incoming call event includes an incoming call answering event and an incoming call reminding event, and when the incoming call event is the incoming call answering event, the information processing apparatus further includes a third control module configured to:
before the acquisition module carries out image shooting, acquiring a distance value between a user and the electronic equipment;
when the distance value is not less than a preset distance, triggering the acquisition module to shoot an image;
and when the distance value is smaller than a preset distance, controlling the screen to be in a screen-off state.
Further, when the incoming call event is an incoming call reminding event, the information processing apparatus further includes a fourth control module configured to:
after the first control module controls the running state of a screen in the electronic equipment according to the radius value, when the screen is in a bright screen state, detecting whether human eye images exist in the image information shot within a preset duration;
if yes, the incoming call is connected to trigger and generate the incoming call answering event;
if not, the incoming call is refused, and the screen is turned off.
Further, the fourth control module is further configured to:
before an incoming call is connected, acquiring environmental noise of the environment where the electronic equipment is located;
determining the playing volume of the incoming call voice according to the environmental noise;
and connecting the incoming call according to the playing volume.
Further, the fourth control module is further configured to:
generating a preview area on the screen in the process of detecting whether human eye images exist in the shot image information within a preset duration;
and displaying the image information shot in the duration in the preview area.
The embodiment of the application also provides a storage medium, wherein a plurality of instructions are stored in the storage medium, and the instructions are suitable for being loaded by a processor to execute any one of the information processing methods.
An embodiment of the present application further provides an electronic device, which includes a processor and a memory, where the processor is electrically connected to the memory, the memory is used to store instructions and data, and the processor is used in any one of the steps of the information processing method described above.
The information processing method, the device, the storage medium and the electronic equipment are applied to the electronic equipment, when an incoming call event is monitored, image shooting is carried out, the shot image information is obtained, whether a human eye image exists in the image information is detected, if the human eye image exists, the size information of an eyeball in the human eye image is obtained, the running state of a screen in the electronic equipment is controlled according to the size information, the running state comprises a screen-on state and a screen-off state, and if the human eye image does not exist, the screen is controlled to be in the screen-off state, so that the intention of a user can be accurately estimated only by shooting the image in the calling or incoming call process, the screen is automatically controlled to be turned on or turned off according to the intention of the user, the method is simple, power consumption reduction is facilitated, and the control effect is good.
Drawings
The technical solution and other advantages of the present application will become apparent from the detailed description of the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart of an information processing method according to an embodiment of the present application.
Fig. 2 is another schematic flow chart of the information processing method according to the embodiment of the present application.
Fig. 3 is a schematic diagram of a screen control scene in an incoming call reminding state according to an embodiment of the present application.
Fig. 4 is a schematic flowchart of an information processing method according to an embodiment of the present application.
Fig. 5 is a schematic diagram of a screen control scene in a call state according to an embodiment of the present application
Fig. 6 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present application.
Fig. 7 is another schematic structural diagram of an information processing apparatus according to an embodiment of the present application.
Fig. 8 is a schematic structural diagram of a first control module according to an embodiment of the present application.
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides an information processing method, an information processing device, a storage medium and electronic equipment.
The embodiment will be described from the perspective of an information processing apparatus, which may be specifically implemented as a stand-alone entity, or may be implemented by being integrated in an electronic device, such as a terminal, which may include a mobile phone, a tablet computer, a personal computer, and the like.
As shown in fig. 1, the information processing method may be applied to an electronic device, and the specific flow may be as follows:
101. and when an incoming call event is monitored, shooting an image and acquiring shot image information.
In this embodiment, the image information may be acquired by a front-facing camera built in the electronic device, and the acquisition operation may be periodic, for example, once in 2s, or real-time, and may be specifically determined according to actual requirements.
For example, the incoming call event may include an incoming call answering event and an incoming call reminding event, and when the incoming call event is the incoming call answering event, before the currently captured image information is acquired, the information processing method may further include:
acquiring a distance value between a user and the electronic equipment;
when the distance value is not less than the preset distance, executing the step of acquiring the currently shot image information;
and when the distance value is smaller than the preset distance, controlling the screen to be in a screen-off state.
In this embodiment, the incoming call answering event mainly refers to a call, and the incoming call reminding event mainly refers to a reminding manner such as vibration or ringing when the call is not connected. The distance value between the user and the electronic device may be detected by a distance sensor, which may include an infrared sensor. The preset distance is mainly used for defining whether the ear or the face of the user is close to the electronic device, and can be set manually, such as 0.05 m.
Generally, during a call, when the distance value between the user and the electronic device is less than the preset distance, it indicates that the user is most likely to place the electronic device near the ear for a call, and at this time, the screen does not need to be lighted, and when the distance value between the electronic device and the user is greater than or equal to the preset distance, it needs to further presume whether the user is looking at the screen according to the currently photographed image information, so as to control the lighting and extinguishing of the screen according to the presumption result.
In the incoming call reminding process, because the telephone is not connected, the user can not approach the ear to the screen generally, namely the distance value between the user and the electronic equipment is usually larger than the preset distance, at the moment, only the user needs to judge whether the user is watching the screen directly according to the currently shot image information, and the screen is controlled to be turned on or off according to the judgment result, and the distance detection is not needed in real time, so that the control accuracy is ensured, the distance detection step is omitted, the method is simple, and the power consumption is saved.
102. Whether a human eye image exists in the image information is detected, if yes, the following step 103 is executed, and if not, the following step 104 is executed.
In this embodiment, the eye image mainly includes an eyelid, an eyeball (iris), and a white of the eye (sclera), a human face may be extracted from image information by a human face detection technique, and then the human eye may be found from the human face based on a biometric feature recognition technique, which mainly includes iris recognition and retina recognition.
103. And acquiring the size information of eyeballs in the human eye image, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state.
In this embodiment, an eyeball part may be extracted from a human eye image according to a special shape of an eyeball in an eye, size information such as a radius value or a diameter value of the eyeball may be calculated, and a screen may be controlled according to the size information.
Further, the size information may include a radius value, and in this case, the step of "controlling the operation state of the screen in the electronic device according to the radius value" may specifically include:
judging whether the radius value is smaller than a preset radius;
if the radius value is smaller than the preset radius, controlling the screen to be in a screen extinguishing state;
and if the radius value is larger than or equal to the preset radius, controlling the screen to be in a bright screen state.
In the embodiment, although the eyes of different people have different sizes, the length is mainly based on the length of the eyelid, and for the eyeball, the size of most of the eyeballs is within a normal range, for example, the length of the front and back diameters of the eyeball of a general person is about 24mm, and the length of the vertical diameter is about 23mm, so that the reliability of judging whether the user watches the screen through the radius or the diameter of the eyeball is higher compared with other reference factors. The preset radius can be an eyeball radius estimated in advance when a call user is farthest away from the screen, when the radius value is smaller than the preset radius, the eye attention of the user is usually represented at other places, or the eye image is not shot by the front camera aiming at the call user and possibly shot by other pedestrians on the road, at the moment, the screen does not need to be lightened, when the radius value is larger than or equal to the preset radius, the distance between the user and the screen is moderate, the attention is on the screen, and at the moment, the screen needs to be lightened.
For example, the step of "controlling the screen to be in the bright screen state" may specifically include:
acquiring color parameters of each pixel point in the image information;
determining the ambient light brightness of the environment where the electronic equipment is located according to the color parameters;
determining a corresponding screen brightness value according to the ambient light brightness;
and controlling the screen to be in a bright screen state by using the screen brightness value.
In this embodiment, the color parameter may include a brightness value, a hue value, and a color saturation value, and the ambient light brightness is mainly determined according to the brightness value, for example, images under different ambient light brightness may be collected in advance, and then a relationship between the ambient light brightness and the brightness value is summarized according to the collected images and stored in the electronic device, so that the corresponding ambient light brightness may be obtained subsequently according to the actual brightness value, and this obtaining manner of the ambient light brightness may be implemented only by an existing front camera without additionally providing a light sensor, thereby saving the configuration cost.
In addition, when the incoming call event is an incoming call reminding event, the user may directly make a call through the direct-view screen after the screen is lit up, that is, after the step 103, the information processing method may further include:
when the screen is in a bright screen state, detecting whether human eye images exist in the shot image information within a preset duration;
if yes, the incoming call is connected to trigger and generate the incoming call answering event;
if not, the incoming call is refused, and the screen is turned off.
In this embodiment, the preset duration may be set manually according to actual requirements, for example, 3 seconds or 5 seconds, and it may be presumed that the user needs to answer the call only when it is detected that the eyes of the user watch the screen within a certain period of time, otherwise, it may be presumed that the user does not want to answer the call, and the electronic device may automatically control the connection and disconnection of the call according to the presumed result, without manual operation, and the method is simple and has high flexibility.
For example, before an incoming call is connected, the information processing method may further include:
acquiring environmental noise of an environment where the electronic equipment is located;
determining the playing volume of the incoming call voice according to the environmental noise;
and connecting the incoming call according to the playing volume.
In this embodiment, the playing volume of the voice corresponding to different environmental noises can be stored in the local library in advance, and during actual application, the corresponding playing volume can be directly obtained according to the environmental noises of the environment where the user is located, and the voice is played and answered by using the obtained playing volume, so that the voice size can be flexibly adjusted according to different environments, manual operation of the user is not needed, and the experience is good.
For example, in the process of detecting whether human eye images exist in the image information shot within the preset duration, the information processing method may further include:
generating a preview area on the screen;
and displaying the image information shot in the duration in the preview area.
In this embodiment, the size of the preview area is usually much smaller than the total size of the screen, and the setting position thereof can be set manually, for example, it can be located at the upper left corner or the upper right corner of the screen. Specifically, when the screen is on, the shot image information is displayed in the preview area in real time, so that the user can quickly adjust the face position according to the purpose (such as calling or not calling), and the flexibility is good.
104. And controlling the screen to be in a screen-off state.
In the embodiment, in the communication process, the screen is in the screen extinguishing state only when the ear of the user is tightly attached to the screen, and if the camera is still started all the time to acquire the images of the human eyes, the user undoubtedly does useless work, so that the power consumption problem is considered, and after the screen is extinguished, the image acquisition operation can be further stopped, namely the front camera is turned off, so that the electric quantity is saved.
As can be seen from the above, the information processing method provided in this embodiment is applied to an electronic device, and when an incoming call event is monitored, the image information is obtained by performing image shooting, and whether a human eye image exists in the image information is detected, if so, the size information of an eyeball in the human eye image is obtained, and the operating state of a screen in the electronic device is controlled according to the size information, where the operating state includes a screen-on state and a screen-off state, and if not, the screen is controlled to be in the screen-off state, so that a user intention can be accurately inferred only by shooting an image in a call or incoming call process, and the screen is automatically controlled to be turned on or off according to the user intention.
In this embodiment, the information processing apparatus is specifically integrated in an electronic device, and the incoming call event is an incoming call reminding event, which is taken as an example for detailed description.
Referring to fig. 2 and fig. 3, a specific flow of an information processing method may be as follows:
201. when the incoming call reminding event is monitored, the electronic equipment shoots an image and acquires shot image information.
For example, when an incoming call is received, the electronic device may notify the user by ringing or vibrating, and meanwhile, the built-in front-facing camera is used to capture a new current image, and the capturing operation may be periodic, such as once in 2s, or real-time.
202. The electronic device detects whether or not the image information contains a human eye image, and if so, executes step 203 described below, and if not, executes step 204 described below.
For example, when an image is acquired, the electronic device may extract a human face from the image information by a human face detection technique, and then find human eyes from the human face based on a biometric recognition technique, which mainly includes iris recognition and retina recognition.
203. The electronic device obtains a radius value of an eyeball in the eye image, and determines whether the radius value is smaller than a preset radius, if so, the following step 204 is executed, and if not, the following step 205 and 206 are executed.
For example, when the presence of the human eye image is detected, it can only be stated that the presence user is located right within the shooting range of the front camera, but the person may be the current user or a distant passerby, generally, only when the radius value of the eyeball in the human eye image is greater than or equal to the preset radius, the user may be considered as the current user and the sight line of the current user is right on the screen, otherwise, the user may be considered as a distant passerby or the sight line of the current user is elsewhere.
204. The electronic equipment controls the screen to be in a screen-off state.
For example, when it is determined that the user is a passerby at a distance or the current user's line of sight is at another place, it may not be necessary to light the screen.
205. The electronic equipment acquires the color parameter of each pixel point in the image information, determines the ambient light brightness of the environment where the electronic equipment is located according to the color parameter, and then determines the corresponding screen brightness value according to the ambient light brightness.
For example, the color parameters may include a brightness value, a hue value, and a saturation value, and the ambient light brightness is determined mainly according to the brightness value, in the practical application process, images under different ambient light brightness may be collected in advance, and then the relationship between the ambient light brightness and the brightness value may be summarized according to the collected images and stored in the electronic device, so that the corresponding ambient light brightness may be obtained according to the practical brightness value.
206. The electronic device controls the screen to be in a bright screen state by using the screen brightness value, detects whether human eye images exist in the image information shot in a preset duration, if yes, executes the following step 207, and if not, rejects the incoming call and controls the screen to be in a screen off state.
For example, when it is determined that the user is the current user and the line of sight of the current user is exactly on the screen, the screen may be lit, and at this time, if the current screen is in the off-screen state, the screen may be lit first, and then the screen brightness may be adjusted to the screen brightness value, and if the current screen is in the on-screen state, the screen brightness may be directly adjusted to the screen brightness value. The preset duration can be 3 seconds which are set manually, namely, if the human eye images of the user are detected within 3 seconds, the call can be automatically switched on, otherwise, the user can be considered not to answer the call and can be directly hung up.
207. The electronic equipment acquires the environmental noise of the environment where the electronic equipment is located, determines the playing volume of the incoming call voice according to the environmental noise, and then connects the incoming call according to the playing volume.
For example, because the surrounding environment noise has a great influence on the user to answer the call, in order to avoid that the user needs to manually adjust the volume every time the user answers the call, the playing volume of the incoming call voice can be automatically adjusted according to the surrounding environment noise before the user connects the call, so that the voice can be flexibly adjusted according to different environments, the manual operation of the user is not needed, and the experience is good.
In addition, in the process of detecting whether human eye images exist in the shot image information within the preset duration, a preview area can be generated at the upper left corner or the upper right corner of the screen, and the shot image information is displayed in the preview area, so that the user can adjust the face position quickly according to the purpose (such as calling or not calling) of the user, and the flexibility is good.
As can be seen from the above, in the information processing method provided in this embodiment, when an incoming call reminding event is monitored, the electronic device may perform image shooting, acquire shot image information, detect whether a human eye image exists in the image information, if not, control the screen to be in a screen-off state, if so, acquire a radius value of an eyeball in the human eye image, and determine whether the radius value is smaller than a preset radius, if so, control the screen to be in the screen-off state, if not, acquire a color parameter of each pixel point in the image information, determine an ambient light brightness of an environment where the electronic device is located according to the color parameter, then determine a corresponding screen brightness value according to the ambient light brightness, then control the screen to be in a screen-on state by using the screen brightness value, and detect whether all human eye images exist in the shot image information within a preset duration, if so, acquiring the environmental noise of the environment where the mobile phone is located, determining the playing volume of the voice of the incoming call according to the environmental noise, then connecting the incoming call according to the playing volume, and if not, rejecting the incoming call, so that when the incoming call is received, not only can the screen be automatically controlled to be turned on and off according to the intention of a user, but also the incoming call can be automatically hung up and answered, and the method is simple, high in practicability and good in user experience.
In another embodiment, the information processing apparatus is specifically integrated in an electronic device, and the incoming call event is an incoming call answering event.
Referring to fig. 4 and 5, a specific flow of an information processing method may be as follows:
301. when the incoming call answering event is monitored, the electronic equipment acquires a distance value between the user and the electronic equipment.
For example, when in a call, the electronic device may detect a distance value between the user and the electronic device through a distance sensor, which may include an infrared sensor.
302. The electronic device determines whether the distance value is not less than a preset distance, if not, the following step 303 is executed, and if so, the following step 307 is executed.
For example, the predetermined distance is mainly used to define whether the ear or face of the user is close to the electronic device, and may be set manually, such as 0.05 m. When the distance value between the user and the electronic equipment is smaller than the preset distance, the fact that the user is probably placing the electronic equipment beside the ears to carry out conversation indicates that the screen does not need to be lightened, the camera can be turned off for saving electric quantity, the camera is turned on again when the distance is changed, and when the distance value between the electronic equipment and the user is larger than or equal to the preset distance, images need to be further shot to determine whether the screen is turned off or turned on.
303. The electronic device acquires currently captured image information, detects whether a human eye image exists in the image information, and if so, executes the following step 304, and if not, executes the following step 307.
For example, a human face may be extracted from image information by a human face detection technique, and then human eyes may be found from the human face based on a biometric recognition technique, which mainly includes iris recognition and retina recognition.
304. The electronic device obtains a radius value of an eyeball in the eye image, and determines whether the radius value is smaller than a preset radius, if not, the following step 305 and step 306 are executed, and if so, the following step 307 is executed.
For example, when the presence of the human eye image is detected, it can only be stated that the presence user is located right within the shooting range of the front camera, but the person may be the current user or a distant passerby, generally, only when the radius value of the eyeball in the human eye image is greater than or equal to the preset radius, the user may be considered as the current user and the sight line of the current user is right on the screen, otherwise, the user may be considered as a distant passerby or the sight line of the current user is elsewhere.
305. The electronic equipment acquires the color parameter of each pixel point in the image information, determines the ambient light brightness of the environment where the electronic equipment is located according to the color parameter, and then determines the corresponding screen brightness value according to the ambient light brightness.
For example, the color parameters may include a brightness value, a hue value, and a saturation value, and the ambient light brightness is determined mainly according to the brightness value, in the practical application process, images under different ambient light brightness may be collected in advance, and then the relationship between the ambient light brightness and the brightness value may be summarized according to the collected images and stored in the electronic device, so that the corresponding ambient light brightness may be obtained according to the practical brightness value.
306. The electronic equipment controls the screen to be in a bright screen state by utilizing the screen brightness value.
For example, when it is determined that the user is the current user and the line of sight of the current user is exactly on the screen, the screen may be lit, and at this time, if the current screen is in the off-screen state, the screen may be lit first, and then the screen brightness may be adjusted to the screen brightness value, and if the current screen is in the on-screen state, the screen brightness may be directly adjusted to the screen brightness value.
307. The electronic equipment controls the screen to be in a screen-off state.
For example, when it is determined that the user is a passerby at a distance or the current user's line of sight is at another place, it may not be necessary to light the screen.
As can be seen from the above, in the information processing method provided in this embodiment, when an incoming call answering event is monitored, the electronic device may obtain a distance value between a user and the electronic device, and determine whether the distance value is not less than a preset distance, if so, control the screen to be in a screen-off state, if not, obtain image information currently captured, and detect whether a human eye image exists in the image information, if not, control the screen to be in a screen-off state, if so, obtain a radius value of an eyeball in the human eye image, and determine whether the radius value is less than a preset radius, if not, obtain a color parameter of each pixel point in the image information, determine an environmental brightness of an environment where the electronic device is located according to the color parameter, then determine a corresponding screen brightness value according to the environmental brightness, and then control the screen to be in a screen-on state by using the screen brightness value, if so, controlling the screen to be in a screen-off state, so that the screen can be accurately and automatically controlled to be turned on or off according to the intention of a user in the conversation process.
The present embodiment will be further described from the perspective of an information processing apparatus that can be integrated in an electronic device, according to the method described in the above embodiment.
Referring to fig. 6, fig. 6 specifically illustrates an information processing apparatus provided in an embodiment of the present application, which is applied to an electronic device, and includes: the device comprises an acquisition module 10, a detection module 20, a first control module 30 and a second control module 40, wherein:
(1) acquisition module 10
The obtaining module 10 is configured to perform image shooting when an incoming call event is monitored, and obtain shot image information.
In this embodiment, the image information may be acquired by a front-facing camera built in the electronic device, and the acquisition operation may be periodic, for example, once in 2s, or real-time, and may be specifically determined according to actual requirements.
For example, referring to fig. 7, the incoming call event may include an incoming call answering event and an incoming call reminding event, and when the incoming call event is the incoming call answering event, the information processing apparatus may further include a third control module 50 configured to:
before the acquisition module 10 takes an image, acquiring a distance value between a user and the electronic equipment;
when the distance value is not less than the preset distance, triggering the acquisition module 10 to shoot the image;
and when the distance value is smaller than the preset distance, controlling the screen to be in a screen-off state.
In this embodiment, the incoming call answering event mainly refers to a call, and the incoming call reminding event mainly refers to a reminding manner such as vibration or ringing when the call is not connected. The third control module 50 may detect a distance value between the user and the electronic device through a distance sensor, which may include an infrared sensor. The preset distance is mainly used for defining whether the ear or the face of the user is close to the electronic device, and can be set manually, such as 0.05 m.
Generally, during a call, when the distance value between the user and the electronic device is less than the preset distance, it indicates that the user is most likely to place the electronic device near the ear for a call, and at this time, the screen does not need to be lighted, and when the distance value between the electronic device and the user is greater than or equal to the preset distance, it needs to further presume whether the user is looking at the screen according to the currently photographed image information, so as to control the lighting and extinguishing of the screen according to the presumption result.
In the incoming call reminding process, because the telephone is not connected, the user can not approach the ear to the screen generally, namely the distance value between the user and the electronic equipment is usually larger than the preset distance, at the moment, only the user needs to judge whether the user is watching the screen directly according to the currently shot image information, and the screen is controlled to be turned on or off according to the judgment result, and the distance detection is not needed in real time, so that the control accuracy is ensured, the distance detection step is omitted, the method is simple, and the power consumption is saved.
(2) Detection module 20
And a detecting module 20, configured to detect whether a human eye image exists in the image information.
In this embodiment, the eye image mainly includes an eyelid, an eyeball (iris), and a white of eye (sclera), the detection module 20 may extract a face from the image information by a face detection technique, and then find out the eye from the face based on a biometric identification technique, which mainly includes iris identification and retina identification.
(3) First control Module 30
The first control module 30 is configured to, if the size information of the eyeball in the image of the human eye exists, obtain size information of the eyeball in the image of the human eye, and control an operation state of a screen in the electronic device according to the size information, where the operation state includes a screen-on state and a screen-off state.
In this embodiment, an eyeball part may be extracted from a human eye image according to a special shape of an eyeball in an eye, size information such as a radius value or a diameter value of the eyeball may be calculated, and a screen may be controlled according to the size information.
Further, referring to fig. 8, the size information may include a radius value, and the first control module 30 may specifically include:
a judging unit 31 for judging whether the radius value is smaller than a preset radius;
the first control unit 32 is configured to control the screen to be in a screen-off state if the radius value is smaller than a preset radius;
and a second control unit 33, configured to control the screen to be in a bright screen state if the radius value is greater than or equal to the preset radius.
In the embodiment, although the eyes of different people have different sizes, the length is mainly based on the length of the eyelid, and for the eyeball, the size of most of the eyeballs is within a normal range, for example, the length of the front and back diameters of the eyeball of a general person is about 24mm, and the length of the vertical diameter is about 23mm, so that the reliability of judging whether the user watches the screen through the radius or the diameter of the eyeball is higher compared with other reference factors. The preset radius can be an eyeball radius estimated in advance when a call user is farthest away from the screen, when the radius value is smaller than the preset radius, the eye attention of the user is usually represented at other places, or the eye image is not shot by the front camera aiming at the call user and possibly shot by other pedestrians on the road, at the moment, the screen does not need to be lightened, when the radius value is larger than or equal to the preset radius, the distance between the user and the screen is moderate, the attention is on the screen, and at the moment, the screen needs to be lightened.
For example, the first control unit 32 may specifically be configured to:
acquiring color parameters of each pixel point in the image information;
determining the ambient light brightness of the environment where the electronic equipment is located according to the color parameters;
determining a corresponding screen brightness value according to the ambient light brightness;
and controlling the screen to be in a bright screen state by using the screen brightness value.
In this embodiment, the color parameter may include a brightness value, a hue value, and a color saturation value, and the ambient light brightness is mainly determined according to the brightness value, for example, images under different ambient light brightness may be collected in advance, and then a relationship between the ambient light brightness and the brightness value is summarized according to the collected images and stored in the electronic device, so that the corresponding ambient light brightness may be obtained subsequently according to the actual brightness value, and this obtaining manner of the ambient light brightness may be implemented only by an existing front camera without additionally providing a light sensor, thereby saving the configuration cost.
In addition, when the incoming call event is an incoming call reminding event, the user can directly make a call through the direct-view screen after the screen is lighted up, that is, the information processing apparatus may further include a fourth control module 60 for:
after the first control module 30 controls the running state of the screen in the electronic device according to the radius value, when the screen is in a bright screen state, detecting whether human eye images exist in the image information shot within a preset duration;
if yes, the incoming call is connected to trigger and generate the incoming call answering event;
if not, the incoming call is refused, and the screen is turned off.
In this embodiment, the preset duration may be set manually according to actual requirements, for example, 3 seconds or 5 seconds, and it may be presumed that the user needs to answer the call only when it is detected that the eyes of the user watch the screen within a certain period of time, otherwise, it may be presumed that the user does not want to answer the call, and the electronic device may automatically control the connection and disconnection of the call according to the presumed result, without manual operation, and the method is simple and has high flexibility.
For example, the fourth control module 60 may also be configured to:
before an incoming call is connected, acquiring environmental noise of the environment where the electronic equipment is located;
determining the playing volume of the incoming call voice according to the environmental noise;
and connecting the incoming call according to the playing volume.
In this embodiment, the playing volume of the voice corresponding to different environmental noises can be stored in the local library in advance, and in practical application, the fourth control module 60 can directly obtain the corresponding playing volume according to the environmental noises of the environment where the fourth control module is located, and play and answer the voice by using the obtained playing volume, so that the voice size can be flexibly adjusted according to different environments, manual operation of a user is not needed, and the experience is good.
For example, the fourth control module 60 may also be configured to:
generating a preview area on the screen in the process of detecting whether human eye images exist in the shot image information within a preset duration;
and displaying the image information shot in the duration in the preview area.
In this embodiment, the size of the preview area is usually much smaller than the total size of the screen, and the setting position thereof can be set manually, for example, it can be located at the upper left corner or the upper right corner of the screen. Specifically, when the screen is on, the shot image information is displayed in real time in the preview area through the fourth control module 60, so that the user can quickly adjust the face position according to the purpose (such as calling or not calling), and the flexibility is good.
(4) Second control module 40
And the second control module 40 is used for controlling the screen to be in a screen-off state if the screen does not exist.
In this embodiment, in the communication process, only when the ear of the user is tightly attached to the screen, the screen is in the screen-off state, and if the camera is still turned on all the time to obtain the images of the human eyes, no work is undoubtedly done, so the power consumption problem is considered, and after the screen is turned off, the second control module 40 can further stop the image acquisition operation, that is, turn off the front-facing camera, so as to save the electric quantity.
In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.
As can be seen from the above description, the information processing apparatus provided in this embodiment is applied to an electronic device, and when an incoming call event is monitored, an image is captured by the obtaining module 10, and captured image information is obtained, the detecting module 20 detects whether a human eye image exists in the image information, if so, the first control module 30 obtains size information of an eyeball in the human eye image, and controls a running state of a screen in the electronic device according to the size information, where the running state includes a screen-on state and a screen-off state, and if not, the second control module 40 controls the screen to be in the screen-off state, so that a user intention can be accurately inferred only by capturing an image during a call or an incoming call, and the screen is automatically controlled to be turned on or off according to the user intention.
In addition, the embodiment of the application also provides electronic equipment which can be equipment such as a smart phone and a tablet computer. As shown in fig. 7, the electronic device 700 includes a processor 701, a memory 702, a display screen 703, a control circuit 704, and a camera 705. The processor 701 is electrically connected to the memory 702, the display screen 703, the control circuit 704, and the camera 705.
The processor 701 is a control center of the electronic device 700, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or loading an application program stored in the memory 702 and calling data stored in the memory 702, thereby integrally monitoring the electronic device.
In this embodiment, the processor 701 in the electronic device 700 loads instructions corresponding to processes of one or more application programs into the memory 702 according to the following steps, and the processor 701 runs the application programs stored in the memory 702, thereby implementing various functions:
when an incoming call event is monitored, acquiring currently shot image information;
detecting whether the image information has human eye images or not;
if the eye size information exists, acquiring the eye size information in the eye image, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state;
and if not, controlling the screen to be in a screen-off state.
The camera 705 may be configured to capture an image and obtain captured image information when an incoming call event is detected.
The memory 702 may be used to store applications and data. The memory 702 stores applications containing instructions executable in the processor. The application programs may constitute various functional modules. The processor 701 executes various functional applications and data processing by running an application program stored in the memory 702.
The display screen 703 may be used to display information input by or provided to the user as well as various graphical user interfaces of the terminal, which may be comprised of images, text, icons, video, and any combination thereof.
The control circuit 704 is electrically connected to the display screen 703 and is configured to control the display screen 703 to display information, for example, when the control circuit 704 transmits a screen-off signal, the display screen 703 turns off the backlight and does not display information, and when the control circuit 704 transmits a screen-on signal, the display screen 703 turns on the backlight and displays information.
In some embodiments, the electronic device 700 may also include at least one sensor 706, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a distance sensor, where the distance sensor may acquire a distance value between a user and the electronic device, and when the distance value is not less than a preset distance, the camera 705 is triggered to perform an operation of acquiring image information currently captured, and when the distance value is less than the preset distance, the display screen 703 is triggered to turn off the backlight. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.
In some embodiments, the electronic device 700 may further include: a radio frequency circuit 707, an input unit 708, and a power supply 709. The processor 701 is electrically connected to the rf circuit 707, the input unit 708, and the power source 709, respectively.
The rf circuit 707 is configured to transceive rf signals to establish wireless communication with a network device or other electronic devices through wireless communication, and transceive signals with the network device or other electronic devices.
The input unit 708 may be used to receive input numbers, character information, or user characteristic information (e.g., fingerprint), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. The input unit 708 may include a fingerprint recognition module.
The power supply 709 is used to supply power to various components of the electronic device 700. In some embodiments, the power supply 709 may be logically connected to the processor 701 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system.
According to the electronic equipment provided by the embodiment of the application, when an incoming call event is monitored, image shooting is carried out, the shot image information is obtained, whether a human eye image exists in the image information is detected, if the human eye image exists, the size information of eyeballs in the human eye image is obtained, the running state of a screen in the electronic equipment is controlled according to the size information, the running state comprises a screen lightening state and a screen extinguishing state, and if the human eye image does not exist, the screen is controlled to be in the screen extinguishing state, so that the user intention can be accurately estimated only by shooting the image in the calling or incoming call process, the screen is automatically controlled to be lightened or extinguished according to the user intention, the method is simple, the power consumption is reduced, and the control effect is good.
In addition, a storage medium is further provided, where a plurality of instructions are stored in the storage medium, and the instructions are suitable for being loaded by a processor to execute the information processing method according to any one of the foregoing embodiments. The storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
In summary, although the present application has been described with reference to the preferred embodiments, the above-described preferred embodiments are not intended to limit the present application, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application, so that the scope of the present application shall be determined by the appended claims.
Claims (10)
1. An information processing method applied to an electronic device, the method comprising:
when an incoming call event is monitored, shooting an image and acquiring shot image information;
detecting whether a human eye image exists in the image information;
if the eye size information exists, acquiring the eye size information in the eye image, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state;
and if not, controlling the screen to be in a screen-off state.
2. The information processing method according to claim 1, wherein the size information includes a radius value, and the controlling of the operating state of the screen in the electronic device according to the size information includes:
judging whether the radius value is smaller than a preset radius or not;
if the radius value is smaller than the preset radius, controlling the screen to be in a screen-off state;
and if the radius value is larger than or equal to the preset radius, controlling the screen to be in a bright screen state.
3. The information processing method according to claim 2, wherein the controlling the screen to be in a bright screen state includes:
acquiring color parameters of each pixel point in the image information;
determining the ambient light brightness of the environment where the electronic equipment is located according to the color parameters;
determining a corresponding screen brightness value according to the ambient light brightness;
and controlling the screen to be in a bright screen state by using the screen brightness value.
4. The information processing method according to any one of claims 1 to 3, wherein the incoming call event includes an incoming call answering event and an incoming call reminding event, and when the incoming call event is the incoming call answering event, before acquiring the currently captured image information, the method further includes:
acquiring a distance value between a user and the electronic equipment;
when the distance value is not smaller than a preset distance, executing the step of acquiring the currently shot image information;
and when the distance value is smaller than a preset distance, controlling the screen to be in a screen-off state.
5. The information processing method according to claim 4, wherein when the incoming call event is an incoming call alert event, after controlling the operating state of a screen in the electronic device according to the size information, further comprising:
when the screen is in a bright screen state, detecting whether human eye images exist in the shot image information within a preset duration;
if yes, the incoming call is connected to trigger and generate the incoming call answering event;
if not, the incoming call is refused, and the screen is turned off.
6. The information processing method according to claim 5, further comprising, before the incoming call is connected:
acquiring environmental noise of an environment where the electronic equipment is located;
determining the playing volume of the incoming call voice according to the environmental noise;
and connecting the incoming call according to the playing volume.
7. The information processing method according to claim 5, wherein in detecting whether human eye images are present in all pieces of image information captured within a preset duration, the method further comprises:
generating a preview area on the screen;
and displaying the image information shot in the duration in the preview area.
8. An information processing apparatus applied to an electronic device, comprising:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for shooting images and acquiring shot image information when an incoming call event is monitored;
the detection module is used for detecting whether a human eye image exists in the image information;
the first control module is used for acquiring the size information of eyeballs in the human eye image if the eye balls exist, and controlling the running state of a screen in the electronic equipment according to the size information, wherein the running state comprises a screen-on state and a screen-off state;
and the second control module is used for controlling the screen to be in a screen-off state if the screen does not exist.
9. A storage medium having stored therein a plurality of instructions adapted to be loaded by a processor to execute the information processing method of any one of claims 1 to 7.
10. An electronic device, comprising a processor and a memory, wherein the processor is electrically connected to the memory, the memory is used for storing instructions and data, and the processor is used for executing the steps in the information processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710775584.3A CN107566643B (en) | 2017-08-31 | 2017-08-31 | Information processing method, information processing apparatus, storage medium, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710775584.3A CN107566643B (en) | 2017-08-31 | 2017-08-31 | Information processing method, information processing apparatus, storage medium, and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107566643A CN107566643A (en) | 2018-01-09 |
| CN107566643B true CN107566643B (en) | 2020-02-14 |
Family
ID=60978574
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710775584.3A Active CN107566643B (en) | 2017-08-31 | 2017-08-31 | Information processing method, information processing apparatus, storage medium, and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107566643B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108833694B (en) * | 2018-06-06 | 2020-06-26 | Oppo广东移动通信有限公司 | Control method, control device, electronic device, computer storage medium, and apparatus |
| CN109618056A (en) * | 2018-12-28 | 2019-04-12 | 惠州Tcl移动通信有限公司 | Mobile terminal and its control method of screen light on and off, computer storage medium |
| CN111081090B (en) * | 2019-06-09 | 2022-05-03 | 广东小天才科技有限公司 | Information output method and learning device in point-to-read scene |
| CN113596248B (en) * | 2020-04-30 | 2022-11-11 | 华为技术有限公司 | Display screen control method and device |
| CN112506344A (en) * | 2020-12-09 | 2021-03-16 | 上海龙旗科技股份有限公司 | Visual control method and equipment |
| CN113190119A (en) * | 2021-05-06 | 2021-07-30 | Tcl通讯（宁波）有限公司 | Mobile terminal screen lighting control method and device, mobile terminal and storage medium |
| CN114980286B (en) * | 2022-04-29 | 2023-08-29 | 荣耀终端有限公司 | Display method for electronic equipment screen-off |
| CN116880702B (en) * | 2023-09-08 | 2024-01-05 | 深圳市江元科技(集团)有限公司 | Control method, system and storage medium of induction type vehicle-mounted medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7306337B2 (en) * | 2003-03-06 | 2007-12-11 | Rensselaer Polytechnic Institute | Calibration-free gaze tracking under natural head movement |
| CN102231777B (en) * | 2011-06-28 | 2015-04-01 | Tcl通讯科技（成都）有限公司 | Mobile terminal and signal incoming call processing method thereof |
| KR101818573B1 (en) * | 2011-07-07 | 2018-01-15 | 삼성전자 주식회사 | Method and apparatus for displaying of view mode using face recognition |
| US8885882B1 (en) * | 2011-07-14 | 2014-11-11 | The Research Foundation For The State University Of New York | Real time eye tracking for human computer interaction |
| CN103780746B (en) * | 2012-10-19 | 2016-12-21 | 宇瞻科技股份有限公司 | touch screen backlight switch control method |
| CN102999162B (en) * | 2012-11-20 | 2016-04-20 | 广东欧珀移动通信有限公司 | Mobile terminal keeps the method for bright screen state, system and mobile terminal automatically |
| CN103051795B (en) * | 2012-12-18 | 2014-12-10 | 广东欧珀移动通信有限公司 | Method for switching front camera and rear camera of mobile terminal and mobile terminal |
| CN105338192A (en) * | 2015-11-25 | 2016-02-17 | 努比亚技术有限公司 | Mobile terminal and operation processing method thereof |
| CN106648081A (en) * | 2016-12-06 | 2017-05-10 | 捷开通讯(深圳)有限公司 | Method for turning off screen and electronic equipment |
-
2017
- 2017-08-31 CN CN201710775584.3A patent/CN107566643B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107566643A (en) | 2018-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107566643B (en) | Information processing method, information processing apparatus, storage medium, and electronic device | |
| EP3277057B1 (en) | Light emission control method and device | |
| US10133957B2 (en) | Method and device for recognizing object | |
| EP3154270A1 (en) | Method and device for adjusting and displaying an image | |
| CN109120863B (en) | Shooting method, shooting device, storage medium and mobile terminal | |
| US20170032638A1 (en) | Method, apparatus, and storage medium for providing alert of abnormal video information | |
| EP3299946B1 (en) | Method and device for switching environment picture | |
| CN107566746B (en) | Photographing method and user terminal | |
| CN107948498B (en) | A kind of elimination camera Morie fringe method and mobile terminal | |
| CN112188074B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN110298304A (en) | A kind of skin detecting method and terminal | |
| CN109525837B (en) | Image generation method and mobile terminal | |
| CN110874905A (en) | Monitoring method and device | |
| CN108986803B (en) | Scene control method and device, electronic equipment and readable storage medium | |
| CN110597426A (en) | Bright screen processing method and device, storage medium and terminal | |
| CN109151217B (en) | Backlight mode adjusting method and device | |
| CN108924413B (en) | Shooting method and mobile terminal | |
| US20170244891A1 (en) | Method for automatically capturing photograph, electronic device and medium | |
| CN107563395B (en) | Method and device for dressing management through intelligent mirror | |
| CN106896917B (en) | Method and device for assisting user in experiencing virtual reality and electronic equipment | |
| CN107343100B (en) | Information prompting method and device, storage medium and electronic equipment | |
| CN112733673A (en) | Content display method and device, electronic equipment and readable storage medium | |
| CN111698600A (en) | Processing execution method and device and readable medium | |
| CN111614841B (en) | Alarm clock control method and device, storage medium and mobile terminal | |
| CN109561215B (en) | Method, device, terminal and storage medium for controlling beautifying function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: Guangdong Opel Mobile Communications Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |