CN113064792A - Information processing method and device - Google Patents
Information processing method and device Download PDFInfo
- Publication number
- CN113064792A CN113064792A CN202110325531.8A CN202110325531A CN113064792A CN 113064792 A CN113064792 A CN 113064792A CN 202110325531 A CN202110325531 A CN 202110325531A CN 113064792 A CN113064792 A CN 113064792A
- Authority
- CN
- China
- Prior art keywords
- mode
- ambient light
- intensity
- determining
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4411—Configuring for operating with peripheral devices; Loading of device drivers
Abstract
The application provides an information processing method and an electronic device, wherein the method comprises the following steps: determining a change in intensity of ambient light; and determining a target acquisition mode or a processing mode of environmental data based on the intensity change of the environmental light, wherein the environmental data is used for assisting the electronic equipment to realize system control. The information processing method provided by the embodiment of the application can adjust the acquisition mode or the processing mode of the environmental data according to different environmental light intensities so as to assist the electronic equipment to realize accurate control on the system.
Description
Technical Field
The present application relates to the field of information processing technologies, and in particular, to an information processing method and apparatus.
Background
With the continuous development of internet technology, terminal devices are widely used. In existing terminal devices, many devices such as a screen can operate by collecting environmental data, including the display effect of the screen.
However, the environmental data are collected by the camera at present, and the requirement on the brightness condition of the environment is strict when the camera collects the environmental data, so that when the brightness condition of the environment is in problem, the camera is easy to fail to collect the data or has a large error, and the electronic equipment is influenced to realize system control.
Disclosure of Invention
The embodiment of the application is used for providing an information processing method which can adjust the acquisition mode or the processing mode of environmental data according to different environmental light intensities so as to accurately control an electronic equipment system, and an electronic device applying the method.
In order to solve the above problem, the present application provides an information processing method, including:
determining a change in intensity of ambient light;
and determining a target acquisition mode or a processing mode of environmental data based on the intensity change of the environmental light, wherein the environmental data is used for assisting the electronic equipment to realize system control.
Optionally, the determining the change in intensity of the ambient light comprises:
determining the intensity change value of the ambient light; or
The rate of change of the intensity of the ambient light is determined.
Optionally, the determining the change in intensity of the ambient light comprises:
the change in the intensity of the ambient light is determined at least by the photographic effect of the ambient light sensor or camera.
Optionally, the determining a target acquisition manner of the environmental data based on the intensity variation of the environmental light includes:
determining that the environment data is obtained in a first mode under the condition that the intensity change of the environment light does not meet a trigger condition, wherein the first mode comprises a mode of being collected by a camera;
and under the condition that the intensity change of the ambient light meets a trigger condition, determining that the ambient data is obtained in a second mode, wherein the second mode comprises a mode that the collection quality is not influenced by the intensity change of the ambient light.
Optionally, the method further comprises:
determining a target object based on the environmental data;
the second mode comprises one or more of a position tracking mode and a time-of-flight detection mode for determining the target object.
Optionally, the environment data is used to assist in implementing system control of the electronic device, and includes:
the environmental data is used to assist the electronic device in controlling the display of the screen based on the location of the target object.
Optionally, the environmental data is obtained by image acquisition through a camera;
the processing mode for determining the environmental data based on the intensity change of the environmental light comprises the following steps:
respectively adding feature codes into images acquired in a first time period to form a feature frame sequence so that the electronic equipment refuses to realize system control based on the feature frame sequence;
the first time period is the time when the intensity change of the ambient light continuously meets the trigger condition.
Optionally, the environment data is used to assist in implementing system control of the electronic device, and includes:
and controlling the screen to keep a target display state in the first time period, wherein the target display state comprises a preset specified display state or the current display state of the screen.
Optionally, the electronic device has a driving framework service program therein, which is configured to collect collected data and process the collected data according to each function that the electronic device can perform, so that the electronic device can directly obtain required data from the driving framework service program when performing different functions;
the method further comprises the following steps:
and obtaining the environment data through the driving framework service program, and further realizing system control based on the environment data.
Another embodiment of the present invention further provides an electronic device, including:
a determination module for determining an intensity variation of the ambient light;
and the processing module is used for determining a target acquisition mode or a processing mode of environmental data according to the intensity change of the environmental light, wherein the environmental data is used for assisting the electronic equipment to realize system control.
Based on the disclosure of the above embodiment, it can be known that the beneficial effects of this embodiment include that the environmental data collection mode or the processing mode of adaptation is selected under different environmental light intensity conditions by determining the environmental light intensity change of the environment where the electronic device is located, so that when the electronic device implements system control, the electronic device can be effectively ensured to accurately control the system according to the environmental data, and the user experience of the user on the electronic device is improved.
Drawings
Fig. 1 is a flowchart of an information processing method in an embodiment of the present invention.
Fig. 2 is a flowchart of an information processing method according to another embodiment of the present invention.
Fig. 3 is a flowchart illustrating an actual application of the information processing method according to an embodiment of the present invention.
Fig. 4 is a flow chart of an actual application of the information processing method in another embodiment of the present invention.
Fig. 5 is a flowchart of an application of the driver framework service program in the embodiment of the present invention.
FIG. 6 is a flowchart of another application of the driver framework service in the embodiment of the present invention.
FIG. 7 is a flowchart illustrating an application of a driver framework service according to another embodiment of the present invention.
FIG. 8 is a flowchart of another application of the driver framework service in another embodiment of the present invention.
Fig. 9 is a block diagram of an electronic device according to an embodiment of the invention.
Detailed Description
Various aspects and features of the present application are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments of the present application. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the application.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with a general description of the application given above and the detailed description of the embodiments given below, serve to explain the principles of the application.
These and other characteristics of the present application will become apparent from the following description of preferred forms of embodiment, given as non-limiting examples, with reference to the attached drawings.
It is also to be understood that although the present application has been described with reference to some specific examples, those skilled in the art are able to ascertain many other equivalents to the practice of the present application.
The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the application, which can be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the application of unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present application in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the application.
As shown in fig. 1, an embodiment of the present application provides a processing method, including:
determining a change in intensity of ambient light;
and determining a target acquisition mode or a processing mode of the environmental data based on the intensity change of the environmental light, wherein the environmental data is used for assisting the electronic equipment to realize system control.
For example, the electronic device is a notebook computer, but may be other electronic devices, and is not limited to the above. The computer can determine the change in the intensity of the ambient light in real time, or periodically, or in the event that a mechanism for determining the intensity of the ambient light is triggered under certain environmental conditions. For example, when a user carries a computer from outdoors to an indoor environment with dim light, or sits behind a strong light source, if the user sits in front of a floor lamp, the body or the head of the user just shields the strong light irradiated on the computer, at this time, if the user moves the body or tilts or lowers the head, the strong light can be irradiated on the computer, under the similar condition, the ambient light of the environment where the computer is located can be changed in a larger intensity, or the computer is in an environment with poor light intensity or higher light intensity, the computer can be triggered to determine the ambient light intensity change or the ambient light intensity mechanism, and at this time, the computer can determine the ambient light intensity change or the ambient light intensity through one or more preset modes. Then, a target acquisition mode or processing mode of the environmental data is determined based on the determined ambient light intensity change or ambient light intensity to ensure more accurate environmental data acquisition. For example, in general, a computer obtains environmental data by using RGB images captured by an RGB camera, but since the RGB camera can only ensure that the captured image quality meets the requirements under normal ambient light conditions, if the ambient light changes, such as too strong, too dark, or suddenly receives strong light, the captured image cannot be normally used at all, and the image quality is seriously damaged. Therefore, the computer in this embodiment may determine to adapt to the current ambient light condition according to different ambient light conditions, or may adapt to the current ambient light condition, and may acquire a target acquisition manner that obtains the ambient data meeting the usage requirement, so as to ensure the acquisition quality of the ambient data. Or, a target processing mode for the acquired environmental data is determined according to the current environmental light intensity, because the previous processing mode for the environmental data is only suitable for being used under the condition that the environmental data has no large error, and if the environmental data has a large error, the same processing mode is used, so that serious deviation occurs in the subsequent electronic device control system, and the use of a user is influenced. The environmental data in this embodiment is mainly used to assist the electronic device in performing system control, for example, the electronic device controls the operating state and the power consumption state of the system based on the environmental data, including controlling the sleep state and the normal operating state, or controlling the display condition of the screen, including controlling the definition, locking the screen, and the like. And can also comprise on-off control of the camera and the like. In addition, the specific form and content of the environment data in this embodiment are not limited, and may be specifically determined according to the type and content of data required by the electronic device, for example, the environment data may include image, video and other types of data.
Therefore, the beneficial effects of the embodiment include that the adaptive environmental data acquisition mode or processing mode is selected under different environmental light intensity conditions by determining the environmental light intensity change of the environment where the electronic device is located, so that when the electronic device realizes system control, the electronic device can be effectively ensured to accurately control the system according to the environmental data, and the use experience of the user on the electronic device is improved.
Further, in the present embodiment, the determining the intensity variation of the ambient light includes:
determining the intensity change value of the ambient light; or
The rate of change of the intensity of the ambient light is determined.
For example, the intensity change value of the ambient light may be detected in real time or at regular time or when a trigger condition is satisfied, for example, when it is determined that the intensity of the ambient light suddenly changes, the intensity change value of the ambient light at that time may be detected, and the rate of change of the intensity of the ambient light in the environment where the electronic device is located within a period of time may also be monitored. Of course, the intensity value of the ambient light may be monitored only, and when the intensity value of the ambient light reaches a preset threshold range, the electronic device may also control to change the collection mode or the processing mode of the ambient data. If the ambient light intensity value reaches the light intensity range in which the camera cannot normally shoot the image, the electronic equipment can change the ambient data acquisition mode according to the current ambient light intensity.
Specifically, determining the intensity variation of the ambient light in this embodiment includes:
the change in the intensity of the ambient light is determined at least by the photographic effect of the ambient light sensor or camera.
For example, the electronic device directly obtains the ambient light intensity in real time or at regular time through an Ambient Light Sensor (ALS) or based on the control of the electronic device, and then the electronic device automatically analyzes and determines whether the variation range of the ambient light intensity meets preset conditions or whether the acquisition or processing mode of the ambient data needs to be changed. Or, the change of the ambient light intensity or the ambient light intensity value may be determined directly by the shooting effect of the camera, for example, by analyzing the image quality according to the shooting effect of the preview image or the image that is completely acquired.
Further, as shown in fig. 2, the determining a target acquisition mode of the environmental data based on the intensity variation of the environmental light in the embodiment includes:
under the condition that the intensity change of the ambient light does not meet the triggering condition, determining that the ambient data is obtained in a first mode, wherein the first mode comprises a mode of being collected by a camera;
determining that the environmental data is obtained in a second manner under the condition that the intensity variation of the environmental light satisfies the trigger condition, wherein the second manner comprises a manner that the acquisition quality is not influenced by the intensity variation of the environmental light.
Specifically, when it is determined through, for example, an ambient light sensor or image analysis that the intensity variation of ambient light falls within a normal range, for example, all fall within a range of an illumination threshold required by a camera, the electronic device may determine that, in this state, the accuracy of ambient data acquisition may be ensured by using a camera acquisition mode, so that the electronic device may be controlled to acquire the ambient data through a first mode, i.e., a camera acquisition mode. If the intensity change of the ambient light is determined to be beyond the normal range through analysis, if the intensity change of the ambient light is beyond the range of the illumination threshold value required by the camera, the electronic device can determine that the ambient data can not be collected by using the camera at the moment. The second mode in this embodiment may specifically include any mode in which all the acquisition quality is not affected by the change of the current ambient light intensity, for example, the second mode may be a mode in which data acquisition is implemented by using another camera different from the shooting mode of the aforementioned camera, such as an infrared camera, a camera that acquires an image by using ultrasonic waves, or the like, and may also be a data acquisition mode implemented by using a functional device other than a camera, which is not specifically determined.
Further, when the electronic device in this embodiment controls the system based on the environment data, the electronic device further includes:
determining a target object based on the environmental data;
that is, when the electronic device controls the system based on the environment data, the electronic device determines a target object based on the environment data, and then assists in implementing the control of the system based on the target object. For example, the electronic device may determine whether there is a target object in the environment data according to whether there is portrait data of the user in the environment data, and if so, determine the target object, and control the system to operate based on an analysis of the target object. Specifically, it may be determined whether the user is in front of the electronic device, if so, the control system starts or maintains the running state, and if it is found that the target object is not present, that is, the user is not in front of the device, the control system enters the sleep state, and the like. Or, the target object may be a line of sight of the user, for example, whether the line of sight of the user falls on a display screen of the electronic device is determined based on the environment data, if yes, the screen is started or kept in a normal display state, and if the line of sight of the user does not fall on the display screen, even if the user sits in front of the electronic device, the electronic device may control the screen of the display screen to be in a screen locking state or a screen protection state, for example, a current displayed page is subjected to blurring processing, or a mosaic layer is added to protect screen display content and prevent privacy disclosure caused by peeping.
Specifically, the second mode in this embodiment includes one or more of a position tracking mode and a time-of-flight detection mode for determining the target object.
In practical applications, the electronic device may be equipped with a position tracking module for implementing position tracking, and one or more of a time of flight (TOF) ultrasonic module for implementing time of flight detection to implement environmental data acquisition.
Further, the environmental data in this embodiment is used to assist in implementing system control of the electronic device, and includes:
the environmental data is used to assist the electronic device in controlling the display of the screen based on the location of the target object.
That is, the environment data in the present embodiment is mainly used to assist the electronic device to realize control of the display screen based on the position of the target object in the environment data. For example, the target object may be the user or the line of sight of the user, and the electronic device may control the display of the screen based on the position of the user relative to the electronic device or the position of the line of sight of the user relative to the screen in the environment data. If it is determined that the user is in front of the device, or the user's sight line falls on the screen, or only the user is in front of the device and the sight line falls on the screen, the electronic device controls the screen to normally display, and if it is determined that the user is not in front of the device, or the sight line does not fall on the screen, or the user is not in front of the device but is within a preset distance range, and the sight line falls on the screen, or the user is outside the preset distance range, and the sight line falls on the screen, or the user is within the preset distance range, including in front of the device, but the sight line does not fall on the screen, the electronic device can control the screen to open a screen protection program, or directly lock the screen, so that not only energy consumption is saved, but also the privacy of the user can be effectively protected from being leaked.
Further, when the environment data in the present embodiment is obtained by image acquisition by the camera,
the electronic equipment determines a processing mode of environment data based on the intensity change of the environment light, and the processing mode comprises the following steps:
respectively adding feature codes into the images acquired in the first time period to form a feature frame sequence so that the electronic equipment refuses to realize system control based on the feature frame sequence;
the first time period is the time when the intensity change of the ambient light continuously meets the triggering condition;
the environmental data is used for assisting system control of the electronic device, and comprises:
the control screen maintains a target display state for a first period of time, the target display state including a preset designated display state or a current display state of the screen.
For example, when only a camera is installed in the electronic device and no other device or module for collecting the environmental data is provided, or when the other device or module for collecting the environmental data fails, that is, the electronic device currently supports only the collection of the environmental data in the first manner, but not the collection of the environmental data in the second manner. Or, when the electronic device fails, during a period that the ambient light intensity or the ambient light intensity variation does not satisfy the requirement of acquiring the ambient data by the camera, that is, the first time period described in this embodiment, the ambient data is always acquired based on the camera, and a processing module in the electronic device intends to start processing such as analyzing the ambient data to assist in implementing system control, the electronic device may sort the acquired images acquired by the camera according to a time sequence, control the system or the camera to mark image frames whose acquisition time is within the first time period, add a feature code to form a feature frame sequence, and notify the processing module of the feature code, so that the module ignores and abandons the image with the feature code when analyzing the acquired images, and only analyzes the image without the feature code, thereby avoiding the electronic device from performing error control on the system, if the user is still in the use state at present, at this time, if the electronic device automatically controls the screen to be in the screen locking state based on the image with poor acquisition quality, the use of the user is seriously affected. Therefore, in order not to influence the use of the user, the electronic equipment directly defaults to only control the system to keep the current state and not automatically change the system operation state in the first time period unless the instruction input by the user is received and is changed according to the instruction input by the user. Or, the screen is directly controlled to be in a display state preset by the user, the specific state is not definite, and is realized by user definition, and certainly, the specific state can also be set by default.
Furthermore, the electronic device may continue to detect the intensity or intensity variation of the ambient light in real time or at regular time after the control system is not changed or the control system is controlled based on the ambient data collected in the second mode, so that when it is determined that the intensity or intensity variation of the ambient light is within the normal range, the electronic device automatically switches to the first mode to implement data collection or automatically switches to the original processing mode, that is, processes the ambient data in a mode of processing more collected ambient data. Of course, when data collection is realized based on different ambient light intensities or intensity changes, the electronic device may be controlled to select the second mode most suitable for the current ambient light condition to realize collection based on the difference of a plurality of second modes, that is, the modules or devices for realizing data collection have different illumination requirements.
In particular, in order to better illustrate the embodiments of the present application, the following detailed description is given in terms of various embodiments:
the first embodiment is as follows:
as shown in fig. 3, the electronic device is equipped with a TOF ultrasound module, a camera (amera), an Ambient Light Sensor (ALS), and a glare program, which are used to capture the line of sight of the user according to the environmental data and assist the electronic device to control the display of the screen based on the position relationship between the line of sight of the user and the screen, for example, to control the screen to be in a screen-locked state or to open a screen saver when the line of sight of the user does not fall on the screen. In practical application, when ALS is continuously detected for a period of time, after the fact that the light fluctuation range of the environment where the user is located currently is determined to be beyond the light intensity range which can be identified by the Glance, the Glance is informed, the Camera is closed through the system, the ToF or other sensors (sensors) used for collecting required environment data are turned on, and a mode that the ToF or other sensors are used for tracking the user and the sight line position of the user is entered. That is, the mode in which environmental data is acquired with a TOF ultrasound module or other sensor is determined. When ALS finds that the current ambient light fluctuation range of the electronic equipment is recovered to the light range which can be identified by the Glance through continuous detection, the Glance is informed, the Glance is enabled to open the camera again through the system, other sensor detection modes such as ToF and the like are closed, and the common camera tracking mode is recovered. That is, the mode is switched to the mode in which the environmental data is collected by the camera.
Example two:
as shown in fig. 4, the electronic device is equipped with a camera (camera), an Ambient Light Sensor (ALS) and a glare program, and when the ALS detects that the variation range of the ambient light exceeds the light intensity range recognizable by glare, the ALS notifies the camera of image driving so that a random feature code is added to the image output by the camera in the next period of time, that is, in the period of time when the light intensity does not meet the light intensity range recognizable by glare, to form a feature frame sequence. Meanwhile, the ALS informs the added random feature code sequence to the Glance through a BIOS (basic input output System) and an OS (operating system), so that the Glance selectively ignores the feature frame containing the random feature code when decoding the image frame transmitted by the Camera, thereby avoiding the error recognition caused by the change of the light environment of the Glance, finally carrying out error control on the screen, influencing the normal use of a user and bringing inconvenience to the user. Such as automatically locking the screen when the user is in normal use, preventing the user from viewing the content displayed on the screen, etc.
Optionally, in order to meet the uniform requirement of each application program in the electronic device for the same collected data, for example, multiple application programs all need to use environment data when running, determine a user position through the environment data, determine light, and determine an environment scene to implement a certain control or response, in general, each application program respectively and independently collects required data, and then respectively performs part of the same processing procedures, which may increase power consumption of the electronic device and make data resources not be better utilized. Moreover, because the processing speeds of the application programs are different, the response speeds of the application programs are different, and the experience speed of the whole intelligent function is influenced. In order to reduce the power consumption of the device, improve the resource utilization rate, and unify the response speed of each application program as much as possible, the electronic device in this embodiment has a driving framework service program, which may be specifically an AI architecture or implemented in combination with the AI architecture, and is configured to collect data collected by each of different collection devices such as a sensor and a camera, and correspondingly process the collected data according to each function that the electronic device can execute, so that the electronic device can directly obtain required data from the driving framework service program when executing different functions;
the method of the embodiment further comprises the following steps:
the environment data is obtained by driving the framework service program, and then the system control is realized based on the environment data.
For example, as shown in fig. 5 and fig. 6, a completely new Driver Framework Service (Driver Framework Service) and AI Chip architecture are established, which are responsible for uniformly collecting data output by all hardware devices, including camera, sensor, microphone, and the like, and then uniformly distributing some calculation data required by the intelligent function through the uniform AI Chip architecture, for example:
1) acquiring the user state through a camera;
2) whether the user is in front of the computer or not is known through the sensor;
3) acquiring ambient noise by a microphone (Mic);
4) ambient light brightness or ambient light color temperature information acquired by an ALS/color sensor.
The AI Chip aims at different intelligent requirements, specifically can be according to the predetermined function type of each application program, the function type of the electronic equipment system determines the different intelligent requirements, after acquiring the collected data from different hardware, the AI Chip performs unified calculation and extraction, then the AI Chip transmits the calculated data to the drive frame service program, the drive frame service program is used for docking the APPs with different functions, specifically, a unified interface can be set for docking with different APPs, when the collected data is processed in a unified manner, the AI Chip can be based on the AI architecture, a CPU, an NPU, one or more of the GPUs can complete calculation together, and when the AI Chip is applied, data transmission and interaction can be realized based on public key information. In addition, the specific calculation process is determined according to different predetermined intelligentized requirements, the apps with different functions acquire required calculation results from the drive framework service program according to the intelligentized functions to be realized, for example, position data of the user, ambient light intensity data, ambient light intensity change data, the sight line focus position of the user, color temperature information of ambient light, voice data obtained through a microphone and the like are acquired, and finally, calculation is continued according to the algorithm in the apps, so that the functions to be realized are finally realized. For example, when the Glance application in this embodiment implements control of the screen, the driving frame service program may obtain the position information of the user, the position information of the line-of-sight focus, for example, information required for notifying the driving frame service program, and then, for example, the notification driving frame service program transmits the required information to the Glance program, at this time, the Glance program may perform analysis and calculation based on the obtained information, and finally determine how to control the display state, the display content, and the like of the screen.
Further, as shown in fig. 7 and 8, the driving framework service program in this embodiment may also have functions of image inverse recognition and frame complementing. For example, the camera module has an image beautifying function, and the images captured by the camera module are automatically beautified, but the images collected by the driving framework service program from the camera module are all beautified images, but the use of the liance program by the beautified images has a great influence, so that the liance program cannot correctly judge the sight focus position of the user or normally judge the change of the ambient light intensity based on the obtained images. Therefore, after the driving framework service program in this embodiment collects the collected image, it provides the beautified image for other APPs to use, and for the Glance program or the same type of program as the Glance program, i.e., the APP with a higher requirement for the reality of the image content, provides the APP with the image inverse recognition, and the image after the inverse processing. For example, in practical application, a customized decoder module (such as an MFT driver in the figure) and an MEMC motion compensation module may be set in the drive frame service program, and the drive frame service program decodes the beautified image through the decoder module, identifies and captures a feature frame, where the feature frame is obtained by correspondingly adding feature codes at intervals of partial frame images when the camera outputs the beautified image, so that the drive frame service program only needs to perform inverse processing on the frame image added with the feature codes to obtain a common frame image, thereby reducing the processing load. After the decoder module determines the feature frame, the key predetermined with the camera module is used to process the feature frame image, which is equivalent to performing inverse processing on the image to remove beautification, so as to obtain the original common frame image (image feed). And then, a MEMC motion compensation module is used for compensating missing frames among a plurality of obtained common frame images, because the sequence of the characteristic frames and the position of the characteristic frames compared with the original video stream are fixed, frames are inserted to complement the frame rate according to a motion compensation algorithm for the compensated frames without the beautifying effect of the front frame and the back frame, so that after the normal image frame data stream is transmitted to Glance and other facial motion tracking software, the software can normally use the image frame data to finish the accurate tracking of sight, facial motion and the like.
As shown in fig. 9, another embodiment of the present application further provides an electronic device, including:
a determination module for determining an intensity variation of the ambient light;
and the processing module is used for determining a target acquisition mode or a processing mode of the environmental data according to the intensity change of the environmental light, and the environmental data is used for assisting the electronic equipment to realize system control.
Therefore, the beneficial effects of the embodiment include that the adaptive environmental data acquisition mode or processing mode is selected under different environmental light intensity conditions by determining the environmental light intensity change of the environment where the electronic device is located, so that when the electronic device realizes system control, the electronic device can be effectively ensured to accurately control the system according to the environmental data, and the use experience of the user on the electronic device is improved.
Optionally, the determining module determines the intensity variation of the ambient light, including:
determining the intensity change value of the ambient light; or
The rate of change of the intensity of the ambient light is determined.
Optionally, the determining module determines the intensity variation of the ambient light, including:
the change in the intensity of the ambient light is determined at least by the photographic effect of the ambient light sensor or camera.
Optionally, the processing module determines a target acquisition mode of the environmental data based on the intensity variation of the environmental light, and includes:
determining that the environment data is obtained in a first mode under the condition that the intensity change of the environment light does not meet a trigger condition, wherein the first mode comprises a mode of being collected by a camera;
and under the condition that the intensity change of the ambient light meets a trigger condition, determining that the ambient data is obtained in a second mode, wherein the second mode comprises a mode that the collection quality is not influenced by the intensity change of the ambient light.
Optionally, the processing module is further configured to:
determining a target object based on the environmental data;
the second mode comprises one or more of a position tracking mode and a time-of-flight detection mode for determining the target object.
Optionally, the environment data is used to assist in implementing system control of the electronic device, and includes:
the environmental data is used to assist the electronic device in controlling the display of the screen based on the location of the target object.
Optionally, the environmental data is obtained by image acquisition through a camera;
the processing module determines a processing mode of the environmental data based on the intensity change of the environmental light, and the processing mode comprises the following steps:
respectively adding feature codes into images acquired in a first time period to form a feature frame sequence so that the electronic equipment refuses to realize system control based on the feature frame sequence;
the first time period is the time when the intensity change of the ambient light continuously meets the trigger condition.
Optionally, the environment data is used to assist in implementing system control of the electronic device, and includes:
and controlling the screen to keep a target display state in the first time period, wherein the target display state comprises a preset specified display state or the current display state of the screen.
Optionally, the electronic device has a driving framework service program therein, which is configured to collect collected data and process the collected data according to each function that the electronic device can perform, so that the electronic device can directly obtain required data from the driving framework service program when performing different functions;
the processing module is further configured to:
and obtaining the environment data through the driving framework service program, and further realizing system control based on the environment data.
Further, another embodiment of the present application also provides an electronic device, including:
one or more processors;
a memory configured to store one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the processing methods described above.
Further, an embodiment of the present application also provides a storage medium, on which a computer program is stored, which when executed by a processor implements the processing method as described above. It should be understood that each solution in this embodiment has a corresponding technical effect in the foregoing method embodiments, and details are not described here.
Further, the present application embodiments also provide a computer program product that is tangibly stored on a computer-readable medium and includes computer-executable instructions that, when executed, cause at least one processor to perform a processing method such as the embodiments described above. It should be understood that each solution in this embodiment has a corresponding technical effect in the foregoing method embodiments, and details are not described here.
It should be noted that the computer storage media of the present application can be computer readable signal media or computer readable storage media or any combination of the two. The computer readable medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access storage media (RAM), a read-only storage media (ROM), an erasable programmable read-only storage media (EPROM or flash memory), an optical fiber, a portable compact disc read-only storage media (CD-ROM), an optical storage media piece, a magnetic storage media piece, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, antenna, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
It should be understood that although the present application has been described in terms of various embodiments, not every embodiment includes only a single embodiment, and such description is for clarity purposes only, and those skilled in the art will recognize that the embodiments described herein may be combined as suitable to form other embodiments, as will be appreciated by those skilled in the art.
The above embodiments are only exemplary embodiments of the present invention, and are not intended to limit the present invention, and the scope of the present invention is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present invention, and such modifications and equivalents should also be considered as falling within the scope of the present invention.
Claims (10)
1. An information processing method comprising:
determining a change in intensity of ambient light;
and determining a target acquisition mode or a processing mode of environmental data based on the intensity change of the environmental light, wherein the environmental data is used for assisting the electronic equipment to realize system control.
2. The method of claim 1, wherein the determining the change in intensity of the ambient light comprises:
determining the intensity change value of the ambient light; or
The rate of change of the intensity of the ambient light is determined.
3. The method of claim 1, wherein the determining the change in intensity of the ambient light comprises:
the change in the intensity of the ambient light is determined at least by the photographic effect of the ambient light sensor or camera.
4. The method of claim 1, wherein determining a target acquisition mode for environmental data based on the intensity variation of the ambient light comprises:
determining that the environment data is obtained in a first mode under the condition that the intensity change of the environment light does not meet a trigger condition, wherein the first mode comprises a mode of being collected by a camera;
and under the condition that the intensity change of the ambient light meets a trigger condition, determining that the ambient data is obtained in a second mode, wherein the second mode comprises a mode that the collection quality is not influenced by the intensity change of the ambient light.
5. The method of claim 4, further comprising:
determining a target object based on the environmental data;
the second mode comprises one or more of a position tracking mode and a time-of-flight detection mode for determining the target object.
6. The method of claim 5, wherein the environmental data is used to facilitate system control of an electronic device, comprising:
the environmental data is used to assist the electronic device in controlling the display of the screen based on the location of the target object.
7. The method of claim 1, wherein the environmental data is obtained via image acquisition by a camera;
the processing mode for determining the environmental data based on the intensity change of the environmental light comprises the following steps:
respectively adding feature codes into images acquired in a first time period to form a feature frame sequence so that the electronic equipment refuses to realize system control based on the feature frame sequence;
the first time period is the time when the intensity change of the ambient light continuously meets the trigger condition.
8. The method of claim 7, wherein the environmental data is used to facilitate system control of an electronic device, comprising:
and controlling the screen to keep a target display state in the first time period, wherein the target display state comprises a preset specified display state or the current display state of the screen.
9. The method of claim 1, wherein the electronic device has a driver framework service program therein for collecting the collected data and processing the collected data according to each function that the electronic device can perform, so that the electronic device can obtain the required data directly from the driver framework service program when performing different functions;
the method further comprises the following steps:
and obtaining the environment data through the driving framework service program, and further realizing system control based on the environment data.
10. An electronic device, comprising:
a determination module for determining an intensity variation of the ambient light;
and the processing module is used for determining a target acquisition mode or a processing mode of environmental data according to the intensity change of the environmental light, wherein the environmental data is used for assisting the electronic equipment to realize system control.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110325531.8A CN113064792A (en) | 2021-03-26 | 2021-03-26 | Information processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110325531.8A CN113064792A (en) | 2021-03-26 | 2021-03-26 | Information processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113064792A true CN113064792A (en) | 2021-07-02 |
Family
ID=76563676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110325531.8A Pending CN113064792A (en) | 2021-03-26 | 2021-03-26 | Information processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113064792A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102981736A (en) * | 2012-10-29 | 2013-03-20 | 华为终端有限公司 | Screen unlocking method and screen unlocking terminal |
| CN106941588A (en) * | 2017-03-13 | 2017-07-11 | 联想(北京)有限公司 | A kind of data processing method and electronic equipment |
| CN108900700A (en) * | 2018-06-04 | 2018-11-27 | 北京大学 | Authentication method and system based on the double verification that recognition of face and sight position |
| CN109029720A (en) * | 2018-06-29 | 2018-12-18 | 北京小米移动软件有限公司 | Intensity of illumination detection method and device |
| CN111414078A (en) * | 2020-03-17 | 2020-07-14 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| WO2020151712A1 (en) * | 2019-01-22 | 2020-07-30 | Huawei Technologies Co., Ltd. | Indoor detections based on ambient light |
-
2021
- 2021-03-26 CN CN202110325531.8A patent/CN113064792A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102981736A (en) * | 2012-10-29 | 2013-03-20 | 华为终端有限公司 | Screen unlocking method and screen unlocking terminal |
| CN106941588A (en) * | 2017-03-13 | 2017-07-11 | 联想(北京)有限公司 | A kind of data processing method and electronic equipment |
| CN108900700A (en) * | 2018-06-04 | 2018-11-27 | 北京大学 | Authentication method and system based on the double verification that recognition of face and sight position |
| CN109029720A (en) * | 2018-06-29 | 2018-12-18 | 北京小米移动软件有限公司 | Intensity of illumination detection method and device |
| WO2020151712A1 (en) * | 2019-01-22 | 2020-07-30 | Huawei Technologies Co., Ltd. | Indoor detections based on ambient light |
| CN111414078A (en) * | 2020-03-17 | 2020-07-14 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20140128885A (en) | Power efficient image sensing apparatus, method of operating the same and eye/gaze tracking system | |
| US9311712B2 (en) | Image processing device and image processing method | |
| US11689817B2 (en) | Method and apparatus for automatically detecting and suppressing fringes, electronic device and computer-readable storage medium | |
| KR101423916B1 (en) | Method and apparatus for recognizing the plural number of faces | |
| US20110103643A1 (en) | Imaging system with integrated image preprocessing capabilities | |
| US20140232843A1 (en) | Gain Value of Image Capture Component | |
| US10255683B1 (en) | Discontinuity detection in video data | |
| EP2198394A1 (en) | Face tracking in a camera processor | |
| CN108513069B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20230269462A1 (en) | Wake-up method for surveillance camera, surveillance camera, and non-transitory computer-readable storage medium | |
| US20200336661A1 (en) | Video recording and processing method and electronic device | |
| WO2018080649A1 (en) | Power saving techniques for an image capture device | |
| CN106200904A (en) | A kind of gesture identifying device, electronic equipment and gesture identification method | |
| US10769416B2 (en) | Image processing method, electronic device and storage medium | |
| US20190045100A1 (en) | Image processing device, method, and program | |
| EP4072124A1 (en) | Image capturing method and device, apparatus, and storage medium | |
| CN110933314B (en) | Focus-following shooting method and related product | |
| CN113064792A (en) | Information processing method and device | |
| CN108495038B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN108847191B (en) | Backlight adjusting system, backlight adjusting method and device thereof, and intelligent interaction equipment | |
| KR101629553B1 (en) | Display screen controlling apparatus in mobile terminal and method thereof | |
| Inoue et al. | Situation-based dynamic frame-rate control for on-line object tracking | |
| US9667854B2 (en) | Electornic device and information processing unit | |
| CN112702530B (en) | Algorithm control method and electronic equipment | |
| CN116347224B (en) | Shooting frame rate control method, electronic device, chip system and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |