CN113114843B - Data processing method and device, terminal and storage medium - Google Patents
Data processing method and device, terminal and storage medium Download PDFInfo
- Publication number
- CN113114843B CN113114843B CN202110322302.0A CN202110322302A CN113114843B CN 113114843 B CN113114843 B CN 113114843B CN 202110322302 A CN202110322302 A CN 202110322302A CN 113114843 B CN113114843 B CN 113114843B
- Authority
- CN
- China
- Prior art keywords
- display
- picture frame
- queue
- empty
- current picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure relates to a data processing method and device, a terminal and a storage medium. The method comprises the following steps: detecting whether a queue for storing display contents of the picture frame is empty; determining a state identifier for displaying the current picture frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not; acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame; storing the state identifier corresponding to the current picture frame and the performance data into a preset data set; and the state identifier and the performance data have a mapping relation. By the method, real operation data can be automatically acquired under the condition that a user does not sense the operation data, and the method has the characteristic of intellectualization.
Description
Technical Field
The present disclosure relates to the field of electronic technologies, and in particular, to a data processing method and apparatus, a terminal, and a storage medium.
Background
With the resolution of smart phones, the refresh rate is higher and higher, how to make applications (apps) not stuck is more and more important, and the reason for the stuck is analyzed after the stuck occurs.
Taking the application not stuck as an example, one solution to this need is to predict whether App is likely to be stuck next, and to prioritize resource ramping when App is predicted to be stuck. The Kalton prediction needs to be carried out through a machine learning algorithm, and the most important thing for falling to the ground of a supervised learning algorithm in machine learning is to collect a large amount of labeled data. There is always interest in how to facilitate the collection of annotation data.
Disclosure of Invention
The disclosure provides a data processing method and device, a terminal and a storage medium.
According to a first aspect of the embodiments of the present disclosure, there is provided a data processing method applied in an electronic device, including:
detecting whether a queue for storing display contents of the picture frame is empty;
determining a state identifier for displaying the current picture frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame;
storing the state identifier corresponding to the current picture frame and the performance data into a preset data set; and the state identifier and the performance data have a mapping relation.
In some embodiments, the detecting whether a queue for storing display content of the picture frame is empty includes:
detecting whether a queue for storing display contents of the picture frame is empty by a graphic composition component; wherein the detection operation is triggered by the graphics composition component upon receipt of a display signal indicating a display screen frame.
In some embodiments, the obtaining performance data of the electronic device in a period from the display of the previous frame to the display of the current frame includes:
sending a driving instruction to a hardware driving layer through an equipment control interface; the sending of the driving instruction is triggered after the graphic synthesis component receives a notification message, and the driving instruction comprises a state identifier of the current picture frame;
acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame through the hardware driving layer; wherein the obtaining operation is triggered by the hardware driver layer according to the driving instruction.
In some embodiments, the method further comprises:
rendering the content to be displayed;
and updating the rendered content to be displayed to the queue, and sending the notification message to the graphic composition component.
In some embodiments, the graphical composition component comprises: surface flinger; the display signal includes: the vertical sync VSYNC pulse signal.
In some embodiments, the method further comprises:
if the queue is not empty, acquiring the display content from the queue, synthesizing the display content, and displaying the synthesized display content as a current picture frame;
and if the queue is empty, displaying the previous picture frame as the current picture frame.
In some embodiments, the method further comprises:
before the electronic equipment displays the picture frame, predicting whether the electronic equipment is blocked when the picture is displayed according to a blocking prediction model; the Kanton prediction model is trained based on state identifications and performance data corresponding to different current picture frames in the preset data set.
According to a second aspect of the embodiments of the present disclosure, there is provided a data processing apparatus, applied to an electronic device, including:
a detection module configured to detect whether a queue for storing display contents of the picture frame is empty;
the identification module is configured to determine a state identification for displaying the current picture frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
the acquisition module is configured to acquire the performance data of the electronic equipment in a time period from the display of the previous picture frame to the display of the current picture frame;
the storage module is configured to store the state identifier corresponding to the current picture frame and the performance data into a preset data set; and the state identifier and the performance data have a mapping relation.
In some embodiments, the detection module is further configured to detect, by the graphics composition component, whether a queue for storing display content of the picture frame is empty; wherein the detection operation is triggered by the graphics composition component upon receipt of a display signal indicating a display screen frame.
In some embodiments, the obtaining module is further configured to send a driving instruction to the hardware driving layer through the device control interface; the sending of the driving instruction is triggered after the graphic synthesis component receives a notification message, and the driving instruction comprises a state identifier of the current picture frame; acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame through the hardware driving layer; wherein the obtaining operation is triggered by the hardware driver layer according to the driving instruction.
In some embodiments, the apparatus further comprises:
a rendering module configured to render content to be displayed;
and the sending module is configured to update the rendered content to be displayed to the queue and send the notification message to the graphic composition component.
In some embodiments, the graphical composition component comprises: surface flinger; the display signal includes: the vertical sync VSYNC pulse signal.
In some embodiments, the apparatus further comprises:
the display module is configured to acquire the display content from the queue and display the display content as a current picture frame after synthesizing the display content if the queue is not empty; and if the queue is empty, displaying the previous picture frame as the current picture frame.
In some embodiments, the apparatus further comprises:
the prediction module is configured to predict whether the electronic equipment is stuck when the electronic equipment performs picture display according to a stuck prediction model before the electronic equipment performs picture frame display; the Kanton prediction model is trained based on state identifications and performance data corresponding to different current picture frames in the preset data set.
According to a third aspect of the embodiments of the present disclosure, there is provided a terminal, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the data processing method as described in the first aspect above.
According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium including:
the instructions in said storage medium, when executed by a processor of a terminal, enable the terminal to perform the data processing method as described in the first aspect above.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the embodiment of the disclosure, by identifying the state of the current frame, acquiring the performance data of the electronic device in the time period from the display of the previous frame to the display of the current frame, and storing the state identification and the performance data corresponding to the current frame into the predetermined data set, the real operating data can be automatically acquired without perception of the user, and the method has the characteristic of intelligence. Particularly, if the state and performance data corresponding to the current picture frame stored in the preset data set are used for training, compared with the manual collection and manual labeling mode, the scheme disclosed by the invention greatly reduces the labor cost, the financial cost and the time cost, and the state corresponding to the performance data disclosed by the invention is automatically identified according to the condition that whether the queue is empty or not, and is more accurate compared with the manual identification mode.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart illustrating a data processing method according to an embodiment of the disclosure.
FIG. 2 is an exemplary diagram illustrating the execution of the image composition component functionality according to one exemplary embodiment of the present disclosure.
Fig. 3 is an exemplary diagram illustrating a picture frame display procedure according to an exemplary embodiment of the present disclosure.
Fig. 4 is a flowchart illustrating a data processing method according to an embodiment of the disclosure.
FIG. 5 is a diagram illustrating a data processing apparatus according to an example embodiment.
Fig. 6 is a block diagram of a terminal shown in an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Fig. 1 is a flowchart illustrating a data processing method according to an embodiment of the present disclosure, and as shown in fig. 1, the data processing method applied to an electronic device includes the following steps:
s11, detecting whether a queue for storing the display content of the picture frame is empty;
s12, determining the state identifier of the current picture frame according to the detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
s13, acquiring performance data of the electronic equipment in a time period from the display of the previous picture frame to the display of the current picture frame;
s14, storing the state identifier corresponding to the current picture frame and the performance data into a preset data set; and the state identifier and the performance data have a mapping relation.
In an embodiment of the present disclosure, an electronic device includes: a mobile device and a stationary device; the mobile device includes: a mobile phone, a tablet computer or a wearable device. The stationary device includes, but is not limited to, a Personal Computer (PC).
The electronic device comprises a display screen which can display picture frames. The display content of the frame consists of multiple parts, such as a status bar at the top of the screen, a navigation bar at the bottom or side, and an interface for the application. Some applications may have more or fewer layers (e.g., a default home screen application has a separate wallpaper layer, while a full screen game may hide the status bar). Generally, the display content of the picture frame is stored in a queue, when the picture frame is to be displayed, the electronic device extracts all parts of the display content from the queue, synthesizes the parts of the display content and displays the parts of the display content on the display screen, and the display content corresponding to the picture frame stored in the queue is deleted from the queue.
In step S11, the electronic device detects whether the queue for storing the display content of the frame is empty. It should be noted that the reason why the queue is empty may be that after the display of the previous frame is completed, the display content of the frame to be displayed is not temporarily stored in the queue, which is also one of the reasons for causing display jam.
In step S12, the electronic device determines a status flag indicating whether the display content in the current queue can be displayed, according to the detection result of whether the queue is empty.
As described above, when the electronic device normally performs frame display, the display content is extracted from the queue and displayed after being synthesized, and thus in the embodiment of the present disclosure, a state in which the display content in the current queue can be displayed is referred to as a "normal" state, and a state in which the display content in the current queue cannot be displayed (i.e., there is a dropped frame) is referred to as an "abnormal" state. For example, for the "normal" state, the state of the current picture frame may be identified as 0; for an "abnormal" state, the state of the current picture frame may be identified as 1.
It should be noted that, in the embodiment of the present disclosure, the electronic device performs status identification for each picture frame.
In some embodiments, the method further comprises:
if the queue is not empty, acquiring the display content from the queue, synthesizing the display content, and displaying the synthesized display content as a current picture frame;
and if the queue is empty, displaying the previous picture frame as the current picture frame.
In the embodiment of the present disclosure, when the frame is displayed, if the queue is not empty, the electronic device obtains the display content from the queue, synthesizes the display content, and displays the synthesized display content as the current frame, that is, refreshes the display frame; if the queue is empty, the display screen cannot be refreshed in the abnormal state at this time, and the previous screen frame is used as the current screen frame for display.
In step S13, the electronic device obtains performance data of the electronic device in a period from the display of the previous frame to the display of the current frame, where the performance data includes at least one of:
the frequency of the central processing unit CPU; the frequency of the CPU can comprise a small core frequency, a large core frequency and an ultra-large core frequency;
waiting for the completion time of the input and output iowait;
a frequency of a graphics processor GPU;
and (5) storing the value.
In step S14, the electronic device stores the status flag and the performance data corresponding to the current frame into a predetermined data set, where the status flag and the performance data in the predetermined data set have a mapping relationship. The predetermined data set may be a block of a memory pool in the electronic device. For example, the mapping relationship between the state identifier and the performance data corresponding to the current picture frame may be as shown in table 1 below:
TABLE 1
It should be noted that, in table 1, the 0 th frame and the 1 st frame are both the current picture frames of the embodiment of the present disclosure, and the 0 th frame and the 1 st frame are only the current picture frames to be displayed in different time periods. The predetermined data set of the present disclosure may store state identifiers and performance data corresponding to a plurality of current picture frames.
After the state identifier and the performance data corresponding to the current picture frame are stored in the predetermined data set, in some embodiments, the log format may be generated for the predetermined data set, so that after the log is derived, a research and development worker may check whether the electronic device is qualified or not in combination with the display condition and the log of the electronic device before the electronic device leaves a factory, or search for a reason for the display abnormality of the electronic device.
In other embodiments, before the electronic device displays the picture frame, predicting whether the electronic device will be stuck when displaying the picture according to a stuck prediction model; the Kanton prediction model is trained based on state identification and performance data corresponding to different current picture frames in the preset data set.
In this embodiment, based on the state identifiers and performance data corresponding to a large number of current picture frames stored in a predetermined data set, a katon prediction model may be trained, for example, based on a deep learning network such as Long Short-Term Memory (LSTM). Based on the trained katon prediction model, before the electronic equipment displays the picture frame, whether the electronic equipment is subjected to the katon prediction can be predicted according to the katon prediction model. Specifically, for example, performance data monitored in a period from the display of the previous frame to the display of the current frame is input into the stuck model, so that a prediction of whether stuck occurs under the current performance data is obtained.
In the embodiment of the present disclosure, if the electronic device predicts that the electronic device may be stuck based on the stuck prediction model, a certain resource tilt may be performed on the display of the electronic device, more memory may be allocated to the display module of the electronic device, or the priority of the screen display may be raised.
It can be understood that, in the process of displaying the current picture frame, the embodiment of the present disclosure identifies the state of the current picture frame, obtains the performance data of the electronic device in the time period from the display of the previous picture frame to the display of the current picture frame, and stores the state identification and the performance data corresponding to the current picture frame into the predetermined data set, so that the real operating data can be automatically obtained without perception by the user, and the present disclosure has an intelligent characteristic. Particularly, if the state and performance data corresponding to the current picture frame stored in the preset data set are used for training, compared with the manual collection and manual labeling mode, the scheme disclosed by the invention greatly reduces the labor cost, the financial cost and the time cost, and the state corresponding to the performance data disclosed by the invention is automatically identified according to the condition that whether the queue is empty or not, and is more accurate compared with the manual identification mode.
It should be noted that the data processing method in the embodiment of the present disclosure may be used in an android system, and may also be used in systems such as an apple system, and the embodiment of the present disclosure is not limited thereto.
In some embodiments, the detecting whether a queue for storing display content of the picture frame is empty includes:
detecting whether a queue for storing display contents of the picture frame is empty by a graphic composition component; wherein the detection operation is triggered by the graphics composition component upon receipt of a display signal indicating a display screen frame.
As described above, the electronic device extracts the display contents of the respective portions from the queue, synthesizes the display contents, and displays the synthesized display contents on the display screen, and the display contents corresponding to the frame stored in the queue are deleted from the queue after the display is completed. Before the synthesis display is executed, the graphics synthesis component receives a display signal indicating a display frame, detects whether the content in the queue is empty or not based on the display signal, and if not, the queue is updated, so that the graphics synthesis component extracts the display content from the updated queue to synthesize the display content, and displays the synthesized frame. In the present disclosure, the electronic device detects whether the queue is empty by the graphics composition component, and performs a composition display function by the graphics composition component.
Taking the android system as an example, in some embodiments, the graphics composition component includes: surface flinger; the display signal includes: the vertical sync VSYNC pulse signal.
Fig. 2 is an exemplary diagram illustrating the function execution of an image composition component according to an exemplary embodiment of the present disclosure, and as shown in fig. 2, the image composition component is a surface flicker, and a status bar, a control, a wallpaper, an application page, and the like of an a area identified by a dotted line are composited by the component to obtain a screen of a B display area identified by a dotted line.
Fig. 3 is an exemplary diagram illustrating a screen frame display process according to an exemplary embodiment of the present disclosure, and as shown in fig. 3, (product) may be an application having display requirements, and a CONSUMER (CONSUMER) may be a graphics composition component surface flicker of the present disclosure. The producer is responsible for rendering various contents and submitting the contents to a queue (BUFFERQUEUE) through a content submission component, wherein the queue can simultaneously maintain the contents of to-be-displayed picture frames of 2 applications; and the consumer synthesizes the content rendered by each application and finally displays the content on a screen. Each time when the surface flinger starts to synthesize, it is checked from the queue container whether there is data (Buffer, one application corresponds to one Buffer) corresponding to the rendered display content, if the display content is not empty, for example, if there are 1 or 2 buffers, it indicates that the application has not dropped frames, and the synthesis can be completed; if the display is empty, the application is dropped. And releasing the synthesized picture frame after the synthesis of the surface Flinger is finished, and dequeuing the display content corresponding to the picture frame in the queue.
In the embodiment of the disclosure, the status of whether the data to be synthesized can be obtained is identified by using the process of obtaining the data in the queue for synthesis by using the surfaceFlinger, so that other data processing can be conveniently performed on the performance data based on the status identification and the obtained performance data, the scheme is simple and effective, and the user does not feel.
In some embodiments, the obtaining performance data of the electronic device in a period from the display of the previous frame to the display of the current frame includes:
sending a driving instruction to a hardware driving layer through an equipment control interface; the sending of the driving instruction is triggered after the graphic synthesis component receives a notification message, and the driving instruction comprises a state identifier of the current picture frame;
acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame through the hardware driving layer; wherein the obtaining operation is triggered by the hardware driver layer according to the driving instruction.
In this embodiment, taking an android system as an example, the device control interface may be ioctl, and the hardware driver layer is, for example, a Linux kernel. When the application submits the rendered display content to the surfaceFlinger through the queueBuffer, the rendered display content can be used as a trigger signal and is informed to the Linux Kernel through the system call of ioctl.
Meanwhile, in the present disclosure, after the electronic device detects whether the queue is empty through the graph synthesis component and makes a corresponding status identifier, the electronic device also sends the status identifier to the hardware driver layer through the device control interface.
When the Linux kernel receives the driving signal, the Linux kernel starts to collect performance data of the electronic equipment in the time period from the display of the previous picture frame to the display of the current picture frame in terms of the CPU, the GPU, the memory, the input and the output and the like. After the electronic device acquires the performance data of the electronic device in the time period from the display of the previous picture frame to the display of the current picture frame through the hardware driving layer, the performance data and the corresponding state identifier are stored in a preset data set.
In some embodiments, the method further comprises:
rendering the content to be displayed;
and updating the rendered content to be displayed to the queue, and sending the notification message to the graphic composition component.
In this embodiment, as described above, the application with display requirement is responsible for rendering the content to be displayed and updating the rendered content to be displayed to the queue, and in addition, the application submits the rendered content to the surface flunger through the queue buffer, that is, the application sends a notification message to the graphics composition component.
Fig. 4 is a flowchart illustrating a data processing method according to an embodiment of the present disclosure, and as shown in fig. 4, the data processing method includes the following steps:
and S21, starting the application process.
In this embodiment, the application may be an application having display requirements. After the application process is started, the work of displaying the picture frame is started.
And S22, after the application is started, the application submits the updated queue to the graph composition component through the content submission component.
In this embodiment, the content submission component may be a queueBuffer and the graphical composition component may be a surfaceflag. The application submits the updated queue to the graphics composition component through the content submission component, i.e., sends a notification message to the graphics composition component.
S23, the graphics composition component checks whether the queue of the application is empty according to the received display signal.
In this embodiment, the display signal may be a VSYNC pulse signal. After the graphic synthesis component checks that the queue is empty, identifying that the frame drop exists; and if the checking queue is not empty, identifying that no frame drop exists.
It should be noted that the reason why the queue is empty may be that the application has not completed rendering within the last VSYNC cycle.
And S24, the equipment control interface sends a driving instruction to the hardware driving layer.
In this embodiment, the device control interface may be an ioctl interface, and the hardware driver layer may be a linux kernel. And when the graphic synthesis component receives the notification message of queue updating, the device control interface is triggered to send a driving instruction including the state identifier of the current picture frame to the hardware driving layer.
S25, the hardware driver layer collects performance data.
In this embodiment, the hardware driver layer collects performance data according to the driver instructions. The performance data includes data of CPU, GPU, memory, input and output, etc.
It should be noted that the performance data collected by the hardware driver layer is the performance data in the period from the display of the previous frame to the display of the current frame.
And S26, the data processing component stores the collected performance data and the state identifier of the current picture frame into a reserved memory pool.
In this embodiment, the data processing component may be a central processing unit in the electronic device, and the data processing component stores the performance data and the state identifier corresponding to different current picture frames into a predetermined memory pool. As shown in fig. 4, the performance data with data labels is packaged and placed in a reserved memory pool. After the application process is finished, the data in the memory pool are packed and compressed into a data file, so that subsequent use is facilitated, for example, a machine learning based training kanton model.
In the embodiment of the disclosure, by identifying the state of the current frame, acquiring the performance data of the electronic device in the time period from the display of the previous frame to the display of the current frame, and storing the state identification and the performance data corresponding to the current frame in the predetermined memory pool, the real operation data can be automatically acquired without perception of the user, and the method has the characteristic of intelligence. Particularly, if the state and performance data corresponding to the current picture frame stored in the predetermined memory pool are used for training, compared with a manual collection and manual labeling mode, the scheme disclosed by the invention greatly reduces the labor cost, the financial cost and the time cost, and the state corresponding to the performance data disclosed by the invention is automatically identified according to the condition that whether the queue is empty, and is more accurate compared with a manual identification mode.
FIG. 5 is a diagram illustrating a data processing apparatus according to an example embodiment. Referring to fig. 5, the apparatus applied to the electronic device includes:
a detection module 101 configured to detect whether a queue for storing display contents of a picture frame is empty;
an identification module 102, configured to determine a status identification of displaying the current frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
the acquisition module 103 is configured to acquire performance data of the electronic device in a time period from the display of a previous frame to the display of a current frame;
a saving module 104 configured to save the state identifier corresponding to the current frame and the performance data into a predetermined data set; and the state identifier and the performance data have a mapping relation.
In some embodiments, the detecting module 101 is further configured to detect, by the graphics composition component, whether a queue for storing display content of the picture frame is empty; wherein the detection operation is triggered by the graphics composition component upon receipt of a display signal indicating a display screen frame.
In some embodiments, the obtaining module 103 is further configured to send a driving instruction to the hardware driver layer through the device control interface; the sending of the driving instruction is triggered after the graphic synthesis component receives a notification message, and the driving instruction comprises a state identifier of the current picture frame; acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame through the hardware driving layer; wherein the obtaining operation is triggered by the hardware driver layer according to the driving instruction.
In some embodiments, the apparatus further comprises:
a rendering module 105 configured to render content to be displayed;
a sending module 106, configured to update the rendered content to be displayed to the queue, and send the notification message to the graphics composition component.
In some embodiments, the graphical composition component comprises: surface flinger; the display signal includes: the vertical sync VSYNC pulse signal.
In some embodiments, the apparatus further comprises:
a display module 107 configured to obtain the display content from the queue for synthesis and display as a current frame if the queue is not empty; and if the queue is empty, displaying the previous picture frame as the current picture frame.
In some embodiments, the apparatus further comprises:
the prediction module 108 is configured to predict whether the electronic device is stuck when performing the picture display according to a stuck prediction model before the electronic device performs the picture frame display; the Kanton prediction model is trained based on state identifications and performance data corresponding to different current picture frames in the preset data set.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 6 is a block diagram illustrating a terminal apparatus 800 according to an example embodiment. For example, the device 800 may be a cell phone, a computer, etc.
Referring to fig. 6, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
A power supply component 806 provides power to the various components of the device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a data processing method, the method comprising:
detecting whether a queue for storing display contents of the picture frame is empty;
determining a state identifier for displaying the current picture frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame;
storing the state identifier corresponding to the current picture frame and the performance data into a preset data set; and the state identifier and the performance data have a mapping relation.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (16)
1. A data processing method is applied to electronic equipment and comprises the following steps:
detecting whether a queue for storing display contents of the picture frame is empty;
determining a state identifier for displaying the current picture frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame;
correspondingly storing the state identification corresponding to the current picture frame and the performance data into a preset data set; wherein the performance data and the state identification in the predetermined data set are used for training a stuck prediction model; and the result of whether the seizure is generated or not is predicted by the seizure prediction model and is used for resource allocation displayed by the electronic equipment.
2. The method of claim 1, wherein the detecting whether the queue for storing the display content of the picture frame is empty comprises:
detecting whether a queue for storing display contents of the picture frame is empty by a graphic composition component; wherein the detection operation is triggered by the graphics composition component upon receipt of a display signal indicating a display screen frame.
3. The method of claim 2, wherein the obtaining performance data of the electronic device during a period from the display of the previous frame to the display of the current frame comprises:
sending a driving instruction to a hardware driving layer through an equipment control interface; the sending of the driving instruction is triggered after the graphic synthesis component receives a notification message, and the driving instruction comprises a state identifier of the current picture frame;
acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame through the hardware driving layer; wherein the obtaining operation is triggered by the hardware driver layer according to the driving instruction.
4. The method of claim 3, further comprising:
rendering the content to be displayed;
and updating the rendered content to be displayed to the queue, and sending the notification message to the graphic composition component.
5. The method of claim 2, wherein the graphical composition component comprises: surface flinger; the display signal includes: a vertical sync VSYNC pulse signal.
6. The method of claim 1, further comprising:
if the queue is not empty, acquiring the display content from the queue, synthesizing the display content, and displaying the synthesized display content as a current picture frame;
and if the queue is empty, displaying the previous picture frame as the current picture frame.
7. The method according to any one of claims 1 to 6, further comprising:
predicting whether the electronic equipment is blocked or not when the picture is displayed according to the blocking prediction model;
and according to the result of whether the jamming occurs, performing resource allocation displayed by the electronic equipment.
8. A data processing device, applied to an electronic device, includes:
a detection module configured to detect whether a queue for storing display contents of the picture frame is empty;
the identification module is configured to determine a state identification for displaying the current picture frame according to a detection result of whether the queue is empty; the state identification is used for representing whether display content in the current queue can be displayed or not;
the acquisition module is configured to acquire the performance data of the electronic equipment in a time period from the display of the previous picture frame to the display of the current picture frame;
the storage module is configured to correspondingly store the state identifier corresponding to the current picture frame and the performance data into a preset data set; wherein the performance data and the state identification in the predetermined data set are used for training a stuck prediction model; and the result of whether the electronic equipment is subjected to the pause is predicted by the pause prediction model and is used for resource allocation displayed by the electronic equipment.
9. The apparatus of claim 8,
the detection module is also configured to detect whether a queue for storing display contents of the picture frame is empty through the graphic composition component; wherein the detection operation is triggered by the graphics composition component upon receipt of a display signal indicating a display screen frame.
10. The apparatus of claim 9,
the acquisition module is also configured to send a driving instruction to the hardware driving layer through the device control interface; the sending of the driving instruction is triggered after the graphic synthesis component receives a notification message, and the driving instruction comprises a state identifier of the current picture frame; acquiring performance data of the electronic equipment in a time period from the display of a previous picture frame to the display of a current picture frame through the hardware driving layer; wherein the obtaining operation is triggered by the hardware driver layer according to the driving instruction.
11. The apparatus of claim 10, further comprising:
a rendering module configured to render content to be displayed;
and the sending module is configured to update the rendered content to be displayed to the queue and send the notification message to the graphic composition component.
12. The apparatus of claim 9, wherein the graphical composition component comprises: surface flinger; the display signal includes: the vertical sync VSYNC pulse signal.
13. The apparatus of claim 8, further comprising:
the display module is configured to acquire the display content from the queue and display the display content as a current picture frame after synthesizing the display content if the queue is not empty; and if the queue is empty, displaying the previous picture frame as the current picture frame.
14. The apparatus of any one of claims 8 to 13, further comprising:
the prediction module is configured to predict whether the electronic equipment is blocked when the picture is displayed according to the blocking prediction model; and according to the result that whether the jamming happens or not, performing resource allocation displayed by the electronic equipment.
15. A terminal, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the data processing method of any one of claims 1 to 7.
16. A non-transitory computer-readable storage medium, in which instructions, when executed by a processor of a terminal, enable the terminal to perform the data processing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110322302.0A CN113114843B (en) | 2021-03-25 | 2021-03-25 | Data processing method and device, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110322302.0A CN113114843B (en) | 2021-03-25 | 2021-03-25 | Data processing method and device, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113114843A CN113114843A (en) | 2021-07-13 |
| CN113114843B true CN113114843B (en) | 2022-06-10 |
Family
ID=76712322
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110322302.0A Active CN113114843B (en) | 2021-03-25 | 2021-03-25 | Data processing method and device, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113114843B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115639977B (en) * | 2022-12-23 | 2024-01-26 | 安徽海马云科技股份有限公司 | Android graph synthesis method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014165786A (en) * | 2013-02-27 | 2014-09-08 | Mitsubishi Electric Corp | Image encoding device and image decoding device |
| CN107241650A (en) * | 2017-08-09 | 2017-10-10 | 四川长虹电器股份有限公司 | A kind of method of quick positioning playing Caton phenomenon reason |
| CN109710448A (en) * | 2019-01-10 | 2019-05-03 | 湖南快乐阳光互动娱乐传媒有限公司 | Method and device for improving blockage of mobile terminal |
| CN110688245A (en) * | 2019-10-08 | 2020-01-14 | 广州市百果园信息技术有限公司 | Information acquisition method, device, storage medium and equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3084557B2 (en) * | 1998-12-16 | 2000-09-04 | コナミ株式会社 | Fluid image simple display method, image display device, recording medium |
| CN107193678B (en) * | 2017-04-28 | 2020-06-19 | 北京小米移动软件有限公司 | Method and device for determining cause of stuck and storage medium |
| CN109981628B (en) * | 2019-03-18 | 2021-11-23 | 网易（杭州）网络有限公司 | Method and device for monitoring network live broadcast software performance and electronic equipment |
| CN111949511A (en) * | 2020-07-09 | 2020-11-17 | 厦门美柚股份有限公司 | Application program pause processing method and device, terminal and storage medium |
-
2021
- 2021-03-25 CN CN202110322302.0A patent/CN113114843B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014165786A (en) * | 2013-02-27 | 2014-09-08 | Mitsubishi Electric Corp | Image encoding device and image decoding device |
| CN107241650A (en) * | 2017-08-09 | 2017-10-10 | 四川长虹电器股份有限公司 | A kind of method of quick positioning playing Caton phenomenon reason |
| CN109710448A (en) * | 2019-01-10 | 2019-05-03 | 湖南快乐阳光互动娱乐传媒有限公司 | Method and device for improving blockage of mobile terminal |
| CN110688245A (en) * | 2019-10-08 | 2020-01-14 | 广州市百果园信息技术有限公司 | Information acquisition method, device, storage medium and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113114843A (en) | 2021-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106970754B (en) | Screen capture processing method and device | |
| CN107526494B (en) | Keyboard display method, device, terminal and storage medium | |
| US20180284948A1 (en) | Method and apparatus for split-window display | |
| US9667774B2 (en) | Methods and devices for sending virtual information card | |
| US11086482B2 (en) | Method and device for displaying history pages in application program and computer-readable medium | |
| US9928811B2 (en) | Methods, devices, and computer-readable storage medium for image display | |
| US9800666B2 (en) | Method and client terminal for remote assistance | |
| EP3407189B1 (en) | Application distribution method and device | |
| EP3264257A1 (en) | Image outputting method and apparatus, computer program and recording medium | |
| US20170060260A1 (en) | Method and device for connecting external equipment | |
| EP3147802B1 (en) | Method and apparatus for processing information | |
| EP3128411A1 (en) | Interface display method and device | |
| US20170300211A1 (en) | Method and apparatus for displaying status information of application | |
| CN106354504B (en) | Message display method and device | |
| CN112130940A (en) | Terminal control method and device, storage medium and electronic equipment | |
| CN106155703B (en) | Emotional state display method and device | |
| EP3236355A1 (en) | Method and apparatus for managing task of instant messaging application | |
| CN111552426B (en) | Intelligent equipment operation method and device and storage medium | |
| EP3425533A1 (en) | Displaying page | |
| CN113114843B (en) | Data processing method and device, terminal and storage medium | |
| CN110209445B (en) | Information reminding method, device, terminal and storage medium | |
| CN110321042B (en) | Interface information display method and device and electronic equipment | |
| US11600300B2 (en) | Method and device for generating dynamic image | |
| CN112153218B (en) | Page display method and device, wearable device and storage medium | |
| CN111552532A (en) | Popup window control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |