CN112135081B - Mode control method and device, frame insertion chip and electronic equipment - Google Patents
Mode control method and device, frame insertion chip and electronic equipment Download PDFInfo
- Publication number
- CN112135081B CN112135081B CN202010953771.8A CN202010953771A CN112135081B CN 112135081 B CN112135081 B CN 112135081B CN 202010953771 A CN202010953771 A CN 202010953771A CN 112135081 B CN112135081 B CN 112135081B
- Authority
- CN
- China
- Prior art keywords
- image data
- frame
- chip
- state
- mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
Abstract
The embodiment of the application discloses a mode control method and device, a frame insertion chip and electronic equipment. The method is applied to electronic equipment configured with a frame interpolation chip, wherein the frame interpolation chip is used for carrying out frame interpolation operation on image data, and the method comprises the following steps: acquiring a current image data display state; if the image data display state is a target state, switching the working mode of the frame insertion chip to a bypass mode; and the frame insertion chip in the bypass mode directly outputs the received image data. According to the method, when the current image data display state of the electronic equipment is in the target state, the frame insertion chip can directly output the received image data without any processing, so that the electronic equipment in the target state can reduce power consumption.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a mode control method and apparatus, a frame insertion chip, and an electronic device.
Background
The image data can be subjected to frame interpolation operation through a special frame interpolation chip in the electronic equipment. In related electronic devices, after the frame insertion chip is configured on the power-on of the power-on device, when the frame insertion chip does not perform an operation, the mode of the frame insertion chip is configured to a standby state.
Disclosure of Invention
In view of the above problems, the present application provides a mode control method, apparatus, frame interpolation chip and electronic device to improve the above problems.
In a first aspect, the present application provides a mode control method applied to an electronic device configured with a frame interpolation chip, where the frame interpolation chip is configured to perform a frame interpolation operation on image data, and the method includes: acquiring a current image data display state; if the image data display state is a target state, switching the working mode of the frame insertion chip to a bypass mode; and the frame inserting chip in the bypass mode directly outputs the received image data.
In a second aspect, the present application provides a frame interpolation chip, including a data flow direction control module, a data processing module, and an output module; the control module is used for acquiring the current image data display state; if the image data display state is a target state, sending a first control instruction to the data flow direction control module, wherein the first control instruction is used for triggering the frame insertion chip working mode to be switched into a bypass mode; the data flow direction control module is used for responding to the first control instruction, enabling the data flow direction control module to be connected with the output module, and enabling the data flow direction control module to be disconnected with the data processing module; and the output module is used for outputting the received image data.
In a third aspect, the present application provides a mode control apparatus, for operating in an electronic device configured with a frame insertion chip, where the frame insertion chip is configured to perform a frame insertion operation on image data, and the apparatus includes: a state acquisition unit for acquiring a current image data display state; the working mode control unit is used for switching the working mode of the frame insertion chip into a bypass mode if the image data display state is a target state; and the frame inserting chip in the bypass mode directly outputs the received image data.
In a fourth aspect, the present application provides an electronic device, comprising a frame insertion chip, a processor, and a memory; one or more programs are stored in the memory and configured to be executed by the framing chip and/or the processor to implement the methods described above.
In a fifth aspect, the present application provides a computer readable storage medium having program code stored therein, wherein the method described above is performed when the program code is executed by a framing chip and/or a processor.
According to the mode control method, the mode control device, the frame insertion chip and the electronic equipment, the current image data display state is obtained, and if the image data display state is the target state, the working mode of the frame insertion chip is switched to the bypass mode, so that when the current image data display state of the electronic equipment is in the target state, the frame insertion chip can directly output the received image data without any processing, and the power consumption of the electronic equipment in the target state can be reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart illustrating a mode control method according to an embodiment of the present application;
FIG. 2 is a diagram showing a configuration of an application program of a specified type in an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating an example of adding an insertion frame to image data in the embodiment of the present application;
FIG. 4 is a diagram illustrating an embodiment of the present application in which image data of an inserted frame is added;
FIG. 5 is a schematic diagram of a target pixel in an embodiment of the present application;
FIG. 6 is a schematic diagram of another target pixel in an embodiment of the present application;
FIG. 7 is a flow chart illustrating a mode control method according to yet another embodiment of the present application;
fig. 8 is a block diagram showing a mode control apparatus according to another embodiment of the present application;
fig. 9 shows a block diagram of a frame interpolation chip according to an embodiment of the present application;
fig. 10 is a block diagram showing a configuration of an electronic device of the present application for executing a mode control method according to an embodiment of the present application;
fig. 11 is a storage unit according to an embodiment of the present application, configured to store or carry program codes for implementing a mode control method according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
With the advent of the mobile internet age, the popularity of electronic devices has become a large trend in the mobile phone market. The emergence of electronic devices has changed the lifestyle of many people and the demand for traditional communication tools, and with the increase of user demands, people no longer satisfy the use of the appearance and basic functions of electronic devices, but have pursued electronic devices that can bring more, stronger, and more personalized functional services to people. Such as video playback and games. The display process of the image data is involved in both the video playing scene and the game scene. The image data displayed in the video playing scene is a video picture, and the image data displayed in the game scene may include a game picture.
However, after studying the display process of the related image data, the inventors found that in order to improve the display effect of the image data in the display process, the fluency in the display process of the image data can be improved by performing frame interpolation on the image data. However, after further research on the frame interpolation, the inventor finds that when the relevant frame interpolation chip is in a state where the frame interpolation operation is not needed, the operating mode of the frame interpolation chip is configured to be in a standby state, and although the frame interpolation chip in the standby state may not perform the frame interpolation operation on the image data when receiving the image data, the frame interpolation chip still performs the operation of data decapsulation or format conversion, but does not perform the frame interpolation processing on the data decapsulated or converted data, but merely performs buffering, thereby wasting power consumption.
Therefore, the inventor proposes a mode control method, a mode control device, a frame insertion chip and an electronic device, which can improve the above problems, in which, when the frame insertion chip is used for performing frame insertion operation on image data, the current image data display state is acquired, and if the image data display state is the target state, the operating mode of the frame insertion chip is switched to the bypass mode, so that when the current image data display state of the electronic device is in the target state, the frame insertion chip directly outputs the received image data without any processing, so that the electronic device in the target state can reduce power consumption.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Referring to fig. 1, a mode control method provided in an embodiment of the present application is applied to an electronic device configured with a frame interpolation chip, where the frame interpolation chip is used to perform a frame interpolation operation on image data, and the method includes:
s110: the current image data display state is acquired.
As one way, in the present embodiment, the image data display state may be determined by detecting the application program currently running.
In this way, it may be detected whether the application currently running in the foreground is an application of a specified type, and if it is determined that the application currently running in the foreground is an application of a specified type, the current image data display state is determined to be a state in which image data is displayed, whereas if it is detected that the application currently running in the foreground is not an application of the specified type, the image data display state is determined to be a state in which image data is not displayed. For example, a correspondence table between the application program list and the type may be pre-established, and the type of the foreground-run application program may be obtained by querying the correspondence table after the foreground-run application program is obtained.
Optionally, the specified types of applications include video-type applications and game-type applications. For example, if it is detected that the application currently running in the foreground is a game-type application, it is determined that the application currently running in the foreground is a designated-type application, and it is correspondingly determined that the current image data display state is a state in which image data is being displayed.
As a manner, if the electronic device may be an Android operating system, the name of the application program currently running in the foreground may be obtained by executing a getringing tasks method of an activtymanager. In addition, the electronic device may further acquire a list of programs used by the user through the usagetstatsmanager, and identify a most recently used application program recorded in the list as a current foreground application. Moreover, the Android can monitor the change of the focus of the window through the barrier-free function of the Android, and the package name corresponding to the focus window is taken as the application program which runs in the foreground at the present time.
It should be noted that the type specifically included for the application program of the specified type may be changed according to the actual situation. It can be understood that, in the case that the more types included in the application program of the specified type, the greater the probability of triggering the frame interpolation chip to switch to the frame interpolation mode for performing the frame interpolation operation. However, in some cases, the improvement of the display effect caused by the frame interpolation operation performed on the image data being displayed is not so significant.
Then, as a way of doing so, the number of types specifically included by the application of the specified type may be determined according to the remaining resources of the electronic device. It should be noted that, if the electronic device performs frame insertion on the image data during the display process of the image data, processing resources of the CPU or the GPU are consumed, and if the frame insertion function is still turned on to execute the mode control method provided in this embodiment under the condition that the current remaining processing resources of the electronic device are relatively tight, the load of the electronic device may be increased, and the electronic device may be stuck. Similarly, the electronic device also needs to consume power of the electronic device during the process of frame insertion of the image data, and if the remaining amount of power is low, the power consumption of the electronic device may be too fast if the frame insertion function is still turned on. In order to avoid the foregoing problem, the electronic device may detect whether the remaining processing resource is greater than a resource threshold, and if so, may keep the type of the application program of the specified type unchanged, and correspondingly, when it is detected that the remaining processing resource is not greater than the resource threshold, may delete a part of the types of the application program of the specified type, so as to reduce the probability of triggering the frame insertion chip to perform the frame insertion operation.
For example, if the application programs of the specified type include type a, type B, and type C, when it is detected that the remaining processing resources are not greater than the resource threshold, type C is deleted, so that the application programs of the specified type only include type a and type B. As one way, in the case where a specified type of application includes a plurality of types, the plurality of types may be prioritized. Further, type deletion from applications of a specified type may be performed from low priority to high priority based on the processing resources currently remaining. For example, as shown in FIG. 2, the remaining processing resources are gradually decreased as the direction indicated by the arrow. Wherein the priority of type a is higher than the priority of type B, and the priority of type B is higher than the priority of type C. And then the type C with the lowest priority is deleted from the application program of the specified type firstly as the residual processing resources are gradually reduced, and if the residual processing resources are gradually reduced and then further reduced, the type B is deleted from the application program of the specified type firstly.
Alternatively, in the case where the specified types of applications include a video-type application and a game-type application, the priority of the video-type application is higher than that of the game-type application.
Alternatively, the type and number of specific applications of a given type may be determined at the user's option. In this manner, a type management interface may be configured in the electronic device, in which a user may specifically configure which types of applications are to be designated as application types.
S120: and if the image data display state is the target state, switching the working mode of the frame insertion chip to a bypass mode. And the frame insertion chip in the bypass mode directly outputs the received image data.
It should be noted that the frame interpolation operation performed on the image data being displayed is performed by a frame interpolation chip, and the image data display state represents that the frame interpolation operation on the image data is not required when the image data display state is the target state, so that when the frame interpolation chip is switched to be in a bypass mode (bypass mode), the frame interpolation chip does not process the image data and directly outputs the image data to the display screen for display when the transmitted image data is received in time, and further, the power consumption can be reduced.
The frame interpolation operation according to the present embodiment will be described below.
In this embodiment, during the frame insertion operation, the corresponding frame insertion control parameter may be determined according to the current actual frame insertion requirement. In this embodiment, the frame rate control parameter is a parameter for controlling a frame rate of the image data in the display process, and after the frame rate control parameter is determined, the frame rate of the image data in the display process can be controlled by the frame rate control parameter so as to meet the requirement of the determined frame rate control parameter. Optionally, in this embodiment, the frame rate may be changed by inserting a new frame (an insertion frame) into the image data, and the frame rate control parameter may be used to determine the number of the insertion frames.
Alternatively, the frame rate control parameter may include a target frame rate, as shown in fig. 3, where the image data 40 is image data before frame insertion, and in a case that the target frame rate is higher than an original frame rate of the image data 40, it is necessary to insert more frame images into the image data 40 in order to enable the frame rate of the image data 40 to reach the target frame rate, for example, if it is determined that the inserted frame includes the inserted image 51, the inserted image 52, the inserted image 53, the inserted image 54, and the inserted image 55 shown in fig. 8 according to the target frame rate corresponding to the frame rate control section, and an inserted image position corresponding to each inserted image is a position pointed by a corresponding arrow, after performing the frame insertion operation, the image data 41 shown in fig. 4 may be obtained, where the image data 41 is image data into which the inserted frame has been inserted, and the frame rate of the corresponding image data 41 is the target frame rate.
Optionally, if the frame rate control parameter includes a target frame rate of 50fps, in the process of performing control based on the frame rate control parameter, if the original frame rate of the image data is lower than 50fps, a new frame is generated based on 50fps to be used as an insertion frame to be inserted into the original image data, so that the frame rate of the image data in the display process reaches 50fps. Optionally, if the frame rate control parameter includes a target frame rate of 60fps, in the process of controlling based on the frame rate control parameter, if the original frame rate of the image data is lower than 60fps, a new frame is generated based on 60fps as an insertion frame to be inserted into the original image data, so that the frame rate of the image data in the display process reaches 60fps.
In the present embodiment, whether the image data display state is the target state may be determined in various ways.
In one mode, if the image data display state is a state in which image data is not displayed, it is determined that the current image data display state is a target state.
Alternatively, if the image data display state is a state in which image data is being displayed and the motion parameter of the reference object in the image data satisfies a specified motion state, the current image data display state is determined as the object state.
Optionally, the image data is a video picture, the reference target is a target pixel, and the motion parameter is a motion vector, where the method further includes: and if the motion vector of the target pixel in the video picture is smaller than the vector threshold value, determining that the motion vector meets the specified motion state.
The motion vector will be explained first.
The motion vector characterizes the displacement between the content block and the best matching block, or the displacement of any pixel. Where the pixel 10 in the image of the previous frame in fig. 5 is located at (a, b) and the location in the image of the next frame is (c, d), then the motion vector corresponding to the pixel 10 in the image of the next frame is (dx, dy), where dx represents the displacement of the pixel 10 in the X-axis direction and dy represents the displacement of the pixel 10 in the Y-axis direction, so that dx = a-c and dy = d-b in the case shown in fig. 5.
As shown in fig. 6, the best matching block refers to the content block 31 of the next frame image 30 that matches the content block 21 of the previous frame image 20 to the highest degree. It should be noted that a plurality of pixels may be included in a content block, and in this embodiment, the displacement of the pixel at the center point of the content block may be used as the displacement of the content block. Wherein the center point may be a geometric center. In the content shown in fig. 6, the motion vectors between the content block and the best matching block are (a-c, d-b). Wherein a content block can be understood as characterizing a region in an image that has a solid meaning. For example, if a person is in the image, the head of the person is a region with a solid meaning, the solid meaning is that the image data of the region represents the head of the person, and the head region can be used as a content block. For another example, the hand of the person is also an area with a solid meaning, and the hand area can be used as a content block.
As another mode, if the image data display state is a state in which image data is being displayed and the display in the image data is in a pause state, it is determined that the current image data display state is the target state.
It should be noted that, as shown in the foregoing, if the current image data display state is a state in which image data is being displayed, which may be in a video playing scene, and the display of the image data may be suspended in the video playing scene, in this case, there is no actual frame insertion requirement, and in this case, the operating mode of the frame insertion chip is switched to the bypass mode, which is also beneficial to reducing power consumption.
In still another mode, if the image data display state is a state in which image data is being displayed and the currently displayed interface is not a data display interface, it is determined that the current image data display state is the target state. It should be noted that, as described above, the image data display state is determined by detecting the application program running in the foreground, and the video-type application program itself may also include various interfaces, that is, in addition to an interface for displaying actual image data, a content selection interface or a configuration interface may also be included, and when the content selection interface or the configuration interface is displayed, if the frame insertion chip is in the frame insertion mode, power consumption may still be wasted. And then, if the image data display state is the state of displaying the image data and the currently displayed interface is not the data display interface, the frame insertion chip is switched to the bypass mode, so that the power consumption is further saved.
According to the mode control method, the current image data display state is acquired, and if the image data display state is the target state, the working mode of the frame insertion chip is switched to the bypass mode, so that when the current image data display state of the electronic equipment is in the target state, the frame insertion chip can directly output the received image data without any processing, and the power consumption of the electronic equipment in the target state can be reduced.
Referring to fig. 7, a mode control method provided in an embodiment of the present application is applied to an electronic device configured with a frame interpolation chip, where the frame interpolation chip is used to perform frame interpolation on image data, and the method includes:
s210: and acquiring the current image data display state.
S220: the current image data display state is detected.
S230: and if the image data display state is the target state, switching the working mode of the frame insertion chip to a bypass mode.
S240: and if the image data display state is a non-target state, switching the working mode of the frame insertion chip into a frame insertion mode. The frame insertion chip in the frame insertion mode outputs the received image data after performing frame insertion, and the frame insertion chip in the bypass mode directly outputs the received image data.
As described in the foregoing embodiments, the current image data display state may be determined by detecting an application currently running in the foreground. Correspondingly, if it is detected that the foreground does not run the application program, or it is detected that the type of the application program running on the foreground is not the application program of the specified type, or it is detected that the image data display state is currently performed, and the motion parameter of the reference target in the image data does not meet the specified motion state, the current image data display state is determined to be a non-target state. For example, if the specified types of applications include a video type and a game type, it is detected that the application currently running in the foreground is a document editing type application, and then it is determined that the current image data display state is a state in which image data is not displayed, and the state in which image data is not displayed may be a non-target state.
It should be noted that whether the frame insertion chip switches the operating mode may be determined based on whether the electronic device starts the mode switching function. Optionally, the step of S210: before the current image data display state is acquired, whether the mode switching function is started is detected, and if the mode switching function is started, the step S210 is executed: and acquiring the current image data display state, and ending the process if the current image data display state is not started.
Whether the mode switching function is activated may be determined according to the remaining resources of the electronic device, as one way. The resource may be a processing resource or an electrical quantity. It should be noted that, if the electronic device performs frame insertion on the image data during the display process of the image data, processing resources of the CPU or the GPU are consumed, and if the image data is still frame-inserted in all states under the condition that the current remaining processing resources of the electronic device are relatively tight, the load of the electronic device may be increased, and the electronic device may be stuck. Similarly, the electronic device also needs to consume the power of the electronic device during the frame interpolation of the image data, and if the remaining power is low, the mode switching function is still turned on, which may cause the power consumption of the electronic device to be too fast. In order to avoid the foregoing problem, the electronic device may detect whether the remaining processing resource is greater than a resource threshold, and if so, may configure the mode switching function to be in an on state, and correspondingly, when it is detected that the remaining processing resource is not greater than the resource threshold, may configure the mode switching function to be in an off state.
Wherein the resource threshold may comprise a first threshold for processing resources and/or a second threshold for power. If the resource threshold only includes a first threshold related to the processing resource, the electronic device triggers the mode switching function to be turned on when detecting that the current remaining processing resource is greater than the first threshold, otherwise, the mode switching function is turned off. If the resource threshold only includes a second threshold related to the power amount, the electronic device may trigger the mode switching function to be turned on when detecting that the current remaining power amount is greater than the second threshold, otherwise, turn off the mode switching function. The resource threshold includes both a first threshold related to the processing resource and a second threshold related to the power amount, and the electronic device detects that the current remaining processing resource is greater than the first threshold, and triggers the mode switching function to be turned on if the current remaining power amount is greater than the second threshold, otherwise, turns off the mode switching function.
As another mode, a mode switching function management control may be configured on a setting interface of the electronic device, and a user may control to turn on or off the mode switching function by touching the mode switching function management control.
It should be noted that, before the frame insertion chip performs the switching of the working mode, the current working mode may be detected, if the current working mode is the same as the working mode to be determined to be switched, the switching operation of the working mode is not performed, and if the current working mode is different from the working mode to be determined to be switched, the switching operation of the working mode is performed. For example, if the current image data display state is the target state, the operating mode to be determined to be converted to is the bypass mode, and then it is determined whether the frame interpolation chip is currently in the bypass mode, if so, the operating mode switching operation is not required to be performed, and if not (for example, in the frame interpolation mode), the operating mode switching operation is performed.
According to the mode control method, under the condition that the frame insertion chip is used for carrying out frame insertion operation on image data, the current image data display state is obtained, and if the image data display state is the target state, the working mode of the frame insertion chip is switched to the bypass mode, so that when the current image data display state of the electronic equipment is in the target state, the frame insertion chip can directly output the received image data without carrying out any processing, and the power consumption of the electronic equipment in the target state can be reduced. In addition, in this embodiment, the working mode of the frame interpolation chip is switched to the frame interpolation mode when the image data display state is a non-target state, so that switching between the frame interpolation mode and the bypass mode can be controlled according to the image data display state, and the flexibility of switching the working mode of the frame interpolation chip is improved.
Referring to fig. 8, a mode control apparatus 300 according to an embodiment of the present application is configured to operate in an electronic device equipped with a frame interpolation chip, where the frame interpolation chip is configured to perform a frame interpolation operation on image data, and the apparatus 300 includes: a state acquisition unit 310 and an operation mode control unit 320.
The state acquiring unit 310 is configured to acquire a current image data display state.
The working mode control unit 320 is configured to switch the working mode of the frame interpolation chip to a bypass mode if the image data display state is the target state.
And the frame inserting chip in the bypass mode directly outputs the received image data.
As one mode, the operation mode control unit 320 is specifically configured to determine that the current image data display state is the target state if the image data display state is a state in which image data is not displayed. As another mode, the operation mode control unit 320 is specifically configured to determine that the current image data display state is the target state if the image data display state is a state in which image data is being displayed and the motion parameter of the reference target in the image data satisfies a specified motion state.
Optionally, the image data is a video image, the reference target is a target pixel, the motion parameter is a motion vector, and the working mode control unit 320 is specifically configured to determine that the motion vector satisfies a specified motion state if the motion vector of the target pixel in the video image is smaller than a vector threshold.
The working mode control unit 320 is further configured to switch the working mode of the frame interpolation chip to a frame interpolation mode if the image data display state is a non-target state;
and the frame inserting chip in the frame inserting mode inserts the received image data and then outputs the image data.
The application provides a mode control device, under the condition that the frame inserting chip is used for carrying out the frame inserting operation to image data, through obtaining the present image data display state, and if the image data display state is the target state, with the mode that the mode of frame inserting chip switches into bypass mode for when the present image data display state of electronic equipment is in the target state, make frame inserting chip can directly carry out the output under the condition that the image data that will receive do not carry out any processing, so that can make the electronic equipment that is in the target state can reduce the power consumption.
Referring to fig. 9, a frame interpolation chip 400 according to an embodiment of the present disclosure includes a data flow control module 410, a control module (not shown), a data processing module 430, and an output module 440. The data processing module 430 further includes an input unit, a frame insertion unit, a compression unit, an effect processing unit, and a display driving unit. Alternatively, the data flow direction control module 410 may receive data transmitted based on the MIPI interface, and the corresponding output module 440 may be a module named MIPI TX shown in the figure. Alternatively, the data flow direction control module 410 may be a TFT (Thin Film Transistor) control module. The frame interpolation unit in the data processing module 430 may be a frame interpolation unit based on MEMC (Motion Estimation and Motion Compensation) technology. Among them, the Compression unit may be a Compression unit based on DSC (Display Stream Compression) technology.
The control module is used for acquiring the current image data display state; if the image data display state is the target state, a first control instruction is sent to the data flow direction control module 410, where the first control instruction is used to trigger the frame insertion chip to switch to the bypass mode.
The data flow direction control module 410 is configured to respond to the first control instruction to turn on the data flow direction control module and the output module, and keep the data flow direction control module 410 and the data processing module 430 disconnected. In this case, the data transmitted by the MIPI interface is directly transmitted to the output module 440 through the line 70, and then displayed on the display screen.
The output module 440 is configured to output the received image data.
As a mode, the control module is further configured to send a second control instruction to the data flow direction control module 410 if the image data display state is in a non-target state, where the second control instruction is used to trigger the frame insertion chip to switch the working mode to the frame insertion mode. Under the frame insertion mode, the data flow direction control module 410 inputs the data transmitted through the MIPI interface to the input unit of the data processing module 430, and then sequentially passes through the frame insertion unit, the compression unit, the effect processing unit and the display driving unit for processing, and then outputs the data to the output module 440.
The data flow direction control module 410 is further configured to switch on the data flow direction control module 410 and the data processing module 430 in response to the second control instruction, and switch off the data flow direction control module 410 and the output module 440, where the data processing module 430 is configured to perform frame interpolation on the image data transmitted by the data flow direction control module 410, and transmit the image data after frame interpolation to the output module 440.
According to the frame insertion chip, under the condition that the frame insertion chip is used for carrying out frame insertion operation on image data, the current image data display state is obtained, and if the image data display state is the target state, the working mode of the frame insertion chip is switched to the bypass mode, so that when the current image data display state of the electronic equipment is in the target state, the frame insertion chip can directly output the received image data without carrying out any processing, and the power consumption of the electronic equipment in the target state can be reduced.
It should be noted that the device embodiment and the method embodiment in the present application correspond to each other, and specific principles in the device embodiment may refer to the contents in the method embodiment, which is not described herein again.
An electronic device provided by the present application will be described with reference to fig. 10.
Referring to fig. 10, based on the mode control method and apparatus, another electronic device 200 capable of executing the mode control method is further provided in the embodiment of the present application. The electronic device 200 includes one or more (only one shown) processors 102, memory 104, network module 106, and framing chip 108 coupled to each other. The memory 104 stores therein a program that can execute the content in the foregoing embodiments, and the framing chip 108 can execute the program stored in the memory 104. When the frame interpolation chip 108 executes the program stored in the memory 104, it can be understood that the mode control method provided by the embodiment can be executed by the frame interpolation chip 108, which is further beneficial to reducing the load of the processor 102. Optionally, the framing chip 108 may receive the image data through MIPI (Mobile Industry Processor Interface) reception.
Furthermore, the frame interpolation chip and the processor can jointly execute the mode control method in the embodiment of the application. Alternatively, S110 in the foregoing embodiment may be executed by the processor, and S120 may be executed by the framing chip.
The Memory 104 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 104 may be used to store instructions, programs, code sets, or instruction sets. The memory 104 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal 100 in use, such as a phonebook, audio-video data, chat log data, and the like.
The network module 106 is configured to receive and transmit electromagnetic waves, and implement interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, for example, an audio playing device. The network module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The network module 106 may communicate with various networks, such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. For example, the network module 106 may interact with a base station.
Referring to fig. 11, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 1100 has stored therein program code that can be called by a processor to perform the method described in the above-described method embodiments.
The computer-readable storage medium 1100 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 1100 includes a non-volatile computer-readable medium. The computer readable storage medium 1100 has storage space for program code 1110 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 1110 may be compressed, for example, in a suitable form.
To sum up, according to the mode control method, the mode control device, the frame insertion chip and the electronic device provided by the application, by obtaining the current image data display state and switching the working mode of the frame insertion chip to the bypass mode if the image data display state is the target state, when the current image data display state of the electronic device is in the target state, the frame insertion chip directly outputs the received image data without any processing, so that the power consumption of the electronic device in the target state can be reduced.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (6)
1. A mode control method is applied to an electronic device provided with a frame interpolation chip, wherein the frame interpolation chip is used for performing frame interpolation on image data, and the method comprises the following steps:
acquiring a current image data display state;
if the image data display state is a state in which image data is being displayed and a motion vector of a reference target in the image data meets a specified motion state, determining that the current image data display state is a target state, wherein the image data is a video picture and the reference target is a target pixel;
if the image data display state is a target state, switching the working mode of the frame insertion chip to a bypass mode;
the frame insertion chip in the bypass mode directly outputs received image data;
if the image data display state is a non-target state, switching the working mode of the frame insertion chip into a frame insertion mode;
and the frame inserting chip in the frame inserting mode inserts the received image data into a frame and then outputs the image data.
2. A frame insertion chip is characterized by comprising a data flow direction control module, a data processing module and an output module;
the control module is used for acquiring the current image data display state; if the image data display state is a state in which image data is being displayed and a motion vector of a reference target in the image data meets a specified motion state, determining that the current image data display state is a target state, wherein the image data is a video picture and the reference target is a target pixel, if the image data display state is the target state, sending a first control instruction to a data flow direction control module, wherein the first control instruction is used for triggering the frame insertion chip to switch to a bypass mode, and if the image data display state is a non-target state, switching the frame insertion chip to a frame insertion mode; the frame insertion chip in the frame insertion mode inserts the received image data and then outputs the image data;
the data flow direction control module is used for responding to the first control instruction, enabling the data flow direction control module to be connected with the output module, and enabling the data flow direction control module to be disconnected with the data processing module;
and the output module is used for outputting the received image data.
3. The frame interpolation chip of claim 2, wherein the control module is further configured to send a second control instruction to the data flow control module if the image data display state is in a non-target state, where the second control instruction is used to trigger the frame interpolation chip to switch to the frame interpolation mode;
the data flow direction control module is further configured to switch on the data flow direction control module and the data processing module in response to the second control instruction, and disconnect the data flow direction control module from the output module, where the data processing module is configured to perform frame interpolation on the image data transmitted by the data flow direction control module, and transmit the image data subjected to frame interpolation to the output module.
4. A mode control apparatus, operable in an electronic device equipped with a frame interpolation chip for performing a frame interpolation operation on image data, the apparatus comprising:
the state acquisition unit is used for acquiring the current image data display state;
a working mode control unit, configured to determine that the current image data display state is a target state if the image data display state is a state in which image data is being displayed and a motion vector of a reference target in the image data satisfies a specified motion state, where the image data is a video frame and the reference target is a target pixel; if the image data display state is a target state, switching the working mode of the frame insertion chip to a bypass mode; if the image data display state is a non-target state, switching the working mode of the frame insertion chip to a frame insertion mode; the frame insertion chip in the frame insertion mode outputs the received image data after performing frame insertion on the received image data, and the frame insertion chip in the bypass mode directly outputs the received image data.
5. An electronic device, comprising a frame insertion chip, a processor and a memory;
one or more programs are stored in the memory and configured to be executed by the framing chip and/or the processor to implement the method of claim 1.
6. A computer-readable storage medium, in which a program code is stored, wherein the method of claim 1 is performed when the program code is run by a framing chip and/or a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010953771.8A CN112135081B (en) | 2020-09-11 | 2020-09-11 | Mode control method and device, frame insertion chip and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010953771.8A CN112135081B (en) | 2020-09-11 | 2020-09-11 | Mode control method and device, frame insertion chip and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112135081A CN112135081A (en) | 2020-12-25 |
| CN112135081B true CN112135081B (en) | 2022-10-28 |
Family
ID=73846363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010953771.8A Active CN112135081B (en) | 2020-09-11 | 2020-09-11 | Mode control method and device, frame insertion chip and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112135081B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115442586A (en) * | 2021-06-01 | 2022-12-06 | Oppo广东移动通信有限公司 | Image processing chip and exception handling method applied to image processing chip |
| CN113709301B (en) * | 2021-08-25 | 2023-05-30 | Oppo广东移动通信有限公司 | Image processing method and device, memory and electronic equipment |
| CN113835657A (en) * | 2021-09-08 | 2021-12-24 | 维沃移动通信有限公司 | Display method and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010263468A (en) * | 2009-05-08 | 2010-11-18 | Victor Co Of Japan Ltd | Frame rate converting apparatus and method |
| CN107027029A (en) * | 2017-03-01 | 2017-08-08 | 四川大学 | High-performance video coding improved method based on frame rate conversion |
| CN111479154A (en) * | 2020-04-03 | 2020-07-31 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4181593B2 (en) * | 2006-09-20 | 2008-11-19 | シャープ株式会社 | Image display apparatus and method |
| JP4309453B2 (en) * | 2007-12-26 | 2009-08-05 | 株式会社東芝 | Interpolated frame generating apparatus, interpolated frame generating method, and broadcast receiving apparatus |
| CN105828183B (en) * | 2015-01-04 | 2017-12-05 | 华为技术有限公司 | Video frame processing method and frame of video process chip |
| CN108431724A (en) * | 2016-11-07 | 2018-08-21 | 华为技术有限公司 | A kind of display methods and electric terminal |
| CN110149555B (en) * | 2018-08-14 | 2022-07-22 | 腾讯科技（深圳）有限公司 | Video processing method and video receiving device |
| CN110874128B (en) * | 2018-08-31 | 2021-03-30 | 上海瑾盛通信科技有限公司 | Visualized data processing method and electronic equipment |
| CN111064863B (en) * | 2019-12-25 | 2022-04-15 | Oppo广东移动通信有限公司 | Image data processing method and related device |
-
2020
- 2020-09-11 CN CN202010953771.8A patent/CN112135081B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010263468A (en) * | 2009-05-08 | 2010-11-18 | Victor Co Of Japan Ltd | Frame rate converting apparatus and method |
| CN107027029A (en) * | 2017-03-01 | 2017-08-08 | 四川大学 | High-performance video coding improved method based on frame rate conversion |
| CN111479154A (en) * | 2020-04-03 | 2020-07-31 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 基于视频对象的自适应去帧/插帧视频处理;肖永豪等;《华南理工大学学报(自然科学版)》;20030828(第08期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112135081A (en) | 2020-12-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112135081B (en) | Mode control method and device, frame insertion chip and electronic equipment | |
| US11711623B2 (en) | Video stream processing method, device, terminal device, and computer-readable storage medium | |
| CN110913442B (en) | Network switching method and device, electronic equipment and storage medium | |
| CN109151194B (en) | Data transmission method, device, electronic equipment and storage medium | |
| CN106792120B (en) | Video picture display method and device and terminal | |
| CN105391965A (en) | Multi-camera-based video recording method and apparatus | |
| US11145238B2 (en) | Method for controlling image graphing of terminal, nontransitory computer-readable storage medium, and terminal | |
| CN109274407B (en) | Data transmission method, device, electronic equipment and storage medium | |
| CN109107158B (en) | Sound effect processing method and device, electronic equipment and computer readable storage medium | |
| CN110389696B (en) | Method and device for controlling screen color gamut, electronic equipment and storage medium | |
| CN112203034B (en) | Frame rate control method and device and electronic equipment | |
| CN112057842B (en) | Frame rate control method and device and electronic equipment | |
| EP3883255B1 (en) | Video decoding control method and apparatus, electronic device, and storage medium | |
| CN109361950B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN110703944B (en) | Touch data processing method and device, terminal and storage medium | |
| CN109600654B (en) | Bullet screen processing method and device and electronic equipment | |
| CN111273769B (en) | Equipment control method and device, electronic equipment and storage medium | |
| CN113014987A (en) | Screen recording method and device, electronic equipment and storage medium | |
| CN110569008A (en) | screen data processing method and device and electronic equipment | |
| CN113559498A (en) | Three-dimensional model display method and device, storage medium and electronic equipment | |
| CN114816692A (en) | Screen projection display method and device, mobile terminal and storage medium | |
| CN111263216B (en) | Video transmission method, device, storage medium and terminal | |
| CN114827708A (en) | Video playing method and device and electronic equipment | |
| US20070081412A1 (en) | Apparatus and method for controlling dual port memory in a mobile communication terminal with multi processors | |
| CN114690996A (en) | Content display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |