CN113766316A - Display device and video information processing method - Google Patents
Display device and video information processing method Download PDFInfo
- Publication number
- CN113766316A CN113766316A CN202010493104.6A CN202010493104A CN113766316A CN 113766316 A CN113766316 A CN 113766316A CN 202010493104 A CN202010493104 A CN 202010493104A CN 113766316 A CN113766316 A CN 113766316A
- Authority
- CN
- China
- Prior art keywords
- frame
- original video
- decoding
- display screen
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 24
- 238000003672 processing method Methods 0.000 title claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 118
- 238000000034 method Methods 0.000 claims abstract description 42
- 230000008569 process Effects 0.000 claims abstract description 25
- 238000012544 monitoring process Methods 0.000 claims description 34
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000013461 design Methods 0.000 abstract description 5
- 238000013507 mapping Methods 0.000 description 11
- 239000004973 liquid crystal related substance Substances 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The application provides a display device and a video information processing method, wherein the display device comprises a processor and a display screen, wherein the processor is used for executing: acquiring the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame; adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications; and sending the target video information to a display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame. The method is used for saving the cost of the processor and further reducing the design cost of the display device, so that the display screen can smoothly display video images according to target video information, and the problems of display screen blockage, screen splash and the like are avoided.
Description
Technical Field
The present application relates to the field of televisions, and in particular, to a display device and a video information processing method.
Background
The television generally includes a System on Chip (SoC) Chip and a liquid crystal display, where the SoC Chip may process a video code stream to obtain video information and send the video information to the liquid crystal display, so that the liquid crystal display may display a video image according to the video information.
Currently, when the liquid crystal display screen is a display screen with a resolution of 4K and a refresh rate of 60 hertz (Hz), the method for displaying the video image by the liquid crystal display screen comprises the following steps: the SoC chip receives a video code stream; the SoC chip decodes the video code stream to obtain video information, and sends the video information to the liquid crystal display screen so that the liquid crystal display screen displays video images according to the video information.
In the prior art, a liquid crystal display screen is generally a display screen with a resolution greater than 4K and a refresh rate greater than 60Hz, and if the liquid crystal display screen with the resolution greater than 4K and the refresh rate greater than 60Hz can display a video image smoothly, a SoC chip with high processing capability is required to decode a video code stream corresponding to the resolution greater than 4K and the refresh rate greater than 60 Hz. The SoC chip with high processing capability usually has a high price, which results in a high cost of the SoC chip, and the SoC chip with high processing capability is liable to generate a large amount of heat during operation, which results in a low reliability of the SoC chip with high processing capability.
Disclosure of Invention
The application provides a display device and a video information processing method. The method is used for saving the cost of the processor and further reducing the design cost of the display device, so that the display screen can smoothly display video images according to target video information, and the problems of display screen blockage, screen splash and the like are avoided.
In a first aspect, the present application provides a display device comprising: a processor and a display screen, wherein,
acquiring the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame;
adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications;
and sending the target video information to a display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame.
In a second aspect, the present application provides a video information processing method, applied to a display device, where the display device includes a processor and a display screen, and the method includes:
the processor acquires the decoding occupancy rate in the process of decoding and processing the original video code stream, and performs frame skipping decoding processing on the original video code stream to generate an original video frame;
the processor adds a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications;
and the processor sends the target video information to the display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame so as to display the original video frame.
The application provides a display device and a video information processing method, wherein the display device comprises: a processor and a display screen, wherein the processor is configured to perform: acquiring the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame; adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications; and sending the target video information to a display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame. The method is used for saving the cost of the processor and further reducing the design cost of the display device, so that the display screen can smoothly display video images according to target video information, and the problems of display screen blockage, screen splash and the like are avoided.
Drawings
In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a first schematic flowchart of a video information processing method provided in the present application;
fig. 2 is a schematic flowchart illustrating a second video information processing method according to the present application;
fig. 3 is a schematic structural diagram of a display device provided in the present application;
fig. 4 is a schematic structural diagram of a video information processing apparatus provided in the present application.
Detailed Description
To make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be clearly and completely described below with reference to the drawings in the present application, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 1 is a first schematic flow chart of a video information processing method provided in the present application. As shown in fig. 1, the video information processing method includes:
s101: and acquiring the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame.
In some embodiments, the execution subject of the embodiments of the present application may be a processor in the display device, and may also be a video information processing apparatus provided in the processor, and the video information processing apparatus may be implemented by a combination of software and/or hardware.
In some embodiments, the processor obtains the original video code stream from a storage medium provided in the display device or a network device connected to the display device, and performs frame skipping decoding processing on the original video code stream in units of frames to generate an original video frame.
In some embodiments, the frame skipping decoding process represents a processing mode of decoding the original video code stream every N data frames. For example, data frames included in the original video code are data frame 1, data frame 2, data frame 3, data frame 4, and data frame 5 in this order, and if N is 1, the original video frame 1 is obtained by decoding data frame 1 in the original video code, the original video frame 3 is obtained by decoding data frame 3, and the original video frame 5 is obtained by decoding data frame 5. After the above processing, the video frames included in the obtained original video frame are the original video frame 1, the original video frame 3, and the original video frame 5 in sequence.
In some embodiments, N (frame skipping value) is determined according to the decoding occupancy rate, and then frame skipping decoding processing is performed on the original video code stream according to N to generate an original video frame.
In some embodiments, within the same processing time length, when the number of generated original video frames is different, the decoding occupancy rate in the process of decoding and processing the original video code stream is different. Wherein, the decoding occupancy rate is the utilization rate of the processor in the decoding process.
In some embodiments, the frame skipping value is determined according to the decoding occupancy and a preset mapping relationship, wherein the preset mapping relationship comprises at least one decoding occupancy and a frame skipping value corresponding to each decoding occupancy. In some embodiments, after the decoding occupancy is obtained, the frame skipping value corresponding to the decoding occupancy is searched in the preset mapping relationship, and the frame skipping value corresponding to the decoding occupancy is determined as N.
In some embodiments, the frame skip value is determined based on the decoding occupancy, the codestream processing policy, and the occupancy threshold. The code stream processing strategy can be a sequential frame processing strategy and a frame skipping processing strategy, and the occupancy rate threshold can be 80%, 85% and the like. In practical application, the specific value of the occupancy rate threshold can be designed according to actual needs. In some embodiments, at the beginning, the code stream processing policy is usually a sequential frame processing policy, that is, data frames included in the original video code are data frame 1, data frame 2, data frame 3, data frame 4, and data frame 5 in sequence, where decoding data frame 1 to obtain original video frame 1, decoding data frame 2 to obtain original video frame 2, decoding data frame 3 to obtain original video frame 3, decoding data frame 4 to obtain original video frame 4, and decoding data frame 5 to obtain original video frame 5. When the data processing capability of the display device is insufficient, the code stream processing strategy may be a frame skipping processing strategy, that is, the data frames included in the original video code are the data frame 1, the data frame 2, the data frame 3, the data frame 4 and the data frame 5 in sequence, if N is 1, the data frame 1 in the original video code is decoded to obtain the original video frame 1, the data frame 3 is decoded to obtain the original video frame 3, and the data frame 5 is decoded to obtain the original video frame 5; data frame 2 and data frame 4 are not subjected to decoding processing. How the data frames not subjected to decoding processing are allocated requires a reference frame skipping value, which may be different depending on the decoding occupancy. In some embodiments, the method for determining the frame skipping value according to the decoding occupancy, the code stream processing policy and the occupancy threshold may refer to S201 to S205 in fig. 2.
In some embodiments, the frame skipping value enables a frame rate of a video frame in a video code stream received by the display device to meet a refresh rate of the display screen, and the number of decoded original video frames corresponding to different frame skipping values is different, and the refresh rates of the corresponding display screens are also different.
S102: and adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications.
In some embodiments, the number of the preset compensation frames may be determined according to the number of video frame intervals between adjacent original video frames, wherein the amount of data included in the preset compensation frames and the original video frames is the same.
For example, the adjacent original video frames are respectively: the number of video frame intervals between the original video frame 1 and the original video frame 3 is 1 at the original video frame 1 and the original video frame 3, and thus, the number of the preset compensation frames can be determined to be 1. Further, a preset compensation frame may be added between the original video frame 1 and the original video frame 3, thereby forming the target video information.
In some embodiments, the original video frame and the preset compensation frame have different identifiers, for example, the original video frame has a first display identifier, the preset compensation frame has a second display identifier, wherein the first display identifier and the second display identifier are different, and the first display identifier and the second display identifier have different roles. In some embodiments, the first display identifier may trigger the display screen to display the original video frame, and the second display identifier may not trigger the display screen to display the original video frame.
In some embodiments, the original video frame includes a display identifier, and the preset compensation frame does not include the display identifier, wherein the display identifier may trigger the display screen to display the original video frame.
In some embodiments, if the skip frame value is 2 and the preset display line number is 2200, i.e. the line number of each original video frame is 2200, meaning that two data frames are missing in the video bitstream, 2200 by 2 data need to be compensated to ensure saturation of the data path between the processor and the display screen, and thus 2 frames of blank data (i.e. 2 preset compensation frames) need to be compensated between two adjacent original video frames. Saturation of the data path between the processor and the display screen is required in some embodiments by the display device.
In some embodiments, if the data path between the processor and the display screen does not require saturation, the original video frame may be directly sent to the display screens, so that the display screens perform refresh display according to the original video frame.
In some embodiments, the refresh rate of the display screen is not a continuous value, but several preset values.
S103: and sending the target video information to a display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame.
In some embodiments, for example, the display screen determines that a video frame includes the first display identifier, and may determine that the video frame is an original video frame; for example, the display screen determines that a video frame includes the second display identifier, and may determine that the video frame is a preset video frame.
In some embodiments, for example, the display screen determines that the display identifier is present in a video frame, which may be the original video frame.
It should be noted that the display screen is a variable refresh rate VRR display screen, which usually has a preset refresh rate (for example, X hz), and when the number of the preset compensation frames added between the adjacent original video frames in the target video information is Y (its value is equal to N), if the display screen refreshes the display screen according to the original video frames to display the original video frames, the refresh rate of the display screen is X/(1+ Y) hz.
For example, when X is 120, if Y is 1, the display screen refreshes the display screen according to the original video frame so that the refresh rate of the display screen when displaying the original video frame is 120/(1+1) is 60.
In some embodiments, in the process of sending the target video information to the display, the transmission frame rate of the target video information is within the range of the preset receiving frame rate of the display screen. For example, when X is 120, the preset receiving frame rate of the display screen ranges from 0 to 120.
It should be noted that, in the process that the display screen refreshes the display screen according to the original video frame to display the original video frame, after the refresh according to the current original video frame is finished, the display of the current original video frame is maintained until the next original video frame is received and the refresh is performed according to the next original video frame. I.e. the display screen does not display the compensated video frame between the current original video frame and the next original video frame.
Some embodiments of the present application provide a video information processing method including: acquiring the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame; adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications; and sending the target video information to a display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame. In the method, frame skipping decoding processing is carried out on an original video code stream to generate an original video frame, a preset compensation frame is added between adjacent original video frames after frame skipping to generate target video information, so that a display screen can refresh the display screen according to the original video frame to display the original video frame, the refresh rate of the display screen is reduced, the display screen can display the original video frame in a flow, and the problems of screen blockage, screen splash and the like are avoided. Moreover, the original video code stream is subjected to frame skipping decoding processing to generate the original video frame, so that the problem that the cost of a processor is high due to the use of a processor with high processing capacity can be avoided, the problem that the reliability of a chip is reduced due to the fact that the processor with high processing capacity generates large heat in the working process is further avoided, the cost of the processor is saved, and the design cost of the display device is further reduced.
Different from the prior art, in the prior art, when the resolution of the display screen is greater than 4K and the refresh rate is greater than 60Hz (hertz), if the processor in the prior art is used to process the original video code stream corresponding to the resolution greater than 4K and the refresh rate greater than 60Hz to obtain video information, the display screen is stuck and displayed when displaying the video image according to the video information. In the application, the processor can determine the target video information according to the frame skipping value and the original video information, so that when the resolution of the display screen is greater than 4K and the refresh rate is greater than 60Hz, if the processor in the prior art is used for decoding the video code stream corresponding to the resolution greater than 4K and the refresh rate greater than 60Hz to obtain the target video information, the problems of display screen blockage, screen splash and the like can not occur when the display screen displays video images according to the video information.
On the basis of the above embodiments, the video information processing method provided by the present application is further described in detail below with reference to fig. 2.
Fig. 2 is a schematic flowchart of a video information processing method according to the present application. As shown in fig. 2, the video information processing method includes:
s201: and acquiring a decoding occupancy rate and a code stream processing strategy in the process of decoding and processing the original video code stream.
The code stream processing policy may be a sequential frame processing policy or a frame skipping processing policy.
In some embodiments, a frame skipping value may be determined according to the decoding occupancy, and a code stream processing policy may be determined according to the frame skipping value. For example, the frame skipping value is 0, and the code stream processing strategy is a sequential frame processing strategy; the frame skipping value is larger than 0, and the code stream processing strategy is a frame skipping processing strategy.
In some embodiments, the codestream processing policy may be determined from the identity of the display device record. For example, the identifier is a standard exceeding identifier, and the code stream processing strategy is a frame skipping processing strategy; the mark is a mark which does not exceed the standard, and the code stream processing strategy is a sequential frame processing strategy.
In some embodiments, when determining the frame skipping value according to the decoding occupancy, a preset mapping relationship needs to be referred to, where the preset mapping relationship includes the decoding occupancy and the frame skipping value, and may also include the decoding occupancy and the standard frame skipping value.
For example, when the preset mapping relationship includes the decoding occupancy and the frame skip value, the frame skip value corresponding to the decoding occupancy may be searched in the preset mapping relationship, and the frame skip value corresponding to the decoding occupancy is determined as the frame skip value.
For example, when the preset mapping relationship includes the decoding occupancy and the standard frame skip value, after the standard frame skip value corresponding to the decoding occupancy is found in the preset mapping relationship, the frame skip value to be added is determined according to the standard frame skip value and the current frame skip value, and then the frame skip value to be added is used as the frame skip value.
S202: and processing the decoding occupancy rate and the occupancy rate threshold value to obtain the calculation capacity monitoring information.
In some embodiments, it is determined whether the decoding occupancy is less than an occupancy threshold.
If the decoding occupancy rate is smaller than the occupancy rate threshold value, determining the ratio of the decoding occupancy rate to the occupancy rate threshold value and the standard exceeding identifier as calculation capacity monitoring information;
and if the decoding occupancy rate is greater than or equal to the occupancy rate threshold value, determining the ratio of the decoding occupancy rate to the occupancy rate threshold value as the calculation capacity monitoring information.
In some embodiments, when the decoding occupancy is less than the occupancy threshold, the calculation force monitoring information includes a superstandard identifier and a ratio of the decoding occupancy to the occupancy threshold; and when the decoding occupancy rate is greater than or equal to the occupancy rate threshold value, the calculation force monitoring information comprises the ratio of the decoding occupancy rate to the occupancy rate threshold value. Wherein the ratio is equal to the ratio of the occupancy threshold divided by the decoding occupancy.
Alternatively, the superscalar flag may be a flag stored in advance for indicating that the decoding occupancy is greater than or equal to the occupancy threshold. For example, the superscalar flag may be "YES", "1", etc.
In some embodiments, when the decoding occupancy is greater than or equal to the occupancy threshold, the computation force monitoring information may include a preset non-exceeding flag, where the preset non-exceeding flag is a flag stored in advance and used for indicating that the decoding occupancy is less than the occupancy threshold. For example, the default non-exceeding flag may be "NO", "2", or the like.
S203: and judging whether the code stream processing strategy is a sequential frame processing strategy.
If yes, go to step S204.
If not, go to S205.
In some embodiments, the frame skip value is determined according to a preset mapping relationship.
In some embodiments, the target frame skip value is determined directly according to the preset mapping relationship without a processing strategy.
S204: and when the calculation force monitoring information contains the standard exceeding identification, determining a first preset frame skipping value as a frame skipping value.
Optionally, the first preset frame skipping value is a frame skipping value preset to be stored in the display device. For example: the first preset frame skip value may be 1, 3, etc. In some embodiments, the first preset frame skipping value is not limited by the present application.
In some embodiments, when the force monitoring information contains the non-overproof identifier or the non-overproof identifier, the original video code is continuously decoded and processed according to the sequential frame processing strategy.
S205: when the calculation force monitoring information does not contain the standard exceeding identification and the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than or equal to the preset threshold, subtracting a second preset frame skipping value from a frame skipping value corresponding to the frame skipping processing strategy to obtain a frame skipping value; and when the computing power monitoring information contains the standard exceeding identification, adding a second preset frame skipping value to the frame skipping value corresponding to the frame skipping processing strategy to obtain a frame skipping value.
Optionally, the preset threshold is a threshold pre-stored in the display device, and the second preset frame skipping value is a frame skipping value pre-stored in the display device. For example, the preset threshold may be 2, 3, etc., and the second preset frame skipping value may be 1, 2, etc., and in some embodiments, the preset threshold and the second preset frame skipping value are not limited in this application.
For example, when the calculation force monitoring information does not include the superstandard flag, the preset threshold is 2, and the ratio of the decoding occupancy to the occupancy threshold is 3 (that is, the ratio of the decoding occupancy to the occupancy threshold is greater than the preset threshold), if the frame skipping value corresponding to the frame skipping processing policy is 2 and the second preset frame skipping value is 1, the frame skipping value obtained after subtracting the second preset frame skipping value 1 from the frame skipping value corresponding to the frame skipping processing policy is 2 is 1.
For example, when the computation force monitoring information includes the superstandard flag, if the frame skipping value corresponding to the frame skipping processing policy is 2 and the second preset frame skipping value is 1, the frame skipping value obtained after adding the second preset frame skipping value 1 to the frame skipping value 2 corresponding to the frame skipping processing policy is 3.
It should be noted that the above process of obtaining the frame skipping value may be repeatedly executed, and the frame skipping value may be adjusted in real time.
S206: and determining the number of the compensated video frames between the adjusted adjacent original video frames according to the frame skipping value.
In some embodiments, the frame skip value is the same as the number of compensated video frames.
In some embodiments, when the number of the compensated video frames is determined according to the frame skipping value, the number of the compensated video frames is determined according to a preset corresponding relationship, wherein the preset corresponding relationship comprises at least one frame skipping value and the number corresponding to each frame skipping value. In practice, the number corresponding to the frame skipping value in the preset corresponding relationship may be searched, and the number corresponding to the frame skipping value may be determined as the number of the compensated video frames.
S207: and adding the compensation video frames between the adjacent original video frames according to the number of the compensation video frames between the original video frames and the adjusted adjacent original video frames to generate the target video information.
For example, if the number of compensated video frames is 1, 1 compensated video frame is added; if the number of compensation video frames is 2, 2 compensation video frames (respectively compensation video frame 1 and compensation video frame 2) are added.
For example, the adjusted adjacent original video frames are the original video frame 1, the original video frame 2, and the original video frame 3, respectively, and if the number of the compensated video frames is 2, the video frames included in the target video information are the original video frame 1, the compensated video frame 2, the original video frame 2, the compensated video frame 1, the compensated video frame 2, and the original video frame in sequence.
S208: and sending the target video information to a display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame.
In some embodiments, after receiving the target video information, the display screen performs data refreshing according to the display identifier in the target video information, so that the video frames included in the target video information are in sequence as follows: the method comprises the steps that effective video frames corresponding to data frames 1, 2 ineffective video frames, effective video frames corresponding to data frames 2 and 2 ineffective video frames, the invalid video frames do not contain display marks or contain display marks different from the effective video frames, therefore, a display screen can refresh the television screen according to the display marks of the data frames 1 so as to display image content corresponding to the data frames 1 on the display screen, the display screen does not refresh when two subsequent invalid video frames exist, the image content corresponding to the data frames 1 is kept unchanged, the display screen refreshes according to the display marks so as to display the image content corresponding to the data frames 2 on the display screen when the data frames 2 are the two subsequent invalid video frames, the display screen does not refresh, and the image content corresponding to the data frames 2 is kept unchanged. In the above example, the first video code stream does not have a frame skip, and each frame in the image frames parsed from the first video code stream can refresh and display the display screen, where the refresh period is 1/f and the corresponding refresh rate is f, and in the second video code stream, because the first video code stream is a code stream generated after frame skip processing according to the target frame skip value, when a frame is screened in the generation process by two frames, two invalid video frames are included between adjacent valid video frames in the target video information, the display screen can refresh and display according to the valid video frames, the refresh frequency period is 3/f and the corresponding refresh rate is f/3. The frame skipping processing is only an example, and one frame may be filtered every other frame, or one frame may be filtered every other N frames, where N is greater than or equal to 1.
Because the determination of the frame skipping value can be changed along with the change of the decoding occupancy rate, the video code stream decoded by the display device in the time T1 and the video code stream decoded in the time T2 in the adjacent time periods can be different, and the refresh frequency of the corresponding display screen can be correspondingly adjusted, wherein T1 is greater than or equal to 0, and T2 is greater than or equal to 0. The durations of T1 and T2 may be adjusted as the decoding occupancy changes.
In some embodiments, the frame skip value is not adjusted when the decoding occupancy is stable.
Some embodiments of the present application provide a video information processing method comprising: acquiring a decoding occupancy rate and a code stream processing strategy in the process of decoding and processing an original video code stream; processing the decoding occupancy rate and the occupancy rate threshold value to obtain calculation capacity monitoring information; judging whether the code stream processing strategy is a sequential frame processing strategy or not; if so, determining a first preset frame skipping value as a frame skipping value when the computational power monitoring information contains the standard exceeding identifier, and if not, subtracting a second preset frame skipping value from the frame skipping value corresponding to the frame skipping processing strategy to obtain a frame skipping value when the computational power monitoring information does not contain the standard exceeding identifier and the ratio of the decoding occupancy to the occupancy threshold is greater than or equal to the preset threshold; and when the computing power monitoring information contains the standard exceeding identification, adding a second preset frame skipping value to the frame skipping value corresponding to the frame skipping processing strategy to obtain a frame skipping value. In the method, the decoding occupancy rate and the occupancy rate threshold are processed to obtain the computing power monitoring information, and then the target video information is obtained according to the computing power monitoring information, so that the display screen can refresh the display screen according to the original video frame to display the original video frame, the refresh rate of the display screen is reduced, the display screen can display the original video frame in a flow, the problems of display screen blockage, screen splash and the like are avoided, the problem that the reliability of a chip is reduced due to the fact that a processor with high processing capacity generates large heat in the working process can be avoided, the cost of the processor is saved, and the design cost of the display device is reduced.
Fig. 3 is a schematic structural diagram of a display device provided in the present application. As shown in fig. 3, the display device 30 includes: a processor 301 and a display screen 302, wherein,
the processor 301 is configured to perform:
acquiring the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame;
adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications;
and sending the target video information to the display screen 302, wherein the display screen 302 is used for determining the original video frame according to the identifier corresponding to the original video frame, and refreshing the display screen 302 according to the original video frame to display the original video frame.
The processor in the display device provided by the present application may execute the technical solutions shown in the above method embodiments, and the implementation principles and beneficial effects thereof are similar, and are not described herein again.
In some embodiments, the obtaining, by the processor 301, the decoding occupancy rate in the process of decoding and processing the original video code stream, and performing frame skipping decoding processing on the original video code stream to obtain the original video information includes that the processor 301:
determining a frame skipping value according to the decoding occupancy rate, the code stream processing strategy and the occupancy rate threshold value;
and carrying out frame skipping decoding processing on the original video code stream according to the frame skipping value to generate original video information, wherein the original video information comprises a display identifier, and the preset compensation frame does not comprise the display identifier.
In some embodiments, the determining, by the processor 301, the frame skipping value according to the decoding occupancy, the code stream processing policy, and the occupancy threshold includes the processor 301:
processing the decoding occupancy rate and the occupancy rate threshold value to obtain calculation capacity monitoring information;
and determining frame skipping values according to the calculation force monitoring information and the code stream processing strategy, wherein different frame skipping values correspond to different decoding occupancy rates.
In some embodiments, the processor 301 is further configured to:
if the decoding occupancy rate is smaller than the occupancy rate threshold value, determining the ratio of the decoding occupancy rate to the occupancy rate threshold value and the standard exceeding identifier as calculation capacity monitoring information;
and if the decoding occupancy rate is greater than or equal to the occupancy rate threshold value, determining the ratio of the decoding occupancy rate to the occupancy rate threshold value as the calculation capacity monitoring information.
In some embodiments, the processor 301 is further configured to:
and when the code stream processing strategy is a sequential frame processing strategy, if the computational power monitoring information contains an overproof identifier, determining a first preset frame skipping value as a frame skipping value.
In some embodiments, the processor 301 is further configured to:
when the code stream processing strategy is a frame skipping processing strategy, if the computational power monitoring information does not contain the standard exceeding identification and the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than or equal to a preset threshold, subtracting a second preset frame skipping value from a frame skipping value corresponding to the frame skipping processing strategy to obtain a frame skipping value;
and if the calculation force monitoring information contains the standard exceeding identification, adding a second preset frame skipping value to the frame skipping value corresponding to the frame skipping processing strategy to obtain a frame skipping value.
In some embodiments, the processor 301 is further configured to:
determining the number of the compensated video frames between the adjusted adjacent original video frames according to the frame skipping value;
and adding the compensation video frames between the adjacent original video frames according to the number of the compensation video frames between the original video frames and the adjusted adjacent original video frames to generate the target video information.
In some embodiments, the transmission frame rate of the target video information is within a preset receiving frame rate range of the display screen.
In some embodiments, within the same processing time length, when the number of generated original video frames is different, the decoding occupancy rate in the process of decoding and processing the original video code stream is different.
In some embodiments, the display screen 302 is further configured to: and after the refreshing according to the current original video frame is finished, maintaining the display of the current original video frame until a next frame of original video frame is received and refreshing according to the next frame of original video frame.
Fig. 4 is a schematic structural diagram of a video information processing apparatus provided in the present application. The video-information processing apparatus 40 is provided in the processor 301, the video-information processing apparatus 40 including: a decoding module 401, a decoding monitoring module 402, a video information determining module 404, a sending module 405, wherein,
the decoding module 401 is configured to obtain an original video frame from an original video code stream subjected to decoding processing, and provide the original video frame to the video information determining module 404;
the decoding monitoring module 402 is configured to obtain a decoding occupancy rate, and provide the decoding occupancy rate to the video information determining module 404;
the video information determining module 404 is configured to add a preset compensation frame between adjacent original video frames after frame skipping according to the receiving and decoding occupancy rate and the original video frame, generate target video information, and provide the target video information to the sending module 405.
The sending module 405 is configured to send the target video information to the display screen.
The video information processing apparatus provided in the present application can execute the technical solutions shown in the above method embodiments, and the implementation principles and beneficial effects thereof are similar, and are not described herein again.
In some embodiments, video-information processing apparatus 40 may further include: a frame skip determination module 403, wherein,
the frame skipping determination module 403 is configured to obtain the decoding occupancy in the decoding module 402, determine a frame skipping value according to the code stream processing policy of the decoding module 401, the decoding occupancy, the occupancy threshold, and the processing policy, and provide the frame skipping value to the video information determination module 404;
the video information determining module 404 is further configured to determine the target video information according to the frame skipping value and the original video information.
The video information processing apparatus provided in the present application can execute the technical solutions shown in the above method embodiments, and the implementation principles and beneficial effects thereof are similar, and are not described herein again.
In the embodiment shown in fig. 3, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
The memory may comprise high speed RAM memory and may also include non-volatile storage NVM, such as disk storage.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The application also provides a computer readable storage medium, wherein computer execution instructions are stored in the computer readable storage medium, and when a processor executes the computer execution instructions, the video information processing method is realized.
The computer-readable storage medium may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. Readable storage media can be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary readable storage medium is coupled to the processor such the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the readable storage medium may also reside as discrete components in the apparatus.
The division of the unit is only a logical division, and other division ways are possible in actual implementation, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (11)
1. A display device, comprising: a processor and a display screen, wherein,
the processor is configured to perform:
acquiring a decoding occupancy rate in the process of decoding and processing an original video code stream, and performing frame skipping decoding processing on the original video code stream to generate an original video frame;
adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications;
and sending the target video information to the display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame to display the original video frame.
2. The apparatus according to claim 1, wherein the processor obtains a decoding occupancy rate during decoding processing of an original video stream, and performs frame skipping decoding processing on the original video stream to obtain original video information, and the processor includes:
determining a frame skipping value according to the decoding occupancy rate, the code stream processing strategy and the occupancy rate threshold value;
and carrying out frame skipping decoding processing on the original video code stream according to the frame skipping value to generate original video information, wherein the original video information comprises a display identifier, and the preset compensation frame does not comprise the display identifier.
3. The device of claim 2, wherein the processor determines a frame skip value according to the decoding occupancy, the codestream processing policy, and an occupancy threshold, comprising the processor:
processing the decoding occupancy rate and the occupancy rate threshold value to obtain calculation capacity monitoring information;
and determining the frame skipping value according to the computing power monitoring information and the code stream processing strategy, wherein different frame skipping values correspond to different decoding occupancy rates.
4. The device of claim 3, wherein the processor is further configured to:
if the decoding occupancy rate is smaller than the occupancy rate threshold, determining the ratio of the decoding occupancy rate to the occupancy rate threshold and a standard exceeding identifier as the calculation capacity monitoring information;
and if the decoding occupancy rate is greater than or equal to the occupancy rate threshold, determining the ratio of the decoding occupancy rate to the occupancy rate threshold as the calculation capacity monitoring information.
5. The device of claim 3 or 4, wherein the processor is further configured to:
and when the code stream processing strategy is a sequential frame processing strategy, if the computational power monitoring information contains an overproof identifier, determining a first preset frame skipping value as the frame skipping value.
6. The device of claim 3 or 4, wherein the processor is further configured to:
when the code stream processing strategy is a frame skipping processing strategy, if the computational power monitoring information does not contain a standard exceeding identifier and the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than or equal to a preset threshold, subtracting a second preset frame skipping value from a frame skipping value corresponding to the frame skipping processing strategy to obtain the frame skipping value;
and if the calculation force monitoring information contains the standard exceeding identification, adding a second preset frame skipping value to the frame skipping value corresponding to the frame skipping processing strategy to obtain the frame skipping value.
7. The apparatus of any of claims 2 to 6, wherein the processor is further configured to:
determining the number of the compensated video frames between the adjusted adjacent original video frames according to the frame skipping value;
and adding the compensation video frame between the adjacent original video frames according to the number of the compensation video frames between the original video frames and the adjusted adjacent original video frames to generate the target video information.
8. The apparatus of claim 2,
and the transmission frame rate of the target video information is within the range of the preset receiving frame rate of the display screen.
9. The apparatus of claim 1, wherein the decoding occupancy rate during decoding processing of the original video stream is different when the number of generated original video frames is different within the same processing duration.
10. The device of claim 1, wherein the display screen is further configured to: and after the refreshing according to the current original video frame is finished, maintaining the display of the current original video frame until a next frame of original video frame is received and refreshing according to the next frame of original video frame.
11. A video information processing method applied to a display device including a processor and a display screen, the method comprising:
the processor acquires the decoding occupancy rate in the process of decoding and processing the original video code stream, and performs frame skipping decoding processing on the original video code stream to generate an original video frame;
the processor adds a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifications;
and the processor sends the target video information to the display screen, wherein the display screen is used for determining the original video frame according to the identifier corresponding to the original video frame and refreshing the display screen according to the original video frame so as to display the original video frame.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010493104.6A CN113766316A (en) | 2020-06-03 | 2020-06-03 | Display device and video information processing method |
| PCT/CN2021/081917 WO2021238362A1 (en) | 2020-05-26 | 2021-03-19 | Display apparatus |
| PCT/CN2021/081883 WO2021238361A1 (en) | 2020-05-26 | 2021-03-19 | Display device and display control method |
| US17/808,041 US11830446B2 (en) | 2020-05-26 | 2022-06-21 | Display apparatus and display control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010493104.6A CN113766316A (en) | 2020-06-03 | 2020-06-03 | Display device and video information processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113766316A true CN113766316A (en) | 2021-12-07 |
Family
ID=78783028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010493104.6A Pending CN113766316A (en) | 2020-05-26 | 2020-06-03 | Display device and video information processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113766316A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114726400A (en) * | 2022-03-31 | 2022-07-08 | 成都信息工程大学 | Blind frequency hopping pattern FHSS signal frequency hopping removing method |
| CN116506618A (en) * | 2023-06-26 | 2023-07-28 | 北京麟卓信息科技有限公司 | Video decoding optimization method based on load dynamic self-adaption |
-
2020
- 2020-06-03 CN CN202010493104.6A patent/CN113766316A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114726400A (en) * | 2022-03-31 | 2022-07-08 | 成都信息工程大学 | Blind frequency hopping pattern FHSS signal frequency hopping removing method |
| CN114726400B (en) * | 2022-03-31 | 2023-08-04 | 成都信息工程大学 | Frequency hopping method for FHSS signal of blind frequency hopping pattern |
| CN116506618A (en) * | 2023-06-26 | 2023-07-28 | 北京麟卓信息科技有限公司 | Video decoding optimization method based on load dynamic self-adaption |
| CN116506618B (en) * | 2023-06-26 | 2023-08-22 | 北京麟卓信息科技有限公司 | Video decoding optimization method based on load dynamic self-adaption |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111354323B (en) | Display panel brightness control method and display device | |
| CN110363831B (en) | Layer composition method and device, electronic equipment and storage medium | |
| CN110888521B (en) | Mobile terminal and application program running method thereof | |
| CN113055742B (en) | Video display method, device, terminal and storage medium | |
| CN111158619B (en) | Picture processing method and device | |
| CN113766316A (en) | Display device and video information processing method | |
| US11212540B2 (en) | Video data processing system | |
| CN107734352B (en) | Information determination method, device and storage medium | |
| CN111476852B (en) | Reader refresh method, computing device, and computer storage medium | |
| CN107665681B (en) | Liquid crystal display driving method, system and computer readable medium | |
| US11810524B2 (en) | Virtual reality display device and control method thereof | |
| US20170104800A1 (en) | Performance optimization for streaming video | |
| CN107247508B (en) | Data source processing method and terminal equipment | |
| CN111582968A (en) | Commodity transaction method, commodity transaction device, server and medium for live broadcast platform | |
| CN115079977A (en) | Interface drawing method and device, electronic equipment and storage medium | |
| CN109359255B (en) | Form data display method and terminal equipment | |
| EP3896981A1 (en) | Method and system for determining video definition, computer device, and storage medium | |
| CN113766315A (en) | Display device and video information processing method | |
| CN108765503B (en) | Skin color detection method, device and terminal | |
| CN115129279B (en) | Image drawing method, image drawing device, electronic equipment and computer storage medium | |
| CN113627363A (en) | Video file processing method, device, equipment and storage medium | |
| JP6489913B2 (en) | Video display device | |
| CN112529823B (en) | Image processing method, device and equipment | |
| US8306122B2 (en) | Method and apparatus for processing image data | |
| CN109697045B (en) | Picture display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |