CN117834796A

CN117834796A - Frame rate control method, transmitting card, storage medium and electronic device

Info

Publication number: CN117834796A
Application number: CN202211182925.3A
Authority: CN
Inventors: 陈雄伟; 韩丹
Original assignee: Xian Novastar Electronic Technology Co Ltd
Current assignee: Xian Novastar Electronic Technology Co Ltd
Priority date: 2022-09-27
Filing date: 2022-09-27
Publication date: 2024-04-05

Abstract

The embodiment of the disclosure relates to a frame rate control method, a transmitting card, a storage medium and electronic equipment. The method comprises the following steps: obtaining the maximum output frame rate of the current equipment; acquiring the frame rate of the received video data; judging the frame rate of the video data and the maximum output frame rate of the current equipment; and if the frame rate of the video data is larger than the maximum output frame rate of the current equipment, adjusting the frame rate of the video data to be smaller than or equal to the maximum output frame rate of the current equipment, and then outputting the video data. The method achieves the effects of frame reduction rate and double carrying area.

Description

Frame rate control method, transmitting card, storage medium and electronic device

Technical Field

The embodiment of the disclosure relates to the technical field of display control, in particular to a frame rate control method, a sending card, a storage medium and electronic equipment.

Background

In the LED display industry, with the development of small-pitch display screens, the screen pitch is smaller and smaller, but the load is larger and larger. For the android multimedia playing box, based on the consideration of cost and technology, data transmission is basically performed based on an RJ45 gigabit network, the maximum load of the gigabit network theory is 65W/60Hz data, and the common network interface comprises a single network interface/a double network interface/a 4 network interface/a 6 network interface.

In some scenarios, the actual carrying size of the video that the user needs to play may exceed the output capability of the playing box, and if the playing box is used continuously, the video may be blocked and cannot be played smoothly. In the related art, a user may choose to upgrade the hardware of the playback box or directly replace the playback box so that the output capability of the playback box matches the actual carrying capacity of the video. However, the above method is costly and wastes the existing playing box, and thus, it is necessary to improve one or more problems of the related art.

It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

It is an object of embodiments of the present disclosure to provide a frame rate control method, a transmission card, a storage medium, and an electronic apparatus, which overcome, at least in part, one or more of the problems due to the limitations and disadvantages of the related art.

In a first aspect, the present disclosure provides a frame rate control method, including:

obtaining the maximum output frame rate of the current equipment;

acquiring the frame rate of the received video data;

judging the frame rate of the video data and the maximum output frame rate of the current equipment;

and if the frame rate of the video data is larger than the maximum output frame rate of the current equipment, adjusting the frame rate of the video data so that the frame rate of the finally output video data is smaller than or equal to the maximum output frame rate of the current equipment.

Optionally, the step of adjusting the frame rate of the video data includes:

and adjusting the frame rate of the video data in a frame extraction mode.

Optionally, the step of adjusting the frame rate of the video data by means of frame extraction includes:

and subtracting a plurality of frame images which are continuous in time from the video data according to an arithmetic difference form.

Optionally, the step of subtracting a plurality of frame images, which are temporally continuous, from the video data in an arithmetic form includes:

and the frame images are subtracted in a mode that one frame is extracted from every two frames.

and uniformly reducing the frame rate of the video data to a preset frame rate, wherein the preset frame rate is smaller than or equal to the maximum output frame rate of the current equipment.

Optionally, the method comprises:

and calculating pixel difference degree of the frame image to be subtracted and the previous frame image, and if the pixel difference degree exceeds a preset threshold value, discarding the frame image to be subtracted.

Optionally, the step of calculating the pixel difference degree between the frame image to be subtracted and the previous frame image includes:

acquiring a pixel point which is at the same position in the frame image to be subtracted and the previous frame image and has the largest difference of pixel values;

calculating a first pixel value, wherein the first pixel value is the sum of the pixel points in the frame image to be subtracted and the pixel values of 8 pixel points around the pixel points;

calculating a second pixel value, wherein the second pixel value is the sum of the pixel points in the previous frame image and the pixel values of 8 pixel points around the pixel points;

and obtaining the pixel difference degree by obtaining the absolute value of the interpolation of the first pixel value and the second pixel value.

In a second aspect, the present disclosure provides a transmission card comprising:

a first acquisition unit configured to acquire a maximum output frame rate of the transmission card;

a second acquisition unit configured to acquire a frame rate of the received video data;

a judging unit configured to judge the frame rate of the video data and the maximum output frame rate of the transmitting card;

and the frame rate adjusting unit is used for adjusting the frame rate of the video data when the frame rate of the video data is larger than the maximum output frame rate of the sending card so that the frame rate of the finally output video data is smaller than or equal to the maximum output frame rate of the sending card.

In a third aspect, the present disclosure provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the frame rate control method of any one of the above.

In a fourth aspect, the present disclosure provides an electronic device comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the steps of any of the frame rate control methods described above via execution of the executable instructions.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

in the embodiment of the disclosure, the size between the frame rate of the received video data and the maximum output frame rate of the current device may be determined, and when the frame rate of the video data is greater than the maximum output frame rate of the current device, the frame rate of the video data may be adjusted so that the frame rate of the finally outputted video data is less than or equal to the maximum output frame rate of the current device. Therefore, even if the actual load size of the received video to be played exceeds the output capacity of the playing box, the frame rate of the video data is adjusted to ensure that the finally played video is not blocked, so that the effects of reducing the frame rate and doubling the load area are achieved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.

Fig. 1 is a flowchart illustrating a frame rate control method according to an exemplary embodiment of the present disclosure;

FIG. 2 is a flow chart of a method for calculating pixel disparity between a frame image to be subtracted and a previous frame image in an exemplary embodiment of the present disclosure;

FIG. 3 illustrates a block diagram of a sending card in an exemplary embodiment of the present disclosure;

FIG. 4 illustrates a schematic diagram of a computer-readable storage medium in an exemplary embodiment of the present disclosure;

fig. 5 shows a schematic diagram of an electronic device in an exemplary embodiment of the present disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.

In this exemplary embodiment, there is provided a frame rate control method first, referring to fig. 1, which may include the steps of:

step S101: obtaining the maximum output frame rate of the current equipment;

step S102: acquiring the frame rate of the received video data;

step S103: judging the frame rate of the video data and the maximum output frame rate of the current equipment;

step S104: and if the frame rate of the video data is larger than the maximum output frame rate of the current equipment, adjusting the frame rate of the video data so that the frame rate of the finally output video data is smaller than or equal to the maximum output frame rate of the current equipment.

By the method, the size between the frame rate of the received video data and the maximum output frame rate of the current device can be judged, and when the frame rate of the video data is larger than the maximum output frame rate of the current device, the frame rate of the video data can be adjusted so that the frame rate of the finally output video data is smaller than or equal to the maximum output frame rate of the current device. Therefore, even if the actual load size of the received video to be played exceeds the output capacity of the playing box, the frame rate of the video data is adjusted to ensure that the finally played video is not blocked, so that the effects of reducing the frame rate and doubling the load area are achieved.

Next, each step of the above-described method in the present exemplary embodiment will be described in more detail.

The frame rate in this disclosure refers to the number of frames per second that fill an image, generally indicated by fps (Frames Per Second). A high frame rate results in a smoother, more realistic animation, i.e., the higher the fps, the smoother the displayed motion.

In step S101, the current device may be a transmission card in the display control playback system. The transmitting card is used for receiving the video signal provided by the upper computer, transmitting the processed video signal to the receiving card in the display control playing system, and outputting the processed video signal data to the display screen after the receiving card receives the processed video signal data, so that the display control of the display screen is realized. Typically the transmit card has a fixed maximum output frame rate, for example 60fps, 30fps, etc.

In step S103, the frame rate of the video data and the maximum output frame rate of the current device are determined. When the frame rate of the video data is smaller than the maximum output frame rate of the current device, the current device outputs the video data at the frame rate of the video data.

In step S104, when the frame rate of the video data is greater than the maximum output frame rate of the current device, if the frame rate of the video data is not adjusted to be directly output, the frame rate of the video data will be inevitably lost, and the whole video will be played. The above problem can be avoided by adjusting the frame rate of the video data in advance so that it matches the output frame rate of the current device.

It can be understood that the frame rate of the video data can be adjusted by frame extraction, i.e. according to the video situation, some frames with smaller frame changes from the previous frame are extracted until the final video frame rate meets the output frame rate of the current device. Thus, the smooth feeling of the final output video is enhanced to some extent.

Specifically, the degree of the picture change of the two frames of images can be judged by calculating the pixel difference degree of the frame image to be subtracted and the previous frame of image. For example, when the calculated pixel difference exceeds a preset threshold, it is considered that the two frames of images change too much, and if the frame is subtracted, the smoothness of the video playing is affected, so that the frame is abandoned. If the calculated pixel difference exceeds the preset threshold, the two frames of images are considered to have smaller change, and the frames of images can be subtracted.

In one embodiment, referring to fig. 2, the step of calculating the pixel difference degree between the frame image to be subtracted and the previous frame image may include the steps of:

step S201: and obtaining the pixel points which are at the same position in the frame image to be subtracted and the previous frame image and have the largest difference of pixel values.

Specifically, the pixel point can be found by comparing the pixel values of each pixel point at the same position one by one. Of course, in order to increase the comparison speed, a frame of image may be divided into 4 pixel blocks or 9 pixel blocks, the pixel block with the largest change in the two frames of images is determined according to the pixel change value of the whole block, and then the pixel points with the largest change in the pixel value in the pixel blocks are compared one by one.

Step S202: and calculating a first pixel value which is the sum of the pixel points in the frame image to be subtracted and the pixel values of 8 pixel points around the pixel points.

The accuracy of the judgment of the difference of the two frames of images in the subsequent step can be further improved by calculating the pixel value sum of the pixel point with the largest difference of the pixel values at the same position and the pixel values of 8 peripheral pixel points.

Step S203: and calculating a second pixel value, wherein the second pixel value is the sum of the pixel points in the previous frame image and the pixel values of 8 pixel points around the pixel points.

Step S204: and obtaining the pixel difference degree by obtaining the absolute value of the interpolation of the first pixel value and the second pixel value.

It will be appreciated that the above-described frame extraction may be performed by subtracting a plurality of frame images, which are temporally consecutive, from each other. For example, one frame is subtracted every 2 frames, or one frame is subtracted every 3 frames, etc. Of course, the thinning interval number can be changed at any time in the thinning process, for example, when thinning one frame every 3 frames, there are a plurality of images to be thinned out and the image of the previous frame have larger phase difference, so that thinning one frame every 3 frames can be changed into thinning one frame every 2 frames.

In one embodiment, the frame extracting process may further be to uniformly extract the frame rate of the video data to a preset frame rate, where the preset frame rate is less than or equal to the maximum output frame rate of the current device. For example, the preset frame rate is 30fps, subtraction in an arithmetic form is not required, so long as the pixel difference degree between the finally subtracted frame image and the previous frame image does not exceed a preset threshold value.

Of course, in other embodiments, in addition to the frame extraction matching the device output frame rate, the corresponding resolution may be configured according to the device. For example, if the output resolution and frame rate of the current device are 1080p+60fps, the resolution and frame rate of the video may be configured to 1080p+30fps, etc., to achieve the effect of doubling the load area.

In this example embodiment, there is also provided a transmission card, as shown in fig. 3, including a first acquisition unit, a second acquisition unit, a judgment unit, and a frame rate adjustment unit. The first acquisition unit is used for acquiring the maximum output frame rate of the sending card. The second acquisition unit is used for acquiring the frame rate of the received video data. The judging unit is used for judging the frame rate of the video data and the maximum output frame rate of the sending card. And the frame rate adjusting unit is used for adjusting the frame rate of the video data to be smaller than or equal to the maximum output frame rate of the current equipment and outputting the video data when the frame rate of the video data is larger than the maximum output frame rate of the sending card.

It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied. The components shown as modules or units may or may not be physical units, may be located in one place, or may be distributed across multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood disclosure scheme. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed by, for example, a processor, can implement the steps of the frame rate control method described in any one of the above embodiments. In some possible embodiments, the aspects of the present invention may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention as described in the above-mentioned screen content sharing method section of this specification, when said program product is run on the terminal device.

Referring to fig. 4, a program product 400 for implementing the above-described method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

In an exemplary embodiment of the present disclosure, an electronic device is also provided, which may include a processor, and a memory for storing executable instructions of the processor. Wherein the processor is configured to perform the steps of the frame rate control method of any of the embodiments described above via execution of the executable instructions.

Those skilled in the art will appreciate that the various aspects of the invention may be implemented as a system, method, or program product. Accordingly, aspects of the invention may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.

An electronic device 500 according to such an embodiment of the invention is described below with reference to fig. 5. The electronic device 500 shown in fig. 5 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.

As shown in fig. 5, the electronic device 500 is embodied in the form of a general purpose computing device. The components of electronic device 500 may include, but are not limited to: at least one processing unit 510, at least one memory unit 520, a bus 530 connecting the different system components (including the memory unit 520 and the processing unit 510), a display unit 540, etc.

Wherein the storage unit stores program code executable by the processing unit 510 such that the processing unit 510 performs the steps according to various exemplary embodiments of the present invention described in the above-mentioned screen content sharing method section of the present specification. For example, the processing unit 510 may perform the steps as shown in fig. 1.

The memory unit 520 may include readable media in the form of volatile memory units, such as Random Access Memory (RAM) 5201 and/or cache memory unit 5202, and may further include Read Only Memory (ROM) 5203.

The storage unit 520 may also include a program/utility 5204 having a set (at least one) of program modules 5205, such program modules 5205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

Bus 530 may be one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

The electronic device 500 may also communicate with one or more external devices 600 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 500, and/or any device (e.g., router, modem, etc.) that enables the electronic device 500 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 550. Also, electronic device 500 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 560. The network adapter 560 may communicate with other modules of the electronic device 500 via the bus 530. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 500, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Accordingly, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a usb disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, or a network device, etc.) to perform the above-described frame rate control method according to the embodiments of the present disclosure.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A frame rate control method, comprising:

obtaining the maximum output frame rate of the current equipment;

acquiring the frame rate of the received video data;

and if the frame rate of the video data is larger than the maximum output frame rate of the current equipment, adjusting the frame rate of the video data to be smaller than or equal to the maximum output frame rate of the current equipment, and then outputting the video data.

2. The frame rate control method according to claim 1, wherein the step of adjusting the frame rate of the video data includes:

and adjusting the frame rate of the video data in a frame extraction mode.

3. The frame rate control method according to claim 2, wherein the step of adjusting the frame rate of the video data by frame extraction includes:

4. A frame rate control method according to claim 3, wherein the step of subtracting a plurality of frame images, which are temporally continuous, of the video data in an arithmetic form, comprises:

5. The frame rate control method according to claim 2, wherein the step of adjusting the frame rate of the video data by frame extraction includes:

6. The frame rate control method according to any one of claims 2 to 5, characterized by comprising:

7. The frame rate control method according to claim 6, wherein the step of calculating the pixel difference degree between the frame image to be subtracted and the previous frame image includes:

8. A transmission card, comprising:

and the frame rate adjusting unit is used for adjusting the frame rate of the video data to be smaller than or equal to the maximum output frame rate of the current equipment and outputting the video data when the frame rate of the video data is larger than the maximum output frame rate of the sending card.

9. A computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor realizes the steps of the frame rate control method according to any of claims 1 to 7.

10. An electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the steps of the frame rate control method of any of claims 1 to 7 via execution of the executable instructions.