CN112911299A - Video code rate control method and device, electronic equipment and storage medium - Google Patents
Video code rate control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112911299A CN112911299A CN201911221408.0A CN201911221408A CN112911299A CN 112911299 A CN112911299 A CN 112911299A CN 201911221408 A CN201911221408 A CN 201911221408A CN 112911299 A CN112911299 A CN 112911299A
- Authority
- CN
- China
- Prior art keywords
- sub
- picture
- frame
- image
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/115—Selection of the code volume for a coding unit prior to coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
Abstract
The embodiment of the invention discloses a video code rate control method, a video code rate control device, electronic equipment and a storage medium. The method comprises the following steps: acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor; determining the coding parameters corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameters in the sub-image pictures acquired by each image sensor; and splicing the sub-picture frames into a complete picture frame, carrying out intra-frame coding on the initial frame of the complete picture frame, and independently coding other frames according to each sub-picture frame and the corresponding coding parameters thereof. According to the embodiment of the invention, each sub-picture forming the spliced picture is independently coded according to the corresponding coding parameters, namely, each sub-picture is coded at the corresponding minimum effective code rate, so that the whole video picture is prevented from being coded at a fixed code rate, and the code rate of the spliced picture is effectively reduced.
Description
Technical Field
The embodiment of the invention relates to the technical field of monitoring, in particular to a video code rate control method, a video code rate control device, electronic equipment and a storage medium.
Background
With the rapid development of various technologies in the monitoring field, people pursue higher-quality visual experience, so that the definition of an image is comprehensively improved, from 1080P to 4K or even to 8K, and even higher, however, when a video with 8K or even higher resolution is independently encoded and decoded, as the video resolution is higher, the required code rate is higher, the network transmission bandwidth is unchanged, the too-large code rate can impact the network bandwidth, and sometimes, the code rate surge caused by the superposition of the existing code rates can also impact the network bandwidth, so that how to reduce the code rate becomes a problem to be solved urgently.
At present, the existing scheme is only to perform whole-picture coding processing on the video collected by a single sensor so as to achieve the purpose of reducing the code rate. However, for a monitoring device with multiple sensors (e.g., a multi-view camera), a video picture is composed of pictures acquired by multiple different sensors, and the conventional method for encoding the whole picture cannot effectively reduce the video encoding rate.
Disclosure of Invention
The embodiment of the invention provides a video code rate control method, a video code rate control device, electronic equipment and a storage medium, and aims to solve the technical problem that the encoding code rate cannot be effectively reduced when a video picture of multi-sensor monitoring equipment is processed in the prior art.
In a first aspect, an embodiment of the present invention provides a method for controlling a video bitrate, where the method includes:
acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor;
determining a coding parameter corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameter in a sub-image picture acquired by each image sensor;
splicing all the sub-picture frames into a complete picture frame, carrying out intra-frame coding on the initial frame of the complete picture frame, and independently coding other frames according to each sub-picture frame and the corresponding coding parameters thereof.
In a second aspect, an embodiment of the present invention further provides a method and an apparatus for controlling a video bitrate, where the apparatus includes:
the acquisition module is used for acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor;
the parameter determining module is used for determining the coding parameters corresponding to each image sensor according to the attribute information of each image sensor and correspondingly marking the coding parameters in the sub-image pictures acquired by each image sensor;
and the coding module is used for splicing all the sub-picture pictures into a complete picture, carrying out intra-frame coding on the initial frame of the complete picture, and independently coding other frames according to each sub-picture and the corresponding coding parameters.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the video rate control method according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a video rate control method according to any embodiment of the present invention.
According to the embodiment of the invention, the sub-image pictures collected by each image sensor and the attribute information of each image sensor are obtained, the coding parameters corresponding to each image sensor are determined according to the attributes of each image sensor, the sub-image pictures are spliced into a complete image picture, the initial frame of the complete image picture is subjected to intra-frame coding, and other frames are independently coded according to each sub-image picture and the coding parameters corresponding to the sub-image picture. Therefore, each sub-picture forming the spliced picture is independently coded according to the corresponding coding parameters, namely each sub-picture is coded at the corresponding minimum effective code rate, the whole video picture is prevented from being coded at the fixed code rate, and the code rate of the spliced picture is effectively reduced.
Drawings
Fig. 1 is a flowchart of a video rate control method according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating a video rate control method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a video rate control apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device in a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a video rate control method according to an embodiment of the present invention, where the present embodiment is applicable to a case of encoding a video picture acquired by a multi-view splicing device, and the method may be executed by a video rate control apparatus, and the apparatus may be implemented in a software and/or hardware manner, and may be integrated on an electronic device, such as the multi-view splicing device.
As shown in fig. 1, the video rate control method specifically includes:
s101, acquiring sub-image pictures acquired by the image sensors and attribute information of each image sensor.
In the embodiment of the present invention, the multi-view stitching device includes a plurality of image sensors for acquiring image frames in real time, and therefore, it is necessary to acquire sub-image frames acquired by each image sensor and attribute information of each image sensor in real time, where the attribute information of the image sensor at least includes a shutter, a gain, device information (for example, a model of the sensor), and the like of the sensor. It should be noted here that, even if the shutter and the gain are the same, the noise brightness differs among different sensors, and therefore, when acquiring the image sensor attribute, the device information of each image sensor is acquired.
S102, determining the coding parameters corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameters in the sub-image pictures acquired by each image sensor.
Optionally, the encoding parameters, such as GOP, frame rate, code rate, etc., corresponding to each image sensor may be determined according to device information of each image sensor, such as the model of the sensor, and the encoding parameters correspond to distortion tolerance under different shutter gains. It should be noted that the encoding parameters corresponding to each type of image sensor may be determined in advance through a test, and then the corresponding encoding parameters may be obtained quickly only by querying the type of the sensor. After the coding parameters of each sub-image picture are determined, the coding parameters are correspondingly marked in the sub-image pictures acquired by each image sensor, so that each subsequent sub-image picture is coded according to the respective coding parameters.
S103, splicing all the sub-picture pictures into a complete picture, carrying out intra-frame coding on a starting frame of the complete picture, and independently coding other frames according to each sub-picture and the corresponding coding parameters thereof.
Optionally, the sub-picture frames are spliced into a complete picture frame according to the splicing information of the multiple pictures, and the start frame of the complete picture frame is intra-coded, that is, global I-frame coding is performed, in addition, in order to ensure the quality of the complete picture frame, a mandatory I-frame (that is, a video frame which needs global I-frame coding in addition to the start frame) also exists in the complete picture frame, so that the mandatory I-frame also needs to be intra-coded. And for other frames except the initial frame and the mandatory I frame, independent coding is performed according to each sub-picture and the coding parameter corresponding to the sub-picture, and it needs to be noted that each sub-picture is coded according to the optimal coding parameter.
According to the embodiment of the invention, the sub-image pictures collected by each image sensor and the attribute information of each image sensor are obtained, the coding parameters corresponding to each image sensor are determined according to the attributes of each image sensor, the sub-image pictures are spliced into a complete image picture, the initial frame of the complete image picture is subjected to intra-frame coding, and other frames are independently coded according to each sub-image picture and the coding parameters corresponding to the sub-image picture. Therefore, each sub-picture forming the spliced picture is independently coded according to the corresponding coding parameters, namely each sub-picture is coded at the corresponding minimum effective code rate, the whole video picture is prevented from being coded at the fixed code rate, and the code rate of the spliced picture is effectively reduced.
Example two
Fig. 2 is a schematic flow chart of a video rate control method according to a second embodiment of the present invention, where this embodiment is optimized based on the foregoing embodiment, and referring to fig. 2, the method specifically includes:
s201, acquiring sub-image pictures acquired by the image sensors and attribute information of each image sensor.
S202, respectively carrying out motion detection or feature detection on each sub-image picture, and extracting motion information or feature information.
Optionally, motion detection may be performed based on a frame difference method, specifically, a difference image is obtained by subtracting corresponding pixel values of adjacent frame images, and then binarization is performed on the difference image, where in a case that an environmental brightness change is not large, if a corresponding pixel value change is smaller than a predetermined threshold value, the difference image may be considered as a background pixel; if the pixel values of the image areas are changed greatly, which is considered to be caused by moving objects in the image, the areas are marked as foreground pixels, and the positions of the moving objects in the image, namely the motion information, can be determined by utilizing the marked pixel areas. And feature detection refers to finding an interested region from an image picture, for example, extracting a human face region in the image picture as feature information. In the embodiment of the invention, the purpose of performing motion detection or feature detection on each sub-image picture is to adjust the frame rate or GOP size subsequently so as to reduce the code rate.
S203, determining the coding parameters corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameters in the sub-image pictures acquired by each image sensor.
S204, judging whether the shutter change of each image sensor causes the frame rate of the sub-image pictures collected by the sensor to be reduced. If so, S205 is executed, otherwise, S206 is executed.
In night scenes, the shutter is usually enlarged to increase the image brightness of the video, so that the frame rate is reduced to some extent. Due to the particularity of a multi-view stitching device (e.g., a multi-view camera), when a sub-image captured by an image sensor suddenly brightens, the frame rate of the sub-image is reduced, in the conventional art, the highest frame rate in each sub-image is forced to be used as the global frame rate, and specifically, the frame rates of all sub-images can be improved by reducing a shutter, so that the sub-images without brightness will be noisy, and the frame rate and noise rise will bring about the improvement of the code rate. Therefore, in order to solve the above technical problem, when it is determined that the frame rate of a certain sub-picture is lowered, S205 may be performed.
S205, acquiring the frame rate of each sub-image picture, and selecting a target sub-image picture with the maximum frame rate value; and aiming at each sub-image except the target sub-image, complementing the frame rate of the sub-image in a mode of repeatedly sending frames after frame extraction, and executing the operation of splicing each sub-image into a complete image.
When the frame rate of a certain sub-image picture is determined to be reduced, firstly, the frame rate of each sub-image picture is acquired, whether the frame rates of the sub-image pictures are consistent or not is judged, and if not, a target sub-image picture with the largest frame rate value is selected; and for each sub-image except the target sub-image, complementing the frame rate of the sub-image in a manner of repeatedly sending frames after frame extraction.
As an optional implementation manner, the sub-picture with the low frame rate is frame-doubled according to a coding skip flag manner, for example, if the maximum frame rate of all the sub-pictures is a fps, then a coding skip flag is required for all the current sub-pictures with frame rates lower than the fps, and assuming that the frame rate of a certain sub-picture is B fps, a video frame with K x (a/B) being an integer is selected, where K is a frame number, and the selected video frame is coded skip flag, and then the selected video frame is directly coded according to skip macroblocks when being coded, so that the code rate can be reduced.
It should be noted that, when determining that the frame rate of a certain sub-image screen is lowered, if the frame rates of the acquired sub-image screens are consistent, S206 is directly executed.
S206, detecting whether the motion information or the characteristic information exists in each sub-picture, and executing the operation of splicing each sub-picture into a complete picture when judging that the motion information or the characteristic information exists in each sub-picture.
In the embodiment of the invention, if the motion information or the characteristic information exists in each sub-picture, the operation of splicing each sub-picture into a complete picture is executed, and the coding is carried out according to S207. If the motion information or the characteristic information does not exist in a certain sub-picture, the video frame content of the sub-picture is the same, and frame dropping processing is needed to save the code rate. Since the sub-picture belongs to a sub-picture in the complete picture and cannot be discarded independently, the release frame and the coding skip mark processing are performed. Optionally, even frames in the sub-image picture are retained, an area to be coded in each odd frame is marked as a skip macro block, an operation of splicing each sub-image picture into a complete image picture is performed, and only the even frames need to be coded during coding, so that the visual frame rate can be halved, but the human eye cannot easily perceive the frame rate due to the absence of characteristic objects and motion information. Therefore, the quality of the video image picture can be ensured, and the code rate can be reduced.
S207, carrying out intra-frame coding on the initial frame of the complete image picture, and carrying out independent coding on each sub-image picture by taking GOP as a coding structure unit, wherein the GOP length is dynamically adjusted.
A GOP (Group of Pictures) that includes a starting key frame and at least one predicted frame following the key frame. In the GOP, the key frame is an I frame, and the predicted frame is at least one of a B frame and a P frame. The GOP length refers to the number of frames of video frames included in a GOP. The GOP may be used to characterize how many video frames in a sequence of video frames a key frame occurs within.
Illustratively, in the embodiment of the present application, a video frame is in an IPPP structure, when each sub-picture is encoded by taking a GOP as an encoding structure unit, an I frame in the GOP is encoded in a full intra-frame encoding manner, and the rest of the time is encoded according to a normal P frame, and each sub-picture has independent distortion tolerance, so that the image effect at a unit code rate can be better improved.
In the embodiment of the invention, the GOP length can be dynamically adjusted in order to further reduce the code rate. Optionally, the operation of adjusting the GOP length includes: judging whether a video frame with a skip mark exists in a current coded sub-picture; if the current sub-picture does not exist, the GOP length is adjusted according to the motion information of the current sub-picture, for example, the current sub-picture does not have the motion information, the GOP length is adjusted to be larger, the number of I frames in the sub-picture is reduced, and then the code rate is reduced, and if the current sub-picture has the motion information, the GOP length is adjusted to be smaller in order to avoid the burst of the code rate; if yes, acquiring video frame information and GOP information with skip marks in the current sub-picture; when encoding of a GOP is finished, if the analog I frame of the current sub-picture is judged to be a video frame with a skip mark, the analog I frame is encoded according to the last video frame without the skip mark of the GOP, the value of (M +1) x N is used as the length of the next GOP, and encoding operation is continuously executed, wherein the analog I frame is an I frame in the sub-picture, M represents the number of continuous skip frames, and N is any integer. Therefore, the GOP length is dynamically adjusted through the method, and the video coding rate can be effectively reduced.
In the embodiment of the invention, if the shutter change of a certain image sensor causes the frame rate of the sub-image pictures collected by the sensor to be reduced, the frame rate of the sub-image pictures with the low frame rate is complemented in a mode of repeatedly sending frames after frame extraction so as to reduce the video coding rate, if the frame rate of the sub-image pictures is not reduced and the certain sub-image pictures have no motion information, the purpose of reducing the code rate is achieved by releasing the frames and coding a pskip mark processing mode, and besides, the GOP length is dynamically adjusted, so that the coding rate of the video can be effectively reduced through the operation.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a video rate control apparatus according to a third embodiment of the present invention, where the apparatus is configured in a multi-view splicing device, and the multi-view splicing device includes a plurality of image sensors for acquiring image frames. As shown in fig. 3, the apparatus includes:
an acquisition module 301, configured to acquire sub-image frames acquired by each image sensor and attribute information of each image sensor;
a parameter determining module 302, configured to determine, according to the attribute information of each image sensor, a coding parameter corresponding to each image sensor, and mark the coding parameter in a sub-image frame acquired by each image sensor;
the encoding module 303 is configured to splice the sub-picture frames into a complete picture frame, perform intra-frame encoding on a starting frame of the complete picture frame, and perform independent encoding on other frames according to each sub-picture frame and its corresponding encoding parameter.
According to the embodiment of the invention, the sub-image pictures collected by each image sensor and the attribute information of each image sensor are obtained, the coding parameters corresponding to each image sensor are determined according to the attributes of each image sensor, the sub-image pictures are spliced into a complete image picture, the initial frame of the complete image picture is subjected to intra-frame coding, and other frames are independently coded according to each sub-image picture and the coding parameters corresponding to the sub-image picture. Therefore, each sub-picture forming the spliced picture is independently coded according to the corresponding coding parameters, and the code rate of the spliced picture is effectively reduced.
Optionally, the apparatus further comprises:
and the detection module is used for respectively carrying out motion detection or characteristic detection on each sub-image picture and extracting motion information or characteristic information.
Optionally, the apparatus further comprises:
the first judgment module is used for judging whether the shutter change of each image sensor causes the frame rate of the sub-image pictures acquired by the sensor to be reduced or not;
the first frame rate adjusting module is used for acquiring the frame rate of each sub-image picture and selecting a target sub-image picture with the maximum frame rate value when judging that the frame rate of the sub-image pictures acquired by each image sensor is reduced due to the shutter change of the image sensor; for each sub-image except the target sub-image, frame rate of the sub-image is complemented by repeatedly sending frames after frame extraction;
and the second judgment module is used for detecting whether motion information or characteristic information exists in each sub-image when judging that the shutter change of each image sensor does not cause the frame rate of the sub-image acquired by the sensor to be reduced, and executing the operation of splicing each sub-image into a complete image when judging that the motion information or the characteristic information exists in each sub-image.
Optionally, the apparatus further comprises:
and the second frame rate adjusting module is used for reserving even frames in a sub-picture and performing operation of splicing the sub-pictures into a complete picture after marking an area needing to be coded in each odd frame as a skip macro block if judging that motion information or characteristic information does not exist in a certain sub-picture.
Optionally, the encoding module includes:
and an encoding unit configured to independently encode each sub-picture in units of a GOP coding structure, wherein the GOP length is dynamically adjusted.
Optionally, the encoding unit includes a GOP length adjustment subunit, configured to:
judging whether a video frame with a skip mark exists in a current coded sub-picture;
if not, adjusting the GOP length according to the motion information of the current sub-picture;
if yes, acquiring video frame information and GOP information with skip marks in the current sub-picture; when encoding of a GOP is finished, if the analog I frame of the current sub-picture is judged to be a video frame with a skip mark, the analog I frame is encoded according to the last video frame without the skip mark of the GOP, the value of (M +1) x N is used as the length of the next GOP, and encoding operation is continuously executed, wherein the analog I frame is an I frame in the sub-picture, M represents the number of continuous skip frames, and N is any integer.
The video code rate control device provided by the embodiment of the invention can execute the video code rate control method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
Example four
Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention. Fig. 4 illustrates a block diagram of an exemplary device 12 suitable for use in implementing embodiments of the present invention. The electronic device 12 shown in fig. 4 is only an example and should not bring any limitation to the function and the scope of use of the embodiment of the present invention.
As shown in FIG. 4, electronic device 12 is embodied in the form of a general purpose computing device. The components of electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 connecting the various system components (including the system memory 28 and the processing unit 16), and a plurality of image sensors (not shown) for capturing image frames.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The processing unit 16 executes various functional applications and data processing by running a program stored in the system memory 28, for example, implementing a video rate control method provided by an embodiment of the present invention, the method includes:
acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor;
determining a coding parameter corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameter in a sub-image picture acquired by each image sensor;
splicing all the sub-picture frames into a complete picture frame, carrying out intra-frame coding on the initial frame of the complete picture frame, and independently coding other frames according to each sub-picture frame and the corresponding coding parameters thereof.
EXAMPLE five
The fifth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a video bitrate control method provided in the fifth embodiment of the present invention, where the method includes:
acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor;
determining a coding parameter corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameter in a sub-image picture acquired by each image sensor;
splicing all the sub-picture frames into a complete picture frame, carrying out intra-frame coding on the initial frame of the complete picture frame, and independently coding other frames according to each sub-picture frame and the corresponding coding parameters thereof.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A video code rate control method is applied to multi-view splicing equipment, the multi-view splicing equipment comprises a plurality of image sensors used for collecting image pictures, and the method comprises the following steps:
acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor;
determining a coding parameter corresponding to each image sensor according to the attribute information of each image sensor, and correspondingly marking the coding parameter in a sub-image picture acquired by each image sensor;
splicing all the sub-picture frames into a complete picture frame, carrying out intra-frame coding on the initial frame of the complete picture frame, and independently coding other frames according to each sub-picture frame and the corresponding coding parameters thereof.
2. The method of claim 1, wherein after acquiring the sub-picture frames acquired by each image sensor, the method further comprises:
and respectively carrying out motion detection or characteristic detection on each sub-image picture, and extracting motion information or characteristic information.
3. The method according to claim 2, wherein before stitching the sub-picture frames into a complete picture frame, the method further comprises:
judging whether the shutter change of each image sensor causes the frame rate of the sub-image pictures collected by the sensor to be reduced or not;
if so, acquiring the frame rate of each sub-image picture, and selecting a target sub-image picture with the maximum frame rate value; for each sub-image except the target sub-image, frame rate of the sub-image is complemented by repeatedly sending frames after frame extraction;
if not, detecting whether the motion information or the characteristic information exists in each sub-picture, and executing the operation of splicing each sub-picture into a complete picture when judging that the motion information or the characteristic information exists in each sub-picture.
4. The method of claim 3, further comprising:
if the motion information or the characteristic information does not exist in a certain sub-picture, reserving the even frame in the sub-picture, marking the area needing to be coded in each odd frame as a skip macro block, and then executing the operation of splicing each sub-picture into a complete picture.
5. The method of claim 1, wherein the other frames are independently encoded according to each sub-picture and its corresponding encoding parameters, comprising:
and independently encoding each sub-picture by taking GOP as an encoding structure unit, wherein the GOP length is dynamically adjusted.
6. The method of claim 5, wherein adjusting the GOP length comprises:
judging whether a video frame with a skip mark exists in a current coded sub-picture;
if not, adjusting the GOP length according to the motion information of the current sub-picture;
if yes, acquiring video frame information and GOP information with skip marks in the current sub-picture; when encoding of a GOP is finished, if the analog I frame of the current sub-picture is judged to be a video frame with a skip mark, the analog I frame is encoded according to the last video frame without the skip mark in the GOP, the value of (M +1) x N is used as the length of the next GOP, and encoding operation is continuously executed, wherein the analog I frame is the I frame in the sub-picture, M represents the number of continuous skip frames, and N is any integer.
7. A video rate control device, configured to a multi-view splicing device, where the multi-view splicing device includes a plurality of image sensors for acquiring image frames, the device comprising:
the acquisition module is used for acquiring sub-image pictures acquired by each image sensor and attribute information of each image sensor;
the parameter determining module is used for determining the coding parameters corresponding to each image sensor according to the attribute information of each image sensor and correspondingly marking the coding parameters in the sub-image pictures acquired by each image sensor;
and the coding module is used for splicing all the sub-picture pictures into a complete picture, carrying out intra-frame coding on the initial frame of the complete picture, and independently coding other frames according to each sub-picture and the corresponding coding parameters.
8. The apparatus of claim 7, further comprising:
and the detection module is used for respectively carrying out motion detection or characteristic detection on each sub-image picture and extracting motion information or characteristic information.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the video rate control method of any of claims 1-6.
10. A computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the video rate control method according to any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911221408.0A CN112911299B (en) | 2019-12-03 | 2019-12-03 | Video code rate control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911221408.0A CN112911299B (en) | 2019-12-03 | 2019-12-03 | Video code rate control method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112911299A true CN112911299A (en) | 2021-06-04 |
| CN112911299B CN112911299B (en) | 2023-02-28 |
Family
ID=76104039
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911221408.0A Active CN112911299B (en) | 2019-12-03 | 2019-12-03 | Video code rate control method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112911299B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115190309A (en) * | 2022-06-30 | 2022-10-14 | 北京百度网讯科技有限公司 | Video frame processing method, training method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137259A (en) * | 2011-04-13 | 2011-07-27 | 清华大学 | Method and device for coding two paths of three-dimensional videos |
| CN104780367A (en) * | 2015-04-13 | 2015-07-15 | 浙江宇视科技有限公司 | Method and device for adjusting length of GOP (group of pictures) dynamically |
| CN105681632A (en) * | 2015-12-31 | 2016-06-15 | 深圳市华途数字技术有限公司 | Multi-head camera and frame synchronization method thereof |
| CN107426491A (en) * | 2017-05-17 | 2017-12-01 | 西安邮电大学 | A kind of implementation method of 360 degree of panoramic videos |
| WO2018175802A1 (en) * | 2017-03-23 | 2018-09-27 | Qualcomm Incorporated | Signalling of video content including sub-picture bitstreams for video coding |
| CN108769600A (en) * | 2018-06-12 | 2018-11-06 | 杭州叙简科技股份有限公司 | A kind of desktop sharing system and its desktop sharing method based on video flowing tune frame per second |
-
2019
- 2019-12-03 CN CN201911221408.0A patent/CN112911299B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137259A (en) * | 2011-04-13 | 2011-07-27 | 清华大学 | Method and device for coding two paths of three-dimensional videos |
| CN104780367A (en) * | 2015-04-13 | 2015-07-15 | 浙江宇视科技有限公司 | Method and device for adjusting length of GOP (group of pictures) dynamically |
| CN105681632A (en) * | 2015-12-31 | 2016-06-15 | 深圳市华途数字技术有限公司 | Multi-head camera and frame synchronization method thereof |
| WO2018175802A1 (en) * | 2017-03-23 | 2018-09-27 | Qualcomm Incorporated | Signalling of video content including sub-picture bitstreams for video coding |
| CN107426491A (en) * | 2017-05-17 | 2017-12-01 | 西安邮电大学 | A kind of implementation method of 360 degree of panoramic videos |
| CN108769600A (en) * | 2018-06-12 | 2018-11-06 | 杭州叙简科技股份有限公司 | A kind of desktop sharing system and its desktop sharing method based on video flowing tune frame per second |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115190309A (en) * | 2022-06-30 | 2022-10-14 | 北京百度网讯科技有限公司 | Video frame processing method, training method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112911299B (en) | 2023-02-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10957358B2 (en) | Reference and non-reference video quality evaluation | |
| US10277901B2 (en) | Encoding a video stream having a privacy mask | |
| CN105472205B (en) | Real-time video noise reduction method and device in encoding process | |
| US10728510B2 (en) | Dynamic chroma key for video background replacement | |
| CN108141634B (en) | Method and apparatus for generating preview image and computer-readable storage medium | |
| CN110198475B (en) | Video processing method, device, equipment, server and readable storage medium | |
| US20140002645A1 (en) | Server and video surveillance method of target place | |
| CN112911299B (en) | Video code rate control method and device, electronic equipment and storage medium | |
| US9076207B1 (en) | Image processing method, system and electronic device | |
| US20200221115A1 (en) | Syntax-based Method of Extracting Region of Moving Object in Compressed Video | |
| US20200106821A1 (en) | Video processing apparatus, video conference system, and video processing method | |
| CN114531528B (en) | Method for video processing and image processing apparatus | |
| CN106303366B (en) | Video coding method and device based on regional classification coding | |
| CN112532982A (en) | Reducing bit rate from surveillance cameras using skip block masks | |
| KR100487374B1 (en) | Apparatus for generating thumbnail image of digital video | |
| KR100487330B1 (en) | Apparatus for generating thumbnail image of digital video | |
| KR102608208B1 (en) | Method, device and system for providing streaming service with improved visibility of image of interest | |
| JP6093009B2 (en) | Encoding method and encoding apparatus | |
| DE102018103652A1 (en) | TILE REUSE IN PICTURE PRODUCTION | |
| US11908340B2 (en) | Magnification enhancement of video for visually impaired viewers | |
| KR101313525B1 (en) | Method and system for improving performance of intelligent surveill system using psnr | |
| US20110280438A1 (en) | Image processing method, integrated circuit for image processing and image processing system | |
| CN114422735A (en) | Video recorder, video data processing method and device and electronic equipment | |
| CN117528141A (en) | Video encoding method, video encoding device, electronic device, storage medium, and program product | |
| CN114422734A (en) | Video recorder, video data processing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |