WO2022134923A1 - 图像数据误检方法、视频会议设备和存储介质 - Google Patents

图像数据误检方法、视频会议设备和存储介质 Download PDF

Info

Publication number
WO2022134923A1
WO2022134923A1 PCT/CN2021/130308 CN2021130308W WO2022134923A1 WO 2022134923 A1 WO2022134923 A1 WO 2022134923A1 CN 2021130308 W CN2021130308 W CN 2021130308W WO 2022134923 A1 WO2022134923 A1 WO 2022134923A1
Authority
WO
WIPO (PCT)
Prior art keywords
image data
video frame
frame image
enhancement information
data
Prior art date
Application number
PCT/CN2021/130308
Other languages
English (en)
French (fr)
Inventor
彭旺春
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2022134923A1 publication Critical patent/WO2022134923A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present application relates to the technical field of image processing, and in particular, to a method for false detection of image data, a video conference device and a storage medium.
  • the H.264 or H.265 codec protocol with good compression effect is generally used to encode and decode the video stream.
  • the multi-core parallel DSP chip is generally used for encoding and decoding. decoding.
  • data tampering is often caused by cache write-back exceptions, direct memory storage DMA exceptions, and the like when transferring image data.
  • the image data false detection method in the existing encoding and decoding system mainly relies on the decoding end to judge the regularity of the syntax elements in the code stream.
  • This method cannot detect the blurry screen caused by the tampering of the residual data during the transmission process, nor can it detect The blurred screen caused by the tampering of the reference frame sequence data in the decoder not only has low detection efficiency, but also has low detection accuracy.
  • the main purpose of the embodiments of the present application is to provide an image data error detection method, a video conference device and a storage medium.
  • regularity judgment is required for each syntax element, which leads to the problem of excessive detection overhead, which improves the efficiency and accuracy of image data false detection of the codec system.
  • an embodiment of the present application provides an image data error detection method, which is applied to a decoding end and includes: acquiring encoded data and supplementary enhancement information output by an encoding end, wherein the supplementary enhancement information at least includes a first check value Decode the encoded data to obtain the video frame image data corresponding to the encoded data; determine the second check value corresponding to the video frame image data, according to the first check value and the second check value The test value determines whether the video frame image data has abnormal data.
  • an embodiment of the present application provides a method for false detection of image data, which is applied to an encoding end, including: acquiring encoded data and supplementary enhancement information; outputting the encoded data and the supplementary enhancement information to a decoding end, so that The decoding end decodes the encoded data to obtain video frame image data, and determines whether the video frame image data is abnormal according to the supplementary enhancement information.
  • embodiments of the present application further provide a video conference device, where the video conference device includes an encoding end and/or a decoding end, and the encoding end includes a processor and a memory, which are stored in the memory and can be accessed by any A computer program executed by the processor and a data bus for realizing connection and communication between the processor and the memory, wherein the computer program is executed by the processor to realize the image data error corresponding to the above-mentioned encoding end. inspection method;
  • the decoding end includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein the When the computer program is executed by the processor, the image data error detection method corresponding to the decoding end described above is implemented.
  • embodiments of the present application further provide a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be processed by one or more programs
  • the controller executes to realize the steps of any one of the image data false detection methods provided in the specification of this application.
  • FIG. 1 is a schematic structural diagram of an encoding and decoding system provided by an embodiment of the present application.
  • FIG. 2 is a schematic structural diagram of another encoding and decoding system provided by an embodiment of the present application.
  • FIG. 3 is a schematic block diagram of the structure of a decoding end provided by an embodiment of the present application.
  • FIG. 4 is a schematic block diagram of the structure of a coding end provided by an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a method for false detection of image data according to an embodiment of the present application
  • FIG. 6 is a schematic block diagram of decoding encoded data provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a video frame image data provided by an embodiment of the present application.
  • FIG. 8 is a schematic flowchart of another method for false detection of image data provided by an embodiment of the present application.
  • FIG. 9 is a schematic flowchart of a sub-step of acquiring encoded data and supplementary enhancement information provided by an embodiment of the present application.
  • FIG. 10 is a schematic block diagram of encoding original video frame image data according to an embodiment of the present application.
  • Embodiments of the present application provide a method for false detection of image data, a video conference device, and a storage medium, wherein the method for false detection of image data can be applied to a decoding end, and the video frame image data obtained by decoding is verified according to supplementary enhancement information , which solves the problem of excessive detection overhead caused by the need to make regularity judgment on each syntax element in the process of image data misdetection in the existing codec system, and improves the efficiency and accuracy of image data misdetection in the codec system.
  • the video conference equipment may include a server or a terminal.
  • the server may be an independent server or a server cluster;
  • the terminal may be an electronic device such as a video conference terminal, a smart phone, a tablet computer, a notebook computer, and a desktop computer.
  • the video conference equipment may include an encoding end and a decoding end, and may also include an encoding end or a decoding end. It can be understood that the encoding end and the decoding end may be in the same video conferencing device, or may be in different video conferencing devices.
  • FIG. 1 is a schematic structural diagram of an encoding and decoding system provided by an embodiment of the present application.
  • the encoding and decoding system includes a photographing device, an encoding end and a decoding end; wherein, the decoding end is connected to the display screen, and the encoding end and the decoding end are in the same video conference equipment.
  • the photographing device may send or copy the captured original video frame image data to the encoding end, and the encoding end encodes the original video frame image data.
  • the encoding end After encoding the original video frame image data, the encoding end obtains encoded data and reconstructed image data, and then the encoding end verifies the reconstructed image data according to the preset verification line number to obtain a first verification value; The first check value and the check line number are used to generate supplementary enhancement information, and the encoded data and supplementary enhancement information are output to the decoding end.
  • the decoding end decodes the encoded data to obtain video frame image data corresponding to the encoded data; and then checks the video frame image data according to the supplementary enhancement information to determine whether the video frame image data is abnormal. When it is determined that the video frame image data is normal data, the video frame image data is displayed on the display screen; when it is determined that the video frame image data is abnormal data, the encoding end is requested to refresh the image immediately.
  • FIG. 2 is a schematic structural diagram of another encoding/decoding system provided by an embodiment of the present application.
  • the encoding and decoding system includes a photographing device, an encoding end and a decoding end; wherein, the decoding end is connected to the display screen, and the encoding end and the decoding end are in different video conference equipment.
  • the switching network element does not perform CRC check on the stream packets, which leads to the problem of data tampering at the transport layer.
  • the amount of calculation can be reduced and the detection efficiency can be improved, which solves the problem that the existing codec system needs to check each syntax element in the process of false detection of image data. Doing regularity judgment leads to the problem of excessive detection overhead.
  • the decoding end obtains encoded data and supplementary enhancement information output by the encoding end, wherein the supplementary enhancement information at least includes a first check value; decode the encoded data to obtain video frame image data corresponding to the encoded data; A second check value corresponding to the video frame image data is determined, and whether the video frame image data is abnormal is determined according to the first check value and the second check value.
  • the encoding end obtains encoded data and supplementary enhancement information; outputs the encoded data and the supplementary enhancement information to the decoding end, so that the decoding end decodes the encoded data to obtain video frame image data, and determines according to the supplementary enhancement information Whether the video frame image data is abnormal.
  • FIG. 3 is a schematic structural block diagram of a decoding end provided by an embodiment of the present application.
  • the decoding end 1000 may include a processor 1001 and a memory 1002, wherein the processor 1001 and the memory 1002 may be connected through a bus, such as an I2C (Inter-integrated Circuit) bus or any other suitable bus.
  • I2C Inter-integrated Circuit
  • the memory 1002 may include a non-volatile storage medium and an internal memory.
  • the nonvolatile storage medium can store operating systems and computer programs.
  • the computer program includes program instructions, and when the program instructions are executed, the processor can execute the image data error detection method corresponding to the decoding end 1000 .
  • the processor 1001 is used for providing computing and control capabilities, and supporting the operation of the entire decoding end 1000 .
  • the processor 1001 is configured to run a computer program stored in the memory 1002, and when executing the computer program, implement the following steps: acquiring encoded data and supplementary enhancement information output by the encoding end, wherein the supplementary enhancement The information includes at least a first check value; decode the encoded data to obtain video frame image data corresponding to the encoded data; determine a second check value corresponding to the video frame image data, according to the first check value The check value and the second check value determine whether the video frame image data is abnormal in data.
  • the supplementary enhancement information further includes a check line number, and the first check value is obtained by verifying the reconstructed image data by the encoding end according to the check line number, and the reconstructed image data is obtained by checking the reconstructed image data.
  • the image data is generated when the encoding end encodes the original video frame image data to obtain the encoded data; when the processor 1001 determines the second check value corresponding to the video frame image data, the processor 1001 is configured to:
  • the verification line number verifies the video frame image data to obtain the second verification value corresponding to the video frame image data.
  • the processor 1001 when the processor 1001 performs verification on the video frame image data according to the verification line number to obtain a second verification value corresponding to the video frame image data, the processor 1001 is configured to: Based on a preset pixel acquisition strategy, acquire at least one target pixel corresponding to the video frame image data according to the verification line number; determine the second verification value according to the sum of the pixel values of the at least one target pixel .
  • the processor 1001 acquires at least one target pixel corresponding to the video frame image data according to the verification line number based on a preset pixel acquisition strategy, so as to realize: the verification All pixels of the target row corresponding to the row number are numbered, and the number of the end pixel of the target row is determined; the first target pixel of the target row is determined, and based on the preset pixel interval value and the end pixel , and determine the next target pixel in sequence.
  • the processor 1001 is further configured to: when it is determined that the video frame image data is normal, display the video frame image data; when it is determined that the video frame image data is abnormal, to the encoding end Request an immediate refresh of the image frame.
  • the processor 1001 may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuit (application specific integrated circuit, ASIC) , Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • FIG. 4 is a schematic block diagram of the structure of an encoder provided by an embodiment of the present application.
  • the encoding end 2000 may include a processor 2001 and a memory 2002, wherein the processor 2001 and the memory 2002 may be connected through a bus, such as an I2C (Inter-integrated Circuit) bus or any other suitable bus.
  • I2C Inter-integrated Circuit
  • the memory 2002 may include a non-volatile storage medium and an internal memory.
  • the nonvolatile storage medium can store operating systems and computer programs.
  • the computer program includes program instructions, and when the program instructions are executed, the processor can execute the image data error detection method corresponding to the encoding end 2000 .
  • the processor 2001 is used to provide computing and control capabilities and support the operation of the entire encoding end 2000 .
  • the processor 2001 is configured to run a computer program stored in the memory 2002, and when executing the computer program, implement the following steps: acquiring encoded data and supplementary enhancement information; converting the encoded data and the supplementary enhancement information The information is output to the decoding end, so that the decoding end decodes the encoded data to obtain video frame image data, and determines whether the video frame image data is abnormal according to the supplementary enhancement information.
  • the processor 2001 when the processor 2001 realizes the acquisition of encoded data and supplementary enhancement information, the processor 2001 is configured to: acquire the original video frame image data collected by the photographing device; encode the original video frame image data to obtain the encoded data and the reconstructed image data corresponding to the encoded data; and verifying the reconstructed image data to obtain the supplementary enhancement information.
  • the processor 2001 when the processor 2001 performs verification on the reconstructed image data to obtain the supplementary enhancement information, the processor 2001 is configured to: determine the the verification line number corresponding to the reconstructed image data; verify the reconstructed image data according to the verification row number to obtain a first verification value corresponding to the reconstructed image data; according to the first verification value With the check line number, the supplementary enhancement information is determined.
  • the processor 2001 can be a central processing unit (Central Processing Unit, CPU), and the processor can also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuit (application specific integrated circuit, ASIC) , Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • FIG. 5 is a schematic flowchart of a method for false detection of image data provided by an embodiment of the present application.
  • the image data error detection method can be applied to the decoding end. By verifying the decoded video frame image data according to the supplementary enhancement information, it solves the problem that the existing codec system needs to check each syntax element in the process of image data error detection in the existing encoding and decoding system. Doing regularity judgment leads to the problem of excessive detection overhead, which improves the efficiency and accuracy of image data false detection in the codec system.
  • the image data error detection method includes steps S101 to S103.
  • Step S101 Acquire the encoded data and supplementary enhancement information output by the encoding end, wherein the supplementary enhancement information includes at least a first check value.
  • Supplemental Enhancement Information is a concept in the code stream category. Supplemental Enhancement Information provides a way to add information to the video code stream. It is the H.264/H.265 video codec protocol. a feature of .
  • the supplementary enhancement information is generated by the encoding end according to the reconstructed image data, and the supplementary enhancement information further includes the check line number.
  • the first check value is obtained by verifying the reconstructed image data by the encoding end according to the check line number, and the reconstructed image data is generated when the encoding end encodes the original video frame image data to obtain encoded data.
  • the original video frame image data refers to the image data collected by the photographing device and not encoded.
  • the photographing device may be a built-in camera of the video conference terminal, and may also include electronic devices with photographing functions, such as a notebook, a mobile phone, and a surveillance camera.
  • the encoding end may verify the reconstructed image data according to a preset verification line number to obtain a first verification value; and then generate supplementary enhancement information according to the first verification value and the verification row number.
  • the preset check line number refers to the line number corresponding to the pixel in the reconstructed image data. For example, line 1 pixels, line 3 pixels, line 7 pixels, etc. in the reconstructed image data.
  • the check line number is used for the encoding end to determine the position of the target pixel when calculating the first check value corresponding to the reconstructed image data, and is also used for the decoding end to calculate the second corresponding to the decoded video frame image data. When checking the value, determine the position of the target pixel.
  • the decoding end can obtain the encoded data and supplementary enhancement information output by the encoding end through wired/wireless transmission, and can also obtain the encoded data and supplementary enhancement information output by the encoding end by copying the external storage device .
  • the specific manner of acquiring the encoded data and supplementary enhancement information output by the encoding end is not limited here.
  • the check line number and the first check value can be obtained through the supplementary enhancement information, and then the decoded video frame image can be paired with the check line number and the first check value. Data is checked.
  • Step S102 Decode the encoded data to obtain video frame image data corresponding to the encoded data.
  • FIG. 6 is a schematic block diagram of decoding encoded data provided by an embodiment of the present application.
  • the decoding end may be based on the H.264/H.265 encoding and decoding protocol, and the decoding end inputs the encoded data into the decoder for decoding, and outputs video frame image data corresponding to the encoded data.
  • the decoder is a single-input single-output channel, and after decoding the encoded data, the decoder will not additionally output reconstructed image data.
  • video frame image data corresponding to the encoded data can be obtained.
  • Step S103 Determine a second check value corresponding to the video frame image data, and determine whether the video frame image data has abnormal data according to the first check value and the second check value.
  • the supplementary enhancement information may further include a check line number corresponding to the reconstructed image data.
  • determining the second verification value corresponding to the video frame image data may include: verifying the video frame image data according to the verification line number to obtain the second verification value corresponding to the video frame image data.
  • At least one target pixel corresponding to the video frame image data can be acquired according to the verification line number based on a preset pixel acquisition strategy; according to the sum of the pixel values of the at least one target pixel , to determine the second check value.
  • the preset pixel acquisition strategy refers to extracting at least one target pixel of the row where the verification row number is located within the width value of the video frame image data.
  • acquiring at least one target pixel corresponding to the video frame image data according to the verification line number based on a preset pixel acquisition strategy includes: numbering all the pixels of the target row corresponding to the verification row number, and determining Number of the last pixel of the target row; determine the first target pixel of the target row, and determine the next target pixel in turn based on the preset pixel interval value and the number of the last pixel.
  • FIG. 7 is a schematic diagram of video frame image data provided by an embodiment of the present application.
  • the check line number is 1, the first line of the video frame image data is used as the target line; then all the pixels in the first line are numbered, for example, pixel 0, pixel 1, pixel 2, ..., pixel n.
  • pixel n refers to the number of the last pixel of the first row. If the check line number further includes 3, all the pixels in the third line may also be numbered.
  • the preset pixel interval value may be set according to the actual situation, and the specific value is not limited herein. In this embodiment of the present application, the preset pixel interval value may be 128.
  • the next target pixel is determined to be pixel 256 in turn; wherein, the coding of the target pixel is not greater than that of the end pixel. number n.
  • the second check value may be determined according to the sum of the pixel values of the at least one target pixel.
  • the process of determining the second check value can be implemented through a loop conditional expression, as shown below:
  • j represents the number of the pixel
  • i represents the check line number
  • checkSum represents the second check value
  • Y i [j] represents the pixel value of the j-th pixel in the i-th row.
  • the second check value checkSum is equal to Y 1 [0]+Y 1 [128]+Y 1 [256]+Y 1 [384].
  • the second check value can be conveniently and accurately determined by calculating the sum of the pixel values of the at least one target pixel. .
  • the second check value corresponding to the video frame image data after the second check value corresponding to the video frame image data is determined, it may be determined whether the video frame image data is abnormal according to the first check value and the second check value.
  • determining whether the video frame image data is abnormal according to the first check value and the second check value may include: when the first check value is equal to the second check value, determining whether the video frame image data is abnormal normal.
  • the first check value is obtained by verifying the reconstructed image data at the encoding end according to the check line number, and the reconstructed image data is the same as the image data of the video frame before encoding, it can be obtained according to the first check.
  • the value and the second check value determine whether the video frame image data obtained by decoding is consistent with the video frame image data before encoding.
  • the first check value is equal to the second check value, it means that the decoded video frame image data is consistent with the encoded data, the encoded data has not been tampered with during the transmission process, and the encoded data is in the decoding process. Nor has it been tampered with or decoded incorrectly. Therefore, it can be determined that the decoded video frame image data is normal.
  • the video frame image data when it is determined that the video frame image data is normal, the video frame image data is displayed.
  • video frame image data may be displayed in a display screen.
  • the display screen is the display screen in the video conference equipment corresponding to the decoding end.
  • determining whether the video frame image data is abnormal according to the first check value and the second check value may include: when the first check value is not equal to the second check value, determining whether the video frame image data is abnormal Data exception.
  • the decoded video frame image data is inconsistent with the encoded data. Therefore, it can be determined that the decoded video frame image data is abnormal.
  • the reason for the abnormality may be that the encoded data is tampered with during network transmission, or the encoded data is tampered with during the decoding process or a decoding error occurs.
  • a request is made to the encoder to immediately refresh the image frame.
  • the function of the IDR (Instantaneous Decoding Refresh, immediately refresh the image) frame is to refresh immediately, so that the error does not propagate, starting from the IDR frame, re-determine a new sequence to start decoding.
  • the decoding end may send an IDR frame request message to the encoding end through wired or wireless communication, so that the encoding end returns an IDR frame according to the received IDR frame request message.
  • the decoding end may be based on protocols such as SIP protocol (Session Initiation Protocol, session initiation protocol), H323 protocol (audio and video transmission protocol) or RTCP protocol (Real-time Control Protocol, real-time transmission control protocol) and other protocols and coding
  • SIP protocol Session Initiation Protocol, session initiation protocol
  • H323 protocol audio and video transmission protocol
  • RTCP protocol Real-time Control Protocol, real-time transmission control protocol
  • the terminal establishes a communication connection and sends an IDR frame request message to the encoding terminal.
  • the decoding end when the decoding end encodes the image data of the IDR frame after receiving the IDR frame, it can immediately clear the reference frame queue, output or discard all the decoded video frame image data, and re-find the parameter set. , and start a new sequence. In this way, if there is an error in the image data of the previous video frame, there is an opportunity for resynchronization here.
  • the encoding end is requested to refresh the image frame immediately, so that the image can be refreshed automatically, thereby improving the user experience.
  • the image data false detection method, video conference device and storage medium can obtain the check line number and the first check value through the supplementary enhancement information by acquiring the encoded data and supplementary enhancement information output by the encoding end, and can be used subsequently.
  • the decoded video frame image data is checked by checking the line number and the first check value; by decoding the encoded data, the video frame image data corresponding to the encoded data can be obtained; Image data is verified without regularity judgment for each syntax element, which can improve the efficiency of false detection of image data; through the preset pixel acquisition strategy, at least one corresponding to the video frame image data is acquired according to the verification line number.
  • the second check value can be conveniently and accurately determined by calculating the sum of the pixel values of at least one target pixel; by comparing the first check value with the second check value, it can be conveniently and accurately determined Whether the video frame image data is abnormal, thus improving the efficiency and accuracy of false detection of image data; by requesting the encoder to immediately refresh the image frame when it is determined that the video frame image data is abnormal, the image can be refreshed automatically, thereby improving the user experience. experience.
  • FIG. 8 is a schematic flowchart of another method for false detection of image data provided by an embodiment of the present application.
  • the image data error detection method can be applied to the encoding end. By outputting the encoded data and the supplementary enhancement information to the decoding end together, the decoding end can check the decoded video frame image data according to the supplementary enhancement information, which solves the problem of existing problems.
  • the codec system needs to make regularity judgment on each syntax element, which leads to the problem of excessive detection overhead, which improves the efficiency and accuracy of the codec system for false detection of image data.
  • the image data error detection method includes steps S201 and S202.
  • Step S201 Acquire encoded data and supplementary enhancement information.
  • FIG. 9 is a schematic flowchart of sub-steps of acquiring encoded data and supplementary enhancement information provided by an embodiment of the present application, which may specifically include steps S2011 to S2013 .
  • Step S2011 Obtain the original video frame image data collected by the photographing device.
  • the encoding end may acquire the original video frame image data captured by the camera in real time.
  • the original video frame image data refers to the image data collected by the photographing device and not encoded.
  • the photographing apparatus may include electronic devices with photographing functions, such as a notebook, a mobile phone, and a surveillance camera.
  • the photographing device may be an electronic device that comes with the video conferencing device where the encoding terminal is located, or may be an external electronic device with a photographing function.
  • the original video frame image data when acquiring the original video frame image data collected by the photographing device, the original video frame image data may be numbered. For example, the first frame of video frame image data, the second frame of video frame image data, and the third frame of video frame image data. Therefore, when the original video frame image data is encoded, reconstructed image data corresponding to each frame of video frame image data is obtained.
  • Step S2012 Encode the original video frame image data to obtain the encoded data and reconstructed image data corresponding to the encoded data.
  • the encoding end may encode the original video frame image data to obtain encoded data and reconstructed image data.
  • FIG. 10 is a schematic block diagram of encoding original video frame image data according to an embodiment of the present application. As shown in FIG. 10 , based on the H.264/H.265 codec protocol, the encoding end inputs the original video frame image data into the encoder for encoding, and outputs the encoded data and reconstructed image data.
  • the encoder is a channel with single input and dual output; therefore, in the encoding process, the encoder encodes each frame of image data, outputs the encoded data, and generates reconstructed image data in the reconstruction area.
  • the first frame of encoded data and the first frame of reconstructed image data corresponding to the first frame of video frame image data may be obtained.
  • a reconstructed image corresponding to the encoded data and the encoded data can be obtained, and the reconstructed image data can be checked subsequently to obtain supplementary enhancement information.
  • Step S2013 Verify the reconstructed image data to obtain the supplementary enhancement information.
  • verifying the reconstructed image data to obtain supplementary enhancement information may include: determining the verification line number corresponding to the reconstructed image data according to the frame number and height value corresponding to the reconstructed image data; The reconstructed image data is verified by the number, and the first verification value corresponding to the reconstructed image data is obtained; the supplementary enhancement information is determined according to the first verification value and the verification line number.
  • the height value of the reconstructed image data may be the total number of rows of pixels of the reconstructed image data. Therefore, the height value can be determined from the total number of lines of actual pixels of the reconstructed image data.
  • the check line number when determining the check line number corresponding to the reconstructed image data according to the frame number and height value corresponding to the reconstructed image data, the check line number may be determined according to the remainder of the ratio of the frame number and the height value.
  • the reconstructed image data of the first frame its frame number is 1; if the height value of the reconstructed image data of the first frame is 10, the remainder of the ratio of the frame number 1 to the height value of 10 is 1, that is, the check line number is 1.
  • the reconstructed image data of the second frame its frame number is 2; if the height value of the reconstructed image data of the second frame is 10, the remainder of the ratio of the frame number 2 to the height value of 10 is 2, that is, the check line number is 2.
  • the reconstructed image data of the 11th frame its frame number is 11; if the height value of the reconstructed image data of the 11th frame is 10, the remainder of the ratio of the frame number 11 to the height value 10 is 1, that is, the check line number is 1.
  • verifying the reconstructed image data according to the verification row number to obtain the first verification value corresponding to the reconstructed image data may include: acquiring the reconstructed image data according to the verification row number based on a preset pixel acquisition strategy.
  • the image data corresponds to at least one target pixel; the first check value is determined according to the sum of the pixel values of the at least one target pixel.
  • the process of determining the second check value can be implemented through a loop conditional expression, as shown below:
  • checkSum represents the first check value.
  • the supplementary enhancement information may be determined according to the first check value and the check line number.
  • the supplementary enhancement information includes the first check value A and the check line number B.
  • the verification line number corresponding to the reconstructed image data can be determined according to the frame number and height value corresponding to the reconstructed image data.
  • the first check value, and then the supplementary enhancement information can be obtained according to the first check value and the check line number.
  • Step S202 Output the encoded data and the supplementary enhancement information to a decoding end, so that the decoding end decodes the encoded data to obtain video frame image data, and determines the video frame according to the supplementary enhancement information Whether the image data is abnormal.
  • the encoding end can output the encoded data and supplementary enhancement information to the decoding end through wired/wireless transmission, and can also output the encoded data and the supplementary enhancement information to the decoding end by copying the external storage device .
  • the specific output method is not limited here.
  • the decoder may decode the encoded data to obtain video frame image data, and determine whether the video frame image data is abnormal according to the supplementary enhancement information. For example, the decoding end may determine whether the video frame image data is abnormal according to the first check value in the supplementary enhancement information.
  • the decoding end can check the decoded video frame image data according to the supplementary enhancement information, which solves the problem that the existing encoding and decoding systems need to be in the process of false detection of image data.
  • the regularity judgment of each syntax element leads to the problem of excessive detection overhead, which improves the efficiency and accuracy of image data false detection in the codec system.
  • the method may further include: if receiving the IDR frame request information sent by the decoding end, returning an IDR frame to the decoding end according to the IDR frame request information.
  • the decoder can re-determine a new sequence according to the IDR frame and start decoding, so as to automatically refresh the image, thereby improving the user experience.
  • the verification line number corresponding to the reconstructed image data can be determined; by verifying the reconstructed image data according to the verification line number, it is convenient and Accurately obtain the first check value corresponding to the reconstructed image data, and then obtain supplementary enhancement information according to the first check value and the check line number; by outputting the encoded data and the supplementary enhancement information to the decoding end together, the decoding
  • the terminal verifies the decoded video frame image data according to the supplementary enhancement information, which solves the problem that the existing codec system needs to make regularity judgment on each syntax element during the process of image data misdetection, resulting in excessive detection overhead.
  • the decoding end can re-determine a new sequence according to the IDR frame and start decoding, and automatically refresh the image, thereby improving the user experience. experience.
  • Embodiments of the present application further provide a storage medium for computer-readable storage, where the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the following: Steps of any method for false detection of image data provided in the description of the embodiments of this application.
  • the program is loaded by the processor, and the following steps may be performed: acquiring the encoded data and supplementary enhancement information output by the encoding end, wherein the supplementary enhancement information at least includes a first check value; decoding the encoded data to obtain video frame image data corresponding to the encoded data; determining a second check value corresponding to the video frame image data, and determining whether the video frame image data is based on the first check value and the second check value Data exception.
  • the program is loaded by the processor, and can perform the following steps: acquiring encoded data and supplementary enhancement information; outputting the encoded data and the supplementary enhancement information to a decoding end, so that the decoding end can perform the following steps on the encoded data.
  • Decoding is performed to obtain video frame image data, and whether the video frame image data is abnormal is determined according to the supplementary enhancement information.
  • the storage medium may be an internal storage unit of the video conference device described in the foregoing embodiments, such as a hard disk or a memory of the video conference device.
  • the storage medium may also be an external storage device of the video conferencing device, such as a plug-in hard disk equipped on the video conferencing device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) Card, Flash Card, etc.
  • the embodiments of the present application provide an image data error detection method, a video conference device, and a storage medium.
  • the first check value corresponding to the encoded data can be obtained by the supplementary enhancement information;
  • the video frame image data corresponding to the encoded data can be obtained;
  • the second check value corresponding to the video frame image data it can be determined whether the video frame image data is based on the first check value and the second check value.
  • the data anomaly solves the problem of excessive detection overhead caused by the need to make regularity judgments on each syntax element in the process of image data misdetection in the existing codec system, and improves the efficiency and accuracy of image data misdetection in the codec system sex.
  • Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • computer storage media includes both volatile and nonvolatile implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data flexible, removable and non-removable media.
  • Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may Any other medium used to store desired information and which can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本申请提供了一种图像数据误检方法、视频会议设备和存储介质，属于图像处理技术领域。该方法包括：获取编码端输出的编码数据和补充增强信息，其中，所述补充增强信息至少包括第一校验值；对所述编码数据进行解码，获得所述编码数据对应的视频帧图像数据；确定所述视频帧图像数据对应的第二校验值，根据所述第一校验值和所述第二校验值确定所述视频帧图像数据是否数据异常。

Description

图像数据误检方法、视频会议设备和存储介质
相关申请的交叉引用
本申请要求享有2020年12月24日提交的名称为“图像数据误检方法、视频会议设备和存储介质”的中国专利申请CN202011556473.1的优先权，其全部内容通过引用并入本申请中。
技术领域
本申请涉及图像处理技术领域，尤其涉及一种图像数据误检方法、视频会议设备和存储介质。
背景技术
在视频会议系统中，一般采用压缩效果好的H.264或H.265编解码协议对视频流进行编码和解码，而为了提高编解码的效率和降低功效，一般使用多核并行的DSP芯片进行编解码。在现有的多核系统中，传输图像数据时常常会因为高速缓冲存储器回写异常、直接存储器存储DMA异常等引起数据篡改。现有编解码系统中的图像数据误检方法，主要依赖于解码端判断码流中的语法元素的正则性，该方法无法检测出传输过程中残差数据被篡改引起的花屏，也无法检测出解码器中参考帧序列数据被篡改引起的花屏，不仅检测效率低，而且检测的准确性也不高。
因此如何提高编解码系统中的图像数据误检的效率和准确性成为亟需解决的问题。
发明内容
本申请实施例的主要目的在于提供一种图像数据误检方法、视频会议设备和存储介质，通过根据补充增强信息对解码得到的视频帧图像数据进行校验，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性。
第一方面，本申请实施例提供一种图像数据误检方法，应用于解码端，包括：获取编码端输出的编码数据和补充增强信息，其中，所述补充增强信息至少包括第一校验值；对所述编码数据进行解码，获得所述编码数据对应的视频帧图像数据；确定所述视频帧图像数据对应的第二校验值，根据所述第一校验值和所述第二校验值确定所述视频帧图像数据是否数据异常。
第二方面，本申请实施例提供一种图像数据误检方法，应用于编码端，包括：获取编码数据和补充增强信息；将所述编码数据和所述补充增强信息输出至解码端，以使所述解 码端对所述编码数据进行解码得到视频帧图像数据，并根据所述补充增强信息确定所述视频帧图像数据是否数据异常。
第三方面，本申请实施例还提供一种视频会议设备，所述视频会议设备包括编码端和/或解码端，所述编码端包括处理器、存储器、存储在所述存储器上并可被所述处理器执行的计算机程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线，其中所述计算机程序被所述处理器执行时实现如上述编码端对应的图像数据误检方法；
所述解码端包括处理器、存储器、存储在所述存储器上并可被所述处理器执行的计算机程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线，其中所述计算机程序被所述处理器执行时实现如上述解码端对应的图像数据误检方法。
第四方面，本申请实施例还提供一种存储介质，用于计算机可读存储，其中，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如本申请说明书提供的任一项图像数据误检方法的步骤。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本申请。
附图说明
为了更清楚地说明本申请实施例技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种编解码系统的结构示意图；
图2是本申请实施例提供的另一种编解码系统的结构示意图；
图3是本申请实施例提供的一种解码端的结构示意性框图；
图4是本申请实施例提供的一种编码端的结构示意性框图；
图5为本申请实施例提供的一种图像数据误检方法的示意性流程图；
图6是本申请实施例提供的一种对编码数据进行解码的示意性框图；
图7是本申请实施例提供的一种视频帧图像数据的示意图；
图8是本申请实施例提供的另一种图像数据误检方法的示意性流程图；
图9是本申请实施例提供的一种获取编码数据和补充增强信息的子步骤的示意性流程图；
图10是本申请实施例提供的一种对原始的视频帧图像数据进行编码的示意性框图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
附图中所示的流程图仅是示例说明，不是必须包括所有的内容和操作/步骤，也不是必须按所描述的顺序执行。例如，有的操作/步骤还可以分解、组合或部分合并，因此实际执行的顺序有可能根据实际情况改变。
应当理解，在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样，除非上下文清楚地指明其它情况，否则单数形式的“一”、“一个”及“该”意在包括复数形式。
本申请实施例提供一种图像数据误检方法、视频会议设备和存储介质，其中，该图像数据误检方法可以应用于解码端，通过根据补充增强信息对解码得到的视频帧图像数据进行校验，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性。
示例性的，视频会议设备可以包括服务器或终端。其中，服务器可以为独立的服务器，也可以为服务器集群；终端可以是视频会议终端、智能手机、平板电脑、笔记本电脑和台式电脑等电子设备。
其中，视频会议设备可以包括编码端与解码端，也可以包括编码端或解码端。可以理解的是，编码端与解码端可以在同一视频会议设备中，也可以在不同的视频会议设备中。
请参阅图1，图1是本申请实施例提供的一种编解码系统的结构示意图。如图1所示，编解码系统包括拍摄装置、编码端和解码端；其中，解码端与显示屏连接，编码端与解码端在同一视频会议设备中。
示例性的，拍摄装置可以将采集的原始的视频帧图像数据发送或拷贝至编码端，由编码端对原始的视频帧图像数据进行编码。编码端在对原始的视频帧图像数据进行编码后，得到编码数据与重建图像数据，然后编码端根据预设的校验行号对重建图像数据进行校验，得到第一校验值；并根据第一校验值与校验行号，生成补充增强信息，将编码数据与补充增强信息输出至解码端。解码端对编码数据进行解码，得到编码数据对应的视频帧图像数据；然后根据补充增强信息对视频帧图像数据进行校验，以确定视频帧图像数据是否数据异常。在确定视频帧图像数据是数据正常时，在显示屏显示视频帧图像数据；在确定视频帧图像数据是数据异常时，向编码端请求立即刷新图像。
需要说明的是，通过将编码端与解码端设置在同一视频会议设备中，可以解决现有编解码系统为了提高编解码的效率和降低功效，一般使用多核并行的DSP芯片进行编解码以 及在arm芯片上运行应用层，经常会出现由于高速缓冲存储器回写异常、直接存储器存储异常等引起数据篡改的问题。此外，由于编码端与解码端设置在同一视频会议设备中，因此编码端与解码端之间的交互无须网络通信，从而可以解决现有编解码系统在网络传输时，许多中间的交换网元为了降低性能消耗，并不对码流包进行CRC校验(Cyclic Redundancy Check，循环冗余校验)，导致传输层也存在数据篡改的问题。
请参阅图2，图2是本申请实施例提供的另一种编解码系统的结构示意图。如图2所示，编解码系统包括拍摄装置、编码端以及解码端；其中，解码端与显示屏连接，编码端与解码端在不同的视频会议设备中。
需要说明的是，当编码端与解码端处于不同的视频会议设备时，通过根据补充增强信息对解码得到的视频帧图像数据进行校验，可以解决现有编解码系统在网络传输时，许多中间的交换网元为了降低性能消耗，并不对码流包进行CRC校验，导致传输层也存在数据篡改的问题。此外，通过根据补充增强信息对解码得到的视频帧图像数据进行校验，还可以减少计算量和提高检测效率，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题。
在一种实施方式中，解码端获取编码端输出的编码数据和补充增强信息，其中，补充增强信息至少包括第一校验值；对编码数据进行解码，获得编码数据对应的视频帧图像数据；确定视频帧图像数据对应的第二校验值，根据第一校验值和第二校验值确定视频帧图像数据是否数据异常。
在一种实施方式中，编码端获取编码数据和补充增强信息；将编码数据和补充增强信息输出至解码端，以使解码端对编码数据进行解码得到视频帧图像数据，并根据补充增强信息确定视频帧图像数据是否数据异常。
请参阅图3，图3是本申请实施例提供的一种解码端的结构示意性框图。如图3所示，解码端1000可以包括处理器1001和存储器1002，其中，处理器1001以及存储器1002可以通过总线连接，该总线比如为I2C(Inter-integrated Circuit)总线等任意适用的总线。
其中，存储器1002可以包括非易失性存储介质和内存储器。非易失性存储介质可存储操作系统和计算机程序。该计算机程序包括程序指令，该程序指令被执行时，可使得处理器执行解码端1000对应的图像数据误检方法。
其中，处理器1001用于提供计算和控制能力，支撑整个解码端1000的运行。
在一种实施方式中，处理器1001用于运行存储在存储器1002中的计算机程序，并在执行计算机程序时实现如下步骤：获取编码端输出的编码数据和补充增强信息，其中，所述补充增强信息至少包括第一校验值；对所述编码数据进行解码，获得所述编码数据对应的视频帧图像数据；确定所述视频帧图像数据对应的第二校验值，根据所述第一校验值和 所述第二校验值确定所述视频帧图像数据是否数据异常。
在一种实施方式中，所述补充增强信息还包括校验行号，所述第一校验值为所述编码端根据所述校验行号对重建图像数据进行校验得到，所述重建图像数据由所述编码端对原始的视频帧图像数据进行编码得到所述编码数据时生成；处理器1001在实现确定所述视频帧图像数据对应的第二校验值时，用于实现：根据所述校验行号对所述视频帧图像数据进行校验，得到所述视频帧图像数据对应的所述第二校验值。
在一种实施方式中，处理器1001在实现根据所述校验行号对所述视频帧图像数据进行校验，得到所述视频帧图像数据对应的第二校验值时，用于实现：基于预设的像素获取策略，根据所述校验行号获取所述视频帧图像数据对应的至少一个目标像素；根据所述至少一个目标像素的像素值之和，确定所述第二校验值。
在一种实施方式中，处理器1001在实现基于预设的像素获取策略，根据所述校验行号获取所述视频帧图像数据对应的至少一个目标像素，用于实现：对所述校验行号对应的目标行的全部像素进行编号，并确定所述目标行的末尾像素的编号；确定所述目标行的首个所述目标像素，并基于预设的像素间隔值以及所述末尾像素的编号，依次确定下一个所述目标像素。
在一种实施方式中，处理器1001还用于实现：当确定所述视频帧图像数据正常时，显示所述视频帧图像数据；当确定所述视频帧图像数据异常时，向所述编码端请求立即刷新图像帧。
处理器1001可以是中央处理单元(Central Processing Unit，CPU)，该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
请参阅图4，图4是本申请实施例提供的一种编码端的结构示意性框图。如图4所示，编码端2000可以包括处理器2001和存储器2002，其中，处理器2001以及存储器2002可以通过总线连接，该总线比如为I2C(Inter-integrated Circuit)总线等任意适用的总线。
其中，存储器2002可以包括非易失性存储介质和内存储器。非易失性存储介质可存储操作系统和计算机程序。该计算机程序包括程序指令，该程序指令被执行时，可使得处理器执行编码端2000对应的图像数据误检方法。
其中，处理器2001用于提供计算和控制能力，支撑整个编码端2000的运行。
在一种实施方式中，处理器2001用于运行存储在存储器2002中的计算机程序，并在执行计算机程序时实现如下步骤：获取编码数据和补充增强信息；将所述编码数据和所述 补充增强信息输出至解码端，以使所述解码端对所述编码数据进行解码得到视频帧图像数据，并根据所述补充增强信息确定所述视频帧图像数据是否数据异常。
在一种实施方式中，处理器2001在实现获取编码数据和补充增强信息时，用于实现：获取拍摄装置采集的原始的视频帧图像数据；对原始的所述视频帧图像数据进行编码，得到所述编码数据与所述编码数据对应的重建图像数据；对所述重建图像数据进行校验，得到所述补充增强信息。
在一种实施方式中，处理器2001在实现对所述重建图像数据进行校验，得到所述补充增强信息时，用于实现：根据所述重建图像数据对应的帧号与高度值，确定所述重建图像数据对应的校验行号；根据所述校验行号对所述重建图像数据进行校验，得到所述重建图像数据对应的第一校验值；根据所述第一校验值与所述校验行号，确定所述补充增强信息。
处理器2001可以是中央处理单元(Central Processing Unit，CPU)，该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
下面结合附图，对本申请的一些实施例作详细说明。在不冲突的情况下，下述的实施例及实施例中的特征可以相互组合。
请参阅图5，图5为本申请实施例提供的一种图像数据误检方法的示意性流程图。该图像数据误检方法可应用于解码端，通过根据补充增强信息对解码得到的视频帧图像数据进行校验，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性。该图像数据误检方法包括步骤S101至步骤S103。
步骤S101：获取编码端输出的编码数据和补充增强信息，其中，所述补充增强信息至少包括第一校验值。
需要说明的是，补充增强信息(Supplemental Enhancement Information，SEI)是码流范畴里面的概念，补充增强信息提供了向视频码流中加入信息的办法，是H.264/H.265视频编解码协议的一项特性。
在本申请实施例中，补充增强信息是编码端根据重建图像数据生成的，补充增强信息还包括校验行号。其中，第一校验值为编码端根据校验行号对重建图像数据进行校验得到，重建图像数据由编码端对原始的视频帧图像数据进行编码得到编码数据时生成。可以理解的是，原始的视频帧图像数据是指拍摄装置采集的且未进行编码的图像数据。
示例性的，拍摄装置可以为视频会议终端内置的摄像头，也可以包括笔记本、移动手 机以及监控摄像头等具有拍摄功能的电子设备。
示例性的，编码端可以根据预设的校验行号对重建图像数据进行校验，得到第一校验值；然后根据第一校验值与校验行号，生成补充增强信息。
需要说明的是，预设的校验行号是指重建图像数据中的像素对应的行号。例如，重建图像数据中的第1行像素、第3行像素、第7行像素等等。
示例性的，校验行号用于编码端在计算重建图像数据对应的第一校验值时，确定目标像素的位置，还用于解码端在计算解码后的视频帧图像数据对应的第二校验值时，确定目标像素的位置。
在本申请实施例中，解码端可以通过有线/无线的传输方式，获取编码端输出的编码数据和补充增强信息，还可以通过外部存储设备的拷贝方式获取编码端输出的编码数据和补充增强信息。获取编码端输出的编码数据和补充增强信息的具体方式，在此不作限定。
通过获取编码端输出的编码数据和补充增强信息，可以通过补充增强信息得到校验行号与第一校验值，后续可以通过校验行号与第一校验值对解码后的视频帧图像数据进行校验。
步骤S102：对所述编码数据进行解码，获得所述编码数据对应的视频帧图像数据。
请参阅图6，图6是本申请实施例提供的一种对编码数据进行解码的示意性框图。如图6所示，解码端可以基于H.264/H.265编解码协议，解码端将编码数据输入解码器中进行解码，输出编码数据对应的视频帧图像数据。需要说明的是，解码器为单输入单输出的通道，解码器在对编码数据进行解码后，不会另外输出重建图像数据。
通过对编码数据进行解码，可以得到编码数据对应的视频帧图像数据。
步骤S103、确定所述视频帧图像数据对应的第二校验值，根据所述第一校验值和所述第二校验值确定所述视频帧图像数据是否数据异常。
在本申请实施例中，补充增强信息还可以包括重建图像数据对应的校验行号。
在一些实施例，确定视频帧图像数据对应的第二校验值，可以包括：根据校验行号对视频帧图像数据进行校验，得到视频帧图像数据对应的第二校验值。
通过根据校验行号对视频帧图像数据进行校验，无需对每个语法元素做正则性判断，从而可以提高图像数据误检的效率。
示例性的，在对视频帧图像进行校验时，可以基于预设的像素获取策略，根据校验行号获取视频帧图像数据对应的至少一个目标像素；根据至少一个目标像素的像素值之和，确定第二校验值。
需要说明的是，预设的像素获取策略是指在视频帧图像数据的宽度值内，提取校验行号所在行的至少一个目标像素。
在一些实施方式中，基于预设的像素获取策略，根据校验行号获取视频帧图像数据对应的至少一个目标像素，包括：对校验行号对应的目标行的全部像素进行编号，并确定目标行的末尾像素的编号；确定目标行的首个目标像素，并基于预设的像素间隔值以及末尾像素的编号，依次确定下一个目标像素。
请参阅图7，图7是本申请实施例提供的一种视频帧图像数据的示意图。如图7所示，若校验行号为1，则将视频帧图像数据的第1行作为目标行；然后对第1行的全部像素进行编号，例如，像素0，像素1，像素2，...，像素n。其中，像素n是指第1行的末尾像素的编号。若校验行号还包括3，则还可以对第3行的全部像素进行编号。
示例性的，预设的像素间隔值可以根据实际情况设定，具体数值在此不作限定。在本申请实施例中，预设的像素间隔值可以是128。
如图7所示，当确定目标行的首个目标像素为像素0时，基于预设的像素间隔值128，依次确定下一个目标像素为像素256；其中，目标像素的编码不大于末尾像素的编号n。
在确定视频帧图像数据对应的至少一个目标像素之后，可以根据至少一个目标像素的像素值之和，确定第二校验值。
在本申请实施例中，确定第二校验值的过程，可以通过循环条件表达式来实现，如下所示：
Figure PCTCN2021130308-appb-000001
其中，j表示像素的编号；i表示校验行号；checkSum表示第二校验值；Y i[j]表示第i行第j个像素的像素值。
示例性的，对于第1行，若末尾像素的编号n为500，则第二校验值checkSum等于Y 1[0]+Y 1[128]+Y 1[256]+Y 1[384]。
通过基于预设的像素获取策略，根据校验行号获取视频帧图像数据对应的至少一个目标像素，从而可以通过计算至少一个目标像素的像素值之和，方便且准确地确定第二校验值。
在本申请实施例中，确定视频帧图像数据对应的第二校验值之后，可以根据第一校验值和第二校验值确定视频帧图像数据是否数据异常。
在一种实施方式中，根据第一校验值和第二校验值确定视频帧图像数据是否数据异常， 可以包括：当第一校验值等于第二校验值时，确定视频帧图像数据正常。
可以理解的是，由于第一校验值为编码端根据校验行号对重建图像数据进行校验得到，且重建图像数据与编码前的视频帧图像数据相同，因此，可以根据第一校验值与第二校验值判断解码得到的视频帧图像数据是否与编码前的视频帧图像数据保持一致。
需要说明的是，当第一校验值等于第二校验值，说明解码得到的视频帧图像数据与编码数据保持一致，编码数据在传输过程中并未被篡改，同时编码数据在解码过程中也未被篡改或出现解码错误。因此，可以确定解码后的视频帧图像数据正常。
在本申请实施例中，当确定视频帧图像数据正常时，显示视频帧图像数据。
示例性的，可以在显示屏中显示视频帧图像数据。其中，该显示屏为解码端对应的视频会议设备中的显示屏。
在另一些实施例中，根据第一校验值和第二校验值确定视频帧图像数据是否数据异常，可以包括：当第一校验值不等于第二校验值时，确定视频帧图像数据异常。
需要说明的是，当第一校验值不等于第二校验值，说明解码得到的视频帧图像数据与编码数据不一致，因此，可以确定解码后的视频帧图像数据异常。异常发生的原因可能是，编码数据在网络传输过程中被篡改，或者编码数据在解码过程中被篡改或出现解码错误。
通过将第一校验值和第二校验值进行对比，可以方便、准确地确定视频帧图像数据是否数据异常，从而可以提高图像数据误检的效率和准确性。
在一种实施方式中，当确定视频帧图像数据异常时，向编码端请求立即刷新图像帧。
需要说明的是，IDR(Instantaneous Decoding Refresh，立即刷新图像)帧的作用是立刻刷新，使错误不致传播，从IDR帧开始，重新确定一张新的序列开始解码。
示例性的，解码端可以通过有线或无线的通信方式，向编码端发送IDR帧请求消息，以使编码端根据接收到的IDR帧请求消息返回IDR帧。
在本申请实施例中，解码端可以基于SIP协议(Session Initiation Protocol，会话发起协议)、H323协议(音视频传输协议)或RTCP协议(Real-time Control Protocol，实时传输控制协议)等协议与编码端建立通信连接，并向编码端发送IDR帧请求消息。
示例性的，当解码端在收到IDR帧后，在对IDR帧的图像数据进行编码时，可以立即将参考帧队列清空，将已解码的视频帧图像数据全部输出或抛弃，重新查找参数集，并开始一个新的序列。这样，如果前一个视频帧图像数据出现错误，在这里可以获得重新同步的机会。
通过在确定视频帧图像数据异常时，向编码端请求立即刷新图像帧，可以实现自动刷新图像，从而提升了用户的体验度。
上述实施例提供的图像数据误检方法、视频会议设备和存储介质，通过获取编码端输 出的编码数据和补充增强信息，可以通过补充增强信息得到校验行号与第一校验值，后续可以通过校验行号与第一校验值对解码后的视频帧图像数据进行校验；通过对编码数据进行解码，可以得到编码数据对应的视频帧图像数据；通过根据校验行号对视频帧图像数据进行校验，无需对每个语法元素做正则性判断，从而可以提高图像数据误检的效率；通过基于预设的像素获取策略，根据校验行号获取视频帧图像数据对应的至少一个目标像素，从而可以通过计算至少一个目标像素的像素值之和，方便且准确地确定第二校验值；通过将第一校验值和第二校验值进行对比，可以方便、准确地确定视频帧图像数据是否数据异常，从而可以提高图像数据误检的效率和准确性；通过在确定视频帧图像数据异常时，向编码端请求立即刷新图像帧，可以实现自动刷新图像，从而提升了用户的体验度。
请参阅图8，图8是本申请实施例提供的另一种图像数据误检方法的示意性流程图。该图像数据误检方法可以应用于编码端，通过将编码数据和补充增强信息一起输出至解码端，可以使得解码端根据补充增强信息对解码得到的视频帧图像数据进行校验，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性。该图像数据误检方法包括步骤S201和步骤S202。
步骤S201：获取编码数据和补充增强信息。
请参阅图9，图9是本申请实施例提供的一种获取编码数据和补充增强信息的子步骤的示意性流程图，具体可以包括步骤S2011至步骤S2013。
步骤S2011：获取拍摄装置采集的原始的视频帧图像数据。
示例性的，在视频会议过程中，编码端可以获取拍摄装置实时采集原始的视频帧图像数据。
可以理解的是，原始的视频帧图像数据是指拍摄装置采集的且未进行编码的图像数据。
示例性的，拍摄装置可以包括笔记本、移动手机以及监控摄像头等具有拍摄功能的电子设备。其中，拍摄装置可以是编码端所在的视频会议设备自带的电子设备，也可以是外置的具有拍摄功能的电子设备。
示例性的，可以在获取拍摄装置采集的原始的视频帧图像数据时，对原始的视频帧图像数据进行编号。例如，第1帧视频帧图像数据、第2帧视频帧图像数据、第3帧视频帧图像数据。从而在对原始的视频帧图像数据进行编码时，得到每一帧视频帧图像数据对应的重建图像数据。
步骤S2012：对原始的所述视频帧图像数据进行编码，得到所述编码数据与所述编码数据对应的重建图像数据。
在本申请实施例中，编码端可以对原始的视频帧图像数据进行编码，得到编码数据与 重建图像数据。
请参阅图10，图10是本申请实施例提供的一种对原始的视频帧图像数据进行编码的示意性框图。如图10所示，可以基于H.264/H.265编解码协议，编码端将原始的视频帧图像数据输入编码器中进行编码，输出编码数据与重建图像数据。
需要说明的是，编码器为单输入双输出的通道；因此，在编码过程中，编码器对每一帧图像数据进行编码，输出编码数据，同时在重建区生成重建图像数据。
示例性的，在对第1帧视频帧图像数据进行编码后，可以得到第1帧视频帧图像数据对应的第1帧编码数据与第1帧重建图像数据。
通过对原始的视频帧图像数据进行编码，可以得到编码数据与编码数据对应的重建图像，后续可以对重建图像数据进行校验，从而得到补充增强信息。
步骤S2013：对所述重建图像数据进行校验，得到所述补充增强信息。
在一种实施方式中，对重建图像数据进行校验，得到补充增强信息，可以包括：根据重建图像数据对应的帧号与高度值，确定重建图像数据对应的校验行号；根据校验行号对重建图像数据进行校验，得到重建图像数据对应的第一校验值；根据第一校验值与校验行号，确定补充增强信息。
可以理解的是，重建图像数据的高度值可以是重建图像数据的像素的总行数。因此，高度值可以根据重建图像数据的实际像素的总行数来确定。
示例性的，在根据重建图像数据对应的帧号与高度值，确定重建图像数据对应的校验行号时，可以根据帧号与高度值之比的余数，确定校验行号。
例如，对于第1帧重建图像数据，其帧号为1；若第1帧重建图像数据的高度值为10，则帧号1与高度值10之比的余数为1，即校验行号为1。
例如，对于第2帧重建图像数据，其帧号为2；若第2帧重建图像数据的高度值为10，则帧号2与高度值10之比的余数为2，即校验行号为2。
又例如，对于第11帧重建图像数据，其帧号为11；若第11帧重建图像数据的高度值为10，则帧号11与高度值10之比的余数为1，即校验行号为1。
在一种实施方式中，根据校验行号对重建图像数据进行校验，得到重建图像数据对应的第一校验值，可以包括：基于预设的像素获取策略，根据校验行号获取重建图像数据对于的至少一个目标像素；根据至少一个目标像素的像素值之和，确定第一校验值。
在本申请实施例中，确定第二校验值的过程，可以通过循环条件表达式来实现，如下所示：
Figure PCTCN2021130308-appb-000002
其中，checkSum表示第一校验值。
其中，确定第一校验值的具体过程，可以参见上述实施例确定第二校验值的详细说明，具体过程在此不再赘述。
在一种实施方式中，在确定重建图像数据对应的第一校验值之后，可以根据第一校验值与校验行号，确定补充增强信息。
示例性的，若第一校验值为A，校验行号为B，则补充增强信息包括第一校验值A与校验行号B。
通过根据重建图像数据对应的帧号与高度值，可以确定重建图像数据对应的校验行号；通过根据校验行号对重建图像数据进行校验，可以方便且准确地得到重建图像数据对应的第一校验值，进而可以根据第一校验值与校验行号，得到补充增强信息。
步骤S202：将所述编码数据和所述补充增强信息输出至解码端，以使所述解码端对所述编码数据进行解码得到视频帧图像数据，并根据所述补充增强信息确定所述视频帧图像数据是否数据异常。
在本申请实施例中，编码端可以通过有线/无线的传输方式，将编码数据和补充增强信息输出至解码端，还可以通过外部存储设备的拷贝方式将编码数据和补充增强信息输出至解码端。具体的输出方式，在此不作限定。
示例性的，解码端在接收到编码端输出的编码数据与补充增强信息之后，解码端可以对编码数据进行解码得到视频帧图像数据，并根据补充增强信息确定视频帧图像数据是否数据异常。例如，解码端可以根据补充增强信息中的第一校验值确定视频帧图像数据是否数据异常。
其中，确定视频帧图像数据是否数据异常，可以参见上述实施例的详细说明，具体过程在此不再赘述。
通过将编码数据和补充增强信息一起输出至解码端，可以使得解码端根据补充增强信息对解码得到的视频帧图像数据进行校验，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性。
在一种实施方式中，将编码数据和补充增强信息输出至解码端之后，还可以包括：若接收到解码端发送的IDR帧请求信息，则根据IDR帧请求信息向解码端返回IDR帧。
通过向解码端返回IDR帧，可以使得解码端根据IDR帧重新确定一个新的序列并开始解码，实现自动刷新图像，从而提升了用户的体验度。
上述实施例提供的图像数据误检方法、视频会议设备和存储介质，通过对原始的视频帧图像数据进行编码，可以得到编码数据与编码数据对应的重建图像数据，后续可以对重建图像数据进行校验，从而得到补充增强信息；通过根据重建图像数据对应的帧号与高度值，可以确定重建图像数据对应的校验行号；通过根据校验行号对重建图像数据进行校验，可以方便且准确地得到重建图像数据对应的第一校验值，进而可以根据第一校验值与校验行号，得到补充增强信息；通过将编码数据和补充增强信息一起输出至解码端，可以使得解码端根据补充增强信息对解码得到的视频帧图像数据进行校验，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性；通过向解码端返回IDR帧，可以使得解码端根据IDR帧重新确定一个新的序列并开始解码，实现自动刷新图像，从而提升了用户的体验度。
本申请实施例还提供一种存储介质，用于计算机可读存储，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如本申请实施例说明书提供的任一项图像数据误检方法的步骤。
例如，该程序被处理器加载，可以执行如下步骤：获取编码端输出的编码数据和补充增强信息，其中，所述补充增强信息至少包括第一校验值；对所述编码数据进行解码，获得所述编码数据对应的视频帧图像数据；确定所述视频帧图像数据对应的第二校验值，根据所述第一校验值和所述第二校验值确定所述视频帧图像数据是否数据异常。
又例如，该程序被处理器加载，可以执行如下步骤：获取编码数据和补充增强信息；将所述编码数据和所述补充增强信息输出至解码端，以使所述解码端对所述编码数据进行解码得到视频帧图像数据，并根据所述补充增强信息确定所述视频帧图像数据是否数据异常。
其中，所述存储介质可以是前述实施例所述的视频会议设备的内部存储单元，例如所述视频会议设备的硬盘或内存。所述存储介质也可以是所述视频会议设备的外部存储设备，例如所述视频会议设备上配备的插接式硬盘，智能存储卡(Smart Media Card，SMC)，安全数字(Secure Digital，SD)卡，闪存卡(Flash Card)等。
本申请实施例提供一种图像数据误检方法、视频会议设备和存储介质，通过获取编码端输出的编码数据和补充增强信息，可以通过补充增强信息得到编码数据对应的第一校验值；通过对编码数据进行解码，可以获得编码数据对应的视频帧图像数据；通过确定视频帧图像数据对应的第二校验值，可以根据第一校验值和第二校验值确定视频帧图像数据是 否数据异常，解决了现有编解码系统在图像数据误检过程中，需要对每个语法元素做正则性判断导致检测开销过大的问题，提高了编解码系统的图像数据误检的效率和准确性。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施例中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
应当理解，在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合，并且包括这些组合。需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。以上所述，仅为本申请的具体实施例，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以权利要求的保护范围为准。

Claims (10)

  1. 一种图像数据误检方法，应用于解码端，所述方法包括：
    获取编码端输出的编码数据和补充增强信息，其中，所述补充增强信息至少包括第一校验值；
    对所述编码数据进行解码，获得所述编码数据对应的视频帧图像数据；
    确定所述视频帧图像数据对应的第二校验值，根据所述第一校验值和所述第二校验值确定所述视频帧图像数据是否数据异常。
  2. 根据权利要求1所述的图像数据误检方法，其中，所述补充增强信息还包括校验行号，所述第一校验值为所述编码端根据所述校验行号对重建图像数据进行校验得到，所述重建图像数据由所述编码端对原始的视频帧图像数据进行编码得到所述编码数据时生成；
    所述确定所述视频帧图像数据对应的第二校验值，包括：
    根据所述校验行号对所述视频帧图像数据进行校验，得到所述视频帧图像数据对应的所述第二校验值。
  3. 根据权利要求2所述的图像数据误检方法，其中，所述根据所述校验行号对所述视频帧图像数据进行校验，得到所述视频帧图像数据对应的第二校验值，包括：
    基于预设的像素获取策略，根据所述校验行号获取所述视频帧图像数据对应的至少一个目标像素；
    根据所述至少一个目标像素的像素值之和，确定所述第二校验值。
  4. 根据权利要求3所述的图像数据误检方法，其中，所述基于预设的像素获取策略，根据所述校验行号获取所述视频帧图像数据对应的至少一个目标像素，包括：
    对所述校验行号对应的目标行的全部像素进行编号，并确定所述目标行的末尾像素的编号；
    确定所述目标行的首个所述目标像素，并基于预设的像素间隔值以及所述末尾像素的编号，依次确定下一个所述目标像素。
  5. 根据权利要求1-4任一项所述的图像数据误检方法，其中，所述方法还包括：
    当确定所述视频帧图像数据正常时，显示所述视频帧图像数据；
    当确定所述视频帧图像数据异常时，向所述编码端请求立即刷新图像帧。
  6. 一种图像数据误检方法，应用于编码端，所述方法包括：
    获取编码数据和补充增强信息；
    将所述编码数据和所述补充增强信息输出至解码端，以使所述解码端对所述编码数据进行解码得到视频帧图像数据，并根据所述补充增强信息确定所述视频帧图像数 据是否数据异常。
  7. 根据权利要求6所述的图像数据误检方法，其中，所述获取编码数据和补充增强信息，包括：
    获取拍摄装置采集的原始的视频帧图像数据；
    对原始的所述视频帧图像数据进行编码，得到所述编码数据与所述编码数据对应的重建图像数据；
    对所述重建图像数据进行校验，得到所述补充增强信息。
  8. 根据权利要求7所述的图像数据误检方法，其中，所述对所述重建图像数据进行校验，得到所述补充增强信息，包括：
    根据所述重建图像数据对应的帧号与高度值，确定所述重建图像数据对应的校验行号；
    根据所述校验行号对所述重建图像数据进行校验，得到所述重建图像数据对应的第一校验值；
    根据所述第一校验值与所述校验行号，确定所述补充增强信息。
  9. 一种视频会议设备，其中，所述视频会议设备包括编码端和/或解码端，其中，
    所述编码端包括处理器、存储器、存储在所述存储器上并可被所述处理器执行的计算机程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线，其中所述计算机程序被所述处理器执行时实现如权利要求1至5中任一项所述的图像数据误检方法；
    所述解码端包括处理器、存储器、存储在所述存储器上并可被所述处理器执行的计算机程序以及用于实现所述处理器和所述存储器之间的连接通信的数据总线，其中所述计算机程序被所述处理器执行时实现如权利要求6至8中任一项所述的图像数据误检方法。
  10. 一种存储介质，用于可读存储，其中，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现：
    如权利要求1至5中任一项所述的图像数据误检方法，或
    如权利要求6至8中任一项所述的图像数据误检方法。
PCT/CN2021/130308 2020-12-24 2021-11-12 图像数据误检方法、视频会议设备和存储介质 WO2022134923A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011556473.1A CN114666528A (zh) 2020-12-24 2020-12-24 图像数据误检方法、视频会议设备和存储介质
CN202011556473.1 2020-12-24

Publications (1)

Publication Number Publication Date
WO2022134923A1 true WO2022134923A1 (zh) 2022-06-30

Family

ID=82024612

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/130308 WO2022134923A1 (zh) 2020-12-24 2021-11-12 图像数据误检方法、视频会议设备和存储介质

Country Status (2)

Country Link
CN (1) CN114666528A (zh)
WO (1) WO2022134923A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114884624A (zh) * 2022-07-08 2022-08-09 广州思德医疗科技有限公司 数据处理方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101796846A (zh) * 2007-04-17 2010-08-04 诺基亚公司 基于反馈的可缩放视频编码
US20130266073A1 (en) * 2012-04-08 2013-10-10 Broadcom Corporation Power saving techniques for wireless delivery of video
CN104320673A (zh) * 2014-10-30 2015-01-28 山东泰信电子股份有限公司 一种防止非法篡改节目内容的方法
CN105828066A (zh) * 2016-04-19 2016-08-03 广东威创视讯科技股份有限公司 一种传输信号的检测方法及系统
CN111345768A (zh) * 2018-12-20 2020-06-30 重庆金山医疗器械有限公司 一种图片完整性检验方法、通信装置及胶囊内窥镜系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101796846A (zh) * 2007-04-17 2010-08-04 诺基亚公司 基于反馈的可缩放视频编码
US20130266073A1 (en) * 2012-04-08 2013-10-10 Broadcom Corporation Power saving techniques for wireless delivery of video
CN104320673A (zh) * 2014-10-30 2015-01-28 山东泰信电子股份有限公司 一种防止非法篡改节目内容的方法
CN105828066A (zh) * 2016-04-19 2016-08-03 广东威创视讯科技股份有限公司 一种传输信号的检测方法及系统
CN111345768A (zh) * 2018-12-20 2020-06-30 重庆金山医疗器械有限公司 一种图片完整性检验方法、通信装置及胶囊内窥镜系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114884624A (zh) * 2022-07-08 2022-08-09 广州思德医疗科技有限公司 数据处理方法及装置

Also Published As

Publication number Publication date
CN114666528A (zh) 2022-06-24

Similar Documents

Publication Publication Date Title
US10944970B2 (en) Video coding method, computer device, and storage medium
CN109618225B (zh) 视频抽帧方法、装置、设备和介质
US8660191B2 (en) Software video decoder display buffer underflow prediction and recovery
WO2020133465A1 (en) Systems and methods for multi-video stream transmission
CN102648584B (zh) 使用前向纠错检验可用带宽的系统、方法和介质
US20150117545A1 (en) Layered Video Encoding and Decoding
US10819951B2 (en) Recording video from a bitstream
WO2022134923A1 (zh) 图像数据误检方法、视频会议设备和存储介质
CN112261377A (zh) web版监控视频播放方法、电子设备及存储介质
WO2017020737A1 (zh) 视频流的存储方法、读取方法及装置
US20200029106A1 (en) Object identification method and system, and device
CN113542856B (zh) 在线录像的倒放方法、装置、设备和计算机可读介质
US20110211087A1 (en) Method and apparatus providing for control of a content capturing device with a requesting device to thereby capture a desired content segment
WO2023142715A1 (zh) 视频编码方法、实时通信方法、装置、设备及存储介质
US9997132B2 (en) Data transmission method, data transmission system and portable display device of transmitting compressed data
US20210075843A1 (en) Quality Metadata Signaling for Dynamic Adaptive Streaming of Video
US10080032B2 (en) Lossy channel video blur avoidance
CN113747063B (zh) 一种视频传输的方法、装置、电子设备及可读存储介质
US20220303555A1 (en) Combining high-quality foreground with enhanced low-quality background
TWI735297B (zh) 具有初始化片段之視訊及音訊之寫碼
CN113573004A (zh) 视频会议处理方法、装置、计算机设备及存储介质
US11870575B2 (en) Systems and methods for error detection in transmitted video data
CN109120938B (zh) 一种Camera中间层图像处理方法及片上系统
US12088643B2 (en) Videoconferencing with reduced quality interruptions upon participant join
CN113452953B (zh) 一种视频流传输控制方法、装置、设备和介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21908923

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16-11-2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21908923

Country of ref document: EP

Kind code of ref document: A1