CN118158344A - Audio-visual system sharing image processing program and video processing method thereof - Google Patents

Audio-visual system sharing image processing program and video processing method thereof Download PDF

Info

Publication number
CN118158344A
CN118158344A CN202211555599.6A CN202211555599A CN118158344A CN 118158344 A CN118158344 A CN 118158344A CN 202211555599 A CN202211555599 A CN 202211555599A CN 118158344 A CN118158344 A CN 118158344A
Authority
CN
China
Prior art keywords
video
format
image processing
color space
conversion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211555599.6A
Other languages
Chinese (zh)
Inventor
余家伟
欧欣颖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Realtek Semiconductor Corp
Original Assignee
Realtek Semiconductor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Realtek Semiconductor Corp filed Critical Realtek Semiconductor Corp
Priority to CN202211555599.6A priority Critical patent/CN118158344A/en
Publication of CN118158344A publication Critical patent/CN118158344A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57—Control of contrast or brightness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

An audio-visual system and its video processing method for sharing image processing program, in which the audio-visual system executes an image processing program for optimizing image for a video of a specific format, when the video format input into the audio-visual system is different from the format supported by the image processing technique in the audio-visual system, the video format can be converted by a video conversion program, so that the image processing program in the audio-visual system can be shared by the videos of different formats. In the video processing method, a second format video is received first, then a first format conversion is executed, the second format video is converted into a first format video supported by an image processing program executed in an audio-visual system, so as to execute image processing on the first format video, and then whether to execute format conversion again is determined according to a video format supported by a display device at an output end.

Description

Audio-visual system sharing image processing program and video processing method thereof
Technical Field
The present invention relates to a video processing technology, and more particularly, to an audio-visual system providing a shared image processing program for video of different formats and a video processing method including video format conversion.
Background
In a conventional image processing apparatus, an image processing program is executed for an input image in accordance with the format of the image. The input video format may be a high dynamic range (HIGH DYNAMIC RANGE, HDR) format video or a standard dynamic range (STANDARD DYNAMIC RANGE, SDR) format video, requiring corresponding analysis and image quality processing procedures for different formats of video.
Referring to the schematic diagram of the prior art video processing technology shown in fig. 1, in a video processing circuit, the input video 10 may be a High Dynamic Range (HDR) video or a Standard Dynamic Range (SDR) video, because the characteristics of the high dynamic range image and the standard dynamic range image in terms of brightness (bright) and color gamut (gamut) are different, and generally speaking, the high dynamic range image can provide a richer color range than the standard dynamic range image and can present more details in the image, so that the video images in two formats need to separately provide different image processing procedures, especially need different image processing parameters.
The scope of fig. 1 is for a video processing circuit or process in one of the video formats, and cannot be used with both the HDR and SDR formats. When the video 10 is input into the video processing circuit, an analysis unit (analyzer) 100 is used to analyze the image features in the video in a statistical manner, for example, to obtain the high-low frequency component, the distribution of the statistical brightness, the saturation and hue (hue) of the image, and then the first image processing unit 101 and the second image processing unit 102, which respectively use different processing parameters, perform image processing, for example, noise reduction (noise reduction) and sharpening (sharpness) to enhance the image.
In the prior art, parameters of various image processing are required to be modulated individually for video images in different formats, that is, in terms of circuit design, two sets of video processing circuits or flows shown in fig. 1 are required for two video formats such as HDR and SDR because different processing parameters are required.
Disclosure of Invention
The invention relates to an audio-visual system and a video processing method which can share image processing programs aiming at videos with different formats, and the sharing image processing programs can avoid the need of additionally providing corresponding processing programs aiming at video formats which are not supported by the video processing programs in the audio-visual system.
According to the embodiment of the invention, the video processing method is performed in the proposed audiovisual system sharing the image processing program, when the audiovisual system receives the video of the second format, such as the HDR video, from an audiovisual source, because the video of the second format is different from the video of the first format supported by the image processing program in the audiovisual system, such as the SDR video, i.e. the first format conversion is performed, the video of the second format is converted into the video of the first format supported by the image processing program executed in the audiovisual system, so as to perform the image processing on the video of the first format, and then the video of the first format after the image processing is output.
Further, the processing parameters in the image processing program executed by the audio-visual system are modulated for the video image of the first format, and are used for optimizing the video image output to the terminal display device. After the image processing is finished on the video with the first format, if the terminal display device connected with the output end of the audio-visual system supports to display the video with the second format, the video with the second format is converted into the video with the second format, and the video with the second format is output to the terminal display device.
Further, the first format conversion process includes converting the received second format video frame by frame from the first color space to the second color space, performing an electro-optical conversion process on the video image in the second color space, converting the digital video signal to a visible light signal, performing a video format conversion process, converting the second format video in the second color space to the first format video, performing a photoelectric conversion process on the first format video, performing gamma correction, converting the gamma corrected first format video frame by frame from the second color space to the first color space, and outputting the converted video to an image processing process in the audio-visual system for processing.
Further, the image processing program for performing the optimized image in the audio-visual system includes statistically analyzing image features of the first format video, and then performing one or more image processes on the first format video, including one or more of noise reduction, image sharpening, saturation adjustment, contrast, and hue adjustment.
For a further understanding of the nature and the technical aspects of the present invention, reference should be made to the following detailed description of the invention and the accompanying drawings, which are provided for purposes of reference only and are not intended to limit the invention.
Drawings
FIG. 1 shows a schematic diagram of a prior art video processing technique;
FIG. 2 illustrates an embodiment of an audiovisual system application diagram;
Fig. 3 shows a schematic diagram of an embodiment of an image processing unit in an audiovisual system;
Fig. 4 shows a schematic diagram of an embodiment of an audiovisual system;
fig. 5 shows another schematic diagram of an embodiment of an audiovisual system;
FIG. 6 is a diagram illustrating one embodiment of the stages of units in an audiovisual system performing video format conversion;
FIG. 7 is a diagram illustrating another embodiment of the various stages of units in an audiovisual system that perform video format conversion;
FIG. 8 shows different breadth color gamut schematics;
FIG. 9 is a diagram illustrating an embodiment of a perceptual quantization curve employed by an electro-optic transfer function;
FIG. 10 is a diagram illustrating an embodiment of a perceptual quantization curve employed by a photoelectric conversion function; and
Fig. 11 shows a flow chart of an embodiment of a video processing method.
Reference numerals illustrate:
10 video 100 analysis unit 101 first image processing unit
102 Second image processing unit 20 video 200 audiovisual processing device
202 Terminal display device 30 image processing unit 301 first format video
310, Analysis unit 311, first image processing unit 312, second image processing unit
313 Output video 401 second format video 400 format conversion unit
402 First format video 501 second format video 511 first format conversion unit
512 Second format conversion unit 502 second format video 61 hdr video
601: First color space conversion unit 602: electro-optical conversion unit 603: color gamut conversion matrix
604 Photoelectric conversion unit 605 second color space conversion unit 62 sdr video
71 SDR video 701, first color space conversion unit 702, electro-optic conversion unit
703 Color gamut conversion matrix 704 photoelectric conversion unit 705 second color space conversion unit
72:HDR video
Steps S111-S121 video processing method flow
Detailed Description
Embodiments of the present disclosure will be described below with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or similar elements or method flows.
The following embodiments of the present invention are described in terms of specific examples, and those skilled in the art will appreciate the advantages and effects of the present invention from the disclosure herein. The invention is capable of other and different embodiments and its several details are capable of modifications and various other uses and applications, all of which are obvious from the description, without departing from the spirit of the invention. The drawings of the present invention are merely schematic illustrations, and are not intended to be drawn to actual dimensions. The following embodiments will further illustrate the related art content of the present invention in detail, but the disclosure is not intended to limit the scope of the present invention.
It will be understood that, although the terms "first," "second," "third," etc. may be used herein to describe various elements or signals, these elements or signals should not be limited by these terms. These terms are used primarily to distinguish one element from another element or signal from another signal. In addition, the term "or" as used herein shall include any one or combination of more of the associated listed items as the case may be.
In view of the prior art that needs to provide corresponding video processing circuits or processes for videos of different formats, the present disclosure proposes an audiovisual system and a video processing method thereof for sharing an image processing program, wherein the audiovisual system refers to a system or a device that processes videos and outputs a circuit system, software and a circuit of a video of a specific format, and in the video processing method, a back-end image processing scheme (including a software method or hardware) can be adapted to video images of different formats, such as a High Dynamic Range (HDR) video and a Standard Dynamic Range (SDR) video, through a pre-work of video conversion; the actual product of the audio-visual system can be a system on chip (SoC), an embedded television system or software or a circuit in any audio-visual processing device, and the audio-visual processing device implemented by the audio-visual system can be internally installed in a display device such as a television or the like or a device externally connected with the display device.
The various image processing parameters adopted in the image processing program in the audio-visual system are adapted to support a specific video format, such as the SDR, and are not applicable to HDR, but the image processing program can be applicable to HDR video through a format conversion method in the audio-visual system, so that the purpose of sharing the image processing program is achieved.
The application of the audio-visual system can be seen in the embodiment diagram shown in fig. 2, the embodiment diagram shows that the audio-visual system is arranged in the audio-visual processing device 200 to provide the video sharing image processing program with multiple formats, the output end is connected with the display terminal display device 202, which can be a television or any display, wherein the display function can support High Dynamic Range (HDR) video or Standard Dynamic Range (SDR) video, the terminal display device 202 is externally connected with the audio-visual processing device 200, the audio-visual processing device 200 is provided with the audio-visual system to provide the video sharing image processing program with multiple formats, and the audio-visual system can also be built in the terminal display device 202. After receiving the video 20 via the audio-visual processing apparatus 200, the audio-visual system operates the video processing method, and when detecting a video format which is not supported by the image processing program in the audio-visual system, the format of the video 20 is converted into a video format which is suitable for the video format supported by the image processing program in the audio-visual processing apparatus 200 without additionally processing the video in a different format, and then, if necessary, the video format can be converted into a video format supported by the terminal display apparatus 202.
Next, fig. 3 shows an embodiment of an image processing unit in an audiovisual system, which shows an image processing unit 30 for a video image portion in an audiovisual system, whereas a portion for audio in an audiovisual system may be processed by another processing unit, which is not described here again.
The audiovisual system provides a variety of image processing tools for optimizing video images, the embodiment showing that the image processing unit 30 receives a first format video 301 for which parameters of the relevant image processing have been set at development time, the embodiment being represented by a first image processing unit 311 and a second image processing unit 312. Related image processing tools such as, but not limited to, noise reduction (noise reduction), image sharpening (sharpness), saturation adjustment, contrast and hue adjustment, etc., may include one or more of these processes.
In operation, when the image processing unit 30 receives the first format video 301, the analysis unit 310 can analyze the image features of the first format video 301 in a statistical manner, so as to obtain features of related items of the image processing tool in the image processing unit 30, such as high and low frequency components of the image, distribution of brightness, saturation of the image, color representation and tone, etc., and provide the images to the first image processing unit 311 and the second image processing unit 312, and then output the output video 313 supported by the display device of the terminal.
The audiovisual system implemented by the image processing unit 30 can be seen from the embodiments shown in fig. 4 and 5, and since the image processing unit 30 adjusts parameters for video of only one format, in the audiovisual system, it is required to determine whether to perform format conversion according to the input video format, so that the tools for image processing in the audiovisual system can be applied to video of multiple formats through the mechanism of video format conversion.
The audiovisual system may be implemented in a processor, memory and associated image processing software or firmware, including an image processing unit 30, various image processing tools for processing video in a particular format (referred to herein as first format video), wherein processing parameters that enhance the first format video are applied. When receiving the second format video 401 different from the first format video, the format conversion unit 400 converts the second format video into the first format video, and then delivers the first format video to the image processing unit 30 for processing, if the terminal display device connected with the audio-visual system supports the first format video, the first format video 402 after image processing is directly output.
In accordance with an embodiment, before the video is processed by the image processing unit 30, the audio-visual system may obtain the image features of the second format video 401, including information such as color and tone, by using an analysis means (e.g. the analysis unit 310 in fig. 3) in a statistical manner, so that the image processing unit 30 may perform image processing on the input video image features, and then output the first format video 402.
For example, the image processing unit 30 is a circuit or software for image processing of Standard Dynamic Range (SDR) video (first format video), when the audiovisual system receives High Dynamic Range (HDR) video (second format video), the format conversion unit 400 is required to convert the high dynamic range video into standard dynamic range video, so that the operation of the image processing unit 30 is utilized to implement the sharing audiovisual processing procedure, and then the standard dynamic range video (first format video) after image processing is output. Similarly, another example is that the image processing unit 30 supports HDR video, and if the input video is SDR video, the format conversion unit 400 needs to convert the SDR video into HDR video, and then determine whether to perform format conversion again according to the format supported by the terminal display device.
According to still another embodiment, if the terminal display device of the audio-visual system supports the second format video, the video after image processing needs to be subjected to a format conversion, as shown in fig. 5, the audio-visual system receives the second format video 501, and the image feature may be analyzed first, then the second format video 501 is converted into the first format video suitable for the image processing unit 30 through the first format conversion unit 511, and the image processing unit 30 performs image processing on the image feature of the converted first format video to generate the first format video after image processing, however, when the terminal display device supports the second format video, the second format video is converted by the second format conversion unit 512 and then the second format video 502 is output.
For example, the processing parameters in the image processing unit 30 in the audio-visual system are modulated for the SDR video image, so when the input video is HDR video, the first format converting unit 511 is needed to convert the input HDR video into the SDR video, after image processing, the second format conversion can be performed for the video format (such as HDR) supported by the terminal display device at the output end after the processing of the audio-visual system, that is, the high dynamic range video is converted and output by the second format converting unit 512.
Thus, according to the present description, a video processing method is proposed, in which it is to be determined whether or not to perform format conversion according to an input video format, so that a processing circuit can adapt to a plurality of video formats, in which the process of format conversion is to perform video conversion by a circuit, software or firmware method, in which video detection and conversion circuit, software or their cooperation form an audiovisual system.
Fig. 6 shows an embodiment of the various stages of units of the audio-visual system performing format conversion, which shows the process flow of converting the HDR video 61 into the SDR video 62, and the various stages of units may be implemented by circuits, software or firmware, where the first color space conversion unit 601, the color gamut conversion matrix 603 and the second color space conversion unit 605 process portions of colors, and the electro-optical conversion unit 602 and the photoelectric conversion unit 604 process portions of brightness.
For example, the image of the input video applied here is in the color space of the YUV (or YCrCb) coding system (where Y represents gray scale and brightness, UV represents chroma, YUV coded video is suitable for transmission, and should be finally converted into RGB coded video for display), and may be an ultra-high resolution ITU bt.2020 video specification with a wide color gamut, where resolution (resolution), frame rate (FRAME RATE), bit depth (bit depth), color representation (color presentation), etc. are defined, and different wide color gamuts (color gamut) are shown in fig. 8, where the color gamut covered by both ITU bt.2020 and bt.709 video specifications is indicated.
Initially, the audio-visual system receives video in a second format from an audio-visual source, such as an audio-visual streaming platform or any external electronic device, the audio-visual source provides video in a specific format, such as the HDR video 61 of the embodiment, the HDR video 61 may be encoded in a color space format that is convenient for transmission, such as YUV, where "Y" represents brightness, and "U" and "V" are chrominance (chrominance), and concentration (saturation).
In this flow example, the HDR video 61 in the first color space (e.g. YUV color space) is converted into the second color space (e.g. RGB (red, green and blue) color space) frame by performing color space (color space) conversion by the first color space conversion unit 601, one of the conversion methods may be implemented according to the following conversion formula, but the actual operation is not limited thereto, in this example [ R, G, B ] represents the red, green and blue channel values of the RGB color space,
[ Y, U, V ] is each component value of the YUV color space, and M1 is a conversion matrix (transfer matrix).
Conversion formula one:
[R,G,B]T＝M1[Y,U,V]T；
Wherein the method comprises the steps of
The video image converted into the second color space (RGB color space in this embodiment) is then converted into a visible light signal for display by an electro-optical conversion unit (electro-optical transfer function, EOTF, 2084 EOTF) 602, wherein the electro-optical conversion function applied in the electro-optical conversion process uses a perceptual quantization (perceptual quantizer, PQ) curve, and the encoded digital signal sub-channels (red (R), green (G), blue (B)) can be quantized into 10 bits (bit) of encoded information by the perceptual quantization curve, each quantized value maps the digital encoded conversion information into a luminance range based on human eye characteristics against the perceptual quantization curve, that is, luminance values of red, green and blue channels are mapped by the perceptual quantization curve, and the embodiment shows the highest luminance to 10000 nit (cd/m 2).
Then performing a color gamut conversion using a color gamut conversion matrix (gamut conversion matrix) 603, for example converting from an HDR video format in a second color space to an SDR video, converting from a video specification of ITU bt.2020 covering a wide color gamut to an ITU bt.709 having a narrower color gamut, thereby corresponding to the high resolution SDR video, wherein the bt.2020 color gamut can be mapped onto the bt.709 color gamut by the following 3x3 conversion matrix, wherein the color gamut conversion formula and the conversion matrix are exemplified as follows:
When the video image is converted into a high-resolution video with bt.709 standard, a photoelectric conversion process is performed by a photoelectric conversion unit (optical-electro transfer function, OETF, gamma 0.45) 604, wherein the photoelectric conversion is performed based on the information of each color channel of the video image in the second color space (RGB color space in this embodiment) based on the fact that the human eye is sensitive to the details of the dark portion, and the brightness performance under bt.709 video standard is close to the Gamma 0.45 curve under the Gamma correction, that is, the brightness performance is more suitable for the human eye.
Finally, the second color space conversion unit 605 performs color space conversion again, and converts the video that is gamma corrected and in the second color space (RGB color space in this embodiment) back to the first color space (YUV color space in this embodiment), in which, with respect to the conversion from YUV to RGB color space, one of the conversion methods can be implemented according to the following conversion formula two, but the practical operation is not limited thereto, in this example [ R, G, B ] represents the red, green and blue channel values of RGB color space, [ Y, U, V ] is each component value of YUV color space, and M2 is the conversion matrix (transfer matrix).
Conversion formula II:
[Y,U,V]T＝M2[R,G,B]T；
Wherein the method comprises the steps of
Finally, the HDR video 61 is converted into the SDR video 62 under the BT.709 standard through the format conversion program, the purpose of executing format conversion by the audio-visual system is completed, and then the video is output to the image processing program for image processing.
According to the technical concept of the video processing method set forth in the specification, when the received video format is not the video format supported by image processing in the audio-visual system, format conversion is performed, such as fig. 6 shows that the HDR video 61 is converted into the SDR video 62, and after image processing in the audio-visual system, format conversion may need to be performed again for the video format supported by the display device at the output end, such as fig. 7 shows an embodiment diagram for converting the SDR video into the HDR video.
Fig. 7 shows another example of the various stage units of the audiovisual system performing format conversion, which shows the process flow of converting SDR video 71 to HDR video 72, as such, the various stage units may be implemented by circuitry, software or firmware. In this embodiment, the audiovisual system receives a first format video (such as SDR video 71 of this embodiment) in a first color space (this embodiment is a YUV color space), the SDR video 71 may preferably be an ITU bt.709 video specification, whose coverage gamut (color gamut) may be referred to as the schematic diagram shown in fig. 8, wherein the displayed SDR video 71 adopts a bt.709 video specification that covers a relatively narrow color gamut, and after processing by the audiovisual system, may be converted to a second format video (such as HDR video 72 of this embodiment), the HDR video 72 of this embodiment adopts a bt.2020 video specification that covers a wider color gamut.
In the audio-visual system, the first color space conversion unit 701 converts the SDR video 71 in the YUV color space into the RGB color space frame by frame, and one of the conversion methods can be implemented according to the following conversion formula three, but the actual operation is not limited thereto. In this example, [ R, G, B ] represents the red, green and blue channel values of the RGB color space,
[ Y, U, V ] is each component value of the YUV color space, and M3 is the conversion matrix.
Conversion formula three:
[R,G,B]T＝M3[Y,U,V]T；
Wherein the method comprises the steps of
The video image converted to RGB color space is then passed through an electro-optical conversion unit (EOTF, gamma2.2 may be used) 702 to convert the input digital video into a visible light signal for display. Because the SDR video image inevitably loses details of over-brightness or over-darkness in the image, the information of each color channel of the video image in the RGB color space is corrected by the electro-optical conversion function through the gamma curve, so that the brightness of the bt.709 video specification shows approaching to the gamma2.2 curve.
Then, the bt.709 video is converted into a bt.2020 video with a wider color gamut by using the color gamut conversion matrix 703, so as to correspond to the requirement of outputting the HDR video, and in an embodiment, the bt.709 video specification is mapped onto the bt.2020 video specification suitable for being supported by the terminal display device by using the following 3x3 conversion matrix, where the color gamut conversion formula is as follows:
When the video image is converted into ultra-high resolution video of bt.2020 specification, the information of each color channel of the video image in RGB color space is photoelectrically converted by an photoelectrical conversion unit (OETF, 2084OETF may be used) 704, so that the SDR video image can be mapped to luminance suitable for the terminal display device to display HDR video through a perceptual quantization curve (PQ curve) as in fig. 10. Finally, the second color space conversion unit 705 performs color space conversion again to convert the video in RGB color space back to YUV color space frame by frame, wherein one of the conversion methods can be implemented according to the following conversion formula four, but the practical operation is not limited thereto, and the example shows that [ R, G, B ] (red, green and blue channel values) are converted into [ Y, U, V ] (component values of YUV color space) by the conversion matrix M4.
Conversion formula four:
[Y,U,V]T＝M4[R,G,B]T；
Wherein the method comprises the steps of
The purpose of converting the SDR video 71 to the HDR video 72 under bt.2020 specification by the above format conversion procedure is finally completed.
The present disclosure proposes an audio-visual system implemented in a single chip, firmware or embedded tv system or software or circuitry in any video conversion device, where the video conversion techniques of fig. 4 to 7 are used, and the overall flow may be referred to as a flow chart of an embodiment of the video processing method shown in fig. 11.
The image processing technology for enhancing the display of images in the audio-visual system shown in this embodiment is supported for a specific video format (this flow is called the first format), so that when the audio-visual data is received at the beginning of operation, the format of the input video is detected (step S111) and it is judged whether the input video is in conformity with the intra-system processing format (the first format) (step S113), and if the input video is in conformity with the first format, the image processing is performed directly (step S117), and the video can be outputted in the same format (step S121).
On the contrary, when the video format input to the audio-visual system is the second format, which is different from the intra-system processing format (first format) (no), the first format conversion is performed (step S115), and the second format video is converted into the first format video. As described in the embodiments of fig. 4 and 5, the video format conversion is required first, and the embodiment of the first format conversion can refer to a plurality of processing procedures shown in fig. 6, and the main format conversion procedure includes the steps of first color space conversion, electro-optical conversion, video specification conversion, photoelectric conversion, and second color space conversion. Then, the video converted to the first format is subjected to image processing (step S117), and the image-processed video of the first format can be outputted (step S121).
If the terminal display device in the audio-visual system supports displaying the second format video, after the image processing, the second format conversion needs to be performed (step S119), the first format video is converted into the second format video, and then the second format video is output (step S121).
In the above embodiment, the image processing format supported in the audio-visual system is a first format, such as SDR, and when the input video is a second format, such as HDR, the image processing is performed only by converting the video into the SDR video, and finally, whether to convert the video into the HDR video for output is determined according to the video format supported by the display device. In this way, the same image processing circuitry or software, including the same processing parameters, can be used in an audiovisual system without the need to provide additional image processing schemes for specific formats.
In summary, according to the audiovisual system and the video processing method thereof sharing the image processing program described in the above embodiments, through video format conversion, the related system can support multiple video formats only by providing a circuit or software for image processing. Particularly, because in the video format revolution, most image processing technologies propose an image processing scheme for Standard Dynamic Range (SDR) video, when a video with a High Dynamic Range (HDR) format is proposed, the video processing method proposed in the present specification can make the video with a high dynamic range be equally applicable to the image processing scheme for standard dynamic range video adopted by an audio-visual system, and when the audio-visual system is developed, the solution of the prior art can be used without increasing the cost of additional parameter adjustment or circuit.
The above disclosure is only of the preferred embodiments of the present invention and is not intended to limit the present invention, so all technical equivalents thereof are included in the scope of the present invention.

Claims (10)

1. A video processing method, for use in an audiovisual system, comprising:
Receiving a video in a second format;
performing a first format conversion to convert the second format video into a first format video supported by an image processing program executed in the audiovisual system to perform image processing on the first format video; and
And outputting the video with the first format after the image processing.
2. The video processing method according to claim 1, wherein the processing parameters in the image processing program executed by the audiovisual system are modulation for the first format video image for optimizing the video image output to a terminal display device.
3. The video processing method according to claim 2, wherein when the terminal display device connected to the output end of the audio-visual system supports displaying the video in the second format, the video in the first format after image processing is converted into the video in the second format for outputting to the terminal display device through the second format.
4. The method of claim 3, wherein the first format video supported by the image processing program executed in the audiovisual system is a standard dynamic range video and the second format video is a high dynamic range video.
5. The video processing method according to any one of claims 1 to 4, wherein the program of the first format conversion includes:
converting the received video of the second format from a first color space to a second color space frame by frame;
Executing an electro-optical conversion program on the video image in the second color space to convert the digital video signal into a visible light signal;
Performing color gamut conversion to convert the second format color gamut in the second color space to the first format color gamut;
performing a photoelectric conversion process on the video of the first format in the second color space, and performing gamma correction; and
And converting the gamma corrected video of the first format from the second color space to the first color space frame by frame and outputting the converted video to the image processing program.
6. The video processing method of claim 5, wherein the first color space is a YUV color space and the second color space is an RGB color space.
7. The video processing method according to claim 5, wherein the image processing program includes:
analyzing the image characteristics of the video in the first format by a statistical method; and
One or more image processing is performed on the first format video including one or more of noise reduction, image sharpening, saturation adjustment, contrast, and hue adjustment.
8. An audiovisual system sharing an image processing program, wherein a video processing method is performed, the video processing method comprising:
Receiving a video of a second format from an audio-visual source;
performing a first format conversion to convert the second format video into a first format video supported by an image processing program executed in the audiovisual system to perform image processing on the first format video; and
And outputting the video with the first format after the image processing.
9. The system according to claim 8, wherein processing parameters in the image processing program executed by the audio-visual system are modulated for the first format video image for optimizing the video image output to a terminal display device; when the terminal display device connected with the output end of the audio-visual system supports to display the video with the second format, the video with the first format after image processing is converted into the video with the second format for outputting to the terminal display device through the second format.
10. The audiovisual system of a shared image processing program as set forth in claim 8 or 9, wherein the program for the first format conversion in the video processing method includes:
converting the received video of the second format from a first color space to a second color space frame by frame;
Executing an electro-optical conversion program on the video image in the second color space to convert the digital video signal into a visible light signal;
Performing color gamut conversion to convert the second format color gamut in the second color space to the first format color gamut;
performing a photoelectric conversion process on the video of the first format in the second color space, and performing gamma correction; and
And converting the gamma corrected video of the first format from the second color space to the first color space frame by frame and outputting the converted video to the image processing program.
CN202211555599.6A 2022-12-06 2022-12-06 Audio-visual system sharing image processing program and video processing method thereof Pending CN118158344A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211555599.6A CN118158344A (en) 2022-12-06 2022-12-06 Audio-visual system sharing image processing program and video processing method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211555599.6A CN118158344A (en) 2022-12-06 2022-12-06 Audio-visual system sharing image processing program and video processing method thereof

Publications (1)

Publication Number Publication Date
CN118158344A true CN118158344A (en) 2024-06-07

Family

ID=91297618

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211555599.6A Pending CN118158344A (en) 2022-12-06 2022-12-06 Audio-visual system sharing image processing program and video processing method thereof

Country Status (1)

Country Link
CN (1) CN118158344A (en)

Similar Documents

Publication Publication Date Title
US11973982B2 (en) Color volume transforms in coding of high dynamic range and wide color gamut sequences
US10419689B2 (en) Mapping between linear luminance values and luma codes
US10462407B2 (en) Display method and display device
US20190356891A1 (en) High dynamic range (hdr) data conversion and color space mapping
US7298379B2 (en) Luminance preserving color conversion from YUV to RGB
KR102061349B1 (en) High dynamic range image signal generation and processing
EP3430807B1 (en) A method and a device for encoding a high dynamic range picture, corresponding decoding method and decoding device
US20170034519A1 (en) Method, apparatus and system for encoding video data for selected viewing conditions
CN109274985B (en) Video transcoding method and device, computer equipment and storage medium
EP4089627A2 (en) A method and apparatus of encoding and decoding a color picture
US20170324959A1 (en) Method and apparatus for encoding/decoding a high dynamic range picture into a coded bitstream
KR20180043807A (en) High dynamic range adaptive operations in video decoders
US11070830B2 (en) Coding and decoding method with color conversion and corresponding devices
TW201440531A (en) Extending image dynamic range
EP3522514A1 (en) Adjusting device, adjusting method, and program
US8860745B2 (en) System and method for color gamut mapping
CN108933933A (en) A kind of video signal processing method and device
CN114866809B (en) Video conversion method, apparatus, device, storage medium, and program product
US20190124368A1 (en) Method and apparatus for encoding/decoding a high dynamic range picture into a coded bitstream
CN106210735B (en) A kind of decoded method and device of video
EP3051489A1 (en) A method and apparatus of encoding and decoding a color picture
CN118158344A (en) Audio-visual system sharing image processing program and video processing method thereof
US20240169507A1 (en) Audiovisual system with shared image-processing procedure and method for processing video therein
EP3242481A1 (en) Method and apparatus for encoding/decoding a high dynamic range picture into a coded bitstream
EP3716619A1 (en) Gamut estimation

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination