WO2023286889A1 - A/v 수신 장치 및 무선 디스플레이 시스템 - Google Patents
A/v 수신 장치 및 무선 디스플레이 시스템 Download PDFInfo
- Publication number
- WO2023286889A1 WO2023286889A1 PCT/KR2021/009095 KR2021009095W WO2023286889A1 WO 2023286889 A1 WO2023286889 A1 WO 2023286889A1 KR 2021009095 W KR2021009095 W KR 2021009095W WO 2023286889 A1 WO2023286889 A1 WO 2023286889A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- quality
- value
- area
- picture quality
- picture
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 84
- 238000012937 correction Methods 0.000 claims abstract description 38
- 238000004891 communication Methods 0.000 claims description 16
- 238000013473 artificial intelligence Methods 0.000 description 149
- 230000006835 compression Effects 0.000 description 21
- 238000007906 compression Methods 0.000 description 21
- 238000010586 diagram Methods 0.000 description 15
- 238000000034 method Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 11
- 238000012545 processing Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000006866 deterioration Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/68—Circuits for processing colour signals for controlling the amplitude of colour signals, e.g. automatic chroma control circuits
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/02—Diagnosis, testing or measuring for television systems or their details for colour television signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
Definitions
- the present disclosure relates to a wireless display system for wirelessly transmitting and receiving A/V data.
- SD Standard-Definition
- HD Hi-Definition
- SD supports a resolution of 704 ⁇ 480 and consists of about 350,000 pixels
- HD is divided into HD and Full HD.
- Full HD supports a resolution of 1920 ⁇ 1080 and has 2 million pixels It is configured to provide a high-quality image considerably compared to the SD.
- UHD Ultra High-Definition
- the UHD supports 4K (3840 ⁇ 2160) and 8K (7680 ⁇ 4320) resolutions and up to 22.2 channels of surround audio.
- Such UHD provides 4 times clearer picture quality compared to the HD, even on the basis of 4K UHD, and 8K UHD provides 16 times clearer picture quality compared to the HD.
- a wireless display system is a system that transmits and receives A/V data between an A/V transmission device and an A/V reception device through a local area network.
- the A/V receiving device displays A/V data received from the A/V transmitting device.
- the A/V transmission device also transmits image data to which artificial intelligence quality is applied.
- the quality with artificial intelligence (AI) applied indicates that the value of a specific quality factor of a part constituting an image is adjusted to be different from the value of a specific quality factor of a neighboring region.
- the image quality of a corresponding area may be degraded due to packet loss caused by a deterioration of the network environment.
- the image quality of the area to which the AI quality factor value is applied may deteriorate.
- An object of the present disclosure is to enable a transmission device to maintain an optimal AI image quality when transmitting an image including an AI quality region in a wireless display system.
- An object of the present disclosure is to enable a transmission device to maintain an optimal AI image quality regardless of a network environment when transmitting an image including an AI image quality region in a wireless display system.
- An A/V receiving device receives a compressed Radio Frequency (RF) packet from a display, an RF receiving module for receiving compressed RF (Radio Frequency) packets from an A/V transmitting device, and an A/V transmitting device.
- An RF receiving module for performing the compression the compressed RF packet includes a video frame corresponding to the content video and AI quality information for an AI quality region indicating at least a part of the content video, and based on the AI quality information, the AI quality A picture quality factor value of the AI picture quality area is acquired, the picture quality factor value is transmitted to the A/V transmission device, and the picture quality factor value of the AI picture quality area is corrected. and a microcomputer for receiving a value and outputting the image frame through the display based on the received picture quality correction value.
- a wireless display system includes an A/V transmission device for generating an RF packet, compressing the generated RF packet, and transmitting the compressed compressed RF packet to an A/V receiving device through RF communication;
- the compressed RF packet includes a video signal corresponding to the content video and AI quality information for an AI quality region indicating at least a part of the content video, and based on the AI quality information, the quality factor of the AI quality region obtaining a value, transmitting the value of the picture quality factor to the A/V transmission device, and receiving, from the A/V transmission device, a picture quality correction value obtained by correcting the value of the picture quality factor of the AI picture quality area; and an A/V receiving device outputting the image frame through a display based on the received picture quality correction value.
- an image to which a consistent AI quality is applied may be provided.
- the user can watch the video to which the AI quality is applied without significantly affecting the network environment.
- 1 and 2 are diagrams for explaining the configuration of a display system according to an embodiment of the present disclosure.
- FIG. 3 is a block diagram illustrating the configuration of a remote control device according to an embodiment of the present disclosure.
- FIG. 4 is a ladder diagram for explaining a method of operating a wireless display system according to an embodiment of the present disclosure.
- FIG. 5 is a diagram for explaining an AI quality area according to an embodiment of the present disclosure.
- FIG. 6 is a diagram for explaining a process of correcting a value of a picture quality factor for an AI picture quality area according to an embodiment of the present disclosure.
- FIGS. 7 to 10 are diagrams for comparing measured SNR and compression ratio when AI quality correction is performed under a line of sight (LOS) condition and a non-line of sight (NLOS) condition.
- LOS line of sight
- NLOS non-line of sight
- FIG. 11 is a diagram illustrating a detailed configuration of a wireless display system according to an embodiment of the present disclosure.
- a video/audio (hereinafter referred to as A/V) transmission device is an intelligent device in which a computer support function is added to a broadcast reception function, for example, and an Internet function is added while being faithful to the broadcast reception function.
- a handwriting type input device, a touch screen, or a space remote controller, etc. can be equipped with a more user-friendly interface.
- 1 and 2 are diagrams for explaining the configuration of a wireless display system according to an embodiment of the present disclosure.
- a wireless display system 1 includes an A/V transmission device 100 and an A/V reception device 200.
- the A/V transmission device 100 wirelessly transmits A/V data to the A/V reception device 200, and the A/V reception device 200 transmits the A/V data. It can be an output system.
- the A/V transmission device 100 may be a device capable of encoding video and audio and wirelessly transmitting the encoded content video and audio.
- the A/V transmission device 100 may be a set-top box.
- the A/V transmission device 100 may be connected to an external device such as a set-top box or a USB memory.
- the A/V transmission device 100 may transmit a video signal or an audio signal received from a connected external device to the A/V reception device 200.
- the A/V receiving device 200 may be a display device capable of wirelessly receiving encoded video and audio and decoding the received video and audio.
- the A/V transmission device 100 and the A/V reception device 200 may constitute a video wall display system.
- having a display with a thin bezel plays an important role in visualizing content images.
- For the thin bezel of the display it is efficient to have only the components that can play the minimum role, and to perform the circuits or components for the main functions in a separate device.
- the A/V transmission device 100 may determine the type of content video input from the outside, and determine a compression rate of the content video based on the determined type.
- the compression rate of content video may be defined as the ratio of the size of video data before encoding to the size of video data after encoding.
- the type of content video may include a still video type, a general video type, and a game video type.
- the A/V transmission device 100 may compress the content video according to the determined compression rate and wirelessly transmit the compressed content video to the A/V reception device 200 .
- the A/V receiving device 200 may restore the compressed content image received from the A/V transmitting device 100 and display the restored content image on a display.
- FIG. 2 is a block diagram illustrating detailed configurations of the A/V transmission device 100 and the A/V reception device 200.
- the A/V transmission device 100 includes a microphone 110, a Wi-Fi module 120, a Bluetooth module 130, a memory 140, an RF transmission module 150 and a processor 190. can do.
- the microphone 110 may receive an audio signal and transmit it to the processor 190 .
- the microphone 110 may receive a voice uttered by a user.
- the Wi-Fi module 120 may perform wireless communication through the Wi-Fi standard.
- the Wi-Fi module 120 may perform wireless communication with an external device or the A/V receiving device 200 through the Wi-Fi standard.
- the Bluetooth module 130 may perform wireless communication through the Bluetooth Low Energy (BLE) standard.
- BLE Bluetooth Low Energy
- the Bluetooth module 130 may perform wireless communication with an external device such as a remote controller or the A/V receiving device 200 through Bluetooth Low Energy (BLE) standards.
- BLE Bluetooth Low Energy
- the memory 140 may store programs for signal processing and control, and may store signal-processed video, audio, or data signals.
- the memory 140 may perform a function for temporarily storing video, audio, or data signals input from the outside, and may store information about a predetermined image through a channel storage function.
- the RF transmission module 150 may transmit the A/V signal to the RF reception module 240 of the A/V reception device 200 through Radio Frequency (RF) communication.
- RF Radio Frequency
- the RF transmission module 150 may include one or more antennas.
- the RF transmission module 150 may transmit the compressed A/V signal in digital form to the RF reception module 240 .
- the RF transmission module 150 may transmit the A/V signal to the RF reception module 240 through one or more channels.
- the processor 190 may control the overall operation of the A/V transmission device 100.
- the processor 190 may be configured in the form of a System on Chip (SoC).
- SoC System on Chip
- a plurality of processors 190 may be provided.
- the processor 190 may compress a video signal or an audio signal input from the outside and transmit the compressed signal to the RF transmission module 150 .
- the processor 190 may include an encoder for compressing a video signal or an audio signal.
- Processor 190 may be referred to as a main SoC.
- the processor 190 may have one or more interfaces for connection with external devices.
- the processor 190 may have one or more HDMI ports and one or more USB ports.
- the processor 190 may include a tuner that receives broadcast signals.
- the A/V receiving device 200 includes a Wi-Fi module 210, a Bluetooth module 220, an IR module 230, an RF receiving module 240, a memory 250, a display 260, and a microcomputer 290. can do.
- the Wi-Fi module 210 may perform wireless communication through the Wi-Fi standard.
- the Wi-Fi module 120 may perform wireless communication with an external device or the A/V transmission device 100 through the Wi-Fi standard.
- the Bluetooth module 220 may perform wireless communication through a Bluetooth Low Energy (BLE) standard.
- BLE Bluetooth Low Energy
- the Bluetooth module 220 may perform wireless communication with an external device such as a remote controller or the A/V transmission device 200 through Bluetooth Low Energy (BLE) standards.
- BLE Bluetooth Low Energy
- the IR module 230 may receive a signal from the remote controller 300 to be described later through IR (Infrared) communication.
- the RF receiving module 240 may receive an A/V signal from the RF transmitting module 150.
- the RF receiving module 240 may include a plurality of antennas.
- the RF receiving module 240 may be disposed below the display 260 .
- the RF receiving module 240 may include a first antenna module and a second antenna module. Each of the first antenna module and the second antenna module may include a plurality of antennas.
- the RF receiving module 240 may receive the digital compressed A/V signal from the RF transmitting module 150 and transfer the received A/V signal to the microcomputer 290 .
- the memory 250 may store programs for signal processing and control, and may store signal-processed video, audio, or data signals.
- the display 260 may display an image signal received from the microcomputer 290 .
- the display 260 may display an image signal according to driving of a timing controller (not shown).
- the microcomputer 290 may control overall operations of the display device 200 .
- the microcomputer 290 may restore the compressed A/V signal received by the RF receiving module 240.
- the microcomputer 290 may include a decoder.
- FIG. 3 is a block diagram illustrating the configuration of a remote control device according to an embodiment of the present disclosure.
- the remote control device 300 may include a wireless communication interface 310 , a user input interface 330 , a memory 350 and a controller 390 .
- the wireless communication interface 310 may be an interface for performing wireless communication with the A/V transmission device 100 or the A/V reception device 200.
- the wireless communication interface 310 may include a Bluetooth Low Energy (BLE) module 311 and an InfraRed (IR) module 313 .
- BLE Bluetooth Low Energy
- IR InfraRed
- the BLE module 311 may transmit a signal for controlling the operation of the A/V transmission device 100 to the A/V transmission device 100.
- the BLE module 311 may transmit a signal triggering a pairing operation of the A/V transmission device 100 to the A/V transmission device 100.
- the user input interface 330 may include a keypad, buttons, a touch pad, or a touch screen.
- the user input interface 330 may generate a control command for controlling the operation of the A/V transmission device 100 or the A/V reception device 200 according to a user's manipulation command.
- the user input interface 330 includes a hard key button
- the user can operate the hard key by pushing the hard key button.
- the user input interface 330 may include various types of input means that the user can manipulate, such as a scroll key or a jog key.
- the memory 350 may store programs for operating the controller 390 and may temporarily store input/output data.
- the controller 390 controls operations related to application programs and generally the overall operation of the remote control device 300 .
- FIG. 4 is a ladder diagram for explaining a method of operating a wireless display system according to an embodiment of the present disclosure.
- the processor 190 of the A/V transmission device 100 acquires the AI quality area of the image frame (S401).
- the AI quality area may be an area for emphasizing a value of a specific quality factor among the entire area of an image frame.
- the AI quality area may be an area in which values of one or more picture quality factors are set differently from other areas among the entire areas of the image frame.
- the AI image quality area may be an area representing a specific object such as a person's face or a building.
- the AI quality area may vary according to the genre of the video.
- the AI quality area may be the entire area of the video frame.
- the AI quality area may be an area for emphasizing values of a specific picture quality factor in a partial area or the entire area.
- the quality factor may be any one of sharpness, brightness, luminance, and contrast.
- the processor 190 may extract the AI quality region from the entire region of the image frame using a feature point extraction technique.
- the feature point extraction technique may be a technique of extracting a point for identifying an object included in an image frame.
- a feature point may be a corner point constituting a corner of an object.
- a known technique may be used as a feature point extraction method.
- FIG. 5 is a diagram for explaining an AI quality area according to an embodiment of the present disclosure.
- an image frame 500 may include an AI quality area 510 .
- the AI quality area 510 may be an area representing a building among objects included in the image frame 500 .
- the processor 190 may extract a plurality of feature points included in the area representing the building and obtain an AI quality area 510 connecting the plurality of extracted feature points.
- the processor 190 may obtain values of one or more picture quality factors for the AI picture quality area 510 by using the picture quality factor determination model.
- the processor 190 of the A/V transmission device 100 generates AI quality information of the obtained AI quality area (S403).
- the processor 190 may generate AI quality information including values of one or more quality factors for the AI quality domain.
- the processor 190 may determine values of one or more picture quality factors suitable for the obtained AI picture quality area.
- the processor 190 may obtain AI quality information for the AI quality area based on the quality factor determination model.
- the quality factor determination model may be a model based on an artificial neural network supervised through a deep learning or machine learning algorithm.
- the quality factor determination model may be a supervised model based on a training data set including object image data and one or more quality factor values labeled therewith.
- the picture quality factor determination model may be stored in the memory 140 of the A/V transmission device 100 .
- the processor 190 may obtain values of one or more picture quality factors through a picture quality factor determination model by using an image of the AI picture quality area as input data.
- the AI quality information may include location information indicating a position where the AI quality area is to be displayed on the display. That is, when the AI quality area is a partial area of the image frame, the AI quality information may include coordinate information of the AI quality area.
- the processor 190 of the A/V transmission device 100 transmits the first compressed packet including the image frame and the AI quality information for the AI quality area to the A/V receiving device 200 through the RF transmission module 150. Transmit (S405).
- the encoder of the processor 190 may generate a first compressed packet by compressing a packet including an image frame, AI quality information, and quality information for a region other than the AI quality region.
- the processor 190 may transmit the first compressed packet to the RF receiving module 240 of the A/V receiving device 200 through the RF transmitting module 150 including a plurality of antenna modules.
- the microcomputer 290 of the A/V receiver 200 restores the received first compressed packet (S407) and outputs a restored image frame (S409).
- the microcomputer 290 may restore the first compressed packet through a decoder.
- the microcomputer 290 may output an image frame to the display 260 based on the AI quality information according to the restoration result.
- the microcomputer 290 of the A/V receiving device 200 obtains a quality factor value of the AI quality area included in the restored image frame (S411).
- the microcomputer 290 may obtain one or more picture quality factor values for the AI picture quality area by using coordinate information of the AI picture quality area included in the AI picture quality information.
- the microcomputer 290 may identify the AI quality area through the coordinate information of the AI quality area included in the AI quality information.
- the microcomputer 290 may measure values of one or more picture quality factors for the identified AI picture quality area.
- the microcomputer 290 may measure one or more of sharpness, contrast, and brightness for the AI image quality area using a known technology.
- the micom 290 of the A/V receiving device 200 transmits picture quality feedback information including the value of the quality factor measured through the RF receiving module 240 to the A/V transmitting device 100 (S413).
- the microcomputer 290 may transmit picture quality feedback information from the A/V transmission device 100 to the A/V transmission device 100 for picture quality correction for the AI picture quality area.
- the microcomputer 290 may transmit picture quality feedback information to the A/V transmission device 100 in real time.
- the microcomputer 290 transmits the quality feedback information A when the difference between the value of the quality factor of the AI quality area included in the AI quality information and the value of the quality factor of the measured AI quality area is equal to or greater than a preset value. /V can be transmitted to the transmission device 100.
- the sharpness value of the AI quality area included in the AI quality information is 10
- the actually measured sharpness is 7
- the preset value is 2.
- the microcomputer 290 may transmit the sharpness value of 7 in the AI quality area to the A/V transmission device 100.
- the processor 190 of the A/V transmission device 100 obtains AI picture quality correction information for the AI picture quality area based on the picture quality feedback information (S415).
- the processor 190 may obtain an AI picture quality correction value based on a difference between the picture quality factor value of the AI picture quality area and the picture quality factor value included in the picture quality feedback information.
- the sharpness difference value may be 3.
- the processor 190 may further reflect the sharpness difference value 3 to the AI quality area. Specifically, the processor 190 may increase the sharpness of the existing AI quality area from 10 to 13. A value of increased sharpness may be an AI image quality correction value.
- the AI picture quality correction information may include values of one or more adjusted picture quality factors.
- the processor 190 of the A/V transmission device 100 transmits the second compressed packet including the image frame and the AI quality correction information to the RF reception module 240 through the RF transmission module 150 (S417).
- the processor 190 may generate a second compressed packet by compressing the AI quality correction information including the value of the corrected quality factor for the AI quality region together with the image frame.
- the micom 290 of the A/V receiver 200 restores the received second compressed packet (S419) and outputs an image frame based on the AI quality correction information (S421).
- the microcomputer 290 may correct the value of the quality factor of the AI quality area based on the AI quality correction information.
- the microcomputer 290 may adjust the value of the first quality factor (before feedback) to the value of the second quality factor (after feedback) in the AI quality area.
- the microcomputer 290 may apply the adjusted value of the second quality factor to the AI quality area and output an image frame to which the adjusted value of the quality factor is applied.
- the value of the quality factor can be adjusted in real time for the AI quality area. Accordingly, AI quality can be maintained even after wireless transmission of the video signal.
- FIG. 6 is a diagram for explaining a process of correcting a value of a picture quality factor for an AI picture quality area according to an embodiment of the present disclosure.
- the AI quality area 510 of FIG. 5 will be described as an example.
- the A/V transmission device 100 may extract the AI quality area 510 from the image frame 510 .
- the A/V transmission device 100 determines the sharpness value of the AI quality region 510 as 10, and transmits the determined sharpness value 10 and the coordinate information of the AI quality region 510 to the A/V receiving device 200. can be sent to
- the A/V receiving device 200 may measure the sharpness value of the AI quality region 510 based on the coordinate information of the AI quality region 510 .
- the A/V receiving device 200 may feedback-transmit the measured sharpness value 7 to the A/V transmitting device 100.
- the A/V transmission device 100 may compare the sharpness value 7 of the AI quality area 510 received from the A/V receiving device 200 with the existing sharpness value 10.
- the A/V transmission device 100 may obtain a difference of 3 between the existing sharpness value of 10 and the feedback sharpness value of 7, and may add 3 to the existing sharpness value of 10.
- the A/V transmission device 100 may obtain the summed sharpness value 13 as an AI quality correction value.
- the summation of sharpness values is only one method and is only an example.
- the A/V transmission device 100 may transmit the corrected sharpness value 13 for the AI quality area 510 to the A/V reception device 200.
- the sharpness value of the AI quality area 510 is set in consideration of this.
- the sharpness value of the AI image quality area 510 can be sufficiently maintained.
- AI quality of an image can be sufficiently maintained.
- the user can enjoy the AI image quality experience for video without any inconvenience, regardless of the network environment.
- FIGS. 7 to 10 are diagrams for comparing measured SNR and compression ratio when AI quality correction is performed under a line of sight (LOS) condition and a non-line of sight (NLOS) condition.
- LOS line of sight
- NLOS non-line of sight
- the value of the AI picture quality factor is fed back to the A/V transmission device 100 in real time, and accordingly, the A/V transmission device 100 is the A/V transmission device.
- (100) is an embodiment of correcting and transmitting the value of the AI quality factor in real time.
- the A/V transmission device 100 transmits video data 700 to the A/V reception device 200 .
- the LOS condition may be a condition in which there is no obstacle between the A/V transmission device 100 and the A/V reception device 200 .
- the NLOS condition may be a condition in which an obstacle 800 exists between the A/V transmission device 100 and the A/V reception device 200 .
- the network quality between the A/V transmission device 100 and the A/V reception device 200 is better than that in the case of the NLOS condition.
- the microcomputer 290 of the A/V receiving device 200 may measure a signal to noise ratio (SNR) and compression ratio in each of the LOS condition and the NLOS condition.
- SNR signal to noise ratio
- the microcomputer 290 of the A/V receiving device 200 may measure the SNR and compression ratio from the video signal received under each of the LOS condition and the NLOS condition.
- the compression ratio may indicate a ratio at which the A/V transmission device 100 compresses the video signal.
- a compressed packet received by the A/V receiving device 200 may include information about compression magnification.
- the microcomputer 290 of the A/V receiver 200 may obtain a compression ratio in a process of restoring a compressed packet through a decoder.
- the A/V transmission device 100 may transmit the compression magnification to the A/V reception device 200.
- the measured SNR may be 30 dB.
- the measured SNR may be 10 dB.
- the measured SNR may be equal to 30 dB.
- the measured compression ratio may be 8 times.
- the measured compression ratio may be 16 times.
- the measured compression ratio may be 8 times the same.
- the AI picture quality correction according to an embodiment of the present disclosure has been performed.
- FIG. 11 is a diagram illustrating a detailed configuration of a wireless display system according to an embodiment of the present disclosure.
- the processor 190 of the A/V transmission device 100 may include a main Soc 191, an encoder 193, and an AI quality processing unit 195.
- the main Soc 191 may transmit an image frame corresponding to the content image to the encoder 193 .
- the main SoC 191 may determine whether AI quality is applied to the content video.
- the main SoC 191 may determine whether to apply the AI image quality according to the genre of the content video. When the genre of the content video is a movie, the main SoC 191 may determine that AI quality needs to be applied.
- the main SoC 191 may determine the need to apply the value of the AI quality factor to a partial region of the content video.
- the main SoC 191 may transmit coordinate information about the AI quality area and values of one or more AI quality factors for the AI quality area to the encoder 193 .
- the encoder 193 may compress the video signal and AI quality information.
- the encoder 193 may generate a compressed RF packet through color sampling and transmit the generated RF packet to the RF transmission module 150 .
- the RF transmission module 150 may transmit the compressed RF packet to the RF reception module 240 of the A/V reception device 200 .
- the AI picture quality processing unit 195 may generate an AI picture quality correction value based on the AI picture quality factor value of the AI picture quality area received from the A/V receiving device 200, and convert the generated AI picture quality correction value to an encoder ( 193) can be forwarded.
- the microcomputer 290 of the A/V receiving device 200 may include a decoder 291 and an image quality value detector 293.
- the decoder 291 may restore the RF packet received by the RF receiving module 240.
- the decoder 291 may restore the video signal and AI quality information included in the compressed RF packet.
- the image quality value detection unit 291 may extract an AI image quality area from the AI image quality information and detect a quality factor value of the extracted AI image quality area.
- the quality factor may be any one of luminance, brightness, gradation, and sharpness.
- the quality value detector 293 may transmit the value of the quality factor of the AI quality domain to the decoder 291 .
- the quality value detector 293 may output the image frame restored through the decoder 291 to the timing controller 299 .
- the RF receiving module 240 may transmit quality value information to the RF transmitting module 150 .
- the value of the AI quality factor may be fed back to the A/V transmission device 100.
- the main Soc 191 may transfer the received AI quality factor value to the AI quality processing unit 195 .
- the AI image quality processing unit 195 may be included in the main SoC 191.
- a special picture quality effect for the AI picture quality area can be maintained through such a feedback process for the value of the picture quality factor of the AI picture quality area.
- the user can watch an image having a special picture quality effect for the AI picture quality area.
- the above-described method can be implemented as a processor-readable code in a medium on which a program is recorded.
- media readable by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like.
- the A/V transmission device described above is not limited to the configuration and method of the above-described embodiments, but all or part of each embodiment is selectively combined so that various modifications can be made. may be configured.
Abstract
Description
Claims (15)
- A/V 수신 장치에 있어서,디스플레이;A/V 전송 장치로부터 압축 RF(Radio Frequency) 패킷을 수신하는 RF 수신 모듈, 상기 압축 RF 패킷은 컨텐트 영상에 상응하는 영상 프레임 및 상기 컨텐트 영상의 적어도 일부 영역을 나타내는 AI 화질 영역에 대한 AI 화질 정보를 포함함; 및상기 AI 화질 정보에 기초하여, 상기 AI 화질 영역의 화질 팩터의 값을 획득하고, 상기 화질 팩터의 값을 상기 A/V 전송 장치에 전송하고, 상기 A/V 전송 장치로부터, 상기 상기 AI 화질 영역의 상기 화질 팩터의 값이 보정된 화질 보정 값을 수신하고, 수신된 화질 보정 값에 기초하여, 상기 영상 프레임을 상기 디스플레이를 통해 출력하는 마이컴을 포함하는A/V 수신 장치.
- 제1항에 있어서,상기 마이컴은상기 화질 보정 값을 상기 AI 화질 영역에 적용하여, 상기 영상 프레임을 상기 디스플레이를 통해 출력하는A/V 수신 장치.
- 제1항에 있어서,상기 화질 팩터는 휘도, 밝기, 계조, 선명도 중 어느 하나인A/V 수신 장치.
- 제1항에 있어서,상기 AI 화질 정보는상기 AI 화질 영역이 상기 디스플레이 상에서 표시될 위치를 나타내는 상기 AI 화질 영역의 위치 정보를 포함하고,상기 마이컴은상기 위치 정보에 기초하여, 상기 AI 화질 영역의 상기 화질 팩터의 값을 측정하는A/V 수신 장치.
- 제1항에 있어서,상기 AI 화질 영역은특정 객체를 포함하고, 상기 영상 프레임의 전체 영역 중 상기 화질 팩터의 값이 다른 영역과 다르게 설정된 영역인A/V 수신 장치.
- 제1항에 있어서,상기 컨텐트 영상의 장르가 영화인 경우, 상기 AI 화질 영역은 상기 컨텐트 영상의 전체 영역인A/V 수신 장치.
- 제1항에 있어서,상기 마이컴은상기 AI 화질 정보에 포함된 상기 AI 화질 영역의 화질 팩터의 값과 측정된 AI 화질 영역의 화질 팩터의 값의 차이가 기 설정된 값 이상인 경우, 상기 측정된 화질 팩터의 값을 상기 A/V 전송 장치에 전송하는A/V 수신 장치.
- 무선 디스플레이 시스템에 있어서,RF 패킷을 생성하고, 생성된 RF 패킷을 압축하여, 압축된 압축 RF 패킷을 RF 통신을 통해, A/V 수신 장치에 전송하는 A/V 전송 장치, 상기 압축 RF 패킷은 컨텐트 영상에 상응하는 영상 신호 및 상기 컨텐트 영상의 적어도 일부 영역을 나타내는 AI 화질 영역에 대한 AI 화질 정보를 포함함; 및상기 AI 화질 정보에 기초하여, 상기 AI 화질 영역의 화질 팩터의 값을 획득하고, 상기 화질 팩터의 값을 상기 A/V 전송 장치에 전송하고, 상기 A/V 전송 장치로부터, 상기 상기 AI 화질 영역의 상기 화질 팩터의 값이 보정된 화질 보정 값을 수신하고, 수신된 화질 보정 값에 기초하여, 상기 영상 프레임을 디스플레이를 통해 출력하는 A/V 수신 장치를 포함하는무선 디스플레이 시스템.
- 제8항에 있어서,상기 A/V 수신 장치는상기 화질 보정 값을 상기 AI 화질 영역에 적용하여, 상기 영상 프레임을 상기 디스플레이를 통해 출력하는무선 디스플레이 시스템.
- 제8항에 있어서,상기 화질 팩터는 휘도, 밝기, 계조, 선명도 중 어느 하나인무선 디스플레이 시스템.
- 제8항에 있어서,상기 AI 화질 정보는상기 AI 화질 영역이 상기 디스플레이 상에서 표시될 위치를 나타내는 상기 AI 화질 영역의 위치 정보를 포함하고,상기 A/V 수신 장치는상기 위치 정보에 기초하여, 상기 AI 화질 영역의 상기 화질 팩터의 값을 측정하는무선 디스플레이 시스템.
- 제8항에 있어서,상기 AI 화질 영역은특정 객체를 포함하고, 상기 영상 프레임의 전체 영역 중 상기 화질 팩터의 값이 다른 영역과 다르게 설정된 영역인무선 디스플레이 시스템.
- 제8항에 있어서,상기 컨텐트 영상의 장르가 영화인 경우, 상기 AI 화질 영역은 상기 컨텐트 영상의 전체 영역인무선 디스플레이 시스템.
- 제8항에 있어서,상기 A/V 수신 장치는상기 AI 화질 정보에 포함된 상기 AI 화질 영역의 화질 팩터의 값과 측정된 AI 화질 영역의 화질 팩터의 값의 차이가 기 설정된 값 이상인 경우, 상기 측정된 화질 팩터의 값을 상기 A/V 전송 장치에 전송하는무선 디스플레이 시스템.
- 제8항에 있어서,상기 A/V 전송 장치는상기 A/V 수신 장치로부터 수신된 상기 화질 팩터의 값 정보에 기초하여, 상기 AI 화질 영역의 상기 화질 보정 값을 획득하는무선 디스플레이 시스템.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020247000666A KR20240023104A (ko) | 2021-07-15 | 2021-07-15 | A/v 수신 장치 및 무선 디스플레이 시스템 |
PCT/KR2021/009095 WO2023286889A1 (ko) | 2021-07-15 | 2021-07-15 | A/v 수신 장치 및 무선 디스플레이 시스템 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/KR2021/009095 WO2023286889A1 (ko) | 2021-07-15 | 2021-07-15 | A/v 수신 장치 및 무선 디스플레이 시스템 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023286889A1 true WO2023286889A1 (ko) | 2023-01-19 |
Family
ID=84920407
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2021/009095 WO2023286889A1 (ko) | 2021-07-15 | 2021-07-15 | A/v 수신 장치 및 무선 디스플레이 시스템 |
Country Status (2)
Country | Link |
---|---|
KR (1) | KR20240023104A (ko) |
WO (1) | WO2023286889A1 (ko) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190104927A (ko) * | 2019-08-22 | 2019-09-11 | 엘지전자 주식회사 | 사진 영상 제공 장치 및 사진 영상 제공 방법 |
KR102054453B1 (ko) * | 2019-04-03 | 2019-12-10 | 주식회사 포바이포 | 화질 개선된 인공지능 기반 영상 출력 방법 |
US20200014603A1 (en) * | 2018-07-03 | 2020-01-09 | Kabushiki Kaisha Ubitus | Method for enhancing quality of media transmitted via network |
KR102269034B1 (ko) * | 2019-11-20 | 2021-06-24 | 삼성전자주식회사 | 화질 관련 ai 메타 데이터를 이용하는 장치 및 방법 |
KR102276636B1 (ko) * | 2019-09-19 | 2021-07-12 | 에스케이텔레콤 주식회사 | Ai 기반 영상 자동 추적 및 재생장치와 방법 |
-
2021
- 2021-07-15 WO PCT/KR2021/009095 patent/WO2023286889A1/ko active Application Filing
- 2021-07-15 KR KR1020247000666A patent/KR20240023104A/ko unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200014603A1 (en) * | 2018-07-03 | 2020-01-09 | Kabushiki Kaisha Ubitus | Method for enhancing quality of media transmitted via network |
KR102054453B1 (ko) * | 2019-04-03 | 2019-12-10 | 주식회사 포바이포 | 화질 개선된 인공지능 기반 영상 출력 방법 |
KR20190104927A (ko) * | 2019-08-22 | 2019-09-11 | 엘지전자 주식회사 | 사진 영상 제공 장치 및 사진 영상 제공 방법 |
KR102276636B1 (ko) * | 2019-09-19 | 2021-07-12 | 에스케이텔레콤 주식회사 | Ai 기반 영상 자동 추적 및 재생장치와 방법 |
KR102269034B1 (ko) * | 2019-11-20 | 2021-06-24 | 삼성전자주식회사 | 화질 관련 ai 메타 데이터를 이용하는 장치 및 방법 |
Also Published As
Publication number | Publication date |
---|---|
KR20240023104A (ko) | 2024-02-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2011027957A1 (en) | Method for controlling external device and transmitting apparatus and receiving apparatus thereof | |
WO2017126835A1 (en) | Display apparatus and controlling method thereof | |
WO2015194693A1 (ko) | 영상 표시 기기 및 그의 동작 방법 | |
WO2017000313A1 (zh) | 图像处理系统、图像数据处理方法、装置及相关设备 | |
WO2016072693A1 (ko) | 컨텐츠의 색 범위 조정을 위한 방송 신호를 송수신하는 방법 및 장치 | |
EP2481220A2 (en) | Video signal generation apparatus and method minimizing crosstalk between luminance signal and color difference signal | |
WO2020171657A1 (en) | Display device and image display method of the same | |
WO2023286889A1 (ko) | A/v 수신 장치 및 무선 디스플레이 시스템 | |
WO2018066788A1 (ko) | 디스플레이 장치 | |
WO2020075952A1 (ko) | 전자 장치 및 전자 장치의 제어 방법 | |
WO2020135022A1 (zh) | 显示面板的画面优化方法、装置及计算机可读存储介质 | |
WO2023277205A1 (ko) | A/v 수신 장치 및 무선 디스플레이 시스템 | |
WO2019083138A1 (en) | ELECTRONIC DEVICE, AUDIO OUTPUT DEVICE, AND METHOD FOR OPERATING ELECTRONIC DEVICE | |
WO2022149650A1 (en) | Display device and display system | |
WO2022045389A1 (ko) | 영상 전송 장치 및 영상 수신 장치 | |
WO2022039284A1 (ko) | 원격 제어 장치 및 무선 디스플레이 시스템 | |
WO2023013798A1 (ko) | A/v 전송 장치 및 무선 디스플레이 시스템 | |
WO2021029469A1 (ko) | 디스플레이 장치 및 그의 동작 방법 | |
WO2022250174A1 (ko) | A/v 수신 장치 및 무선 디스플레이 시스템 | |
WO2024005241A1 (ko) | 디스플레이 장치 및 그의 동작 방법 | |
WO2021020627A1 (ko) | 디스플레이 장치 및 그의 동작 방법 | |
WO2022239887A1 (ko) | A/v 전송 장치 및 a/v 수신 장치 | |
WO2024010129A1 (ko) | 디스플레이 장치 및 그의 동작 방법 | |
WO2023054823A1 (en) | Display device | |
WO2023224146A1 (ko) | 무선 수신 장치 및 무선 디스플레이 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21950237 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20247000666 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020247000666 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2021950237 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021950237 Country of ref document: EP Effective date: 20240215 |