KR20100062696A - Image display device and method for image processing in image display device - Google Patents

Abstract

PURPOSE: A video display and a method for video processing are provided to divide video data or audio data efficiently according to the situation of the video buffer or the audio buffer. CONSTITUTION: A channel buffer(121) stores data stream. Video data and audio data are mixed within data stream. A demultiplexer(122) divides video data and audio data within the arbitrary section of the mixed data stream. A controller(140) selects the arbitrary section of the mixed data stream. The controller divides video data and audio data by the control of demultiplexer within the arbitrary section.

Description

Image display device and image processing method {IMAGE DISPLAY DEVICE AND METHOD FOR IMAGE PROCESSING IN IMAGE DISPLAY DEVICE}

The present invention relates to an image display apparatus for reproducing a moving image and sound received from the outside and an image processing method of the image display apparatus.

The image display device refers to a device stored in a memory or reproducing a video and sound received from the outside.

A television (TV), which is a form of an image display apparatus, receives and outputs a broadcast signal that is broadcast as an example of such an image display apparatus. As the television, an analog system that receives and outputs an analog broadcast signal is mainly used. Recently, a digital television that receives and outputs a digital broadcast signal has appeared. The digital television receives and outputs a video signal using an internet network.

In addition to the television, the image display device may be a mobile terminal such as a mobile communication terminal, a navigation device, a telematics terminal, a portable multimedia player (PMP), a laptop computer, or a desktop computer. ), Or a stationary terminal such as an IP TV.

The image display device receives an image from the outside in the form of a data stream in which video data and audio data are mixed. In order to reproduce an image, the image display apparatus needs to consider a method of separating video data and audio data from the mixed data stream, respectively.

The present invention provides an image processing method for efficiently separating video data and audio data included in a received data stream, and an image display apparatus using the same.

An image display apparatus according to an embodiment of the present invention for realizing the above object includes a channel buffer for storing a data stream mixed with video data and audio data, and a video included in an arbitrary section of the mixed data stream. A demultiplexer for separating data and audio data, and a controller for selecting an arbitrary section of the mixed data stream and controlling the demultiplexer to separate video data or audio data included in the selected arbitrary section.

In an aspect of the present invention, the video buffer may further include a video buffer for temporarily storing video data separated from the data stream and an audio buffer for temporarily storing audio data separated from the data stream.

In another aspect of the present invention, the controller may observe the storage space of the audio buffer or the video buffer, and select the arbitrary section according to the observed result.

In another aspect of the present invention, the control unit observes the storage space of the audio buffer or video buffer, and includes audio data or video data to be additionally stored in the audio buffer or video buffer of the data stream. The portion can be selected in any of the above intervals.

In another aspect of the present invention, the control unit observes the storage space of the audio buffer, and if the audio data stored in the storage space of the audio buffer exceeds a predetermined size, of the video buffer of the data stream A portion including continuous video data in the video data stored in the storage space may be selected as the arbitrary section.

In another aspect of the present invention, the control unit observes the storage space of the video buffer, and if the video data stored in the storage space of the video buffer exceeds a predetermined size, of the audio buffer of the data stream A portion including continuous audio data in the audio data stored in the storage space may be selected as the arbitrary section.

In another aspect of the present invention, the control unit observes the storage space of the audio buffer and the video buffer, and if the amount of storage capacity that can be stored in the audio buffer is larger than the amount of storage capacity that can be stored in the video buffer, A portion of the data stream in which audio data stored in the storage space of the audio buffer includes continuous audio data may be selected as the arbitrary section.

In another aspect of the present invention, the control unit, if the amount of storage capacity that can be stored in the audio buffer is smaller than the amount of storage capacity that can be stored in the video buffer, the video stored in the storage space of the video buffer of the data stream A portion including continuous video data in the data may be selected as the arbitrary section.

According to another aspect of the present invention, there is provided an image processing method of an image display apparatus, the method comprising: observing a storage space of an audio buffer or a video buffer, and storing audio stored in a channel buffer according to the observed result. Selecting an interval of a data stream in which data and video data are mixed, and separating audio data or video data included in the selected arbitrary interval.

In an aspect of the present invention, the selecting may include selecting, as the arbitrary section, a portion of the data stream including audio data or video data to be additionally stored in the audio buffer or the video buffer.

In another aspect of the present invention, the observing step is a step of observing a storage space of the audio buffer, and wherein the selecting step is performed when the audio data stored in the storage space of the audio buffer exceeds a preset size. And selecting a portion of the data stream in which video data stored in the storage space of the video buffer includes continuous video data as the arbitrary section.

In another aspect of the invention, the step of observing, the step of observing the storage space of the audio buffer, the selecting step, the video data stored in the storage space of the video buffer exceeds a predetermined size In this case, it may be a step of selecting, as the arbitrary section, a portion of the data stream in which audio data stored in the storage space of the audio buffer includes continuous audio data.

In another aspect of the present invention, the selecting may include: storing a storage space of the audio buffer in the data stream when the storage capacity of the audio buffer is greater than the storage capacity of the video buffer. The portion in which the stored audio data includes continuous audio data may be selected as the arbitrary section.

In still another aspect of the present invention, if the amount of storage capacity that can be stored in the audio buffer is smaller than the amount of storage capacity that can be stored in the video buffer, the data stream may be continuously connected to the video data stored in the storage space of the video buffer. It may be a step of selecting a portion including video data as the arbitrary section.

An image display apparatus according to at least one embodiment of the present invention configured as described above selects an arbitrary section of a mixed data stream to separate video data or audio data included in the selected arbitrary section, thereby providing a video buffer. Alternatively, video data or audio data can be separated efficiently according to the situation of the audio buffer.

Hereinafter, an image display device according to the present invention will be described in detail with reference to the accompanying drawings. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other.

The image display device described herein includes a television, a DVD player, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a PMP. (Portable Multimedia Player), navigation, and other electronic devices having a function of receiving and playing images from the outside may be included.

1 is a block diagram of a video display device according to an embodiment of the present invention.

The mobile terminal 100 includes an image receiver 110, an image processor 120, an image output unit 130, a controller 140, a memory 150, a user input unit 160, an interface unit 170, and the like. can do. The components shown in FIG. 1 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The image receiver 110 receives an image signal and / or information related to an image from the outside of the image display apparatus and transmits the image signal to the image processor 120. The image receiver 110 may include an external signal receiver 111 and a tuner 112.

The external signal receiver 111 may receive an external signal received from an external device and / or a network such as a digital versatile disk (DVD), a set top box, a camcorder, a wired / wireless internet network, and the like.

Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

Wired Internet technologies include Ethernet, Hybrid Fiber Coax (HFC), Asymmetric Digital Subscriber Line (ADSL), and Very High-data Rate Digital Subscriber Line. ; VDSL), Fiber-to-the-home (FTTH), PLC (Power Line Communication), etc. may be used.

The external device and the image display device 100 may be connected by wire and / or wirelessly through the external signal receiver 111.

When the external device and the image display device 100 are wirelessly connected, the external device may be connected through short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The tuner 112 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast associated information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The tuner 112 may be, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), or Digital Video Broadcast-Handheld (DVB-H). ), A digital broadcasting signal may be received using a digital broadcasting system such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the tuner 112 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The image signal and / or image related information received through the image receiving unit 110 may be stored in the memory 160.

The image processor 120 receives an image signal from the image receiver 110 and processes the image signal to be output by the image output unit 130. The image processor 120 may include a channel buffer 121, a demultiplexer 122, an audio buffer 123, a video buffer 124, an audio decoder 125, a video decoder 126, and the like.

The channel buffer 121 may receive an image signal from the image receiver 110 and temporarily store the image signal. The video signal is stored in the form of a data stream in which video data for video reproduction and video data for sound reproduction are mixed in an image.

Data stored in the channel buffer 121 may be deleted after being transmitted to the demultiplexer 122. Data stored in the channel buffer 121 may be deleted immediately after being transmitted to the demultiplexer 122 or may be deleted after a predetermined time.

The demultiplexer 122 is a circuit that receives one or more signals and outputs a greater number of signals to the outside than the number of received signals, also referred to as DEMUX.

The demultiplexer 122 used in the image processor 120 may receive one data stream and convert the same into two or more signals including audio data and video data.

The audio data and the video data separated by the demultiplexer 122 may be temporarily stored in the audio buffer 123 and the video buffer 124, respectively.

The audio buffer 123 temporarily stores the audio data separated by the demultiplexer 122 and transmits the audio data to the audio decoder 125. The video buffer 124 also temporarily stores the video data separated by the demultiplexer 122 and transmits the video data to the video decoder 126.

Data stored in the audio and / or video buffers 123 and 124 may be deleted after being transmitted to the audio and / or video decoders 125 and 126. Data stored in the audio and / or video buffers 123 and 124 may be deleted immediately after being transmitted to the audio and / or video decoders 125 and 126 or after a predetermined time elapses.

The audio decoder 125 may convert the audio data into a format usable by the controller 140 or the image output unit 130. The audio data may have various forms. E.g,

The video decoder 126 may convert the video data into a format usable by the controller 140 or the image output unit 130. The video data may have various forms. For example, video data in the form of AVI (Audio Video Interleaved), Motion Picture Expert Group (MPEG), DivX, XviD, and Windows Media Video codec (WMV) may be encoded / decoded.

The image output unit 130 reproduces the image and / or the sound by using the data converted by the audio decoder 125 and / or the video decoder 126. The image output unit 130 may include a display unit 131 and a sound output module 132.

The display unit 131 displays and outputs information processed by the image display apparatus 100. For example, when the video display device 100 is in a video output mode, a video is output. When the image display apparatus 100 is in an internet communication mode, the image display apparatus 100 displays a user interface (UI) or a graphic user interface (GUI) related to internet communication.

The display unit 131 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display The display device may include at least one of a flexible display, a 3D display, a plasma display panel (PDP), and a multi display tube (MDT).

The sound output unit 132 outputs sound data decoded using the audio decoder 125. The sound output unit 122 may include at least one of a dynamic speaker, an electrostatic speaker, and a planar-magnetic speaker.

The controller 140 controls the overall operation of the image display apparatus 100. For example, the controller 140 processes data received using the image receiver 110 or processes data stored in the memory 150. To this end, the controller 140 may include a digital signal processor (DSP).

The memory 150 may store a program for processing and controlling the controller 140, or may perform a function for temporarily storing input / output data. The memory 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. The image display apparatus 100 may operate a web storage that performs a storage function of the memory 140 on the Internet.

The user input unit 160 receives a signal for controlling the operation of the image display apparatus 100. The operation control signal may mean a control operation (including Rewind, Fast-Foward, Pause, Record, etc.) of a video currently being played. The operation control signal controls the operation of the image display apparatus 100 (power on / off, scheduled recording, internet communication module enable / disable, short range wireless communication module enable / disable, broadcast channel change function, volume control function, mute function, etc.). In addition to the signal for controlling the image display apparatus 100, the user may directly input sound data or image data through a camera or a microphone to the user input unit 160.

The signals may be directly input by the user or indirectly using a wired / wireless remote controller.

The interface unit 170 serves as a path with all external devices connected to the image display device 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the image display device 100, or transmits data inside the mobile terminal 100 to an external device. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 130.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. The software code may be stored in the memory 140 and executed by the controller 130.

As illustrated in FIG. 1, the channel buffer 121 may temporarily store a data stream in which video data and audio data are mixed.

As illustrated in FIG. 1, the demultiplexer 122 may separate video data and audio data included in an arbitrary section of the mixed data stream. The demultiplexer 122 does not read a data stream stored in the channel buffer 121 in a first in first out (FIFO) manner, but reads an arbitrary section existing in the data stream, and an arbitrary section. It is possible to separate video data and audio data existing within.

As shown in FIG. 1, the audio buffer 123 may temporarily store audio data separated from the data stream. The video buffer 124 may temporarily store video data separated from the data stream.

As illustrated in FIG. 1, the controller 140 may select an arbitrary section of the mixed data stream. The controller 140 may control the demultiplexer 122 to separate video data or audio data included in a selected item.

The controller 140 may observe a storage space of the audio buffer 123 or the video buffer 124. The controller 140 may select the arbitrary section according to the observed result.

The controller 140 may select a portion of the data stream including audio data or video data to be additionally stored in the audio buffer 123 or the video buffer 124 as the arbitrary section.

The controller 140 may designate data to be decoded in succession to data decoded by the decoders 125 and 126 as audio data or video data to be additionally stored in the buffers 123 and 124.

The controller 140 observes the storage space of the audio buffer 123 and when the audio data stored in the storage space of the audio buffer exceeds a preset size, the storage space of the video buffer 124 of the data stream. The portion in which the video data stored in the continuous video data is included may be selected as the arbitrary section.

When the audio data exceeds a preset size, the size of the audio data stored in the audio buffer 123 exceeds a preset predetermined size, or the audio data stored in the audio buffer 123 is the entire audio buffer. The ratio of the size occupied in the storage space 123 may exceed a predetermined ratio.

Similarly, the controller 140 observes the storage space of the video buffer 124 and when the video data stored in the storage space of the video buffer 124 exceeds a preset size, the audio of the data stream. A portion including continuous audio data in the audio data stored in the storage space of the buffer 123 may be selected as the arbitrary section.

When the video data exceeds a preset size, the size of the video data stored in the video buffer 124 exceeds a preset predetermined size, or the video data stored in the video buffer 124 is the entire video buffer. A ratio of the size occupied by the storage space 124 may exceed a predetermined ratio.

Alternatively, the controller 140 observes the storage space of the audio buffer 123 and the video buffer 124, and stores the amount of storage capacity that can be stored in the audio buffer 123 and the storage capacity that can be stored in the video buffer 124. The size of the doses can be compared.

As a result of the comparison, when it is determined that the storage capacity that can be stored in the audio buffer 123 is larger than the storage capacity that can be stored in the video buffer 124, the storage of the audio buffer 123 of the data stream is stored. A portion including continuous audio data in the audio data stored in the space may be selected as the arbitrary section.

Alternatively, when it is determined that the storage capacity that can be stored in the audio buffer 123 is smaller than the storage capacity that can be stored in the video buffer 124, the video buffer 124 of the data stream may be stored. A portion including continuous video data in the video data stored in the storage space may be selected as the arbitrary section.

In other words, the controller 140 compares the size of the storage capacity that can be stored in the audio buffer 123 with the size of the storage capacity that can be stored in the video buffer 124. An interval including audio data or video data to be stored in a larger buffer may be selected as an arbitrary interval to cause the demultiplexer 122 to separate the data stream.

2A, 2B, and 2C illustrate a flow of data when a demultiplexer of an image display device divides a data stream by a first-in first-out method.

As shown in FIG. 2A, audio data A ₁ , A ₂ , A ₃ , A ₄ and video data V ₁ , V ₂ , V ₃ , V ₄ are mixed in the channel buffer 121. The stream may be stored temporarily.

As shown in FIG. 2B, data stored in the channel buffer 121 may be transmitted to the demultiplexer 122. The channel buffer 121 may delete the data A ₁ , A ₂ , A ₃ , V ₁ , V ₂ transmitted to the demultiplexer 122 from the channel buffer 121.

The demultiplexer 122 detects data A ₁ , A ₂ , A ₃ , V ₁ , V ₂ received from the channel buffer 121, and separates the data into audio data and video data.

As shown in FIG. 2C, the demultiplexer 122 separates the separated audio data A ₁ , A ₂ , A ₃ and the video data V ₁ , V ₂ into an audio buffer 123 and a video buffer 124, respectively. To send).

The demultiplexer 122 deletes the data A ₁ , A ₂ , A ₃ , V ₁ , V ₂ transmitted to the audio buffer 123 and the video buffer 124, and removes new data A from the channel buffer. ₄ , A ₅ , V ₃ , V ₄ , V ₅ ) can be received.

When the demultiplexer 122 reads the data stream using a first-in, first-out method, the demultiplexer 122 stores video data V ₃ consecutive to the video data V ₂ stored in the video buffer 124. Should be separated.

However, in this case, the video buffer 124 does not have a space for additionally storing video data due to the already stored video data V ₁ and V ₂ .

Accordingly, the demultiplexer 122 should stop the operation until the video buffer 124 deletes the video data stored in the video buffer 124 after the data buffer 124 transmits the data to the video decoder 126.

3A, 3B, 3C, 3D, and 3E illustrate data flow when a demultiplexer of an image display apparatus selects an arbitrary section of a data stream to separate data.

3A and 3B, operations of the channel buffer 121, the demultiplexer 122, the audio buffer 123, and the video buffer 124 are the same as those of FIGS. 2A and 2B, and thus description thereof is omitted.

As shown in FIG. 3C, after the demultiplexer 122 transmits data to the audio buffer 123 and the video buffer 124, the controller 140 controls the audio buffer 123 and the video buffer 124. You can observe the storage space of).

Since the video buffer 124 has insufficient storage space due to pre-stored video data V ₁ and V ₂ , even though the demultiplexer 122 reads the video data, the video buffer 124 receives the separated video data. Could not transfer to

In contrast, the audio buffer 123 has a storage space in addition to the pre-stored audio data A ₁ , A ₂ , and A ₃ .

In this case, the controller 140 may select a section including audio data A ₄ continuous to the audio data stored in the audio buffer 123 as an arbitrary section d. In addition, the controller 140 may control the demultiplexer 122 to separate data by reading a data stream corresponding to the arbitrary section d.

As shown in FIG. 3D, the demultiplexer 122 may read data streams corresponding to the arbitrary period d to separate data.

As shown in FIG. 3E, the demultiplexer 122 may transmit the audio data A ₄ separated from the data stream corresponding to the arbitrary section d to the audio buffer 123.

When the video buffer 124 temporarily transmits the video data V ₁ and V ₂ temporarily stored to the decoder and then stores the new video data V ₃ , the demultiplexer 122 uses the channel buffer 121. Can receive a data stream starting with new video data V ₃ .

The controller 140 may control the demultiplexer 122 to preferentially separate the new video data V ₃ from the bitstream.

Alternatively, the image display device 100 may further include a separate buffer (not shown) for temporarily storing data stored in the demultiplexer 122.

The demultiplexer 122 may transfer the temporarily stored data V ₄ , A ₅ , and V ₅ to a separate buffer (not shown) and delete the data from the demultiplexer 122. The demultiplexer 122 receives a data stream starting with new video data V ₃ from the channel buffer 121 and separates it, and then temporarily stores the data V ₄ , A in a separate buffer (not shown). ₅ , V ₅ ) can be read.

The separate buffer (not shown) may be implemented using one region of the channel buffer 121.

3A, 3B, 3C, 3D, and 3E show that the storage capacity of the video buffer 124 exceeds a preset size, the present invention shows that the storage capacity of the audio buffer 123 exceeds a preset size. The same may be applied to the case.

4 is a flowchart illustrating an image processing method of an image display apparatus according to an exemplary embodiment.

When the image display apparatus 100 receives a data stream in which audio data and video data are mixed (S101), the received data stream is temporarily stored in the channel buffer 121 (S102).

The controller 140 may observe the audio buffer 123 or the video buffer 124 (S103). If the controller 140 determines that the amount of the remaining storage capacity that can be stored in the audio buffer 123 is greater than the amount of the remaining storage capacity that can be stored in the video buffer 124 (S103), the controller 140 determines the channel buffer. Among the data streams stored in 121, an arbitrary section including continuous audio data is selected in the data stored in the audio buffer 123 (S105a).

The controller 140 controls the demultiplexer 122 to separate audio data included in a selected random section (S106a).

The controller 140 may temporarily store the separated audio data in the audio buffer 123 (S107a).

If the controller 140 determines that the size of the remaining storage capacity that can be stored in the audio buffer 123 is smaller than the size of the remaining storage capacity that can be stored in the video buffer 124 (S103), the controller 140 determines that the size of the remaining storage capacity is smaller than that of the video buffer 124. Among the data streams stored in the channel buffer 121, an arbitrary section including continuous video data in the data stored in the video buffer 124 is selected (S105b).

The controller 140 controls the demultiplexer 122 to separate video data included in a selected random section (S106b).

The controller 140 may temporarily store the separated video data in the video buffer 124 (S107b).

5 is a flowchart illustrating an image processing method of an image display apparatus in which a control unit observes an audio buffer and sets an arbitrary section to separate a data stream.

When the image display apparatus 100 receives a data stream in which audio data and video data are mixed (S201), the received data stream is temporarily stored in the channel buffer 121 (S202).

The controller 140 may observe the audio buffer 123 (S203). When the controller 140 determines that the size of the audio data stored in the audio buffer exceeds a preset size (S204), the controller 140 may continuously output video data to data stored in the video buffer among the mixed data streams. The included section may be selected as an arbitrary section (S205).

The controller 140 controls the demultiplexer 122 to separate audio data included in a selected random section (S206).

The controller 140 may temporarily store the separated audio data in the audio buffer 123 (S207).

If the controller 140 determines that the size of the audio data stored in the audio buffer does not exceed a preset size (S204), the image display device may continue to receive the data stream (S201).

6 is a flowchart illustrating an image processing method of an image display apparatus in which a controller observes a video buffer and sets an arbitrary section to separate a data stream.

In FIG. 6, the controller 140 observes the video buffer 124 in a method similar to the method illustrated in FIG. 5 in step S303, and selects an arbitrary section of the data stream in step S305. In addition, the control unit 140 may separate the video data included in the random section selected by the demultiplexer 122 (S306), and temporarily store the separated video data in the video buffer 124 (S307).

The image display device implementing the image processing method described above is not limited to the configuration and method of the embodiments described above. The above embodiments may be configured by selectively combining all or part of the embodiments so that various modifications can be made.

1 is a block diagram of a video display device related to an embodiment of the present invention.

2A, 2B, and 2C illustrate a flow of data when a demultiplexer of an image display device divides a data stream by a first-in first-out method.

3A, 3B, 3C, 3D, and 3E are diagrams illustrating the flow of data when a demultiplexer of an image display device separates data by selecting an arbitrary section of a data stream.

4 is a flowchart illustrating an image processing method of an image display apparatus according to an exemplary embodiment of the present invention.

5 is a flowchart illustrating an image processing method of an image display apparatus in which a control unit observes an audio buffer and sets an arbitrary section to separate a data stream.

6 is a flowchart illustrating an image processing method of an image display apparatus in which a control unit observes a video buffer and sets an arbitrary section to separate a data stream.

Claims (14)

A channel buffer for storing a data stream in which video data and audio data are mixed; A demultiplexer for separating video data and audio data included in an arbitrary section of the mixed data stream; And a controller configured to select an arbitrary section of the mixed data stream and control the demultiplexer to separate video data or audio data included in the selected arbitrary section. According to claim 1, A video buffer for temporarily storing video data separated from the data stream; And an audio buffer for temporarily storing audio data separated from the data stream. The method of claim 2, The control unit, And observing the storage space of the audio buffer or the video buffer and selecting the arbitrary section according to the observed result. The method of claim 3, The control unit, Observe the storage space of the audio buffer or the video buffer, And selecting a portion of the data stream including audio data or video data to be additionally stored in the audio buffer or video buffer as the arbitrary section. The method of claim 3, The control unit, Observe the storage space of the audio buffer, When the audio data stored in the storage space of the audio buffer exceeds a preset size, And a portion of the data stream in which the video data stored in the storage space of the video buffer includes continuous video data as the arbitrary section. The method of claim 3, The control unit, Observe the storage space of the video buffer, When the video data stored in the storage space of the video buffer exceeds a preset size, And a portion of the data stream in which the audio data stored in the storage space of the audio buffer includes continuous audio data as the arbitrary section. The method of claim 3, The control unit, Observe the storage space of the audio buffer and the video buffer, When the size of the storage capacity that can be stored in the audio buffer is greater than the storage capacity that can be stored in the video buffer, And a portion of the data stream in which the audio data stored in the storage space of the audio buffer includes continuous audio data as the arbitrary section. The method of claim 7, wherein The control unit, When the size of the storage capacity that can be stored in the audio buffer is smaller than the storage capacity that can be stored in the video buffer, And a portion of the data stream in which the video data stored in the storage space of the video buffer includes continuous video data as the arbitrary section. Observing the storage space of the audio buffer or the video buffer; Selecting an arbitrary section of a data stream in which audio data and video data stored in a channel buffer are mixed according to the observed result; And separating the audio data or the video data included in the selected arbitrary section. The method of claim 9, The selecting step, And selecting a portion of the data stream including audio data or video data to be additionally stored in the audio buffer or the video buffer as the arbitrary section. The method of claim 9, Observing the step, Observing a storage space of the audio buffer, The selecting step, When the audio data stored in the storage space of the audio buffer exceeds a preset size, And selecting a portion of the data stream including continuous video data in the video data stored in the storage space of the video buffer as the arbitrary section. The method of claim 9, Observing the step, Observing a storage space of the audio buffer, The selecting step, When the video data stored in the storage space of the video buffer exceeds a preset size, And selecting a portion of the data stream in which the audio data stored in the storage space of the audio buffer includes continuous audio data as the arbitrary section. The method of claim 9, The selecting step, When the size of the storage capacity that can be stored in the audio buffer is greater than the storage capacity that can be stored in the video buffer, And selecting a portion of the data stream in which the audio data stored in the storage space of the audio buffer includes continuous audio data as the arbitrary section. The method of claim 9, When the size of the storage capacity that can be stored in the audio buffer is smaller than the storage capacity that can be stored in the video buffer, And selecting a portion of the data stream including continuous video data in the video data stored in the storage space of the video buffer as the arbitrary section.

Images