KR102647940B1 - Display device - Google Patents

Abstract

A display device according to an embodiment of the present invention includes a display unit, an external device interface unit that receives an image signal from a set-top box connected to the display device, information on the standard banner, and location information of a channel number included in the standard banner. If there is a banner matching the standard banner in the broadcast video of the broadcast channel changed according to the request to change the storage unit and broadcast channel, recognize the channel number in the banner based on the location information of the channel number, and , may include a control unit that displays broadcast information related to the recognized channel number on the display unit.

Description

Display device {DISPLAY DEVICE}

The present invention relates to a display device, and more specifically, to a display device that can recognize the channel number of a broadcast program when watching a broadcast program provided from a set-top box connected to the display device.

Digital TV services using wired or wireless communication networks are becoming popular. Digital TV services can provide a variety of services that cannot be provided by existing analog broadcasting services.

For example, IPTV (Internet Protocol Television) and smart TV services, which are types of digital TV services, provide interactivity that allows users to actively select the type of program to watch and the viewing time. IPTV and smart TV services can provide various additional services, such as Internet search, home shopping, and online games, based on this interactivity.

This TV can be connected to a set-top box and provide broadcast programs input from the set-top box.

However, although the TV can obtain Electronic Program Guide (EPG) information from the set-top box, it cannot know the channel number of the broadcast program that the user is currently watching.

Since the TV could not know the channel number of the broadcast program, it could not recommend other channels to the user or provide information about the channel of the broadcast program.

Accordingly, users were unable to use functions related to channels or broadcast programs provided by the TV by using only the remote control of the set-top box, rather than using the TV's remote control.

The purpose of the present invention is to provide a display device that can recognize the channel number of a broadcast program provided from a set-top box connected to the display device.

The purpose of the present invention is to recognize the channel number of a broadcast program provided from a set-top box and provide broadcast information related to the channel number to the user.

The purpose of the present invention is to provide a display device that can extract a banner from a broadcast video provided from a set-top box and recognize a channel number from the extracted banner.

A display device according to an embodiment of the present invention includes a display unit, an external device interface unit that receives an image signal from a set-top box connected to the display device, information on the standard banner, and location information of a channel number included in the standard banner. If there is a banner matching the standard banner in the broadcast video of the broadcast channel changed according to the request to change the storage unit and broadcast channel, recognize the channel number in the banner based on the location information of the channel number, and , may include a control unit that displays broadcast information related to the recognized channel number on the display unit.

According to various embodiments of the present invention, the channel number of a broadcast program provided from a set-top box connected to a display device can be quickly recognized.

Additionally, according to an embodiment of the present invention, the user can receive various broadcasting information such as channel recommendation information and broadcast program information that the TV itself can provide by using the recognized channel number.

Additionally, according to an embodiment of the present invention, the channel number recognition algorithm is performed on the area where the banner is displayed rather than the entire area of the broadcast video, so the amount of calculation of the processor can be reduced. Accordingly, the display device can recognize the channel number more quickly, and the user can receive broadcast information related to the channel number more quickly.

Figure 1 shows a block diagram of the configuration of a display device according to an embodiment of the present invention.
Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention.
Figure 3 shows an example of the actual configuration of a remote control device according to an embodiment of the present invention.
Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.
Figure 5 is a diagram explaining the configuration of a display system according to an embodiment of the present invention.
Figure 6 is a flowchart for explaining a method of operating a display device according to an embodiment of the present invention.
Figures 7 and 8 are diagrams illustrating an example of recognizing the channel number of a currently broadcasting program and providing related broadcasting information according to an embodiment of the present invention.
9 to 15 are diagrams illustrating a process for recognizing the number of a broadcast channel currently being viewed according to an embodiment of the present invention.
Figure 16 is a diagram illustrating in detail the configuration of a control unit that recognizes the number of a broadcast channel according to an embodiment of the present invention.
Figure 17 is a flowchart explaining the process of recognizing a channel number using a banner according to another embodiment of the present invention.
Figure 18 is a flowchart explaining processing when the channel number is not recognized even through the main banner and sub-banner according to an embodiment of the present invention.
FIGS. 19A to 19C are diagrams explaining that the position where the channel number is displayed varies depending on the type of set-top box connected to the display device.
Figure 20 is a diagram explaining a display system according to another embodiment of the present invention.
FIG. 21 is a ladder diagram for explaining a method of operating a display system according to an embodiment of the present invention.
FIG. 22 is a diagram illustrating a database built using set-top box information collected from a plurality of display devices according to an embodiment of the present invention.
FIG. 23 is a diagram illustrating an example of recognizing the channel number of a currently broadcasting program and providing related broadcasting information according to another embodiment of the present invention.
Figure 24 is a flowchart explaining a method of operating a display device according to another embodiment of the present invention.
25 to 32 are diagrams illustrating a process for obtaining a reference banner using a plurality of image frames corresponding to each of a plurality of broadcast channels according to an embodiment of the present invention.
Figure 33 is a flowchart illustrating a process of determining whether a banner included in a video of a changed broadcast channel matches the standard banner when there is a pre-stored standard banner according to an embodiment of the present invention.

Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes “module” and “part” for components used in the following description are given or used interchangeably only for the ease of preparing the specification, and do not have distinct meanings or roles in themselves.

The display device according to an embodiment of the present invention is, for example, an intelligent display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function while adding an Internet function, etc., such as a handwriting input device and a touch screen. Alternatively, it can be equipped with a more convenient interface such as a spatial remote control. In addition, by supporting wired or wireless Internet functions, it is possible to connect to the Internet and a computer and perform functions such as email, web browsing, banking, or gaming. A standardized general-purpose OS can be used for these various functions.

Accordingly, in the display device described in the present invention, for example, various applications can be freely added or deleted on a general-purpose OS kernel, so various user-friendly functions can be performed. More specifically, the display device may be, for example, a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and in some cases, may also be applied to a smartphone.

Figure 1 shows a block diagram of the configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1, the display device 100 includes a broadcast reception unit 130, an external device interface unit 135, a storage unit 140, a user input interface unit 150, a control unit 170, and a wireless communication unit 173. , may include a display unit 180, an audio output unit 185, and a power supply unit 190.

The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface unit 133.

The tuner 131 can select a specific broadcast channel according to a channel selection command. The tuner 131 may receive a broadcast signal for a specific selected broadcast channel.

The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal to a form that can be output.

The external device interface unit 135 may receive an application or application list in an adjacent external device and transmit it to the control unit 170 or the storage unit 140.

The external device interface unit 135 may provide a connection path between the display device 100 and an external device. The external device interface unit 135 may receive one or more of video and audio output from an external device connected wirelessly or wired to the display device 100 and transmit it to the control unit 170. The external device interface unit 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more High Definition Multimedia Interface (HDMI) terminals, and a component terminal.

An image signal from an external device input through the external device interface unit 135 may be output through the display unit 180. A voice signal from an external device input through the external device interface unit 135 may be output through the audio output unit 185.

An external device that can be connected to the external device interface unit 135 may be any one of a set-top box, Blu-ray player, DVD player, game console, sound bar, smartphone, PC, USB memory, or home theater, but this is only an example. .

The network interface unit 133 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 133 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

Additionally, some of the content data stored in the display device 100 may be transmitted to a selected user or selected electronic device among other users or other electronic devices pre-registered in the display device 100.

The network interface unit 133 can access a certain web page through a connected network or another network linked to the connected network. In other words, you can access a certain web page through a network and transmit or receive data with the corresponding server.

And, the network interface unit 133 can receive content or data provided by a content provider or network operator. That is, the network interface unit 133 can receive content and related information such as movies, advertisements, games, VOD, and broadcast signals provided from a content provider or network provider through a network.

Additionally, the network interface unit 133 can receive firmware update information and update files provided by a network operator, and can transmit data to the Internet, a content provider, or a network operator.

The network interface unit 133 can select and receive a desired application from among applications that are open to the public through a network.

The storage unit 140 stores programs for processing and controlling each signal in the control unit 170, and can store signal-processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporary storage of video, voice, or data signals input from the external device interface unit 135 or the network interface unit 133, and may perform a predetermined storage function through the channel memory function. You can also store information about the image.

The storage unit 140 may store an application or application list input from the external device interface unit 135 or the network interface unit 133.

The display device 100 can play content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 140 and provide them to the user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 uses various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or infrared (IR) communication. Control signals such as power on/off, channel selection, and screen settings can be received and processed from the remote control device 200, or control signals from the control unit 170 can be transmitted to the remote control device 200.

Additionally, the user input interface unit 150 can transmit control signals input from local keys (not shown) such as power key, channel key, volume key, and setting value to the control unit 170.

The image signal processed by the control unit 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

The voice signal processed by the control unit 170 may be output as audio to the audio output unit 185. Additionally, the voice signal processed by the control unit 170 may be input to an external output device through the external device interface unit 135.

In addition, the control unit 170 may control overall operations within the display device 100.

In addition, the control unit 170 can control the display device 100 by a user command or internal program input through the user input interface unit 150, and connects to the network to display an application or application list desired by the user on the display device. You can download it within (100).

The control unit 170 allows channel information selected by the user to be output through the display unit 180 or the audio output unit 185 along with the processed video or audio signal.

In addition, the control unit 170 controls the external device image playback command received through the user input interface unit 150, from an external device, for example, a camera or camcorder, input through the external device interface unit 135. A video signal or audio signal can be output through the display unit 180 or the audio output unit 185.

Meanwhile, the control unit 170 can control the display unit 180 to display an image, for example, a broadcast image input through the tuner 131, or an external input input through the external device interface unit 135. An image, an image input through the network interface unit, or an image stored in the storage unit 140 can be controlled to be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or 3D image.

Additionally, the control unit 170 can control the playback of content stored in the display device 100, received broadcast content, or external input content, which may include broadcast video, external input video, or audio files. , can be in various forms such as still images, connected web screens, and document files.

The wireless communication unit 173 can communicate with external devices through wired or wireless communication. The wireless communication unit 173 can perform short range communication with an external device. To this end, the wireless communication unit 173 uses Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wi-Fi. Short-distance communication can be supported using at least one of (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. This wireless communication unit 173 is connected between the display device 100 and a wireless communication system, between the display device 100 and another display device 100, or between the display device 100 and the display device 100 through wireless area networks. Wireless communication between networks where the display device 100 (or an external server) is located can be supported. Local area wireless networks may be wireless personal area networks.

Here, the other display device 100 is a wearable device capable of exchanging data with (or interoperating with) the display device 100 according to the present invention, for example, a smartwatch, smart glasses. It can be a mobile terminal such as (smart glass), HMD (head mounted display), or smart phone. The wireless communication unit 173 may detect (or recognize) a wearable device capable of communication around the display device 100. Furthermore, if the detected wearable device is a device authenticated to communicate with the display device 100 according to the present invention, the control unit 170 sends at least part of the data processed by the display device 100 to the wireless communication unit 173. It can be transmitted to a wearable device. Accordingly, a user of a wearable device can use data processed by the display device 100 through the wearable device.

The display unit 180 converts the video signal, data signal, and OSD signal processed by the control unit 170 or the video signal and data signal received from the external device interface unit 135 into R, G, and B signals, respectively, and operates them. A signal can be generated.

Meanwhile, the display device 100 shown in FIG. 1 is only one embodiment of the present invention. Some of the illustrated components may be integrated, added, or omitted depending on the specifications of the display device 100 that is actually implemented.

That is, as needed, two or more components may be combined into one component, or one component may be subdivided into two or more components. Additionally, the functions performed by each block are for explaining embodiments of the present invention, and the specific operations or devices do not limit the scope of the present invention.

According to another embodiment of the present invention, unlike shown in FIG. 1, the display device 100 does not have a tuner 131 and a demodulation unit 132, but includes a network interface unit 133 or an external device interface unit ( You can also receive and play video through 135).

For example, the display device 100 is divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services, and a content playback device for playing content input from the image processing device. It can be implemented.

In this case, the method of operating a display device according to an embodiment of the present invention, which will be described below, includes not only the display device 100 as described with reference to FIG. 1, but also an image processing device such as the separated set-top box or a display unit ( 180) and a content playback device including an audio output unit 185.

Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present invention will be described.

Figure 2 is a block diagram of a remote control device according to an embodiment of the present invention, and Figure 3 shows an example of the actual configuration of the remote control device 200 according to an embodiment of the present invention.

First, referring to FIG. 2, the remote control device 200 includes a fingerprint recognition unit 210, a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, and a power supply unit 260. ), a storage unit 270, a control unit 280, and a voice acquisition unit 290.

Referring to FIG. 2, the wireless communication unit 225 transmits and receives signals to and from any one of the display devices according to the embodiments of the present invention described above.

The remote control device 200 has an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to RF communication standards, and an RF module 221 capable of transmitting and receiving signals to and from the display device 100 according to IR communication standards. An IR module 223 may be provided. Additionally, the remote control device 200 may be equipped with a Bluetooth module 225 that can transmit and receive signals with the display device 100 according to the Bluetooth communication standard. In addition, the remote control device 200 is equipped with an NFC module 227 capable of transmitting and receiving signals to the display device 100 according to the NFC (Near Field Communication) communication standard, and displays the display device 100 according to the WLAN (Wireless LAN) communication standard. A WLAN module 229 capable of transmitting and receiving signals to and from the device 100 may be provided.

In addition, the remote control device 200 transmits a signal containing information about the movement of the remote control device 200 to the display device 100 through the wireless communication unit 220.

Meanwhile, the remote control device 200 can receive signals transmitted by the display device 100 through the RF module 221 and, if necessary, turn on/off the display device 100 through the IR module 223. Commands for turning off, changing channels, changing volume, etc. can be sent.

The user input unit 230 may be comprised of a keypad, button, touch pad, or touch screen. The user can input commands related to the display device 100 into the remote control device 200 by manipulating the user input unit 230. If the user input unit 230 is provided with a hard key button, the user can input a command related to the display device 100 to the remote control device 200 through a push operation of the hard key button. This will be explained with reference to FIG. 3 .

Referring to FIG. 3, the remote control device 200 may include a plurality of buttons. The plurality of buttons include a fingerprint recognition button (212), power button (231), home button (232), live button (233), external input button (234), volume control button (235), voice recognition button (236), It may include a channel change button 237, a confirmation button 238, and a back button 239.

The fingerprint recognition button 212 may be a button for recognizing the user's fingerprint. In one embodiment, the fingerprint recognition button 212 is capable of a push operation and may receive a push operation and a fingerprint recognition operation. The power button 231 may be a button for turning on/off the power of the display device 100. The home button 232 may be a button for moving to the home screen of the display device 100. The live button 233 may be a button for displaying a real-time broadcast program. The external input button 234 may be a button for receiving an external input connected to the display device 100. The volume control button 235 may be a button for adjusting the volume of the sound output by the display device 100. The voice recognition button 236 may be a button for receiving the user's voice and recognizing the received voice. The channel change button 237 may be a button for receiving a broadcast signal of a specific broadcast channel. The confirmation button 238 may be a button for selecting a specific function, and the back button 239 may be a button for returning to the previous screen.

Figure 2 will be described again.

If the user input unit 230 has a touch screen, the user can input commands related to the display device 100 through the remote control device 200 by touching a soft key on the touch screen. Additionally, the user input unit 230 may be equipped with various types of input means that the user can operate, such as scroll keys and jog keys, and this embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243, and the gyro sensor 241 may sense information about the movement of the remote control device 200.

For example, the gyro sensor 241 can sense information about the operation of the remote control device 200 based on the x, y, and z axes, and the acceleration sensor 243 measures the moving speed of the remote control device 200. Information about such things can be sensed. Meanwhile, the remote control device 200 may further include a distance measurement sensor and can sense the distance from the display unit 180 of the display device 100.

The output unit 250 may output a video or audio signal corresponding to an operation of the user input unit 235 or a signal transmitted from the display device 100. Through the output unit 250, the user can recognize whether the user input unit 235 is operated or whether the display device 100 is controlled.

For example, the output unit 250 includes an LED module 251 that lights up when the user input unit 235 is manipulated or a signal is transmitted and received with the display device 100 through the wireless communication unit 225, and a vibration module that generates vibration ( 253), a sound output module 255 that outputs sound, or a display module 257 that outputs an image.

In addition, the power supply unit 260 supplies power to the remote control device 200, and stops power supply when the remote control device 200 does not move for a predetermined period of time, thereby reducing power waste. The power supply unit 260 can resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, etc. necessary for controlling or operating the remote control device 200. If the remote control device 200 transmits and receives signals wirelessly through the display device 100 and the RF module 221, the remote control device 200 and the display device 100 transmit and receive signals through a predetermined frequency band. .

The control unit 280 of the remote control device 200 stores and references information about the display device 100 paired with the remote control device 200 and the frequency band for wirelessly transmitting and receiving signals in the storage unit 270. can do.

The control unit 280 controls all matters related to the control of the remote control device 200. The control unit 280 sends a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100).

Additionally, the voice acquisition unit 290 of the remote control device 200 can acquire voice.

The voice acquisition unit 290 may include at least one microphone 291 and can acquire voice through the microphone 291.

Next, Figure 4 will be described.

Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

(a) of FIG. 4 illustrates that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right. The pointer 205 displayed on the display unit 180 of the display device 100 corresponds to the movement of the remote control device 200. This remote control device 200 can be called a spatial remote control because the corresponding pointer 205 is moved and displayed according to movement in 3D space, as shown in the drawing.

(b) of FIG. 4 illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the display device 100 also moves to the left correspondingly.

Information about the movement of the remote control device 200 detected through the sensor of the remote control device 200 is transmitted to the display device 100. The display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control device 200. The display device 100 may display the pointer 205 to correspond to the calculated coordinates.

(c) of FIG. 4 illustrates a case where a user moves the remote control device 200 away from the display unit 180 while pressing a specific button in the remote control device 200. As a result, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed enlarged.

Conversely, when the user moves the remote control device 200 closer to the display unit 180, the selected area in the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed in a reduced size.

Meanwhile, when the remote control device 200 moves away from the display unit 180, the selected area may be zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

Additionally, when a specific button in the remote control device 200 is pressed, recognition of up-down, left-right movement may be excluded. That is, when the remote control device 200 moves away from or approaches the display unit 180, up, down, left, and right movements are not recognized, and only forward and backward movements can be recognized. When a specific button in the remote control device 200 is not pressed, only the pointer 205 moves as the remote control device 200 moves up, down, left, and right.

Meanwhile, the moving speed or direction of the pointer 205 may correspond to the moving speed or direction of the remote control device 200.

Meanwhile, a pointer in this specification refers to an object displayed on the display unit 180 in response to the operation of the remote control device 200. Accordingly, the pointer 205 can be an object of various shapes other than the arrow shape shown in the drawing. For example, concepts may include dots, cursors, prompts, thick outlines, etc. In addition, the pointer 205 can be displayed in correspondence to one of the horizontal and vertical axes on the display unit 180, as well as in response to multiple points, such as a line or surface. do.

Next, with reference to FIG. 5, a display system according to an embodiment of the present invention will be described.

Figure 5 is a diagram explaining the configuration of a display system according to an embodiment of the present invention.

Referring to FIG. 5, a display system according to an embodiment of the present invention includes a display device 100 and a set-top box 500.

The display device 100 and the set-top box 500 may be connected wirelessly or wired.

The set-top box 500 may be connected to the display device 100 through the external device interface unit 135.

The set-top box 500 may transmit information about the broadcast to the display device 100. Information about the broadcast may include electronic program guide information including information on the broadcast channel and broadcast programs for each time slot provided by the broadcast channel.

The set-top box 500 may transmit one or more of a video signal and an audio signal to the external device interface unit 135 of the display device 100.

The display device 100 can display an image based on the video signal received from the set-top box 500 through the display unit 180, and output audio based on the received audio signal through the audio output unit 185. You can.

The video based on the received video signal may be a broadcast video, but is not limited thereto, and may also be a streaming video.

The broadcast video may be a real-time broadcast video.

Next, with reference to FIG. 6, a method of operating the display device 100 according to an embodiment of the present invention will be described.

Figure 6 is a flowchart for explaining a method of operating a display device according to an embodiment of the present invention.

The external device interface unit 135 of the display device 100 receives an image signal input from the set-top box 500 connected to the display device 100 (S601).

In one embodiment, the external device interface unit 135 may include one or more HDMI terminals. The set-top box 500 can be connected to the display device 100 through an HDMI terminal.

In another embodiment, the external device interface unit 135 may be provided separately from the display device 100. In this case, the external device interface unit 135 may be wirelessly connected to the display device 100. The external device interface unit 135 is connected to the set-top box 500 and can wirelessly transmit image signals received from the set-top box 500 to the display device 100.

The video signal received from the set-top box 500 may be a broadcast video signal or a content video signal provided by a content provider.

The broadcast video signal may be a real-time broadcast video broadcast in real time.

Hereinafter, the video signal will be described assuming that it is a broadcast video signal.

The control unit 170 displays the first broadcast video based on the received video signal on the display unit 180 (S603).

The first broadcast image displayed on the display unit 180 may be an image of the first broadcast program corresponding to the first broadcast channel.

When a request to change the broadcast channel is received (S605), the control unit 170 displays the second broadcast image of the changed broadcast channel (S607).

In one embodiment, the control unit 170 may receive a request for changing a broadcast channel from the remote control device 200.

The control unit 170 may change the first broadcast channel to the second broadcast channel in response to a request to change the broadcast channel.

The control unit 170 uses the second broadcast video of the changed broadcast channel to recognize the channel number of the second broadcast video (S609).

In one embodiment, when the broadcast channel is changed, the second broadcast video may include a video of the changed second broadcast program and a banner including information about the second broadcast program.

The banner may be displayed overlapping the second broadcast video.

The banner may be displayed for a preset time if the channel is not changed. The preset time may be 3 seconds, but this is only an example value.

The banner may include the channel number of the broadcast program, the name of the broadcast program, the name of the broadcasting station providing the broadcast program, and additional service information for providing additional services related to the broadcast program.

In one embodiment, the control unit 170 may obtain location information indicating a channel number and recognize the channel number based on the obtained location information.

The control unit 170 may store location information indicating the channel number in the storage unit 140. Even if the broadcast channel is changed again later, the control unit 170 can quickly recognize the number of the changed broadcast channel using the stored location information.

In one embodiment, the control unit 170 captures a second broadcast image including a banner, divides the captured second broadcast image into a plurality of areas, and uses an optical character recognition technique within each divided area to channel the second broadcast image including a banner. Numbers can be recognized.

The control unit 170 provides broadcast information related to the recognized channel number (S611).

In one embodiment, the broadcast information related to the recognized channel number may be information about a broadcast program related to the recognized channel number. For example, information about a broadcast program related to a channel number may include information about the channel number and previous episodes of the broadcast program, but this is only an example.

That is, broadcast information related to the channel number may include channel recommendation information, genre of broadcast program, broadcast program recommendation information, etc.

In one embodiment, the control unit 170 may provide broadcast information related to the recognized channel number using an electronic program guide. The electronic program guide may be information that the display device 100 can obtain after connecting to the set-top box 500.

The electronic program guide may be a guide that arranges a channel number and broadcast programs corresponding to the channel number in chronological order.

When the control unit 170 recognizes the channel number of the broadcast program that the user is currently watching, the control unit 170 may display information about the broadcast program corresponding to the recognized channel number using an electronic program guide.

In one embodiment, the control unit 170 may transmit broadcast information related to the recognized channel number to the user's mobile terminal.

Hereinafter, steps S601 to S611 will be briefly described.

Figures 7 and 8 are diagrams illustrating an example of recognizing the channel number of a currently broadcasting program and providing related broadcasting information according to an embodiment of the present invention.

In FIGS. 7 and 8 , the display device 100 is described assuming that the broadcast image input from the set-top box 500 is displayed through the display unit 180.

Referring to FIG. 7, the control unit 170 displays the first broadcast program image 701 corresponding to the first channel number. The name 711 of the broadcasting station that identifies the broadcasting station providing the first broadcasting program image 701 may be displayed overlaid on the first broadcasting program image 701.

The first broadcast program image 701 may be an image displayed when the display device 100 and the set-top box 500 are turned on.

The first broadcast program image 701 may be an image that the user is currently watching after the display device 100 and the set-top box 500 are turned on.

Meanwhile, the control unit 170 can change the first broadcast channel to the second broadcast channel in response to a request for changing the broadcast channel.

Accordingly, the control unit 170 can convert the first broadcast program video 701 into a second broadcast program video 703 corresponding to the second broadcast channel.

The control unit 170 may change the broadcast channel and further display a banner 730 including information about the second broadcast program image 703.

The banner 730 includes the channel number and name of the broadcasting station (731) of the second broadcast program video (703), the channel numbers (732, 733) before and after the channel number currently being viewed, and the episode and name of the broadcast program currently being viewed. It may include (734), the airing time of the broadcast program currently being watched (735), a VOD service (736) that can be provided by the content provider, and an option (737) to provide other broadcast services.

The control unit 170 may use the second broadcast program image 703 and the banner 730 to recognize the channel number <022> of the second broadcast program image 703 currently being broadcast. The control unit 170 may use the information displayed on the second broadcast program image 703 and the banner 730 to obtain the location of the area 750 where the channel number <022> is displayed.

The control unit 170 may recognize the channel number <022> within the area 750 through the acquired location of the area 750.

Even if the channel is changed later, the location of the acquired area 750 is stored, so the control unit 170 can quickly recognize the changed channel number.

The process of recognizing the channel number will be described in detail later.

The control unit 170 may provide broadcast information related to the recognized channel number <022>.

For example, as shown in FIG. 8, the control unit 170 may provide related broadcast information 800 based on the recognized channel number <022> and the electronic program guide received from the set-top box 500. there is.

Specifically, the control unit 170 may display related broadcast information 800 including a plurality of thumbnail images 810 to 840 corresponding to previous episodes of the second broadcast program corresponding to channel number <022>. there is.

The control unit 170 can extract broadcast program information by comparing the recognized channel number <022> with the electronic program guide, and use the extracted broadcast program information to provide related broadcast information that allows viewing of previous episodes of the broadcast program. (800) can be recommended.

When one of the plurality of thumbnail images 810 to 840 is selected, the control unit 170 may play a previous broadcast program corresponding to the selected thumbnail image.

In this way, the user can receive information related to the broadcast channel and broadcast program being watched through the set-top box 500 from the TV itself, and thus can efficiently use the TV's original functions.

Below, the process of recognizing the channel number will be described in detail.

9 to 15 are diagrams illustrating a process for recognizing the number of a broadcast channel currently being viewed according to an embodiment of the present invention.

FIG. 9 is a diagram illustrating step S609 of FIG. 6 in detail.

The control unit 170 captures the second broadcast image (S901).

In one embodiment, when changing channels, the control unit 170 recognizes when a banner is to be output, and when the banner is output, it can capture a second broadcast image including the banner. To this end, the control unit 170 may store the time when the banner will be output in the storage unit 140.

The time at which the banner is displayed may be 0.3 seconds after changing the channel, but this is only an example.

The control unit 170 divides the captured second broadcast image into a plurality of regions (S903).

The size of each of the plurality of divided regions may be the same or different from each other.

Each of the plurality of divided regions may partially overlap with an adjacent region.

The control unit 170 obtains the number of letters within each of the plurality of divided regions (S905).

Here, the letters may be numbers or letters. The characters may be alphabet or Korean, but these are only examples.

The control unit 170 can recognize the letters or number of letters in the corresponding area using teeseract API (Application Programming Interface), an open source optical character recognition (OCR).

The control unit 170 checks whether the number of letters in each area is less than the standard number (S907).

Here, the standard number may be three. This is because channel numbers generally consist of 3 characters or less.

If the number of letters in the divided area exceeds the standard number, the area is further divided (S909).

If the number of characters in the divided area exceeds the standard number, the control unit 170 may divide the divided area into smaller areas to accurately recognize the channel number.

This is because as the number of characters in the divided area increases, the recognition rate may decrease.

If the number of characters in the divided area is less than the standard number, the control unit 170 recognizes the text in the corresponding area (S911).

In one embodiment, when the number of letters in the divided area is three or less, the control unit 170 can recognize the text within the corresponding area.

The control unit 170 can recognize text in the corresponding area using teeseract API (Application Programming Interface), an open source optical character recognition (OCR).

The control unit 170 checks whether the recognized text is valid text (S913), and if the recognized text is invalid text, excludes the corresponding area from the candidate group (S913).

In one embodiment, the control unit 170 may determine that the text is valid when the letters constituting the text are made up of numbers or letters, and if any one of the letters making up the text is not made up of numbers or letters, the control unit 170 may determine that the text is valid. can be judged as invalid text.

This is because each of the plurality of areas may partially overlap, so only a portion of numbers or letters may be included in the area. This will be described later.

If the recognized text is a valid text, the control unit 170 registers the corresponding area as a candidate group and stores the candidate group information (S917).

If the control unit 170 determines that the text in the divided area is valid text, the control unit 170 may register the area as a candidate area for channel number recognition. At the same time, the control unit 170 may store candidate group information corresponding to the candidate group area in the storage unit 140.

The candidate group information may include one or more of the coordinates of the area, letters recognized within the area, the size of the recognized letters, the length of the recognized letters, and a recognition rate indicating the accuracy of letter recognition.

Below, the process of dividing the captured broadcast video and registering the divided area as a candidate group will be described.

Figures 10 to 12 are diagrams for explaining a process of dividing a captured broadcast video and registering the divided areas as a candidate group according to an embodiment of the present invention.

10 to 12 will be described using the embodiment of FIG. 7.

Referring to FIG. 10, the display device 100 displays a second broadcast program image 703 and a banner 730 according to a change in the broadcast channel.

The control unit 170 may capture the second broadcast program image 703 at the time the banner 730 is output.

Afterwards, the control unit 170 may divide the second broadcast program image 703 including the banner 730 into a plurality of areas.

In FIG. 10 , only a portion of the banner 730 is divided for convenience of explanation, but the entire banner 730 or the second broadcast program image 703 can be divided.

The control unit 170 can check the number of letters in each of the plurality of divided areas.

Figure 11 shows recognized areas 1101 to 1109.

The control unit 170 may check whether the number of letters in each of the recognized areas 1101 to 1109 is three or less. For example, the number of letters in the first area 1101, third area 1105, and fifth area 1109 may be confirmed to be three. It can be confirmed that the number of letters in the second area 1103 is 5, and the number of letters in the fourth area 1107 is 2.

Since the number of characters in the second area 1103 exceeds the standard number, the control unit 170 divides the second area 1103 into the first sub-area 1201 and the second sub-area 1203, as shown in FIG. 12. ) can be divided into

Since the number of letters in the first sub-area 1201 is 2 and the number of letters in the second sub-area 1205 is 3, the condition of being less than the standard number is satisfied.

Afterwards, the control unit 170 may register or exclude the plurality of areas shown in FIGS. 11 and 12 as candidates depending on whether the text in the areas is valid text.

For example, since the number 3 in the text <23> in the fourth area 1107 has a truncated shape, the control unit 170 may exclude the fourth area 1107 from the candidate group.

Since the remaining areas (1101, 1105, 1109, 1201, and 1203) do not have numbers or letters cut out, the control unit 170 determines that they are valid text and registers each area as a candidate group.

Additionally, the control unit 170 may store information on the registered candidate group. Information on the registered candidate group may include one or more of the following: coordinates of the area, letters recognized within the area, size of the recognized letters, length of the recognized letters, length of text that is a set of recognized letters, and accuracy of letter recognition. You can.

Next, an example of filtering the candidate group based on information on the registered candidate group and selecting the final candidate group for channel number recognition will be described.

Figure 13 is a flowchart illustrating an example of filtering the candidate group and selecting a final candidate group for channel number recognition based on information on the registered candidate group according to an embodiment of the present invention.

Figure 13 shows the process performed after the flowchart of Figure 9.

Referring to FIG. 13, the control unit 170 filters the candidate group based on information on the registered candidate group (S1301).

In one embodiment, the control unit 170 may exclude a candidate group that includes non-numeric characters among the letters in the candidate group. In general, channel numbers are composed of numbers.

Referring to FIG. 11, the control unit 170 may filter candidate groups 1109 and 1203 in which characters are mixed among the registered candidate groups 1101, 1105, 1109, 1201, and 1203.

In addition, the control unit 170 selects among the remaining candidates 1101, 1105, and 1201 after filtering.

Only the candidate group (1105) with the largest text size can be left, and the remaining candidates (1101, 1201) can be deleted. In general, this is because the number of the currently broadcasting channel is displayed larger than the number of adjacent channels.

Additionally, if the coordinates of the candidate groups are similar but the text lengths are different, the control unit 170 may exclude the candidate group whose text length is small. For example, if the text length of the first candidate group is 5 and the text length of the second candidate group is 6, the control unit 170 may filter the first candidate group. This is because part of the text may be cut off during the segmentation recognition process.

If the recognized texts of the candidate groups are the same, the control unit 170 may delete the remaining candidates, leaving only one.

Here, it is assumed that the text consists only of numbers.

The control unit 170 may accumulate and count the number of extractions of candidate groups containing the same text consisting of three or less numbers. The control unit 170 can sort candidate groups that have the same text consisting of three or less numbers according to the accumulated number of extractions.

The control unit 170 checks whether the number of filtered candidates is two or more (S1303).

If the number of filtered candidates is less than two (when only one candidate group remains), the control unit 170 stores the coordinates of the remaining candidates (S1305).

When only one filtered candidate group remains, the control unit 170 may select the remaining candidate group as the final candidate group and store the coordinates of the selected final candidate group.

The selected final candidate group may be an area where the channel number of the broadcast video currently being viewed is displayed.

Referring to FIG. 14, the final candidate group 1105 selected from the registered candidate groups 1101 to 1109 is shown. The final candidate group may have a rectangular shape, but it is only an example.

The control unit 170 may store vertex coordinate values (x1, y1), (x2, y2), (x3, y3), and (x4, y4) of the final candidate group. Additionally, the control unit 170 may store the horizontal length (W) and vertical length (H) of the final candidate group.

Additionally, as shown in FIG. 15, the control unit 179 may store information on the set-top box 500, channel switching time, and banner output time in addition to the coordinate information of the final candidate group.

The information on the set-top box 500 may include information that can identify the set-top box 500, such as the model name of the set-top box and the version of the set-top box.

The channel change time may be the time it takes for the channel to change in response to a broadcast channel change request.

The banner output time may include one or more of the following: a change in the broadcast channel, a time when the banner is output, and a time when the display of the banner is maintained.

Based on the coordinates of the candidate group, the control unit 170 obtains the channel number in the candidate group as the channel number of the second broadcast video (S1307).

If the broadcast channel is changed later, the control unit 170 may recognize the channel number of the corresponding area based on the coordinates of the final candidate group.

When the coordinates of the final candidate group are obtained, the display device 100 can quickly recognize the number of the changed channel using the position corresponding to the coordinates of the final candidate group obtained within the broadcast image of the changed channel.

Afterwards, the control unit 170 provides broadcast information related to the obtained channel number (S611).

That is, the display device 100 can recognize the number of the changed broadcast channel through a single channel number recognition process, even if the channel is changed, without a complicated process.

Accordingly, the display device 100 can actively provide broadcasting information related to channel numbers to the user using the electronic program guide.

When the display device 100 is rebooted, the control unit 170 can quickly recognize the channel number of the currently broadcasting video using the location information of the stored channel number. In other words, since the location information of the already acquired channel number is stored, there is no need to use the algorithm for finding the channel number again.

Meanwhile, if the number of filtered candidate groups is two or more, the control unit 170 captures the third broadcast video according to the channel change (S1309).

If the number of filtered candidate groups is two or more, the control unit 170 may display information indicating that the channel number cannot be recognized to select the final candidate group.

Additionally, if the number of filtered candidate groups is two or more, the control unit 170 may display information requesting a change in the broadcast channel to select the final candidate group.

The control unit 170 can change the second broadcast channel to the third broadcast channel according to the channel change request and display the third broadcast image corresponding to the third broadcast channel. Additionally, the control unit 170 can capture the third broadcast image.

The control unit 170 acquires new candidate groups corresponding to the coordinates of two or more already obtained candidate groups (S1309).

The control unit 170 may obtain two or more new candidate groups within the captured third broadcast video using the coordinates of each of the two or more candidate groups obtained. Each of the two or more new candidate groups may be identical to the coordinates of each of the two or more previously obtained candidate groups.

At the same time, the control unit 170 may obtain information on each of two or more new candidate groups.

The control unit 170 filters the obtained new candidates (S1311) and stores the coordinates of the remaining candidates (S1313).

The control unit 170 may leave only one candidate group based on information on each of the new candidate groups. For example, if the text (left and right) lengths of each of the new candidate groups are the same, the control unit 170 may select the candidate group whose text has a large top and bottom length as the final candidate group.

The control unit 170 acquires the channel number in the remaining candidate group as the channel number of the third broadcast video (S1315) and provides broadcast information related to the obtained channel number (S611).

Through this process, the control unit 170 can select the final candidate group and store the coordinates of the selected final candidate group. This is the same as described in FIG. 14.

Also, in this case, as shown in FIG. 15, other information in addition to the coordinate information of the final candidate group may be stored together.

Figure 16 is a diagram illustrating in detail the configuration of a control unit that recognizes the number of a broadcast channel according to an embodiment of the present invention.

The control unit 170 according to an embodiment of the present invention may include a capture module 171, a segmentation recognition module 172, a candidate group extraction module 173, a candidate group filtering module 174, and a channel number recognition module 175. there is.

The capture module 171 can capture the broadcast image being displayed. In particular, the capture module 171 can capture broadcast images of the changed broadcast channel when the channel is changed.

The segmentation recognition module 172 may divide the captured broadcast image into a plurality of regions. The segmentation recognition module 172 can recognize letters within a plurality of divided regions.

The segmentation recognition module 172 may check the number of letters included in each of the plurality of regions, and if the number of letters exceeds the standard number, the region may be further divided.

The segmentation recognition module 172 may recognize text within a plurality of regions when the number of letters within each region is less than the standard number.

The candidate group extraction module 173 may check whether the recognized text is a valid text and, if the recognized text is an invalid text, exclude the corresponding area from the candidate group.

If the recognized text is valid text, the candidate group extraction module 173 can register the corresponding area as a candidate group.

The candidate group extraction module 173 may store information on the registered candidate group in the storage unit 140.

The candidate group filtering module 174 may filter the candidate group based on information on each of the plurality of registered candidate groups.

After filtering, the candidate group filtering module 174 may store the coordinate information of the final candidate group in the storage unit 140.

The channel number recognition module 175 can recognize the channel number using the stored coordinate information of the final candidate group.

The channel number recognition module 175 can provide broadcast information related to the recognized channel number using the recognized channel number and the electronic program guide.

Next, a process for recognizing a channel number using a banner according to another embodiment of the present invention will be described.

Figure 17 is a flowchart explaining the process of recognizing a channel number using a banner according to another embodiment of the present invention.

Hereinafter, the description will be made assuming that there are two positions where the channel number is displayed. This is because the position of the displayed banner may vary depending on the channel.

For example, the channel numbers of the broadcast channels included in the first broadcast channel group may be displayed on the main banner at the first location, and the channel numbers of the broadcast channels included in the second broadcast channel group may be displayed on the sub banner at the second location. It can be displayed in .

Hereinafter, the area where the channel numbers of the broadcast channels included in the first broadcast channel group are displayed will be referred to as the main channel area, and the area where the channel numbers of the broadcast channels included in the second broadcast channel group will be displayed will be referred to as the sub-channel area.

The control unit 170 obtains first location information of the main channel area (S1701).

In one embodiment, the control unit 170 may obtain first location information of the main channel area based on the embodiments of FIGS. 9 to 13. The first location information may include coordinate values of a location where the main channel area is displayed.

The control unit 170 checks whether the main banner has been acquired (S1703) and, if the main banner has been acquired, checks whether the main channel area is recognized within the main banner (S1705).

In one embodiment, the control unit 170 may obtain the main banner through comparison between broadcast images when changing channels. Specifically, when the positions of the main banner displayed in the first broadcast video and the second broadcast video of the changed channel are the same, the control unit 170 can obtain the main banner based on the degree of change in the video. If the degree of change in the image is less than a preset change amount, the control unit 170 can acquire the corresponding area as the main banner.

The control unit 170 may recognize the main channel area based on the first location information within the obtained main banner.

When the main channel area is recognized, the control unit 170 provides broadcast information related to the recognized main channel area (S1707).

Meanwhile, when the main banner is not obtained, the control unit 170 checks whether second location information corresponding to the sub-channel area exists (S1709).

That is, the display position of the sub-banner corresponding to the second broadcast channel group may be different from the display position of the main banner, and as a result, the channel number in the main channel area may not be recognized.

The control unit 170 may check whether the second location information corresponding to the sub-channel area is stored in the storage unit 140.

If the second location information exists, the control unit 170 checks whether the sub-banner has been obtained (S1711).

When the second location information of the sub-channel area is stored in the storage unit 140, the control unit 170 can check whether the sub-banner has been acquired using the main banner acquisition process.

When the sub-banner is acquired, the control unit 170 checks whether the sub-channel area is recognized within the sub-banner (S1713).

The control unit 170 may recognize the channel number within the sub-banner by using the second location information of the sub-channel area within the sub-banner.

When the sub-channel area is recognized, the control unit 170 provides broadcast information related to the recognized sub-channel area (S1707).

Meanwhile, if the sub-channel area is not recognized within the sub-banner, the control unit 170 provides broadcast information related to the previously recognized channel number (S1715).

Meanwhile, when the second location information of the sub-channel area does not exist, the control unit 170 acquires the second location information of the sub-channel area based on the sub-image (S1717).

In one embodiment, the sub-image may be images captured from a broadcast channel included in the second broadcast channel group.

The sub-image may include a sub-banner. The control unit 170 may obtain second location information of the sub-channel area by using the sub-banner corresponding to the sub-image. In this process, the embodiments of channel number recognition shown in FIGS. 9 to 13 can be used.

The control unit 170 recognizes the sub-channel area corresponding to the second location information within the sub-banner (S1719) and provides broadcast information related to the recognized sub-channel area (S1707).

According to an embodiment of the present invention, even if the position of the displayed banner varies depending on the broadcast channel, there is an effect of quickly recognizing the channel number through the channel number display area corresponding to each banner.

Meanwhile, according to the embodiment of the present invention, there may be cases where the channel number is not recognized even according to the embodiment of FIG. 17. This is because the user interface provided by the set-top box 500 is updated, and the positions of the main banner and sub-banner may change.

Figure 18 is a flowchart explaining processing when the channel number is not recognized even through the main banner and sub-banner according to an embodiment of the present invention.

Referring to FIG. 18, the control unit 170 acquires a failure image in which the channel number is not recognized (S1801).

The control unit 170 can capture an image of a broadcast channel whose channel number is not recognized. If the channel number is not recognized more than a preset number of times through the channel number recognition process, the control unit 170 can capture the corresponding image.

The control unit 170 checks whether a banner exists in the failure image (S1803).

If there is no banner in the failure image, the control unit 170 deletes the failure image (S1805) and recognizes the channel number using the previously acquired location information of the channel number (S1807).

If a banner exists in the failure image, the control unit 170 checks whether it is the same as the previously obtained banner (S1809).

The control unit 170 may compare the previously obtained main banner and sub-banner with the banner in the failure image.

The control unit 170 may perform a comparison process between banners using the colors of the banners. Generally, banners can be displayed using translucent colors.

If the banner in the failure image is the same as a previously acquired banner, the control unit 170 recognizes the channel number using the location information of the previously acquired channel number (S1807).

If the banner in the failure image is not the same as the previously obtained banner, the control unit 170 returns to step S1701 of FIG. 17 and performs a channel number recognition process.

Meanwhile, the location where the channel number is displayed may vary depending on the type of set-top box 500 and the version of the set-top box 500.

FIGS. 19A to 19C are diagrams explaining that the position where the channel number is displayed varies depending on the type of set-top box connected to the display device.

In Figure 19a, a first set-top box is connected to the display device 100, and the display device 100 displays a first broadcast program image 1910 input from the first set-top box.

A first banner 1913 containing information about the first broadcast program video 1910 may be displayed for a certain period of time. The first banner 1913 may display the first channel number 1915 of the first broadcast program video 1910.

In Figure 19b, a second set-top box is connected to the display device 100, and the display device 100 displays a second broadcast program image 1930 input from the second set-top box.

A second banner 1933 including information about the second broadcast program image 1930 may be displayed for a certain period of time in the second broadcast program image 1930. The second banner 1933 may display the second channel number 1935 of the second broadcast program video 1930.

In Figure 19c, a third set-top box is connected to the display device 100, and the display device 100 displays a third broadcast program image 1950 input from the third set-top box.

A third banner 1953 containing information about the third broadcast program video 1950 may be displayed for a certain period of time. The third banner 1953 may display the third channel number 1955 of the third broadcast program video 1950.

Here, the display positions of the first channel number 1915, the second channel number 1935, and the third channel number 1955 may be different from each other. This is because the location where the banner including the channel number is displayed is different depending on the type of set-top box 500.

Therefore, when different types of set-top boxes 500 or versions of the set-top boxes 500 are different, the channel number can be identified through the location information of the channel number obtained by the channel number recognition algorithm according to the embodiment of FIGS. 9 to 13 cannot be recognized properly.

According to another embodiment of the present invention, the display device 100 can automatically recognize the number of the broadcast channel provided from the set-top box 500 by receiving location information of the channel number from the linked server.

Figure 20 is a diagram explaining a display system according to another embodiment of the present invention.

A display system according to another embodiment of the present invention may include a plurality of display devices (100_1 to 100_n), a plurality of set-top boxes (500_1 to 500_n), and a server (2000).

Each of the plurality of display devices 100_1 to 100_n may collect information about connected set-top boxes.

For example, the first display device 100_1 may collect information about set-top boxes 500_1 to 500_3.

Information on the set-top box 500 may include identification information of the set-top box 500, banner information input from the set-top box 500, and location information of the channel number of the broadcast video input from the set-top box 500.

The identification information of the set-top box 500 may be information for identifying the set-top box 500. Identification information of the set-top box 500 may include one or more of the name of the set-top box 500, the model name of the set-top box 500, and the version of the set-top box 500.

The banner information may include one or more of the banner output (or display) time at which the banner input from the set-top box 500 is output (displayed) and the time for which the display of the banner is maintained. The banner output time may be the time when the banner is displayed on the display after the broadcast channel is changed.

The location information of the channel number may include a coordinate value at which the channel number of the changed broadcast channel is displayed when the broadcast channel is changed. The display device 100 may obtain location information of the channel number using the channel number recognition algorithm according to the embodiment of FIGS. 9 to 13.

The channel number may be displayed on the banner, but this is only an example and may be displayed at one point of the broadcast program video.

Each display device 100 may transmit the collected information on the set-top box 500 to the server 2000.

When each display device 100 is connected to the server 2000 through the network interface unit 144 shown in FIG. 1, it can transmit the collected information about the set-top box 500 to the server 200.

The server 2000 may store information collected from each of the plurality of display devices 100_1 to 100_n to create a database.

When the server 2000 is connected to a network with the display device 100, the server 2000 can transmit the generated database to each display device 100.

Each display device 100 can recognize the channel number of the broadcast channel input from the connected set-top box 500 using the database received from the server 2000.

Specifically, each display device 100 may obtain location information of the channel number corresponding to the set-top box 500 currently connected to the display device 100 included in the database.

Each display device 100 can recognize the channel number using the acquired location information of the channel number.

Each display device 100 can display broadcast information related to the recognized channel number.

Each display device 100 uses the database received from the server 2000 to display the channel number of the broadcast video input from the connected set-top box 500 into a separate channel, no matter what type of set-top box 500 is connected. It can be recognized quickly even without a recognition algorithm.

FIG. 21 is a ladder diagram for explaining a method of operating a display system according to an embodiment of the present invention.

In the embodiment of FIG. 21, an example using only the first display device 100_1 and the second display device 100_2 is shown, but this is only an example and can be applied even when there are three or more display devices.

Additionally, in another embodiment, the embodiment of FIG. 21 may be performed using one display device 100. In this case, different types of set-top boxes are connected to the display device 100 one by one, and information about the connected set-top boxes may be transmitted to the server 2000.

Referring to FIG. 21, the control unit 170 of the first display device 100_1 acquires first information including identification information of the first set-top box, first banner information, and first location information of the channel number (S2101 ).

In one embodiment, the control unit 170 may obtain identification information of the first set-top box from the first set-top box connected through the external device interface unit 135.

Identification information of the first set-top box may include one or more of the type, model, name, and version of the first set-top box.

The control unit 170 may obtain first banner information based on the banner input from the first set-top box. The first banner information may include one or more of the banner output time required for the banner to be displayed after changing the channel, and the banner maintenance time during which the banner display is maintained.

The control unit 170 may identify the banner using the broadcast program image and banner input from the first set-top box. Regarding this, an example of identifying a banner is as described in FIG. 17.

The control unit 170 may obtain location information where the channel number of the broadcast channel input from the first set-top box is displayed.

The control unit 170 may obtain the coordinate value of the channel number using the channel number recognition algorithm according to the embodiment of FIGS. 9 to 13. Another embodiment of the present invention When two channel numbers are displayed, the control unit 170 may obtain the coordinate values of each of the two channel numbers.

The control unit 170 of the first display device 100_1 stores the obtained first information in the storage unit 140 (S2103).

The control unit 170 of the first display device 100_1 transmits the message to the network-connected server 2000 through the network interface unit 133 (S2105).

The control unit 170 may transmit first information including identification information of the first set-top box, first banner information, and first location information of the channel number to the server 2000.

In one embodiment, the control unit 170 may collect the first information while not connected to the network. When connected to a network with the server 2000 through the network interface unit 133, the control unit 170 may transmit the collected first information to the server 2000.

Whenever a new set-top box is connected, the control unit 170 may transmit first information about the new set-top box to the server 2000.

The server 2000 stores the first information received from the first display device 100_1 (S2107).

Meanwhile, the second display device 100_2 also performs the same processes as steps S2101 to S2105.

That is, the control unit 170 of the second display device 100_2 acquires second information including identification information of the second set-top box, second banner information, and second location information of the channel number (S2109).

The control unit 170 of the second display device 100_2 stores the obtained second information in the storage unit 140 (S2111).

The control unit 170 of the second display device 100_2 transmits the data to the network-connected server 2000 through the network interface unit 133 (S2113).

The server 2000 stores the second information received from the second display device 100_2 (S2115).

The server 2000 can build a database using the first information received from the first display device 100_1, the second information received from the second display device 100_2, and the information received from other display devices. there is.

This will be explained with reference to FIG. 22.

FIG. 22 is a diagram illustrating a database built using set-top box information collected from a plurality of display devices according to an embodiment of the present invention.

The database 2200 includes the type of set-top box (2210), first location information of the channel number (2220), second location information of the channel number (2230), banner output time (2240), and set-top box version (2250). ), and may include channel number recognition algorithm type information (2260).

The database 2200 may include a correspondence between channel number location information, banner output time, set-top box version, and channel number recognition algorithm type information depending on the type of set-top box.

The type 2210 of the set-top box may indicate the manufacturer supplying the set-top box 2210 or the model of the set-top box 2210.

The first location information 2220 of the channel number may represent the first coordinate value at which the channel number is displayed within the broadcast program image input from the set-top box 500. The first coordinate value may include the x, y coordinates of the area where the channel number is displayed, the width of the area where the channel number is displayed, and the height of the area where the channel number is displayed.

The second location information 2230 of the channel number may indicate a second coordinate value at which the channel number is displayed within the broadcast program image input from the set-top box 500. The second coordinate value may include the x and y coordinates of the area where the channel number is displayed, the width of the area where the channel number is displayed, and the height of the area where the channel number is displayed.

The banner output time 2240 may represent the time it takes for the banner to be displayed after the broadcast channel is changed.

The version 2250 of the set-top box may indicate the number of times the set-top box has been updated.

Channel number recognition algorithm type information 2260 may be information indicating what type of channel number recognition algorithm the display device 100 used to recognize the channel number.

To this end, when transmitting channel number location information to the server 2000, each display device 100 may transmit to the server 2000 a flag indicating what type of channel number recognition algorithm was used.

The channel number recognition algorithm may be a method through region division recognition according to the embodiments of FIGS. 9 to 13, or may be recognized through other methods.

Explain 21 again.

The server 2000 transmits the database 2200 to each of the first display device 100_1 and the second display device 100_2 (S2117).

In one embodiment, the server 2000 may periodically transmit the database 2200 to the first display device 100_1 and the second display device 100_2.

In another embodiment, when the server 2000 receives an information request from each display device 100, the server 2000 may transmit the database 2200 to the corresponding display device 100.

In another embodiment, the server 2000 may transmit the database 2200 to the display device 100 when the set-top box 500 is connected to the display device 100.

The storage unit 140 of the second display device 100_2 stores the database received from the server 2000 (S2119).

The control unit 170 of the second display device 100_2 checks whether a new set-top box 500 is connected or whether the version of the set-top box 500 has changed (S2121).

The control unit 170 may check whether a set-top box other than the previously connected second set-top box is connected through the external device interface unit 135.

In the embodiment of the present invention, the description is made assuming that different types of set-top boxes are newly connected, but it is not limited to this.

That is, since the version may be different even for the same type of set-top box, the control unit 170 can check whether the version of the set-top box has changed.

The control unit 170 may receive identification information of the set-top box 500 from the connected set-top box 500, and uses the received identification information to determine whether a new set-top box 500 is connected and the set-top box 500. You can check whether the version has changed.

When a new set-top box is connected, the control unit 170 of the second display device 100_2 obtains location information of the channel number using the stored database (S2123).

The control unit 170 may obtain identification information of the set-top box from the newly connected set-top box.

The control unit 170 may extract location information of the channel number from a pre-stored database using the acquired identification information of the set-top box.

For example, if the type of the newly connected set-top box is A (see FIG. 22), the control unit 170 may obtain location information of the channel number corresponding to the set-top box of A through the database 2200.

The control unit 170 of the second display device 100_2 uses the acquired location information of the channel number to determine whether the channel number of the broadcast video input from the currently connected set-top box has been recognized (S2125).

The control unit 170 can recognize the channel number at the corresponding location in the broadcast video using the location information of the channel number obtained from the database, without running a separate channel number recognition algorithm.

Even when changing the broadcast channel, the control unit 170 can automatically recognize the channel number using the location information of the previously acquired channel number.

When the control unit 170 of the second display device 100_2 recognizes the channel number, it provides broadcast information related to the recognized channel number (S2127).

In other words, even if a new set-top box is connected or the version of the set-top box is different, the control unit 170 can automatically recognize the channel number using the stored database without the need to run a separate channel number recognition algorithm. there is.

Accordingly, the time required to run the channel number recognition algorithm can be saved, and users can quickly receive relevant broadcast information.

Additionally, the reliability and accuracy of the location of the channel number can be increased through the database.

If the channel number is not recognized through the location information of the channel number, the control unit 170 of the second display device 100_2 performs the process of step S2109.

If the channel number is not recognized through the location information of the channel number, the control unit 170 of the second display device 100_2 may re-perform the process of acquiring the location information of the channel number through the channel number recognition algorithm.

That is, the control unit 170 can obtain location information of channel information through the channel number recognition algorithm according to the embodiments of FIGS. 9 to 13 and transmit the obtained location information to the server 2000.

When a new set-top box is connected to the display device 100, the server 2000 may not store location information of the channel number corresponding to the new set-top box. In this case, the display device 100 can acquire the location information of the channel number through a channel number recognition algorithm, and the server 2000 can store the location information of the channel number corresponding to the set-top box in correspondence.

Through this, the server 2000 can continuously update the database 2200.

FIG. 23 is a diagram illustrating an example of recognizing the channel number of a currently broadcasting program and providing related broadcasting information according to another embodiment of the present invention.

Referring to FIG. 23, the display device 100 displays the first broadcast program image 1910 input from the connected set-top box 500.

The name 1911 of the first broadcasting station providing the first broadcast program image 1910 may be displayed in the first broadcast program image 1910.

The control unit 170 can change the broadcast channel according to a broadcast channel change request. Accordingly, the control unit 170 can convert the first broadcast program image 1910 into the second broadcast program image 2310.

At the same time, the control unit 170 may display a banner 2303 containing information about the second broadcast program image 2310. The banner 2303 may be displayed 0.3 seconds after changing the broadcast channel, but this is only an example.

The banner 2303 may include the channel number 2307 of the second broadcast program video 2310, the name of the second broadcast program 2310, etc.

The display device 100 may receive the database 2200 shown in FIG. 22 from the server 2000 and store it in the storage unit 140.

When the broadcast channel is changed, the control unit 170 of the display device 100 may extract location information of the channel number stored in the storage unit 140. The control unit 170 may recognize the channel number 2307 in the second broadcast program image 2300 using the location information of the extracted channel number.

The control unit 170 can obtain broadcast information related to the recognized channel number 2307 using the electronic program guide.

The control unit 170 may display broadcast information 2320 related to the recognized channel number in the second broadcast program image 2301.

The related broadcast information 2320 may include one or more of information about characters appearing in the second broadcast program video 2300 and story information of the second broadcast program video 2300.

The control unit 170 may transmit related broadcast information to a mobile terminal such as a user's cell phone or watch-type mobile terminal.

The control unit 170 may further display a broadcast information icon 2310 to provide broadcast information related to the recognized channel number 2307. The broadcast information icon 2310 may be an icon for providing the previous episode of the second broadcast program video 2300 corresponding to the recognized channel number 2307.

The broadcast information icon 2310 may include the name of a content provider that can provide the previous episode of the second broadcast program video 2300, but this is only an example.

The broadcast information icon 2310 may be displayed on the banner 2310, but this is only an example.

The broadcast information icon 2310 may be located within an area where related broadcast information 2320 is displayed.

In another embodiment, the broadcast information icon 2310 may be displayed on a banner 2303 and then moved into an area where related broadcast information 2320 is displayed when the banner 2303 disappears.

Meanwhile, the control unit 170 can vary related broadcast information depending on settings. For example, if the setting for providing related broadcasting information according to channel number recognition is turned on, the control unit 170 may recognize the number of the channel changed according to the channel change and provide related broadcasting information.

If the setting for providing related broadcasting information based on channel number recognition is turned off, the control unit 170 may not recognize the changed channel number and, accordingly, may not provide related broadcasting information.

<Start of LTV16-096>

According to another embodiment of the present invention, channel number recognition can be quickly performed using a banner included in a broadcast video.

Figure 24 is a flowchart explaining a method of operating a display device according to another embodiment of the present invention.

In particular, Figure 24 is a diagram explaining the process of extracting a banner from a broadcast video and recognizing a channel number from the extracted banner.

The external device interface unit 135 of the display device 100 receives an image signal input from the set-top box 500 (S2401).

In one embodiment, the external device interface unit 135 may include one or more HDMI terminals. The set-top box 500 can be connected to the display device 100 through an HDMI terminal.

In another embodiment, the external device interface unit 135 may be provided separately from the display device 100. In this case, the external device interface unit 135 may be wirelessly connected to the display device 100. The external device interface unit 135 is connected to the set-top box 500 and can wirelessly transmit image signals received from the set-top box 500 to the display device 100.

The video signal received from the set-top box 500 may be a broadcast video signal or a content video signal provided by a content provider.

The broadcast video signal may be a real-time broadcast video broadcast in real time.

Hereinafter, the video signal will be described assuming that it is a broadcast video signal.

The control unit 170 displays the first broadcast video based on the received video signal on the display unit 180 (S2403).

The control unit 170 receives a request to change the broadcast channel (S2405) and, in response to the received request, displays the second broadcast image of the broadcast channel on the display unit 180 (S2407).

In one embodiment, the control unit 170 may receive a request to change a broadcast channel from the remote control device 200.

The control unit 170 determines whether the standard banner is stored in the storage unit 140 (S2409).

In one embodiment, the standard banner is a pre-stored banner included in a broadcast video, and may be a banner that serves as a standard for recognizing a channel number.

The reference banner may be obtained and stored through steps S2417 to S2423, which will be described later.

The storage unit 140 may store one or more of the coordinates of the standard banner, the size of the standard banner, the color of the standard banner, and the shape of the standard banner.

If the reference banner is not stored in the storage unit 140 (S2409), the control unit 170 stores the image frame of the second broadcast video being displayed in the storage unit 140 (S2411).

In one embodiment, the control unit 170 may store image frames of the second broadcast video being received in the storage unit 140 on a predetermined time basis. The certain amount of time may be 0.5 seconds, but this is only an example.

The control unit 170 determines whether the number of stored image frames is more than a certain number (S2413).

In one embodiment, the certain number may be 5, but this is only an example.

If the number of stored image frames is more than a certain number, the control unit 170 determines whether the number of changes in the broadcast channel has been changed more than a certain number of times (S2415).

In one embodiment, the control unit 170 may receive a request to change the broadcast channel when the number of image frames constituting a broadcast video provided from one broadcast channel is more than a certain number.

Afterwards, the control unit 170 may store a certain number or more of the image frames of the broadcast video provided from the changed broadcast channel.

If the number of changes to the broadcast channel does not exceed a certain number of times, the control unit 170 performs step S2405.

Here, the certain number of times may be three, but this is only an example.

The reason for changing the broadcasting channel more than a certain number of times and storing image frames corresponding to the changed broadcasting channel is because the properties of the banner included in the video of the broadcasting channel, such as its coordinates or size, may vary.

If the number of changes to the broadcast channel is more than a certain number of times, the control unit 170 obtains a reference banner using each image frame corresponding to each broadcast channel (S2417).

Below, the process of obtaining a standard banner is described in detail.

25 to 32 are diagrams illustrating a process for obtaining a reference banner using a plurality of image frames corresponding to each of a plurality of broadcast channels according to an embodiment of the present invention.

FIG. 25 is a flowchart for specifying step S2417 of FIG. 24.

Referring to FIG. 25, the control unit 170 generates a uniform map for each of a plurality of image frames corresponding to each of a plurality of broadcast channels (S2501).

In one embodiment, a uniform map may be a map that uniformly represents pixels with similar properties, centered on one pixel.

The process of generating a uniform map will be described with reference to the drawings below.

Figures 26 to 28 are diagrams illustrating the process of generating a uniform map corresponding to an image frame of each broadcast channel according to an embodiment of the present invention.

Referring to FIG. 26, the color value of the pixel where the banner is located and the color value of the pixel where the banner is not located in the broadcast video for the same color are shown.

For example, for yellow, the color value (RGB value) of a pixel where a banner is not located is different from the color value (RGB value) of a pixel where a banner is located.

Specifically, for yellow, the color value of a pixel where a banner is not located can be expressed as (255, 237, 043), and the color value of a pixel where a banner is located can be expressed as (029, 023, 000).

Each pixel value may be a combination of subpixels. That is, (255, 237, 043) may represent the value of the red subpixel, the green subpixel, and the blue subpixel, in that order.

Likewise, for white, red, and light blue, there is a difference in the color value of the pixel.

This is a result of the translucency of the banner.

If the minimum value among the three subpixel values constituting one pixel value is within a preset range and the difference between the median value and the minimum value among the three subpixel values is less than a certain value, the control unit 170 displays the pixel as a banner. It can be judged to be a uniform pixel with uniform characteristics corresponding to .

This is because, due to the translucent or opaque nature of the banner, the minimum value among the subpixel values is almost similar, and the difference between the intermediate value and the minimum value is small.

Here, the preset range is from -5 to +5, and a certain value may be 30, but this is only an example.

Referring to the pixel value where the banner is located for yellow in Figure 26, the minimum value among the subpixel values is (000), and the difference between the middle value (023) and the minimum value (000) is 23, so the above condition is satisfied. .

The control unit 170 may select the corresponding pixel as a uniform pixel.

The control unit 170 may perform a uniform pixel determination process for a total of 9 pixels, focusing on one pixel.

As shown in FIG. 27 , the control unit 170 may determine whether nine pixels 2701 to 2709 are uniform pixels based on the center pixel 2701.

That is, the control unit 170 determines that the minimum value among the three subpixel values is -5 or more and +5 or less (-5<=MIN Color(X, Y)<=+5) and the middle value among the three subpixel values. If the difference between and the minimum value is less than 30, the pixel can be determined to be a uniform pixel.

The control unit 170 performs the above process in units of 9 pixels to generate a uniformity map for each image frame. Figure 27 shows the results of selecting nine pixels (2701 to 2709) as uniform pixels with uniform properties.

The control unit 170 generates a uniform map and then performs a binarization process on the uniform map.

Referring to FIG. 28, a plurality of image frames 2801 to 2805 corresponding to each of a plurality of broadcast channels are shown.

The control unit 170 creates a uniform map for each of the plurality of image frames 2801 to 2805 and then performs a binarization process on the created uniform maps.

The binarization process may be a process of converting the value of each pixel to 0 or 255.

Accordingly, binarized images 2811 to 2815 in which a binarization process has been performed on the uniform map can be obtained.

Figure 25 will be described again.

The control unit 170 generates a summed uniform map from a plurality of uniform maps (S2503).

In one embodiment, the control unit 170 extracts commonalities from each of a plurality of uniform maps and generates a summed uniform map using the extracted commonalities.

Specifically, the control unit 170 may extract common points of binarized images on which a binarization process has been performed for each of the plurality of uniform maps.

The control unit 170 can extract parts where pixel values match as common points through a 1:1 comparison of each pixel.

This will be explained with reference to FIG. 29.

Referring to FIG. 29 , the control unit 170 may extract commonalities between a plurality of binarized images 2811 to 2815 and generate one summed uniform map 2900.

That is, the control unit 170 compares pixel values 1:1 for each of the plurality of binarized images 2811 to 2815, extracts the parts with matching pixel values as common points, and obtains a summed uniform map 2900. can do.

Figure 25 will be described again.

Meanwhile, the control unit 170 obtains difference images of each of a plurality of image frames corresponding to a plurality of broadcast channels (S2505).

In one embodiment, the controller 170 may obtain color difference information between two image frames among a plurality of image frames. The controller 170 can obtain a difference image for two image frames using color difference information.

Color difference information may be the RGB value of each pixel.

The control unit 170 may obtain a difference image using the difference in pixel values constituting each of the two image frames.

The control unit 170 converts the obtained difference images into binarized difference images (S2507).

In one embodiment, the control unit 170 may convert the difference image into a binarized difference image by comparing whether the values of pixels constituting the difference image are above a certain value.

Steps S2505 and S2507 will be described with reference to FIG. 31.

Figure 30 is a diagram illustrating a process of acquiring a binarized difference image based on the difference image according to an embodiment of the present invention.

Referring to FIG. 30, a plurality of image frames 2801 to 2805 corresponding to each of a plurality of broadcast channels are shown.

The controller 170 may obtain the first image 3001 using color difference information between the first image frame 2801 and the second image frame 2802. Afterwards, the control unit 170 may convert the first order image 3001 into a first binarized difference image 3011 using the pixel values constituting the first order image 3001.

The controller 170 may obtain the second image 3002 using color difference information between the second image frame 2802 and the third image frame 2803. Thereafter, the control unit 170 may convert the second image 3002 into a second binarized difference image 3012 using the pixel values constituting the second image 3002.

The controller 170 may obtain the third image 3003 using color difference information between the third image frame 2803 and the fourth image frame 2804. Thereafter, the control unit 170 may convert the third image 3003 into a third binarized difference image 3013 using the pixel values constituting the third image 3003.

The controller 170 may obtain the fourth image 3004 using color difference information between the fourth image frame 2804 and the fifth image frame 2805. Thereafter, the control unit 170 may convert the fourth order image 3004 into a fourth binarized difference image 3014 using the pixel values constituting the fourth order image 3004.

Figure 25 will be described again.

The control unit 170 extracts banner candidate areas using the summed uniform map obtained in step S2503 and the converted binarized difference images (S2509).

The control unit 170 may mask each of the binarized difference images with the summed uniform map and extract banner candidate areas from each of the masked images.

The control unit 170 may compare the binarized value of the pixel constituting the sum uniform map with the binarized value of the pixel constituting the binarized difference image.

The control unit 170 may obtain a masking image according to the comparison result and extract banner candidate areas from the obtained masking image.

The control unit 170 strengthens the extracted banner candidate areas using a morphology technique (S2511).

In one embodiment, the morphology technique may be a known technique for describing the shape of an object in an image. The control unit 170 may strengthen banner candidate areas by using an erosion operation among the morphology techniques.

For example, the control unit 170 may perform an erosion operation to change the smallest pixel value within a designated area of the masking image to the value of a pixel located at the center of the area.

The control unit 170 filters the strengthened banner candidate areas (S2513) and obtains a standard banner according to the filtering (S2515).

In one embodiment, the control unit 170 may filter a plurality of banner candidate areas using a preset size range and a preset position range.

The control unit 170 may extract one of the plurality of banner candidate areas as a banner candidate area corresponding to the standard banner according to the filtering result.

The control unit 170 may store a reference banner and an image frame including the reference banner in the storage unit 140 . An image frame containing a reference banner may be named a reference image frame.

In one embodiment, the control unit 170 may store the image of the standard banner, the coordinates of the standard banner, the width of the standard banner, and the width of the standard banner together in the storage unit 140.

Additionally, the control unit 170 may perform the channel number recognition algorithm according to the embodiments of FIGS. 9 to 13 only for the area of the standard banner.

That is, the control unit 170 may divide the image of the standard banner into a plurality of regions and obtain the number of letters in the plurality of divided regions.

If the number of characters in each area is less than the standard number, the control unit 170 can recognize the text in each area, and if the recognized text is valid, register the area as a candidate group.

The control unit 170 may obtain the coordinates of an area registered as a candidate group and obtain the obtained coordinates as location information of the channel number.

Accordingly, the control unit 170 can obtain location information of the channel number included in the standard banner, and store the obtained location information of the channel number in the storage unit 140.

Steps S2509 to S2515 will be described with reference to the drawings below.

Figures 31 and 32 are diagrams illustrating a process for obtaining a standard banner from banner candidate areas according to an embodiment of the present invention.

Referring to FIG. 31, the summed uniform map 2900 and a plurality of difference images 3001 to 3004 described in FIG. 29 are shown.

The control unit 170 may obtain a plurality of masking images 3011 to 3014 by masking the summed uniformity map 2900 to each of the plurality of difference images 3001 to 3004.

As shown in FIG. 32, the control unit 170 may extract banner candidate areas from each of the plurality of masking images 3011 to 3014.

For example, the control unit 170 may extract the first banner candidate area 3011a and the second banner candidate area 3011b from the first masking image 3011.

The control unit 170 may extract an area having a rectangular shape from the first masking image 3011 as a banner candidate area. This is because banners generally have a square shape.

The control unit 170 may extract banner candidate areas for each of the second to fourth masking images 3012 to 3014.

The control unit 170 may strengthen banner candidate areas extracted from each masking image using a morphology technique.

Through this, each banner candidate area can become clearer.

The control unit 170 may filter a plurality of strengthened banner candidate areas according to preset filtering criteria.

For example, the control unit 170 may filter a plurality of banner candidate areas based on a preset size range and a preset banner position.

Specifically, the control unit 170 may filter banner candidate areas in which the size of the banner candidate area is less than a preset size and the location of the banner candidate area is not within a preset coordinate range.

Generally, the banner is located at the bottom of the broadcast video, and the banner has a certain size.

Referring to FIG. 32, the banner candidate areas 3011b, 3013b, and 3014b are within a preset coordinate range, but the banner size is larger than the preset size, so they may be filtered.

Additionally, the banner candidate areas 3011a to 3014a are not within a preset coordinate range and may be filtered.

After filtering, the control unit 170 acquires the image 3200 corresponding to the banner candidate area 3012b, where the size of the banner candidate area is less than the preset size and the position of the banner candidate area is within the preset coordinate range, as a reference banner. can do.

Figure 24 will be described again.

Meanwhile, if a standard banner is stored in the storage unit 140, the control unit 170 determines whether the standard banner and the banner included in the second broadcast video match (S2419).

Step S2419 is explained with reference to FIG. 33.

Figure 33 is a flowchart illustrating a process of determining whether a banner included in a video of a changed broadcast channel matches the standard banner when there is a pre-stored standard banner according to an embodiment of the present invention.

Referring to FIG. 33, the control unit 170 generates a uniform map from a reference image frame including a reference banner stored in the storage unit 140 (S3301).

The process of generating a uniform map is replaced with the description of FIGS. 26 and 27.

The control unit 170 obtains a difference image between the image frame of the second broadcast video and the reference image frame (S3303), and obtains a binarized difference image according to binarization processing of the difference image (S3305).

The process of acquiring the difference image and binarized difference image is replaced with the description in FIG. 30.

The control unit 170 extracts the common area using the uniform map and the binarized difference image (S3307).

The control unit 170 may mask the summed uniform map to the binarized difference image and extract a common area (banner candidate area) from the masked image.

The control unit 170 may compare the binarized value of the pixel constituting the sum uniform map with the binarized value of the pixel constituting the binarized difference image.

The control unit 170 may acquire a masking image according to the comparison result and extract a common area from the obtained masking image. That is, if the binarization values match, it can be determined to be a common area.

The common area may be an area corresponding to the area where the reference banner is located.

If the number of pixels constituting the common area is more than a preset number, the control unit 170 determines that a banner matching the reference banner exists in the second broadcast image (S3311).

Figure 24 will be described again.

When the standard banner and the banner included in the second broadcast video match, the control unit 170 recognizes the channel number included in the banner (S2421).

Thereafter, the control unit 170 may extract the banner area included in the second broadcast image using the coordinates of the standard banner, the width of the standard banner, and the width of the standard banner.

The control unit 170 may perform the channel number recognition algorithm shown in FIGS. 9 to 13 on the extracted banner area.

In this case, there is no need to perform the channel number recognition algorithm on the entire area of the broadcast video, but the channel number recognition algorithm can be performed only on the banner area, which is a partial area. Accordingly, the amount of calculation is small and the channel number can be recognized more quickly.

The control unit 170 provides broadcast information related to the recognized channel number (S2423).

According to an embodiment of the present invention, the above-described method can be implemented as processor-readable code on a program-recorded medium. Examples of media that the processor can read include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

The display device described above is not limited to the configuration and method of the above-described embodiments, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made. It may be possible.

Claims (7)

In the display device,
display unit;
an external device interface unit that receives an image signal from a set-top box connected to the display device;
a storage unit that stores information about a standard banner and location information of a channel number included in the standard banner; and
If there is a banner matching the standard banner in the broadcast video of the broadcast channel changed according to the broadcast channel change request, recognize the channel number in the banner based on the location information of the channel number,
A control unit that displays broadcast information related to a recognized channel number on the display unit,
The control unit
Displaying the broadcast information related to the recognized channel number using electronic program guide information received from the set-top box,
The above broadcast information is
Containing one or more of channel recommendations, information on the broadcast video, and genre of the broadcast video
Display device. According to paragraph 1,
The control unit
Extracting a plurality of banner candidate areas from a plurality of image frames corresponding to each of a plurality of broadcast channels,
Obtaining one of a plurality of banner candidate areas as the reference banner
Display device. According to paragraph 2,
The control unit
Generate a plurality of uniform maps from the plurality of image frames,
Generating a summed uniform map from a plurality of uniform maps,
Extracting the plurality of banner candidate regions using the summed uniform map and binarized difference images obtained from a plurality of image frames,
Filtering the extracted plurality of banner candidate areas to obtain one of the banner candidate areas as the reference banner.
Display device. According to paragraph 3,
The control unit
Based on the size of the preset banner and the position of the preset banner, one of a plurality of banner candidate areas is obtained as the reference banner.
Display device. According to paragraph 1,
The control unit
Dividing the displayed broadcast video into a plurality of areas,
Obtain the number of letters in a plurality of divided areas,
If the number of characters in each area is less than the standard number, the text in each area is recognized,
If the recognized text is valid, register the area as a candidate group,
Obtain the coordinates of the area registered as a candidate group,
Obtaining the obtained coordinates as location information of the channel number
Display device. According to clause 5,
The control unit
When multiple candidates are registered, the plurality of candidates are filtered based on the information of each candidate group,
As a result of filtering, if one candidate group remains, the coordinates of the remaining candidate group are obtained as the location of the channel number,
Information on each candidate group
Contains one or more of the coordinate information of each candidate group, the length of the text included in each candidate group, and the size of the text.
Display device. delete

Images