KR102175535B1 - System and method for providing tv program information using augmented reality - Google Patents

Abstract

A TV program information providing system using augmented reality capable of providing program information currently being broadcast on a TV in augmented reality, and a TV program information providing method thereof, comprising: a broadcast receiver displaying a received broadcast program on a screen; and a broadcast receiver A mobile terminal that scans the screen of a screen with a camera and extracts search information from the scanned screen of the broadcast receiver, and an augmented reality TV that obtains broadcast program information based on the extracted search information and processes the broadcast program information to be realized as augmented reality. Including a server, the mobile terminal, upon receiving a request to search for broadcast program information, activates the camera to scan the screen of the broadcast receiver, extracts the search information from the scanned screen of the broadcast receiver, and transmits the search information to the augmented reality TV server. When program information processed into augmented reality is received from a reality TV server, the program information may be displayed as augmented reality around the screen of a broadcast receiver scanned through a camera.

Description

TV program information providing system using augmented reality and its TV program information providing method {SYSTEM AND METHOD FOR PROVIDING TV PROGRAM INFORMATION USING AUGMENTED REALITY}

The present invention relates to a TV program information providing system, and more particularly, to a TV program information providing system using augmented reality capable of providing program information currently being broadcast on a TV as augmented reality, and a TV program information providing method thereof. .

In general, digital broadcasting services that provide high-definition video and high-quality audio are widely spread and commercialized, and digital broadcasting programs are provided through terrestrial digital broadcasting or satellite digital broadcasting, or to be provided through the Internet. I can.

In addition, in digital broadcasting receivers such as digital television (D-TV), set-top box (STB), IP set-top box (IPSTB), etc. that receive digital broadcasting programs, various types of additional information transmitted together with digital broadcasting programs are detected and It will be extracted.

Meanwhile, the additional information may include broadcasting station-related information, broadcast program guide information, product information on objects displayed in a video image, and information on a website that sells the product.

However, if the user wants to know the program information, such as the contents of the program currently being broadcast, the episode, the cast, the profile of the lecturer giving a lecture, whether or not the program has been viewed, and the program refresh rate at the present time, the user himself/herself There was an inconvenience of having to directly search for program information using a mobile terminal such as a TV, cell phone, or computer.

That is, the user inputs the program name, channel, etc. that he wants to know through the mobile terminal as text, and when a plurality of search information corresponding to the input text is obtained, the user identifies the obtained plurality of search information by himself. There was a discomfort to know.

Accordingly, there is a need to develop a TV program information providing system capable of improving user convenience by providing program information of the automatically scanned TV screen to the mobile terminal in augmented reality when the TV screen is scanned by the camera of the mobile terminal in the future.

The present invention provides a preview of the TV screen displayed on the display of the mobile terminal by processing the program information of the TV screen scanned by the augmented reality TV server into augmented reality and providing it to the mobile terminal when the mobile terminal scans the TV screen with a camera. There is provided a TV program information providing system using augmented reality that can improve user convenience by implementing program information around an image as augmented reality and a method of providing TV program information thereof.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those of ordinary skill in the technical field to which the present invention belongs from the following description. I will be able to.

In order to solve the above technical problem, a TV program information providing system using augmented reality according to an embodiment of the present invention includes a broadcast receiver that displays a received broadcast program on a screen, and scans a screen of the broadcast receiver with a camera. And a mobile terminal that extracts search information from the scanned screen of the broadcast receiver, and an augmented reality TV server that obtains broadcast program information based on the extracted search information and processes the broadcast program information to be implemented as augmented reality. The terminal activates the camera and scans the screen of the broadcast receiver when a request to search for broadcast program information is received, extracts the search information from the scanned screen of the broadcast receiver, and transmits the search information to the augmented reality TV server. Upon receiving the program information processed by the camera, the program information may be displayed in augmented reality around the screen of the broadcast receiver scanned through the camera.

Here, when activating the camera, the mobile terminal may automatically activate the camera when a user input requesting search for broadcast program information is received.

Further, the user input may be a user input of touching a broadcast program information search icon displayed on the display of the mobile terminal, or a user input of uttering a broadcast program information search command with a voice.

Subsequently, when scanning the screen of the broadcast receiver, the mobile terminal may display the screen of the broadcast receiver scanned through the camera as a preview image on the display.

In addition, when scanning the screen of the broadcast receiver, the mobile terminal may control the camera to scan the entire screen area of the broadcast receiver.

Next, when extracting search information from the scanned screen of the broadcast receiver, the mobile terminal recognizes the screen area from the broadcast receiver scanned with the camera and retrieves search information for acquiring program information currently being broadcast within the recognized screen area. Can be extracted.

In addition, when displaying program information in augmented reality, the mobile terminal may display program information and user viewing information together.

Next, the mobile terminal includes a communication unit for communication with an augmented reality TV server, a camera unit for scanning a screen of a broadcast receiver, and a display unit for displaying program information in augmented reality around the screen of the broadcast receiver scanned from the camera unit. And, a control unit for controlling a communication unit, a camera unit, and a display unit, wherein the control unit activates the camera when a broadcast program information search request is received and controls the camera unit to scan the screen of the broadcast receiver, and The communication unit is controlled to extract the search information and transmit it to the augmented reality TV server, and when program information processed into augmented reality is received from the augmented reality TV server, the program information is transferred to augmented reality around the screen of the broadcast receiver scanned through the camera. The display unit can be controlled to display.

Next, when the augmented reality TV server receives the search information from the mobile terminal, it selects the broadcasting station server based on the received search information, requests information on the currently broadcasting program to the selected broadcasting station server, and obtains the requested program information from the broadcasting station server. Then, the user viewing information for the acquired program information is input into the user account, the program information and the user viewing information are processed to be implemented in augmented reality, and the processed program information and the user viewing information can be transmitted to the mobile terminal.

Here, the augmented reality TV server, when selecting a broadcasting station server based on the received search information, performs user authentication based on the user login information received from the mobile terminal, and when the user authentication is completed, the broadcasting station server is based on the received search information. You can choose.

Subsequently, when selecting a broadcasting station server based on the received search information, the augmented reality TV server may select the broadcasting station server based on the broadcasting channel logo included in the received search information.

Next, the augmented reality TV server, when acquiring the requested program information from the broadcasting station server, is among the broadcasting channel name, broadcasting program name, broadcasting program description, cast information, instructor information, episode information of the broadcasting program, and the refresh rate of the broadcasting program. Program information including at least one may be obtained from a broadcasting station server.

And, the augmented reality TV server, when inputting the user viewing information for the acquired program information into the user account, based on the acquired program information, at least one of the user's broadcast program viewing information and the user's broadcast program refresh rate information The included user viewing information may be generated, and the generated user viewing information may be input to a corresponding user account.

Next, the augmented reality TV server includes a communication unit that is connected to a mobile terminal and a broadcasting station server, an augmented reality processing unit that implements program information obtained from the broadcasting station server into augmented reality, and a control unit that controls the communication unit and the augmented reality processing unit. Including, the control unit, upon receiving the search information from the mobile terminal, selects a broadcasting station server based on the received search information, requests the currently broadcasting program information to the selected broadcasting station server, and obtains the requested program information from the broadcasting station server. Input the user viewing information for one program information into the user account, control the augmented reality processing unit so that the program information and user viewing information are implemented as augmented reality, and transmit the processed program information and user viewing information to the mobile terminal. Can control the communication unit.

Meanwhile, in the TV program information providing method of the TV program information providing system according to an embodiment of the present invention, a mobile terminal scans a screen of a broadcast receiver displaying a broadcast program through a camera, and search information from the scanned screen of the broadcast receiver. Extracting and transmitting the extracted search information to the augmented reality TV server, and by selecting a broadcasting station server based on the search information received by the augmented reality TV server, acquiring program information from the selected broadcasting station server, and the acquired program information is augmented. Transmitting the processed program information to the mobile terminal by processing it to be realized in reality, and augmenting the program information around the screen of the broadcast receiver scanned through the camera by receiving the program information processed in augmented reality by the mobile terminal It can be represented as reality.

Here, the transmitting of the extracted search information to the augmented reality TV server includes activating a camera when the mobile terminal receives a search request for broadcasting program information, and a screen of the broadcast receiver in which the mobile terminal displays a broadcast program through the camera. Scanning, extracting search information from the screen of the broadcast receiver scanned by the mobile terminal, and transmitting the extracted search information to the augmented reality TV server by the mobile terminal.

And, the step of transmitting the processed program information to the mobile terminal includes: when the augmented reality TV server receives the search information, selecting a broadcasting station server based on the received search information, and the augmented reality TV server currently selecting a broadcasting station server. A step of requesting information on a program being broadcast, a step of obtaining the requested program information from a broadcasting station server by an augmented reality TV server, and inputting user viewing information about the program information acquired by the augmented reality TV server into a user account; , The augmented reality TV server processing the program information and the user viewing information to be implemented as augmented reality, and the augmented reality TV server transmitting the processed program information and the user viewing information to the mobile terminal. .

Meanwhile, an embodiment of the present invention may further provide a computer-readable program for executing any one of the methods for providing TV program information and a recording medium on which the program is recorded.

A TV program information providing system using augmented reality and a method of providing TV program information thereof according to at least one embodiment of the present invention configured as described above, are scanned by an augmented reality TV server when a mobile terminal scans a TV screen with a camera. By processing the program information on the TV screen into augmented reality and providing it to the mobile terminal, the program information is implemented as augmented reality around the preview image of the TV screen displayed on the display of the mobile terminal to improve user convenience. do.

In addition, the present invention directly searches for a program in a mobile terminal, and without the hassle of finding necessary information within the directly searched program, the program information being broadcast is directly converted to augmented reality with a single scan of the camera TV screen of the mobile terminal. Convenience to check can be provided.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those of ordinary skill in the art from the following description. will be.

1 is a schematic diagram illustrating a TV program information providing system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating the TV program information providing system of FIG. 1.
3 is a block diagram illustrating the mobile terminal of FIG. 2.
4 is a block diagram illustrating the augmented reality TV server of FIG. 2.
5 to 7 are diagrams for explaining a process of providing program information implemented in augmented reality.
8 to 10 are flowcharts illustrating a method of providing TV program information according to an embodiment of the present invention.

Hereinafter, an apparatus and various methods to which embodiments of the present invention are applied will be described in more detail with reference to the drawings. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves.

In the above, even if all the constituent elements constituting the embodiments of the present invention have been described as being combined into one or operating in combination, the present invention is not necessarily limited to these embodiments. That is, within the scope of the object of the present invention, all of the constituent elements may be selectively combined and operated in one or more. In addition, although all the components may be implemented as one independent hardware, a program module that performs some or all functions combined in one or more hardware by selectively combining some or all of each It may be implemented as a computer program having Codes and code segments constituting the computer program may be easily inferred by those skilled in the art. Such a computer program is stored in a computer-readable storage medium, and is read and executed by a computer, thereby implementing an embodiment of the present invention. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, and a carrier wave medium.

In the description of the embodiment, in the case of being described as being formed in "top (top) or bottom (bottom)", "before (front) or after (back)" of each component, "top (top) or bottom (Below)” and “before (front) or after (back)” include both components formed by direct contact with each other or one or more other components disposed between the two components.

In addition, the terms such as "include", "consist of" or "have" described above mean that the corresponding component may be embedded unless otherwise stated, excluding other components Rather, it should be interpreted as being able to further include other components. All terms, including technical or scientific terms, unless otherwise defined, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms generally used, such as terms defined in the dictionary, should be interpreted as being consistent with the meaning in the context of the related technology, and are not interpreted as ideal or excessively formal meanings unless explicitly defined in the present invention.

In addition, in describing the constituent elements of the present invention, terms such as first, second, A, B, (a), (b) may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the component is not limited by the term. When a component is described as being "connected", "coupled" or "connected" to another component, that component may be directly connected or connected to that other component, but another component between each component It should be understood that elements may be “connected”, “coupled” or “connected”.

In addition, in describing the present invention, if it is determined that the subject matter of the present invention may be unnecessarily obscured as matters apparent to those skilled in the art with respect to related known technologies, detailed descriptions thereof will be omitted.

1 is a schematic diagram illustrating a TV program information providing system according to an embodiment of the present invention, and FIG. 2 is a block diagram illustrating a TV program information providing system of FIG. 1.

As shown in FIGS. 1 and 2, the TV program information providing system 10 scans and scans the screen of the broadcast receiver 100 and the broadcast receiver 100 that displays the received broadcast program on the screen. A mobile terminal 200 that extracts search information from the screen of the broadcast receiver 100, and an augmented reality TV server 300 that obtains broadcast program information based on the extracted search information and processes the broadcast program information to be implemented as augmented reality. ) Can be included.

Here, the broadcast receiver 100 is, for example, a fixed type such as a network TV (network TV), a hybrid broadcast broadband TV (HBBTV), a smart TV, an Internet Protocol TV (IPTV), a personal computer (PC), etc. A mobile device such as a standing device, a personal digital assistant (PDA) 410, a smart phone 420, a smart watch 430, a tablet PC, a notebook, etc. device or handheld device) may be included.

In addition, the mobile terminal 200 described in the present specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, Slate PC, tablet PC, ultrabook, wearable device, e.g., smartwatch, smart glass, head mounted display (HMD) )), etc.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to fixed terminals such as digital TVs, desktop computers, and digital signage, except when applicable only to mobile terminals. will be.

The mobile terminal 200 activates the camera when a search request for broadcasting program information is received, scans the screen of the broadcast receiver 100, extracts search information from the scanned screen of the broadcast receiver 100, and extracts the search information from the augmented reality TV server ( 300), and receiving program information processed into augmented reality from the augmented reality TV server 300, the program information may be displayed in augmented reality around the screen of the broadcast receiver scanned through the camera.

Here, when activating the camera, the mobile terminal 200 may automatically activate the camera when a user input requesting search for broadcast program information is received.

For example, the user input may be a user input of touching a broadcast program information search icon displayed on the display of the mobile terminal 200.

In some cases, the user input may be a user input for uttering a broadcast program information search command by voice.

In addition, when scanning the screen of the broadcast receiver 100, the mobile terminal 200 may display the screen of the broadcast receiver 100 scanned through the camera as a preview image on the display.

Also, when scanning the screen of the broadcast receiver 100, the mobile terminal 200 may control the camera to scan the entire screen area of the broadcast receiver 100.

The reason for this is that if the entire screen area of the broadcast receiver 100 is scanned, search information for acquiring program information currently being broadcast can be easily extracted from the scanned screen.

In some cases, when scanning the screen of the broadcast receiver 100, the mobile terminal 200 may control the camera to scan a partial area of the screen of the broadcast receiver 100.

Here, a partial area of the screen to be scanned may be an upper right area of the screen.

This is because search information for acquiring information about a program currently being broadcast exists from the upper right area of the entire screen area of the broadcast receiver 100.

As such, when extracting search information from the scanned screen of the broadcast receiver 100, the mobile terminal 200 recognizes the screen area from the broadcast receiver 100 scanned with the camera, and broadcasts the current within the recognized screen area. It is possible to extract search information for acquiring information on a program being executed.

As an example, the search information for acquiring program information currently being broadcast may be a broadcast channel logo displayed on the screen of the broadcast receiver 100, but is not limited thereto.

Here, the reason for extracting the broadcasting channel logo is to know broadcasting station information of a program currently being broadcast, and based on this, program information can be requested from the broadcasting station.

Also, when extracting search information from the scanned screen of the broadcast receiver 100, the mobile terminal 200 may extract current time information and user login information together.

Here, the reason for extracting the current time information is to know information on a program being broadcast at the current time, and based on this, accurate program information can be obtained from a corresponding broadcasting station.

And, the reason for extracting the user login information is to check whether the subscriber wishes to use the augmented reality program information providing service, and based on this, the augmented reality TV server 300 can provide a corresponding service to the subscriber. to be.

Also, when extracting current time information, the mobile terminal 200 may be extracted at the time of extracting search information.

This is because accurate and reliable program information can be obtained by providing the current time information, which is the program broadcast time, together with the broadcast channel logo, which is search information, to the augmented reality TV server 300.

For example, the mobile terminal 200 may transmit the extracted search information, current time information, and user login information to the augmented reality TV server 300 together.

Next, when displaying program information in augmented reality, the mobile terminal 200 may arrange and display program information according to a preset position value in the augmented reality TV server 300.

For example, when displaying program information in augmented reality, the mobile terminal 200 may display the program information to be positioned in at least one of up, down, left, and right with respect to the screen of the broadcast receiver 100.

In addition, when displaying program information in augmented reality, the mobile terminal 200 may display adjacent program information at a predetermined interval so that adjacent program information does not overlap if there are a plurality of program information.

The reason is for the user to accurately recognize program information implemented in augmented reality.

In some cases, when displaying program information in augmented reality, the mobile terminal 200 displays the program information to be spaced apart from the broadcast receiver 100 so that the screen of the program information and the broadcast receiver 100 do not overlap. I can.

The reason is for the user to accurately recognize program information implemented in augmented reality.

As another case, when displaying the program information in augmented reality, the mobile terminal 200 broadcasts first program information with a large amount of information and second program information with a small amount of information among a plurality of program information. It may be displayed at different locations around the screen of the receiver 100.

The reason is that placing the first program information with a large amount of information in a large space area and placing the second program information with a small amount of information in a narrow space area allows the user to easily recognize and efficiently use the program information arrangement space. Because.

For example, the mobile terminal 200 displays first program information having a large amount of information among a plurality of program information to be located on the left or right of the screen of the broadcast receiver 100, and the amount of information among the plurality of program information The small second program information may be displayed to be located above or below the screen of the broadcast receiver 100.

The reason is that it is convenient for the user to arrange the first program information with a large amount of information on the left or right side of the screen having a large space area and the second program information with a small amount of information on the upper or lower side of the screen having a narrow space area. This is because it is recognizable and can efficiently use the program information arrangement space.

Subsequently, when displaying program information in augmented reality, the mobile terminal 200 may display program information and user viewing information together.

This is because various information can be easily provided to the user.

As an example, the program information may include a broadcast channel name, a broadcast program name, a broadcast program description, cast information, instructor information, episode information of a broadcast program, and a refresh rate of a broadcast program, but is not limited thereto.

In addition, the user viewing information may include information on whether or not the user views a broadcast program, and information on a user's broadcast program refresh rate, but is not limited thereto.

Here, the information on whether the user has viewed the broadcast program may include information on whether or not to watch the broadcast program for each episode.

In addition, the user's broadcast program refresh rate information may include a broadcast program refresh rate corresponding to a time point of searching for broadcast program information.

On the other hand, when the augmented reality TV server 300 receives search information from the mobile terminal 200, it selects the broadcasting station server 400 based on the received search information, and transmits program information currently being broadcast to the selected broadcasting station server 400. When requesting and obtaining the requested program information from the broadcasting station server 400, the user viewing information for the obtained program information is input into the user account, and the program information and the user viewing information are processed to be implemented in augmented reality, and processed. The program information and user viewing information may be transmitted to the mobile terminal 200.

Here, the augmented reality TV server 300, when selecting the broadcasting station server 400 based on the received search information, performs user authentication based on the user login information received from the mobile terminal 200, and when the user authentication is completed The broadcasting station server 400 may be selected based on the received search information.

For example, when selecting the broadcasting station server 400 based on the received search information, the augmented reality TV server 300 may select the broadcasting station server 400 based on a broadcasting channel logo included in the received search information.

And, the augmented reality TV server 300, when acquiring the requested program information from the broadcasting station server 400, a broadcasting channel name, a broadcasting program name, a broadcasting program description, cast information, instructor information, episode information of the broadcasting program, and Program information including at least one of the refresh rates of the broadcast program may be obtained from the broadcasting station server 400.

Next, the augmented reality TV server 300, when inputting the user viewing information for the acquired program information into the user account, based on the acquired program information, at least one of information about whether the user has watched a broadcast program and information about the user's broadcast program refresh rate. User viewing information including any one may be generated, and the generated user viewing information may be input to a corresponding user account.

Here, the information on whether the user has viewed the broadcast program may include information on whether or not to watch the broadcast program for each episode.

In addition, the broadcast program refresh rate information of the user may include a broadcast program refresh rate corresponding to a time point when the broadcast program information is searched.

As described above, according to the present invention, when the mobile terminal 200 scans the TV screen with a camera, the augmented reality TV server 300 processes the program information of the scanned TV screen into augmented reality and provides it to the mobile terminal 200. , User convenience may be improved by implementing program information in augmented reality around the preview image of the TV screen displayed on the display of the mobile terminal 200.

In addition, the present invention, without the hassle of a user directly searching for a program in the mobile terminal 200 and finding necessary information within the directly searched program, the program being broadcasted by one scan of the camera TV screen of the mobile terminal 200 It can provide convenience to immediately check information in augmented reality.

3 is a block diagram illustrating the mobile terminal of FIG. 2.

As shown in FIG. 3, the mobile terminal 200 stores program information around the screen of the communication unit 210, the camera unit 220 that scans the screen of the broadcast receiver, and the screen of the broadcast receiver scanned from the camera unit 220. A display unit 230 for displaying an augmented reality, and a control unit 240 for controlling the communication unit 210, the camera unit 220, and the display unit 230 may be included.

Here, the communication unit 210 may be communicatively connected with an augmented reality TV server, and may transmit/receive digital data such as content by connecting to a network by wire or wirelessly.

For example, the communication unit 210 may include a wireless Internet module, a short-range communication module, and a location information module.

Here, the wireless Internet module refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 200.

The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc. Data is transmitted and received according to at least one wireless Internet technology within a range including Internet technologies not listed in.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, a wireless Internet module that performs wireless Internet access through a mobile communication network is It can also be understood as a kind of module.

The short range communication module is for short range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC (Near NFC). Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication.

The short-range communication module may support wireless communication between the mobile terminal 200 and the augmented reality TV server through wireless area networks.

The local area wireless communication networks may be wireless personal area networks (Wireless Personal Area Networks).

The location information module is a module for obtaining the location (or current location) of the mobile terminal 200, and representative examples thereof include a GPS (Global Positioning System) module or a WiFi (Wireless Fidelity) module.

On the other hand, the control unit 240 controls the camera unit 220 to scan the screen of the broadcast receiver by activating the camera when a broadcast program information search request is received, and extracts search information from the scanned screen of the broadcast receiver to provide augmented reality. Controls the communication unit 210 to transmit to the TV server, and when receiving program information processed into augmented reality from the augmented reality TV server, the program information is displayed in augmented reality around the screen of the broadcast receiver scanned through the camera. It is possible to control the unit 230.

Here, when activating the camera, the control unit 240 may control the camera unit 220 to automatically activate the camera when a user input requesting search for broadcast program information is received.

In addition, when scanning the screen of the broadcast receiver, the controller 240 may control the display 230 to display the screen of the broadcast receiver scanned through the camera as a preview image.

Also, when scanning the screen of the broadcast receiver, the control unit 240 may control the camera unit 220 to scan the entire screen area of the broadcast receiver.

The reason is that by scanning the entire screen area of the broadcast receiver, it is possible to easily extract search information for acquiring program information currently being broadcast from the scanned screen.

In some cases, when scanning the screen of the broadcast receiver, the controller 240 may control the camera 220 to scan a partial area of the screen of the broadcast receiver.

Here, a partial area of the screen to be scanned may be an upper right area of the screen.

The reason is that search information for acquiring program information currently being broadcast exists from the upper right area of the entire screen area of the broadcast receiver.

As such, when extracting search information from the scanned screen of the broadcast receiver, the control unit 240 recognizes the screen area from the broadcast receiver scanned with the camera, and obtains program information currently being broadcast within the recognized screen area. Search information can be extracted.

As an example, the search information for acquiring the currently broadcasting program information may be a broadcasting channel logo displayed on the screen of a broadcasting receiver, but is not limited thereto.

Here, the reason for extracting the broadcasting channel logo is to know broadcasting station information of a program currently being broadcast, and based on this, program information can be requested from the broadcasting station.

In addition, when extracting search information from the scanned screen of the broadcast receiver, the controller 240 may extract current time information and user login information together.

Here, the reason for extracting the current time information is to know information on a program being broadcast at the current time, and based on this, accurate program information can be obtained from a corresponding broadcasting station.

In addition, the reason for extracting user login information is to check whether a subscriber intends to use the augmented reality program information providing service, and based on this, the augmented reality TV server can provide a corresponding service to the subscriber.

In addition, when the current time information is extracted, the control unit 240 may be extracted at the time when the search information is extracted.

The reason is that accurate and reliable program information can be obtained by providing current time information, which is a program broadcast time, together with a broadcast channel logo, which is search information, to an augmented reality TV server.

For example, the control unit 240 may transmit the extracted search information, current time information, and user login information to the augmented reality TV server together.

Next, when the program information is displayed in augmented reality, the controller 240 may control the display 230 to arrange and display program information according to a preset position value in the augmented reality TV server.

As an example, when displaying program information in augmented reality, the controller 240 may control the display 230 to display program information in at least one of top, bottom, left, and right with respect to the screen of the broadcast receiver.

In addition, when the program information is displayed in augmented reality, if there are a plurality of program information, the control unit 240 controls the display unit 230 to display adjacent program information at predetermined intervals so that adjacent program information does not overlap. can do.

The reason is for the user to accurately recognize program information implemented in augmented reality.

In some cases, when displaying program information in augmented reality, the controller 240 may control the display 230 to display the program information at a predetermined interval from the broadcast receiver so that the program information and the screen of the broadcast receiver do not overlap. I can.

The reason is for the user to accurately recognize program information implemented in augmented reality.

As another case, when displaying program information in augmented reality, if there are a plurality of program information, the controller 240 transmits first program information with a large amount of information and second program information with a small amount of information among the plurality of program information. The display unit 230 may be controlled to display at different locations around the screen of.

The reason is that placing the first program information with a large amount of information in a large space area and placing the second program information with a small amount of information in a narrow space area allows the user to easily recognize and efficiently use the program information arrangement space. Because.

For example, the controller 240 displays first program information with a large amount of information among a plurality of program information to be located on the left or right side of the screen of a broadcast receiver, and a second program with a small amount of information among the plurality of program information The display 230 may be controlled to display information to be positioned above or below the screen of the broadcast receiver.

The reason is that it is convenient for the user to arrange the first program information with a large amount of information on the left or right side of the screen having a large space area and the second program information with a small amount of information on the upper or lower side of the screen having a narrow space area This is because it is recognizable and can efficiently use the program information arrangement space.

Subsequently, when the program information is displayed in augmented reality, the controller 240 may control the display 230 to display the program information and the user viewing information together.

This is because various information can be easily provided to the user.

As an example, the program information may include a broadcast channel name, a broadcast program name, a broadcast program description, cast information, instructor information, episode information of a broadcast program, and a refresh rate of a broadcast program, but is not limited thereto.

In addition, the user viewing information may include information on whether or not the user views a broadcast program, and information on a user's broadcast program refresh rate, but is not limited thereto.

Here, the information on whether the user has viewed the broadcast program may include information on whether or not to watch the broadcast program for each episode.

In addition, the user's broadcast program refresh rate information may include a broadcast program refresh rate corresponding to a time point of searching for broadcast program information.

4 is a block diagram illustrating the augmented reality TV server of FIG. 2.

As shown in FIG. 4, the augmented reality TV server 300 includes a communication unit 310, an augmented reality processing unit 320 that implements program information acquired from a broadcasting station server into augmented reality, and a communication unit 310 and augmented reality. It may include a control unit 330 that controls the reality processing unit 320.

Here, the communication unit 310 may be communicatively connected to a mobile terminal and a broadcasting station server, and may transmit/receive digital data such as content by connecting to a network by wire or wirelessly.

For example, the communication unit 310 may include a wireless Internet module, a short-range communication module, and a location information module.

Here, the wireless Internet module refers to a module for wireless Internet access, and may be built-in or external to the augmented reality TV server 300.

The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc. Data is transmitted and received according to at least one wireless Internet technology within a range including Internet technologies not listed in.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, a wireless Internet module that performs wireless Internet access through a mobile communication network is It can also be understood as a kind of module.

The short range communication module is for short range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC (Near NFC). Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication.

The short-range communication module may support wireless communication between the augmented reality TV server 300 and a mobile terminal or between the augmented reality TV server 300 and a broadcasting station server through wireless area networks.

The local area wireless communication networks may be wireless personal area networks (Wireless Personal Area Networks).

The location information module is a module for obtaining the location (or current location) of the augmented reality TV server 300, and representative examples thereof include a GPS (Global Positioning System) module or a WiFi (Wireless Fidelity) module.

On the other hand, when receiving search information from the mobile terminal, the control unit 330 selects a broadcasting station server based on the received search information, requests information on programs currently being broadcast to the selected broadcasting station server, and obtains the requested program information from the broadcasting station server. Then, the user viewing information for the acquired program information is input into the user account, the augmented reality processing unit 320 is controlled so that the program information and the user viewing information are implemented as augmented reality, and the processed program information and the user viewing information are stored. The communication unit 310 can be controlled to transmit to the mobile terminal.

Here, when selecting a broadcasting station server based on the received search information, the control unit 330 performs user authentication based on user login information received from the mobile terminal, and when user authentication is completed, the broadcasting station server is configured based on the received search information. You can choose.

For example, when selecting a broadcasting station server based on the received search information, the controller 330 may select a broadcasting station server based on a broadcasting channel logo included in the received search information.

And, when obtaining the requested program information from the broadcasting station server, the control unit 330 is at least one of a broadcasting channel name, a broadcasting program name, a broadcasting program description, cast information, instructor information, episode information of a broadcasting program, and a refresh rate of the broadcasting program. Program information including any one can be obtained from the broadcasting station server.

Next, when the user viewing information for the acquired program information is input to the user account, the control unit 330 provides at least one of information about whether the user has watched a broadcast program and information about the user's broadcast program refresh rate based on the acquired program information. The included user viewing information may be generated, and the generated user viewing information may be input to a corresponding user account.

Here, the information on whether the user has viewed the broadcast program may include information on whether or not to watch the broadcast program for each episode.

In addition, the broadcast program refresh rate information of the user may include a broadcast program refresh rate corresponding to a time point when the broadcast program information is searched.

5 to 7 are diagrams for explaining a process of providing program information implemented in augmented reality.

As shown in FIG. 5, when a user input for selecting the broadcast program information search icon 236 displayed on the display screen 232 is received, the mobile terminal 200 activates the camera, and the display screen 232 You can display external images by switching to the camera mode.

Here, the mobile terminal 200 may automatically activate the camera 222 when a user input requesting search for broadcast program information is received.

As an example, the user input may be a user input of touching the broadcast program information search icon 236 displayed on the display screen 232 of the mobile terminal 200, as shown in FIG. 5, but the broadcast program information search command is spoken by voice. It may be a user input to do.

Next, as shown in FIG. 6, the mobile terminal 200 may scan the screen 110 of the broadcast receiver 100 displaying a broadcast program through the camera 222.

Here, the mobile terminal 200 may display the screen 110 of the broadcast receiver 100 scanned through the camera 222 as a preview image 234 on the display screen 232.

For example, the mobile terminal 200 may control the camera 222 to scan the entire screen area of the broadcast receiver 100.

In addition, the mobile terminal 200 may extract the search information 238 from the scanned screen of the broadcast receiver 100.

That is, the mobile terminal 200 recognizes a screen area from the broadcast receiver 100 scanned with the camera 222, and extracts search information 238 for acquiring information about a program currently being broadcast within the recognized screen area. can do.

Here, the search information 238 for obtaining program information currently being broadcast may be a broadcast channel logo displayed on the screen 110 of the broadcast receiver 100.

Also, when extracting the search information 238 from the scanned screen of the broadcast receiver 100, the mobile terminal 200 may extract current time information and user login information together.

Here, the current time information may be extracted at the time when the search information is extracted.

Next, the mobile terminal 200 may transmit the extracted search information 238 to the augmented reality TV server.

Here, when transmitting the extracted search information 238 to the augmented reality TV server, the mobile terminal 200 may transmit the extracted search information 238, current time information, and user login information to the augmented reality TV server together. have.

On the other hand, the augmented reality TV server, upon receiving the search information 238, selects a broadcasting station server based on the received search information 238, requests the currently broadcasting program information to the selected broadcasting station server, and sends the requested program information to the broadcasting station. It is acquired from the server and inputs user viewing information for the acquired program information into a user account, processing program information and user viewing information to be implemented in augmented reality, and processing processed program information and user viewing information into a mobile terminal ( 200).

Here, the augmented reality TV server, when selecting a broadcasting station server based on the received search information, performs user authentication based on user login information received from the mobile terminal 200, and when user authentication is completed, based on the received search information. You can select a broadcasting station server.

And, the augmented reality TV server, when acquiring the requested program information from the broadcasting station server, at least one of the broadcasting channel name, the broadcasting program name, the broadcasting program description, the cast information, the instructor information, the episode information of the broadcasting program, and the refresh rate of the broadcasting program. Program information including any one can be obtained from the broadcasting station server.

In addition, the augmented reality TV server, when inputting the user viewing information for the acquired program information into the user account, based on the acquired program information, at least one of the user's broadcast program viewing information and the user's broadcast program refresh rate information. The included user viewing information may be generated, and the generated user viewing information may be input to a corresponding user account.

Here, the information on whether the user has watched the broadcast program may include information on whether or not the user has viewed each episode of the broadcast program, and the information on the refresh rate of the user's broadcast program may include a broadcast program refresh rate corresponding to the time when the broadcast program information is searched. have.

Next, as shown in FIG. 7, the mobile terminal 200 receives the program information processed into augmented reality and scans the screen 110 of the broadcast receiver 100 scanned through the camera 222. Program information around the image 234 may be displayed in augmented reality.

For example, when the broadcast program is an EBS course, the program information includes: first program information 252 including instructor information, second program information 254 including information about whether or not to watch the broadcast program, and broadcast channel name And third program information 256 including a broadcast program name, and fourth program information 258 including refresh rate information of a broadcast program corresponding to a search time point.

Here, when displaying program information in augmented reality, the mobile terminal 200 may arrange and display program information according to a preset position value in the augmented reality TV server.

For example, when displaying program information in augmented reality, the mobile terminal 200 displays the program information to be positioned in at least one of the top, bottom, left, and right with respect to the preview image 234 corresponding to the screen of the broadcast receiver 100 can do.

In addition, when displaying program information in augmented reality, the mobile terminal 200 may display adjacent program information at a predetermined interval so that adjacent program information does not overlap if there are a plurality of program information.

In some cases, when displaying program information in augmented reality, the mobile terminal 200 transmits program information from the preview image 234 of the broadcast receiver 100 so that the program information and the screen of the broadcast receiver 100 do not overlap. It can also be marked to be separated by a certain interval.

As another case, when displaying the program information in augmented reality, the mobile terminal 200 broadcasts first program information with a large amount of information and second program information with a small amount of information among a plurality of program information. It can also be displayed in different locations around the receiver's screen.

For example, among a plurality of program information, the first program information with a large amount of information is displayed to be located on the left or the right side of the preview image 234 corresponding to the screen of the broadcast receiver, and the amount of information among the plurality of program information is small. The second program information may be displayed to be located on the upper or lower side of the vicinity of the preview image 234 corresponding to the screen of the broadcast receiver.

As another case, when displaying program information in augmented reality, the mobile terminal 200 may also display program information and user viewing information together.

Here, the program information includes a broadcast channel name, a broadcast program name, a broadcast program description, cast information, instructor information, episode information of a broadcast program, and a refresh rate of a broadcast program, and the user viewing information is information on whether the user has viewed a broadcast program. And, the broadcast program refresh rate information of the user may be included.

As shown in FIG. 7, information on whether a user has viewed a broadcast program included in the second program information 254 may include information on whether or not to watch a broadcast program for each episode.

For example, the information on whether to watch each episode of a broadcast program includes a first viewing notification mark 254-1 indicating that the program has been viewed from the middle, and a second viewing notification mark 254 indicating that the program has been viewed from the beginning. -2), and a second viewing notification mark 254-3 indicating that the program has not been viewed.

In addition, as shown in FIG. 7, the user's broadcast program refresh rate information included in the fourth program information 258 may include a broadcast program refresh rate corresponding to a time point of searching for broadcast program information.

For example, a broadcast program refresh rate corresponding to a time point of searching for broadcast program information may be displayed in the form of a time bar.

Accordingly, the present invention directly searches for a program in a mobile terminal, and without the hassle of having to find necessary information in the directly searched program, the program information being broadcast is directly converted to augmented reality with a single scan of the camera TV screen of the mobile terminal. Convenience to check can be provided.

8 to 10 are flowcharts illustrating a method of providing TV program information according to an embodiment of the present invention.

As shown in FIG. 8, in the TV program information providing system of the present invention including a mobile terminal and an augmented reality TV server that are communicatively connected to each other, first, the mobile terminal is a broadcast receiver displaying a broadcast program through a camera. Search information may be extracted from the screen of the scanned broadcast receiver by scanning the screen, and the extracted search information may be transmitted to the augmented reality TV server (S100).

In addition, the augmented reality TV server selects a broadcasting station server based on the received search information, obtains program information from the selected broadcasting station server, processes the acquired program information to be implemented as augmented reality, and moves the processed program information. It can be transmitted to the terminal (S200).

Next, the mobile terminal may receive program information processed into augmented reality and display the program information in augmented reality around the screen of the broadcast receiver scanned through the camera (S300).

As shown in FIG. 9, the step of transmitting the extracted search information to the augmented reality TV server (S100) will be described in more detail as follows.

First, when the mobile terminal receives a broadcast program information search request (S110), it activates the camera (S120).

Here, when activating the camera, the mobile terminal may automatically activate the camera when a user input requesting search for broadcast program information is received.

For example, the user input may be a user input of touching a broadcast program information search icon displayed on the display of the mobile terminal, or a user input of uttering a broadcast program information search command with a voice.

Next, the mobile terminal scans the screen of the broadcast receiver displaying the broadcast program through the camera (S130).

Here, when the mobile terminal scans the screen of the broadcast receiver displaying the broadcast program, the screen of the broadcast receiver scanned through the camera may be displayed on the display as a preview image.

In addition, when scanning a screen of a broadcast receiver displaying a broadcast program, the mobile terminal may control the camera to scan the entire screen area of the broadcast receiver.

Subsequently, the mobile terminal extracts search information from the scanned screen of the broadcast receiver (S140).

Here, when the mobile terminal extracts search information from the screen of the scanned broadcast receiver, the mobile terminal recognizes the screen area from the broadcast receiver scanned with the camera, and the search information for acquiring the program information currently being broadcast within the recognized screen area. Can be extracted.

For example, the search information for obtaining information about a program currently being broadcast may be a broadcast channel logo displayed on a screen of a broadcast receiver.

In addition, when extracting search information from the scanned screen of the broadcast receiver, the mobile terminal may extract current time information and user login information together.

As an example, the current time information may be extracted at the time when the search information is extracted.

Next, the mobile terminal may transmit the extracted search information to the augmented reality TV server (S150).

Here, when transmitting the extracted search information to the augmented reality TV server, the mobile terminal may transmit the extracted search information, current time information, and user login information to the augmented reality TV server together.

Meanwhile, as shown in FIG. 10, the step of transmitting the processed program information to the mobile terminal (S200) will be described in more detail as follows.

First, when the augmented reality TV server receives search information (S210), it selects a broadcasting station server based on the received search information (S220).

Here, the augmented reality TV server, when selecting a broadcasting station server based on the received search information, performs user authentication based on the user login information received from the mobile terminal, and when the user authentication is completed, the broadcasting station server is based on the received search information. You can choose.

For example, when selecting a broadcasting station server based on the received search information, the augmented reality TV server may select a broadcasting station server based on a broadcasting channel logo included in the received search information.

Subsequently, the augmented reality TV server requests information on programs currently being broadcast to the selected broadcasting station server.

Next, the augmented reality TV server acquires the requested program information from the broadcasting station server (S230).

Here, when the augmented reality TV server obtains the requested program information from the broadcasting station server, at least one of the broadcasting channel name, the broadcasting program name, the broadcasting program description, the cast information, the instructor information, the episode information of the broadcasting program, and the refresh rate of the broadcasting program. Program information including any one can be obtained from the broadcasting station server.

Then, the augmented reality TV server inputs user viewing information on the acquired program information into the user account (S240).

Here, the augmented reality TV server, when inputting the user viewing information for the acquired program information into the user account, based on the acquired program information, at least one of information on whether the user has watched a broadcast program and information on the user's broadcast program refresh rate. The included user viewing information may be generated, and the generated user viewing information may be input to a corresponding user account.

As an example, the information on whether a user has viewed a broadcast program may include information on whether or not to watch a broadcast program for each episode.

In addition, the broadcast program refresh rate information of the user may include a broadcast program refresh rate corresponding to a time point when the broadcast program information is searched.

Next, the augmented reality TV server processes program information and user viewing information to be implemented in augmented reality (S250).

Subsequently, the augmented reality TV server transmits the processed program information and user viewing information to the mobile terminal (S260).

Meanwhile, in the step of displaying program information in augmented reality (S300), the mobile terminal may arrange and display program information according to a preset position value in the augmented reality TV server.

For example, when displaying program information in augmented reality, the mobile terminal may display the program information to be positioned at least one of top, bottom, left, and right with respect to the screen of the broadcast receiver.

In some cases, when displaying program information in augmented reality, the mobile terminal may display adjacent program information at a predetermined interval so that the program information adjacent to each other does not overlap if there are a plurality of program information.

As another case, when displaying the program information in augmented reality, the mobile terminal may display the program information so that the program information and the screen of the broadcast receiver do not overlap each other at a predetermined interval from the broadcast receiver.

As another case, when displaying program information in augmented reality, the mobile terminal transmits first program information with a large amount of information and second program information with a small amount of information among the plurality of program information to the broadcast receiver. You can also display them in different locations around the screen.

As an example, the first program information with a large amount of information among a plurality of program information is displayed to be located on the left or right side of the screen of the broadcast receiver, and the second program information with a small amount of information among the plurality of program information is the broadcast receiver It can be displayed to be located at the top or bottom of the screen of the screen.

Also, when displaying program information in augmented reality, the mobile terminal may display program information and user viewing information together.

Here, the program information includes a broadcast channel name, a broadcast program name, a broadcast program description, cast information, instructor information, episode information of a broadcast program, and a refresh rate of a broadcast program, and the user viewing information is information on whether the user has viewed a broadcast program. And, the broadcast program refresh rate information of the user may be included.

As an example, the information on whether a user has viewed a broadcast program may include information on whether or not to watch a broadcast program for each episode.

In addition, the broadcast program refresh rate information of the user may include a broadcast program refresh rate corresponding to a time point when the broadcast program information is searched.

As described above, according to the present invention, when the mobile terminal scans the TV screen with the camera, the program information of the TV screen scanned by the augmented reality TV server is processed into augmented reality and provided to the mobile terminal, thereby providing the TV displayed on the display of the mobile terminal. User convenience can be improved by implementing program information in augmented reality around the preview image on the screen.

In addition, the present invention directly searches for a program in a mobile terminal, and without the hassle of finding necessary information within the directly searched program, the program information being broadcast is directly converted to augmented reality with a single scan of the camera TV screen of the mobile terminal. Convenience to check can be provided.

On the other hand, the mobile terminal of the present invention displays program information in augmented reality around the screen of the broadcast receiver, a communication unit for communication with an augmented reality TV server, a camera unit for scanning a screen of a broadcast receiver, and a screen of the broadcast receiver scanned from the camera unit. It may include a display unit, a communication unit, a camera unit, and a control unit for controlling the display unit. The control unit of the mobile terminal activates the camera when a request to search for broadcast program information is received and controls the camera unit to scan the screen of the broadcast receiver. , Controls the communication unit to extract search information from the scanned screen of the broadcast receiver and transmit it to the augmented reality TV server, and when receiving program information processed into augmented reality from the augmented reality TV server, the screen of the broadcast receiver scanned through the camera The display unit may be controlled to display program information in the surrounding area in augmented reality.

In addition, in the present invention, a method for providing TV program information of a mobile terminal that is communicatively connected to an augmented reality TV server includes the steps of activating a camera when receiving a request for searching for broadcast program information to scan a screen of a broadcast receiver displaying a broadcast program; , Extracting search information from the scanned screen of the broadcast receiver, transmitting the extracted search information to an augmented reality TV server, and receiving program information processed into augmented reality from the augmented reality TV server through the camera. It may include displaying program information in augmented reality around a screen of the scanned broadcast receiver.

On the other hand, the augmented reality TV server of the present invention includes a communication unit that is communicatively connected to a mobile terminal and a broadcasting station server, an augmented reality processing unit that implements program information obtained from a broadcasting station server as augmented reality, and a communication unit and an augmented reality processing unit. The control unit of the augmented reality TV server may include a control unit to control the augmented reality TV server, upon receiving the search information extracted from the screen of the broadcast receiver displaying the broadcast program from the mobile terminal, selects a broadcasting station server based on the received search information, and When the broadcasting station server requests information on the currently broadcasting program, and when the requested program information is obtained from the broadcasting station server, the user viewing information for the acquired program information is entered into the user account, and the program information and user viewing information are implemented in augmented reality. The augmented reality processing unit may be controlled, and the communication unit may be controlled to transmit the processed program information and user viewing information to the mobile terminal.

Further, in the present invention, a method of providing TV program information of an augmented reality TV server that is communicatively connected to a mobile terminal includes the steps of receiving search information extracted from a screen of a broadcast receiver displaying a broadcast program from the mobile terminal, and the received search. Selecting a broadcasting station server based on the information and requesting information on a program currently being broadcast to the selected broadcasting station server; obtaining the requested program information from the broadcasting station server and inputting user viewing information for the obtained program information into a user account; and , Processing the program information and the user viewing information to be displayed in augmented reality on the screen of the mobile terminal, and transmitting the program information processed in the augmented reality and the user viewing information to the mobile terminal.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing a function. It may be implemented by the control unit 140.

According to a software implementation, embodiments such as procedures or functions may be implemented together with separate software modules that perform at least one function or operation. The software code can be implemented by a software application written in an appropriate programming language. In addition, the software code may be stored in a memory and loaded and executed by the control unit 140.

In the above embodiment, the information exposure prevention image providing apparatus includes one or more application-specific integrated circuits (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), and field program. Possible gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components.

The method according to the above-described embodiment may be produced as a program to be executed on a computer and stored in a computer-readable recording medium. Examples of computer-readable recording media include ROM, RAM, CD-ROM, and magnetic tape. , Floppy disks, optical data storage devices, etc. are also included.

The computer-readable recording medium is distributed over a computer system connected by a network, and computer-readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above-described method can be easily inferred by programmers in the technical field to which the embodiment belongs.

It is obvious to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

10: TV program information provision system
100: broadcast receiver
200: mobile terminal
210: communication department
220: camera unit
230: display unit
240: control unit
300: Augmented Reality TV Server
310: Ministry of Communications
320: augmented reality processing unit
400: broadcasting station server

Claims (40)

A broadcast receiver that displays a received broadcast program on a screen;
A mobile terminal that scans the screen of the broadcast receiver with a camera and extracts search information from the scanned screen of the broadcast receiver; And,
Comprising an augmented reality TV server that acquires broadcast program information based on the extracted search information and processes the broadcast program information to be implemented as augmented reality,
The mobile terminal,
When a broadcast program information search request is received, the camera is activated to scan the screen of the broadcast receiver, and search information is extracted from the scanned screen of the broadcast receiver and transmitted to the augmented reality TV server, and from the augmented reality TV server Upon receiving the program information processed with the augmented reality, the program information is displayed as augmented reality around the screen of the broadcast receiver scanned through the camera,
The mobile terminal,
When displaying the program information in augmented reality, the program information is displayed in augmented reality so that the user viewing information input to the user account is included,
User viewing information input to the user account,
A TV program information providing system using an augmented reality, characterized in that it includes information about whether or not a user is watching a broadcast program. In the TV program information providing method of a TV program information providing system comprising a mobile terminal and an augmented reality TV server communicatively connected to each other,
The mobile terminal, through a camera, scans a screen of a broadcast receiver displaying a broadcast program, extracts search information from the scanned screen of the broadcast receiver, and transmits the extracted search information to the augmented reality TV server ;
The augmented reality TV server selects a broadcasting station server based on the received search information, obtains the program information from the selected broadcasting station server, processes the acquired program information to be implemented as augmented reality, and processes the processed Transmitting program information to the mobile terminal; And,
Receiving, by the mobile terminal, the program information processed with the augmented reality and displaying the program information as augmented reality around the screen of the broadcast receiver scanned through the camera,
Displaying the program information in augmented reality,
Displaying the program information in augmented reality so that the user viewing information entered in the user account is included,
User viewing information input to the user account,
A method of providing TV program information, comprising information on whether or not to view a broadcast program that a user is watching. In the mobile terminal,
A communication unit communicating with an augmented reality TV server;
A camera unit that scans a screen of a broadcast receiver;
A display unit for displaying program information in augmented reality around a screen of the broadcast receiver scanned from the camera unit; And,
And a control unit for controlling the communication unit, the camera unit, and the display unit,
The control unit,
When a request to search for broadcast program information is received, the communication unit activates a camera to control the camera to scan the screen of the broadcast receiver, and to extract search information from the scanned screen of the broadcast receiver and transmit it to the augmented reality TV server. And when receiving the program information processed into the augmented reality from the augmented reality TV server, controlling the display unit to display the program information in augmented reality around the screen of the broadcast receiver scanned through the camera,
The control unit,
When displaying the program information in augmented reality, the program information is displayed in augmented reality so that the user viewing information input to the user account is included,
User viewing information input to the user account,
A mobile terminal comprising information on whether or not to watch a broadcast program that a user is watching. The method of claim 3, wherein the control unit,
And automatically activating the camera when a user input for requesting search of the broadcast program information is received when activating the camera. The method of claim 3, wherein the control unit,
When extracting search information from the scanned screen of the broadcast receiver, recognizing a screen area from the broadcast receiver scanned with the camera, and extracting search information for acquiring program information currently being broadcast within the recognized screen area A mobile terminal, characterized in that. The method of claim 5, wherein the search information for acquiring the currently broadcasting program information comprises:
And a broadcast channel logo displayed on the screen of the broadcast receiver. The method of claim 3, wherein the control unit,
When extracting search information from the scanned screen of the broadcast receiver, current time information and user login information are extracted together. The method of claim 7, wherein the control unit,
And transmitting the extracted search information, current time information, and user login information to the augmented reality TV server together. The method of claim 3, wherein the control unit,
When the program information is displayed in augmented reality, the program information and user viewing information are displayed together. The method of claim 9, wherein the program information,
Includes broadcast channel name, broadcast program name, broadcast program description, cast information, instructor information, broadcast program episode information, and broadcast program refresh rate,
The user viewing information,
A mobile terminal comprising: information on whether a user views a broadcast program, and information on a user's broadcast program refresh rate. The method of claim 10, wherein the information on whether the user views a broadcast program,
A mobile terminal comprising information on whether or not to watch each episode of a broadcast program. The method of claim 10, wherein the user's broadcast program refresh rate information comprises:
A mobile terminal comprising a broadcast program refresh rate corresponding to a broadcast program information search time point. In the method for providing TV program information of a mobile terminal that is communicatively connected to an augmented reality TV server,
Scanning a screen of a broadcast receiver displaying a broadcast program by activating a camera upon receiving a broadcast program information search request;
Extracting search information from the scanned screen of the broadcast receiver;
Transmitting the extracted search information to the augmented reality TV server; And,
When receiving program information processed into the augmented reality from the augmented reality TV server, displaying the program information in augmented reality around a screen of a broadcast receiver scanned through the camera,
Displaying the program information in augmented reality,
Displaying the program information in augmented reality so that the user viewing information entered in the user account is included,
User viewing information input to the user account,
A method of providing TV program information of a mobile terminal, comprising information on whether or not to view a broadcast program that a user is watching. The method of claim 13, wherein transmitting the extracted search information to the augmented reality TV server,
Activating a camera when the mobile terminal receives a request to search for broadcast program information;
Scanning, by the mobile terminal, a screen of a broadcast receiver displaying a broadcast program through the camera;
Extracting, by the mobile terminal, search information from the scanned screen of the broadcast receiver; And,
And transmitting, by the mobile terminal, the extracted search information to the augmented reality TV server. The method of claim 14, wherein activating the camera comprises:
And automatically activating the camera when a user input requesting search for the broadcast program information is received. The method of claim 14, wherein extracting search information from a screen of the scanned broadcast receiver comprises:
Recognizing a screen area from a broadcast receiver scanned with the camera, and extracting search information for acquiring program information currently being broadcast within the recognized screen area. The method of claim 16, wherein the search information for acquiring the currently broadcasting program information comprises:
And a broadcast channel logo displayed on the screen of the broadcast receiver. The method of claim 14, wherein extracting search information from a screen of the scanned broadcast receiver comprises:
A method of providing TV program information of a mobile terminal, comprising extracting current time information and user login information together. The method of claim 14, wherein transmitting the extracted search information to the augmented reality TV server,
And transmitting the extracted search information, current time information, and user login information to the augmented reality TV server together. The method of claim 13, wherein the displaying of the program information in augmented reality comprises:
A method of providing TV program information of a mobile terminal, wherein the program information and user viewing information are displayed together. The method of claim 20, wherein the program information,
Includes broadcast channel name, broadcast program name, broadcast program description, cast information, instructor information, broadcast program episode information, and broadcast program refresh rate,
The user viewing information,
A method of providing TV program information of a mobile terminal, comprising information about whether a user has viewed a broadcast program and information about a user's broadcast program refresh rate. The method of claim 21, wherein the information on whether the user views a broadcast program,
A method of providing TV program information of a mobile terminal, comprising: information on whether or not to watch each episode of a broadcast program. The method of claim 21, wherein the user's broadcast program refresh rate information comprises:
A method of providing TV program information of a mobile terminal, comprising: a broadcast program refresh rate corresponding to a broadcast program information search time point. In the augmented reality TV server,
A communication unit communicatively connected to a mobile terminal and a broadcasting station server;
An augmented reality processing unit that implements the program information obtained from the broadcasting station server into augmented reality; And,
And a control unit for controlling the communication unit and the augmented reality processing unit,
The control unit,
When the search information extracted from the screen of the broadcast receiver displaying the broadcast program is received from the mobile terminal, the broadcasting station server requests information on the currently broadcasting program to the broadcasting station server based on the received search information, and the requested program information is sent to the broadcasting station server. When obtained from, controlling the augmented reality processing unit so that the program information and user viewing information are implemented as augmented reality, and controlling the communication unit to transmit the processed program information and user viewing information to the mobile terminal,
The control unit,
When controlling the augmented reality processing unit, controlling the augmented reality processing unit so that the program information including user viewing information input to a user account is implemented as augmented reality,
User viewing information input to the user account,
An augmented reality TV server comprising information on whether or not to view a broadcast program that a user is watching. The method of claim 24, wherein the control unit,
When a broadcasting station server requests information on a currently broadcast program based on the received search information, a broadcasting station server is selected based on the received search information, the requested program information is obtained from the selected broadcasting station server, and the program information and An augmented reality TV server, characterized in that processing processing so that user viewing information is displayed as augmented reality on the screen of the mobile terminal, and inputting user viewing information for the acquired program information into a user account. The method of claim 25, wherein the control unit,
When selecting a broadcasting station server based on the received search information, user authentication is performed based on user login information received from the mobile terminal, and when the user authentication is completed, a broadcasting station server is selected based on the received search information. Augmented reality TV server. The method of claim 25, wherein the control unit,
When selecting a broadcasting station server based on the received search information, the broadcasting station server is selected based on a broadcasting channel logo included in the received search information. The method of claim 25, wherein the control unit,
When obtaining the requested program information from the broadcasting station server, a program including at least one of a broadcasting channel name, a broadcasting program name, a broadcasting program description, cast information, instructor information, episode information of a broadcasting program, and a refresh rate of a broadcasting program An augmented reality TV server, characterized in that acquiring information from the broadcasting station server. The method of claim 25, wherein the control unit,
When entering user viewing information for the acquired program information into a user account, user viewing information including at least one of information on whether or not a user has viewed a broadcast program and information on a user's broadcast program refresh rate is provided based on the acquired program information. And inputting the generated user viewing information to a corresponding user account. The method of claim 29, wherein the information on whether the user views a broadcast program comprises:
An augmented reality TV server comprising information about whether or not to watch each episode of a broadcast program. The method of claim 29, wherein the user's broadcast program refresh rate information comprises:
An augmented reality TV server comprising a broadcast program refresh rate corresponding to a broadcast program information search time point. In the method for providing TV program information of an augmented reality TV server that is communicatively connected to a mobile terminal,
Receiving search information extracted from a screen of a broadcast receiver displaying a broadcast program from the mobile terminal;
Requesting information about a program currently being broadcast to a broadcasting station server based on the received search information;
Obtaining the requested program information from the broadcasting station server;
Processing the program information and user viewing information to be displayed in augmented reality on the screen of the mobile terminal; And,
Transmitting the program information processed by the augmented reality and user viewing information to the mobile terminal,
Processing the mobile terminal to be displayed in augmented reality on the screen,
Processing and processing the program information to be displayed in augmented reality, including the user viewing information entered in the user account,
User viewing information input to the user account,
A method of providing TV program information of an augmented reality TV server, comprising: information on whether or not to view a broadcast program that a user is watching. The method of claim 32, wherein the requesting information about a program currently being broadcast to a broadcasting station server based on the received search information comprises:
Further comprising the step of selecting a broadcasting station server based on the received search information,
Obtaining the requested program information from the broadcasting station server, and processing the program information and the user viewing information to be displayed in augmented reality on the screen of the mobile terminal,
And inputting user viewing information on the acquired program information to a user account. The method of claim 33, wherein selecting a broadcasting station server based on the received search information comprises:
A method of providing TV program information of an augmented reality TV server, comprising: performing user authentication based on user login information received from the mobile terminal, and selecting a broadcasting station server based on the received search information when the user authentication is completed. The method of claim 33, wherein selecting a broadcasting station server based on the received search information comprises:
A method of providing TV program information of an augmented reality TV server, comprising selecting a broadcasting station server based on a broadcasting channel logo included in the received search information. The method of claim 33, wherein obtaining the requested program information from the broadcasting station server comprises:
Augmented reality, characterized in that, from the broadcasting station server, program information including at least one of a broadcasting channel name, a broadcasting program name, a broadcasting program description, cast information, instructor information, episode information of a broadcasting program, and a refresh rate of a broadcasting program How to provide TV program information from a TV server. The method of claim 33, wherein the step of inputting user viewing information for the acquired program information into a user account,
Generating user viewing information including at least one of information on whether or not to watch a broadcast program and information on a user's broadcast program refresh rate based on the obtained program information, and inputting the generated user viewing information to a corresponding user account. A method of providing TV program information of an augmented reality TV server, characterized in that. The method of claim 37, wherein the information on whether the user views a broadcast program,
A method of providing TV program information of an augmented reality TV server, comprising: information on whether or not to watch each episode of a broadcast program. The method of claim 37, wherein the user's broadcast program refresh rate information comprises:
A method of providing TV program information of an augmented reality TV server, comprising: a broadcast program refresh rate corresponding to a broadcast program information search time point. A computer-readable recording medium in which a program for executing the method according to any one of claims 2, 13 to 23, and 32 to 39 is recorded.

Images