KR20210027921A - Image display apparatus and method for providing personalized services therof - Google Patents

Abstract

The present invention relates to an image display device and a method for providing a personalized service thereof. According to the present invention, the image display device and the method for providing the personalized service create a virtual window by executing an application in a virtual background, extract and processes content information or personalization information of a corresponding application from a page created in the virtual window, create a personalized UI menu, and provides the same to a user. Accordingly, personalized content information can be provided to the user without receiving information on the type of internal content or recommended content from the application.

Description

Video display device and its personalization service provision method {IMAGE DISPLAY APPARATUS AND METHOD FOR PROVIDING PERSONALIZED SERVICES THEROF}

The present invention relates to an image display device and a method of providing a personalized service therefor, and more particularly, to an image display device that provides a personalized service using an application executed in the image display device, and a method of providing a personalized service therefor.

A video display device is a device that plays video content, and receives and plays video from various sources. The image display device is implemented with various devices such as PC (Personal Computer), smart phone, tablet PC, notebook, and TV. Recently, an image display device such as a smart TV provides an application for providing web content such as a web browser. Users can not only watch broadcasts, but also experience more diverse contents and applications through combination with the Internet.

Although various applications stored in the image display device are executed on the image display device, the types of internal content of the application or information on recommended content cannot be known from the image display device unless the application processes itself and provides it.

A conventional video display device provides recommendations to a user only with limited information transmitted from an application, and the user must execute the application in order to know the internal content information of the application.

[Patent precedence literature]

Korean Patent Publication No. 1020120133219

The problem to be solved by the present invention is to provide a video display device capable of providing personalized content information to a user and a personalization service thereof without receiving information on the type of internal content or recommended content from an application.

The problem to be solved by the present invention is to provide a video display device capable of providing personalized content information to a user and a personalization service thereof, without the user executing an application to check internal content information.

In order to solve the above-described problems, an image display device and a method for providing a personalized service thereof according to an embodiment of the present invention run an application in a virtual background to create a virtual window, and a corresponding application in the page created in the virtual window. It extracts and processes the content information or personalization information of, and creates it as a personalized UI menu and provides it to the user.

In order to solve the above-described problems, a video display device and a method for providing a personalized service thereof according to an embodiment of the present invention extract personalized content information by executing a plurality of applications mounted on the video display device in a virtual background, and It is processed and provided as a personalized UI menu, and when a user selects a desired item from the UI menu, a corresponding operation is performed.

In order to solve the above-described problems, the video display device and its personalization service providing method according to an embodiment of the present invention perform HTML (hypertext markup language) tag analysis or screen capture, OCR, machine learning, etc. in a virtual window. To extract personalized content information.

As described above, the video display device and the method for providing a personalized service thereof according to the present invention can provide personalized content information to a user without receiving information on the type of internal content or recommended content from the application.

As described above, the video display device and the method for providing a personalized service thereof according to the present invention can provide personalized internal content information about the application to the user without directly executing the application and checking the internal content information. .

As described above, the video display device and the method for providing a personalized service thereof according to the present invention can easily receive a desired service by simply selecting a desired item from a personalized UI menu, without a user executing an application and clicking the desired content. have.

1 is a control block diagram of an image display device according to an embodiment of the present invention.
2 is a detailed block diagram of a control unit according to an embodiment of the present invention.
3 illustrates an example of a personalized UI menu generated by a UI generator according to an embodiment of the present invention.
4 is a flowchart illustrating a method of providing a personalized service of an image display device according to an embodiment of the present invention.
5 is a flowchart illustrating a method of extracting internal content information and personalization information of an application in an image display device according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, and only these embodiments make the disclosure of the present invention complete, and are common knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same elements throughout the specification.

1 is a control block diagram of an image display device 100 according to an embodiment of the present invention. The image display device 100 according to the present invention is a device that receives and displays an image, and may include a smart TV, a web phone, a PDA, a mobile phone, and the like. Hereinafter, the image display device 100 having a broadcast reception function is described. Explain with an example.

A signal receiving unit 110, a display unit 120, an audio output unit 130, a user input interface unit 140, a memory unit 150, and a control unit 160 according to an embodiment of the present invention.

The signal receiving unit 110 is for receiving a signal from the outside, and a network interface unit 111 for Internet connection, a broadcast receiving unit 113 for receiving a broadcast signal, and an external device interface unit for connection with an external device (115) may be included.

The network interface unit 111 includes a communication module for connecting to a wired/wireless network including an Internet network. The network interface unit 111 is provided with an Ethernet terminal for connection to a wired network, or for connection to a wireless network, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access) and HSDPA (High Speed Downlink Packet Access) communication standards can be used.

The broadcast receiver 113 may include an RF tuner for receiving an RF broadcast signal and tuning a channel to output an IF signal, and a demodulator for demodulating the IF signal converted by the tuner.

The external device interface unit 115 includes, for example, a High Definition Multimedia Interface (HDMI) connector, a component video connector, a composite video connector, for receiving content from a PC, a set-top box, or a multimedia player. It may include a D-sub connector or the like.

The display unit 120 is for displaying an image on a screen, such as a liquid crystal display (LCD) panel, a light emitting diode (LED) panel, an organic light emitting diode (OLED) panel, etc. It can be implemented as The display unit 120 includes a display module that displays an image, and a display driver that drives the display module.

The audio output unit 130 receives an audio-processed signal, for example, a stereo signal, a 3.1 channel signal, a 5.1 channel signal, a PCM audio signal, and the like, and outputs an audio signal. The audio output unit 130 may be implemented with various types of speakers.

The user input interface unit 140 is for transmitting a signal input by the user to the control unit 160 or transmitting a signal from the control unit 160 to the user, and a remote control device 120 that provides a user's input, for example, It may include a module for communication with the remote controller.

The memory unit 150 may store a program for signal processing and control of the image processing apparatus, and may store signal-processed video, audio, or data signals. In addition, the memory unit 150 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 115 or a network interface. In addition, the memory unit 150 may store various OSs, middleware, platforms, and various applications of the image display device 100.

The control unit 160 is in charge of overall control of the image display apparatus 100 by a user command or an internal program input through the user input interface unit 140. The control unit 160 processes the video signal and/or the audio signal received from the signal receiving unit 110 according to a command input from the user so that it can be output to the display unit 120 and/or the audio output unit 130. Control. The control unit 160 may be implemented including a program code for signal processing and control and a processor that executes the same. In addition, various applications stored in the memory unit 150 are executed by the processor of the control unit 160.

The controller 160 collects internal recommendation information, new content information, and personalization information of the application by executing pre-stored applications in the background while the image display device 100 is playing an image or at an idle time. Extract. Here, since all of the application executions are performed in a virtual background, they are not displayed on the screen, so that the user is not disturbed by viewing videos.

The controller 160 generates and displays a personalized UI (User Interface) menu based on the extracted information, and controls the user to perform an operation corresponding to an item selected from the UI menu. As described above, the present invention provides personalized content information such as internal content information and personalized information about applications previously stored in the video display device 100 to the user, thereby providing internal content information or personalization information without executing the application. You can know, and you can easily run the desired service by selecting the desired content.

The control unit 160 includes a list of applications to be collected in the background, and a data table set in advance about an execution order, and the like. The data table related to the list of target applications and execution order, etc. may be updated or changed by a server or a user connected through a network.

2 is a detailed block diagram of a control unit 160 according to an embodiment of the present invention. The control unit 160 will be described in more detail with reference to FIG. 2. Referring to FIG. 2, the control unit 160 includes a virtual window generation unit 161, a personalized information extraction unit 163, a UI generation unit 165, and an agent unit 167.

The virtual window generation unit 161 is for generating an application in a virtual window in the background, and the virtual window generated by the virtual window generation unit 161 is not displayed on the display unit 120 of the image display device 100. It does not, and is created only in the background. When the application is executed in the background, the virtual window generator 161 creates and displays the application in the virtual window. Here, the display of the virtual window refers to an operation that is temporarily stored in an internal scaler or memory rather than being displayed on the display unit 120.

The personalization information extraction unit 163 collects and extracts personalization information and content information from an image created and displayed on a virtual window. The data collected by the personalization information extraction unit 163 includes video, audio, text information, etc. included in an image frame generated in the virtual window.

When the application to be executed is a web application, the personalized information extracting unit 163 may parse HTML data and analyze the HTML tag (TAG) to easily extract internal content information and personalization information. If the web application is known, internal content information and personalization information may be extracted through a series of data processing such as screen capture, optical character recognition (OCR), and machine learning.

The content information and personalization information extracted by the personalization information extraction unit 163 may include recently viewed content, continuation view, application internal recommendation information, or new content information inside the application. Personalized content information such as content that the user has viewed in the past or the content being watched, preferred content, preferred genre, and recommended content through the application may be included therein.

The internal content information of such an application corresponds to information that cannot be known unless the user directly executes the application or provides it directly from the application, but the present invention can extract related content information and personalization information by executing the application in the background. have.

At this time, the extracted content information and personalization information, and access information capable of accessing the extracted information are stored in a storage unit (eg, memory, not shown). Here, the access information means information for executing or connecting (linking) a service corresponding to the extracted content or personalized information.

The UI generation unit 165 generates a personalized UI menu by processing the internal content information and personalization information extracted by the personalization information extraction unit 163. The UI generator 165 includes internal content information and personalization information of applications that extract at least one of the shape, size, location, color, display order, and content of a menu item from a UI menu basically provided by the image display device 100. Create personalized UI menu by changing it according to.

3 illustrates an example of a personalized UI menu generated by the UI generator 165 according to an embodiment of the present invention. The personalized UI menu is provided in a form in which a UI menu indicating internal content information and personalization information is added to a basic UI menu basically provided by the image display apparatus 100. Referring to FIG. 3, the personalized UI menu includes four items such as follow-up (301, 302), my favorite content (303, 304), popular content (305, 306), and new content (307, 308). , Corresponding thumbnail images are displayed in items 301, 303, 305, and 307, respectively.

The UI generator 165 may generate a personalized UI menu corresponding to a menu (application) selected by the user from the basic UI menu displayed below. For example, in FIG. 3, signal sources and applications are displayed in the lower basic menu. When a user selects a specific application from the basic UI menu displayed at the bottom, a personalized UI menu showing extracted content information and personalization information about the application The service can be provided in the form that is displayed at the top. At this time, when the user selects a desired item, for example, a thumbnail or text of the following view, from the personalized UI menu, the access information of the corresponding content is checked and the service is directly connected.

The agent unit 167 is for controlling the operation of the virtual window generation unit 161, the personalization information extraction unit 163, and the UI generation unit 165, for executing an application, extracting content or personalization information, and creating a UI. Control logic is in place. The personalization information extraction unit 163 extracts the corresponding content information and personalization information according to a preset control logic, and the UI generation unit 165 selects the content or personalization information to be generated as a UI menu according to the preset control logic. Processed and personalized UI creation is performed.

Hereinafter, a detailed control flow of the agent unit 167 will be described with reference to FIG. 4. 4 is a flowchart illustrating a method of providing a personalized service of the image display device 100 according to an embodiment of the present invention.

When a background data collection command event occurs according to a specific condition, the agent unit 167 executes a specific application in a virtual background based on information such as an application list and execution order stored in the data table (S10). The specific condition means a condition for generating a preset background data collection command event, and a certain condition such as idle time or broadcast viewing may be set as a condition for performing the operation of the present invention.

The virtual window generation unit 161 creates the executed application in the virtual window (S11). The virtual window is generated in a virtual background and is not displayed on the display unit 120 and is temporarily stored in an internal scaler or memory.

The personalization information extraction unit 163 collects various information, text, picture, and audio information included in the image generated in the virtual window, and extracts personalization information and content information (S12, S13). Then, the extracted information and access information for accessing the information are stored in the storage unit (S14).

If the user selects a UI menu, such as the home menu or the first screen (S15), the controller 160 controls the UI generator 165 to generate a personalized UI menu and display it on the display 120 ( S16).

When the user selects a desired item from the personalized UI menu (S17), the agent unit 167 checks the access information corresponding to the item and controls the corresponding service and operation to be performed (S18). For example, when a user selects a specific broadcast program during continuous viewing, the corresponding application is executed and the corresponding page is displayed to switch to a service screen for viewing the program.

5 is a flowchart illustrating a method of extracting internal content information and personalization information of an application in the image display device 100 according to an embodiment of the present invention. Referring to FIG. 4, when a background data collection command event occurs, a specific application is executed in a virtual background based on information such as an application list and execution order stored in a data table (S20).

When a specific application is executed, a virtual window is executed, and the corresponding application is created and displayed in the virtual window (S21).

If the specific application to be executed is a web application (S22), HTML data included in the web page, in particular, HTML tag data, is collected and analyzed (S23), and internal content information and personalization information are extracted (S25).

If the specific application to be executed is not a web application (S22), content information and personalization information may be extracted through a series of data collection and processing processes such as screen capture, OCR, and machine learning (S24, S25). .

The extracted content information, personalization information, and access information corresponding thereto are stored in the storage unit (S26). The agent unit 167 may generate multiple virtual windows by clicking a specific item on the application execution screen displayed on the virtual window (S27) and executing an operation corresponding to the click (S28) (S21). When an application is executed in the background, the agent unit 167 may generate multiple virtual windows through application navigation to extract content information and personalization information from a plurality of pages. The application navigation logic of the agent unit 167 is also set in advance, and may be programmed differently according to the executed application.

The present invention can extract internal content information and personalization information by executing a plurality of applications stored in the image display device 100 in the background, and generate and display a personalized UI menu based on the extracted information, according to the user's taste. The accuracy of recommendation can be improved, and user convenience can be provided by providing application information to the user without being directly provided with recommendation information from the application.

Meanwhile, the method of operating the image display device 100 of the present invention may be implemented as a code that can be read by a processor on a recording medium that can be read by a processor provided in the image display device 100. The processor-readable recording medium includes all types of recording devices that store data that can be read by the processor. Examples of recording media that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also include those implemented in the form of carrier waves such as transmission through the Internet. . In addition, the recording medium readable by the processor may be distributed over a computer system connected through a network, so that code readable by the processor may be stored and executed in a distributed manner.

Meanwhile, in the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: image display device 110: signal receiver
111: network interface unit 113: broadcast receiving unit
115: external device interface unit 120: display unit
130: audio output unit 140: user input interface unit
150: memory unit 160: control unit
161: virtual window generation unit 163: personalization information extraction unit
165: UI generation unit 167: agent unit
200: remote control device

Claims (10)

Executing at least one application in a virtual background;
Creating the application in a virtual window and collecting personalization information and content information from the virtual window;
Generating and displaying a personalized UI menu based on the collected information; And
And performing an operation in response to an item selected by a user.
The method of claim 1,
In the step of collecting personalization information and content information in the virtual window, when the application is a web application, information is collected through HTML tag analysis.
The method of claim 1,
In the step of collecting personalization information and content information in the virtual window, when the application is not a web application, information is collected using at least one of screen capture, optical character recognition (OCR), and machine learning. A method of providing a personalized service of an image display device, characterized in that.
The method of claim 1,
Further comprising storing access information corresponding to the personalized information and content information;
The step of executing an application operation in response to an item selected by the user comprises performing an operation based on access information corresponding to the selected item.
The method of claim 1,
The step of collecting personalization information and content information from the virtual window comprises generating multiple virtual windows through internal navigation of the application and collecting personalization information and content information from the plurality of virtual windows. Method of providing personalization service of video display device.
The method of claim 1,
The generating of the personalized UI menu comprises changing at least one of a type, size, position, color, display order, and content of a menu item in a basic UI menu according to the collected information. How to provide personalized service.
In the image display device,
A virtual window generation unit that creates an application in a virtual window in a virtual background;
A personalization information extraction unit collecting and extracting personalization information and content information from a virtual window;
A UI generator that generates a personalized UI menu based on the information extracted by the personalized information extractor;
A display unit that displays the UI menu; And
And an agent unit controlling to execute at least one application in the virtual background and to perform an operation corresponding to an item selected by a user in the UI menu.
The method of claim 7,
A storage unit for storing access information corresponding to the personalized information and content information;
And the agent unit performs an operation based on access information corresponding to an item selected by the user.
The method of claim 7,
The agent unit controls to generate multiple virtual windows through the internal navigation of the application, and controls the personalization information extraction unit to collect and extract personalization information and content information from the plurality of virtual windows. Display device.
The method of claim 7,
The personalization information and content information includes at least one of recently viewed content, continuation view, application internal recommendation information, and application internal new content information.

Images