KR101978299B1 - Apparatus for service contents in contents service system - Google Patents

Abstract

The present invention relates to a content service system, an apparatus and a method for content service in the system, and more particularly, it relates to a content service system in which at least one terminal device monitors and captures an eye movement of a user through a camera in real time, Eye tracking is performed, and content information matching the eye tracking information obtained through eye tracking is checked to request interest contents related to the content information. When the service device receives from the one or more terminal devices Collecting the contents related to the content information matched with the eye tracking information and constituting the collected contents as interested contents to be provided to the one or more terminal devices so that the user's taste And a suitable pipe Can you recommend your content, so there is an effect that can offer a wider variety of personalized services.

Description

[0001] APPARATUS FOR SERVICE CONTENTS IN CONTENTS SERVICE SYSTEM [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a content service system, and more particularly, to an apparatus and method for a content service in a content service system capable of tracking a movement of a pupil in real time, .

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

In recent years, it is possible to receive various contents services through smart devices, and it is possible to perform communication by recognizing the user's face through the camera mounted on the smart device, Technologies are developing in various ways.

In addition to basic functions such as photo / video recording and video call, the camera attached to the existing smart device is utilized for name calling using facial recognition, facial recognition shooting, and screen on / off function utilizing the pupil gazing.

However, in existing smart devices and the like, it is possible to monitor whether or not the eye of the pupil is observed through the camera installed. However, the technology for automatically receiving the contents service without the input signal of the user by tracking the movement of the pupil is not utilized.

Korean Registered Patent No. 10-1163772, July 02, 2012 Registered (name: portable terminal for tracking user's pupil position and method thereof)

The present invention has been proposed in order to solve the inconvenience of the related art, and it is an object of the present invention to provide an apparatus and a method for a content service in a content service system for providing a content of interest to a user by tracking the movement of a pupil in real time in a content service system do.

According to another aspect of the present invention, there is provided a content service system for monitoring an eye movement of a user through a camera in real time, performing eye tracking by analyzing the captured image, One or more terminal devices for confirming content information matched with eye tracking information obtained through tracking and requesting contents of interest related to the content information; And a service device for collecting contents associated with content information matched with the eye tracking information received from one or more terminal devices according to a request for a content of interest and constituting the collected contents as contents of interest to be provided to one or more terminal devices .

According to another aspect of the present invention, there is provided a terminal apparatus for a content service in a content service system, comprising: a communication unit for performing communication for a content service and a service apparatus connected through a communication network; A photographing unit for photographing and observing the eye movement of the user in real time; And a controller for performing eyeball tracking by analyzing the image photographed by the photographing unit and checking content information matched with the eyeball tracking information obtained through eyeball tracking to request interest contents related to the content information.

In a terminal apparatus for a content service in a content service system according to a preferred embodiment of the present invention, the control unit includes: an application execution module that executes an application provided by the service apparatus; An eyeball tracking module for performing an eyeball tracking according to a user's eye movement by analyzing an image photographed by the photographing part; And a content processing module for confirming the content information matched with the eye tracking information obtained through the eyeball tracking, requesting the interested content related to the content information, and providing the interested content provided from the service device to the user.

In the control unit of the terminal device for the content service in the content service system according to the preferred embodiment of the present invention, the eye tracking module detects the position where the user's gaze stays at a predetermined time or longer in the executed application, Eye tracking information corresponding to the eye-tracking information.

In the control unit of the terminal device for the content service in the content service system according to the preferred embodiment of the present invention, the eye tracking module analyzes images taken in real time in the movement of the eyeball, (UI element) according to the identified pixel size, and divides the resolution by the number of the identified objects so that an element having a size of a predetermined pixel or more per unit is obtained .

In the control unit of the terminal device for content service in the content service system according to the preferred embodiment of the present invention, the eyeball tracking module may include a camera resolution, an angle of view, a display resolution, an actual movement distance of the eyeball, Eye tracking is performed using one or more of them.

In accordance with another aspect of the present invention, there is provided a service apparatus for a content service in a content service system, the apparatus comprising: a communication unit for performing communication for a content service with one or more terminal apparatuses connected through a communication network; Identifying content information matched to the received eye tracking information according to a request for content of interest from one or more terminal devices, collecting content associated with the identified content information, constructing the content of interest as content of interest to recommend, A control unit for performing control for providing to the terminal device; And a storage unit for storing contents of interest in one or more terminal apparatuses in a personalized database.

According to another aspect of the present invention, there is provided a method for content service in a terminal device of a content service system, the method comprising: executing an application provided in a service device; Monitoring a movement of a pupil of a user taking an application to be executed through a camera and photographing the motion in real time; Performing eye tracking by analyzing images photographed in real time; Requesting content of interest associated with content information by checking content information matched with eye tracking information obtained through eye tracking; Receiving, from a service apparatus, interest information recommended in association with content information in a service apparatus according to a request for a content of interest; And providing the user with recommended interest information; .

According to another aspect of the present invention, there is provided a method for content service in a service device of a content service system, the method comprising: receiving content information Receiving a request for content of interest; Collecting content associated with the received content information; Constructing the collected contents as interested contents to be recommended; And providing the configured content of interest to one or more terminal devices.

The method for content service in a service apparatus of a content service system according to a preferred embodiment of the present invention further includes storing the collected content in a user-specific database.

According to an aspect of the present invention, there is provided a computer-readable recording medium having recorded thereon a program for executing a method for content service.

The present invention provides a content service system in which recommended content information recommended in association with content information matched with eye tracking information obtained by performing eye tracking according to movement of a user's eyeball on a screen of an application executed in a terminal device is provided, It is possible to grasp the user's taste only by the movement of the eyeball without the input of the user and to recommend the content of interest suitable for the user, so that it is possible to provide more personalized services.

In addition, the present invention has an effect of collecting information of various people from a service device and configuring a personalization database, thereby analyzing the characteristics and preferences of the contents preferred by the general public, and reflecting the characteristics and preferences of new contents.

1 is a diagram illustrating a configuration of a content service system according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a terminal device for providing contents of interest through eye tracking in a contents service system according to an embodiment of the present invention.
3 is a diagram illustrating a configuration of a service apparatus for providing interested contents according to eye tracking in a content service system according to an embodiment of the present invention.
4 is a diagram illustrating a method for providing interesting content according to eye tracking in a content service system according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the present specification and claims should not be construed to be limited to ordinary or dictionary meanings and the inventor is not limited to the concept of terminology for describing his or her invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

First, a content service system according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a configuration of a content service system according to an embodiment of the present invention.

Referring to FIG. 1, a content service system may include one or more terminal devices 100 and a service device 200 connected through a communication network 10.

The terminal device 100 is a terminal capable of transmitting and receiving various data via the communication network 10 in accordance with a key operation of a user. The terminal device 100 includes a tablet PC, a laptop, a personal computer ), A smart phone, a personal digital assistant (PDA), a smart TV, and a mobile communication terminal. The terminal device 100 is a terminal that performs voice or data communication using the communication network 10 and includes a browser for communicating with the service device 200 via the communication network 10, And a microprocessor for executing and controlling various programs. Also, the terminal device 100 is preferably manufactured in a form having a touch screen, but is not limited thereto.

In particular, the terminal device 100 according to the embodiment of the present invention preferably includes a camera, and can perform the eye tracking of the user through the camera.

That is, the terminal device 100 according to the embodiment of the present invention executes an application for providing a content, monitors eye movements of a user viewing an application execution screen through a camera to perform eye tracking, It is possible to provide interested contents information related to the retrieved contents information using the eye tracking information obtained through the eye tracking pursuant to the service apparatus 200 and to provide the contents to the user.

The service device 200 can communicate with one or more terminal devices 100 through the communication network 10 to provide content services. To this end, the service apparatus 200 collects content information related to content information according to the eyeball tracking information obtained by tracking the movement of the eyeball in the terminal device 100, , Moving picture, news, etc.) to the terminal device 100 of the user.

One or more of the terminal apparatuses 100 and the service apparatuses 200 are linked through a communication network 10 and the communication network 10 is connected to the communication network 10 using various wired / wireless communication technologies such as an Internet network, an intranet network, a mobile communication network, It is a network that can send and receive data by internet protocol. The communication network 10 is also coupled to the service device 200 and stores computing resources such as hardware and software. The communication network 10 may be a closed network such as a LAN (Local Area Network) or a WAN (Wide Area Network), an open network such as the Internet, a CDMA (Code Division Multiple Access), a WCDMA The concept is called the next generation network and computing network that will be implemented next, such as Multiple Access, Global System for Mobile Communications (GSM), Long Term Evolution (LTE) and Evolved Packet Core (EPC)

Hereinafter, a configuration of a terminal device 100 according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

2 is a diagram illustrating a configuration of a terminal device for providing content of interest through eye tracking in a content service system according to embodiments of the present invention.

2, the terminal device 100 of the present invention includes a control unit 110, an input unit 120, a communication unit 130, a photographing unit 140, a storage unit 150, and an output unit 160 Can be configured.

The control unit 110 controls the overall operation of the terminal device 100 and the operations related to the content service. In particular, the control unit 110 performs eye tracking, controls the series of processes for constructing content information for receiving interest contents through eye tracking, and receiving interest contents related to the configured content information. For this, the controller 110 may include an application execution module 111, an eye tracking module 112, and a content processing module 113.

The application execution module 111 executes the application provided by the service apparatus 200 and displays it on the screen of the output unit 160. [ Here, the screen configuration of the application is high, but the application having the advertisement area at the top of the screen and displaying the 3 * 3 icon in the remaining area can be exemplified. If the terminal device 100 is a device having eye tracking information with low reliability, it is possible to provide a large icon-shaped content. In the case of the icon area, the application execution module 111 can provide more information such as, for example, a thumbnail photograph, a highlight movie, and a news headline.

The eye tracking module 112 performs eye tracking according to the movement of the user's eye using the preset eye tracking algorithm and solution in the application execution screen to grasp the eye tracking information. That is, the eye tracking module 112 analyzes the photographed image, that is, the image captured by the photographing unit 140, and obtains eye tracking information by grasping the position where the user's eyes stay at a predetermined time or more on the executed application screen . Here, eye tracking can be performed using various factors such as a resolution of a camera, an angle of view, a display resolution, an actual moving distance of an eyeball, and an algorithm for identifying the distance. Specifically, the movement of the eyeball is monitored by the camera of the photographing unit 140, and the screen pixel size according to the moving distance of the eyeball, where the user's gaze stays for a predetermined time or longer, is checked. By identifying an object (UI element) according to its size and dividing the resolution by the number of identified UI elements, it is possible to identify an element having a size larger than a predetermined number of pixels per piece. For example, assuming that both the resolution and the display resolution are HD (1280 * 720), assuming that the angle of view is 60 degrees and the distance between the camera and the eye is 400 mm, the shooting range that can be photographed by the camera is 460 mm . Therefore, assuming that the moving distance of the eyeball is 5mm, the movement of the eyeball is about 13.9px in the HD image taken by the proportional expression. In this case, when there is motion more than 1px, 13.9 objects can be identified using an algorithm that can detect eye movements. By dividing 1280, which is the horizontal resolution of the screen, by 13.9, it is possible to identify elements having sizes larger than 92px .

The content processing module 113 receives the eye tracking information tracked by the eye tracking module 112, and confirms the content information matched with the generated eye tracking information. That is, the content processing module 113 analyzes the eye tracking information, grasps the display position according to the resolution, and retrieves the content information executed at the display position. Accordingly, the content processing module 113 regards the content executed at the identified position as the content that the user is interested in, and reads the stored content information about the corresponding content at the identified position. The content processing module 113 then transmits the interested content request message including the confirmed content information to the service device 200. [

Also, the content processing module 113 receives the interested content providing message including the interested contents recommended in association with the interest information according to the eye tracking information from the service device 200, and transmits the received interested contents to the output unit 160 Display it on the screen.

The input unit 120 may generate a user input signal corresponding to a request or information of a user according to a user's operation and may be implemented as various input means that are currently commercialized or can be commercialized in the future. , A joystick, a touch screen, a touch pad, or the like, as well as a gesture input means for sensing a user's motion and generating a specific input signal. The input unit 120 may generate input signals to the control unit 310 as the user inputs information. In particular, the input unit 120 may receive information for executing an application provided by the service device 200 from a user and generate an input signal.

The communication unit 130 communicates with the service device 200 through the communication network 10 to perform communication for providing a contents service. The communication unit 130 can transmit and receive data through various communication methods as well as wire and wireless methods. In addition, the communication unit 130 may transmit and receive data using one or more communication methods. For this purpose, the communication unit 130 may include a plurality of communication modules that transmit and receive data according to different communication methods, respectively. In particular, the communication unit 130 transmits the interested content request message including the eye tracking information and the content information generated by the control unit 110 to the service device 200, and receives the interested content providing message received from the service device 200 And transmits it to the control unit 110.

The photographing unit 140 monitors the movement of the user's eyeball, captures an HD image according to the moving distance of the eyeball in real time, and delivers the photographed image to the control unit 110. [

The storage unit 150 stores information necessary for the operation of the terminal device 100 and may store information related to the provision of the content service and information on the applications provided by the service device 200. [ In addition, the storage unit 150 may store eye tracking information that tracks movement of the user's eyeball, and content information about the executed contents, and may store interest content information received from the service apparatus 200. [ The storage unit 150 may be an optical storage medium such as a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, a compact disk read only memory (CD-ROM), or a digital video disk (DVD) A magneto-optical medium such as a floppy disk and a ROM, a random access memory (RAM), and a flash memory.

The output unit 160 is a means for providing a user with an operation result or status of the terminal device 100. The output unit 160 may include a display unit for visually outputting the result through the screen or a speaker for outputting an audible sound can do. In particular, an execution screen of an application driven by the terminal device 100 can be displayed, and contents executed on the execution screen of the application can be displayed. Also, the output unit 160 may display the content of interest received on the service device 200 on the screen. In addition, the photographing unit 160 can display an image photographed in real time according to the movement of the eyeball on the screen.

Next, a configuration of a service apparatus for providing a content service in a communication system according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

3 is a diagram illustrating a configuration of a service apparatus for providing contents of interest according to eye tracking in a contents service system according to embodiments of the present invention.

3, a service apparatus 200 according to an embodiment of the present invention communicates with one or more terminal devices 100 to provide a content service, constitutes a content of interest of a user using ocular tracking information, And transmits the content of interest to the terminal device 200. For this purpose, the service apparatus 200 may include a control unit 210, a communication unit 220, and a storage unit 230.

The control unit 210 controls the overall operation of the service device 200 and receives an interested content request message including content information matched with the eye tracking information from the one or more terminal devices 100, And confirms the contents information included in the request message. In addition, the control unit 210 collects the content related to the content information, and constructs the collected content into the content of interest. Then, the control unit 210 generates an interested content providing message including the configured content of interest, and transmits the generated interested content providing message to the corresponding terminal device 100.

In addition, the control unit 210 may combine eye tracking information and existing use history to provide interest contents (advertisement, photo, moving picture, news, etc.) suitable for the user. To this end, the control unit 210 may control the user group to be classified and stored in a personalized database by combining the history of the individual as well as the history of the user as a whole. Accordingly, the control unit 210 can recommend the preferred content in the group to the individual user. Also, the controller 210 may classify the preferences of the existing contents according to the eye tracking information so that the new contents can be created, and classify the preferences of the existing contents into the content types preferred by the users and manage them.

The communication unit 220 communicates with one or more terminal devices 100 through the communication network 10 to transmit and receive messages for content service. In addition, the communication unit 220 can transmit and receive data through various communication methods as well as wired and wireless methods. In addition, the communication unit 220 may transmit and receive data using one or more communication methods. For this purpose, the communication unit 220 may include a plurality of communication modules that transmit and receive data according to different communication methods, respectively. In particular, the communication unit 220 receives the interested content request message including the eye tracking information from the terminal device 100, and transmits the interested content providing message generated in the control unit 110 to the corresponding terminal device 100.

The storage unit 230 stores relevant information to provide a service for image sharing. Specifically, the storage unit 230 may store eye tracking information received from one or more terminal devices 100, and may store content information matching the eye tracking information. In addition, the storage unit 230 may classify and store information about interesting contents collected in association with the content information in a personalized database for each user. The storage unit 230 may be included in the service apparatus 200 or may be configured as a separate storage apparatus and may be interlocked with the service apparatus 200. The storage unit 230 may be an optical recording medium such as a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a CD-ROM (Compact Disk Read Only Memory), a DVD (Digital Video Disk) A magneto-optical medium such as a floppy disk and a ROM, a random access memory (RAM), and a flash memory.

A content service method according to an exemplary embodiment of the present invention will now be described in detail with reference to the accompanying drawings.

4 is a diagram illustrating a method for providing interesting content according to eye tracking in a content service system according to an embodiment of the present invention.

Referring to FIG. 4, in step 1101, the terminal device 100 executes an application provided from the service device 200. FIG. At this time, in step 1102, the terminal device 100 monitors the eye movement of the user through the camera of the photographing part 140, and photographs the image accordingly.

Accordingly, in step 1103, the terminal device 100 performs eyeball tracking in the application executed through the photographed image, and in step 1104, the eyeball tracking information obtained through the eyeball tracking and the content information of the executed application matched thereto are checked . Thereafter, in step 1105, the terminal device 100 transmits the interested content request message including the confirmed content information to the service device 200.

Then, in step 1106, the service device 200 confirms the content information included in the interested content request message received from the terminal device 100, constructs a content of interest to be provided by recommending the content associated with the content information, do. In step 1107, the service device 200 generates an interesting content providing message including the configured content of interest and transmits the generated content of interest providing message to the service device 200.

Accordingly, in step 1108, the terminal device 100 displays interested contents including interest content information on the screen of the output unit 160 from the service device 200, and provides the contents to the user.

Program instructions to be recorded may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. For example, the recording medium may be an optical recording medium such as a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a compact disk read only memory (CD-ROM), a digital video disk (DVD) Includes a hardware device that is specially configured to store and execute program instructions such as a magneto-optical medium such as a floppy disk and a ROM, a random access memory (RAM), a flash memory, do. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of specific examples for the purpose of understanding and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

The present invention relates to a content service system, an apparatus and a method for content service in the system, and in an apparatus and method for content service, an eyeball obtained by performing eyeball tracking according to movement of a user's eyeball on a screen of an application Since the recommended content information recommended in association with the content information matched with the tracking information is provided, it is possible to grasp the user's taste only by moving the eyeball without inputting the user, There is an effect that can be.

In addition, the present invention has an effect of collecting information of various people from a service device and configuring a personalization database, thereby analyzing the characteristics and preferences of the contents preferred by the general public, and reflecting the characteristics and preferences of new contents.

The present invention can be applied to the field of contents service, and it is a useful invention that generates the effect of constructing and providing a preferred content through eye tracking without requiring a separate user input, thereby contributing to the development of the service industry .

10: communication network 100: terminal device 110:
111: Application execution module 112: Eye tracking module
113: Content processing module 120:
130: communication unit 140: photographing unit 150:
160: output unit 200: service apparatus 210: control unit
220: communication unit 230: storage unit

Claims (11)

delete A communication unit for performing communication for a content service and a service apparatus connected through a communication network;
A photographing unit for photographing and observing the eye movement of the user in real time; And
And a control unit for performing eyeball tracking by analyzing the image photographed by the photographing unit and checking content information matched with eyeball tracking information obtained through eyeball tracking to request interest contents related to the content information, ,
The control unit
Wherein the controller controls to display the size of the icon displayed on the display relatively large when the reliability of the eye tracking information of the terminal device is lower than a preset value. ◈ Claim 3 is abandoned due to the registration fee. 3. The apparatus of claim 2,
An application execution module that executes an application provided by the service apparatus;
An eyeball tracking module for analyzing the image photographed by the photographing unit and performing eyeball tracking according to the movement of the user's eyeball; And
A content processing module for confirming content information matched with the eyeball tracking information obtained through eyeball tracking and requesting interested contents related to the contents information and providing interested contents provided from the service device to the user;
And a terminal device for a content service in the content service system. ◈ Claim 4 is abandoned due to the registration fee. 4. The eye tracking module according to claim 3,
And the eye tracking information corresponding to the identified position is obtained by identifying a position where the user's gaze is longer than a preset time in the executed application. delete delete A communication unit for performing communication for content service with one or more terminal devices connected through a communication network;
The method of claim 1, further comprising: confirming content information matched to the received eye tracking information in response to a request for a content of interest from the one or more terminal devices; collecting content associated with the identified content information; A control unit for performing control for providing to the terminal device; And
And a storage unit for storing contents of interest in the personalized database for each of the one or more terminal apparatuses,
The control unit
When the reliability of the eye tracking information of the terminal device is lower than a preset value, provides an application set to display the size of the icon displayed on the display relatively large, to the one or more terminal devices Service devices for services.

delete delete delete delete

Images