KR100807897B1 - Apparatus, system and method for deciding object concentration in video using by mobile communication terminals - Google Patents

Abstract

The present invention provides an image service by including object frame data in an image, and determines the object concentration in the image according to the present invention. To this end, the present invention is different from the conventional method of providing only an image service requested using a mobile communication terminal. In contrast, when a video service is requested through a mobile communication terminal having a camera function, an object frame data of each object in the image is generated accordingly, and a video service including the same is provided, and the iris of the viewer is captured according to a preset period. When the visual direction of the captured iris is determined and the object information in the image is derived and transmitted according to the determined visual direction, the received information is determined and the concentration degree is determined for each object in the image. The object concentration in the image is determined according to the object information, and then the viewer's interest Depending on who is able to provide the relevant services effectively.

Mobile terminal, object frame data, iris imaging, object concentration

Description

Apparatus, method and method for determining object concentration in video using a mobile communication terminal {APPARATUS, SYSTEM AND METHOD FOR DECIDING OBJECT CONCENTRATION IN VIDEO USING BY MOBILE COMMUNICATION TERMINALS}

1 is a block diagram of a system for determining concentration in an image using a mobile communication terminal suitable for determining concentration for each object in an image according to the present invention;

2 is a block diagram of a mobile communication terminal suitable for deriving and transmitting object information according to object frame data in an image according to the present invention;

3 is a block diagram of a video service server suitable for providing a video service including object frame data in an image according to the present invention, and determining the degree of concentration for each object according to the transmitted object information in the image;

4 is a flowchart illustrating a process of determining a degree of concentration for each object in an image serviced according to the present invention;

5A to 5C are diagrams illustrating determining the visual direction of the iris and deriving object information according to the present invention.

<Description of the symbols for the main parts of the drawings>

102: mobile communication terminal 104: wireless communication network

104a: wireless base station 104b: base station controller

106: MSC 108: HLR / VLR

110: internet communication network 112: video service server

202: control unit 204: key input unit

206: display unit 208: memory

210: transmitter 212: duplexer

214: First receiver 216: Audio processor

218: camera unit 302: second receiver

304: server control unit 306: video database

308: object frame data generation unit 310: transmission unit

312: object concentration determination unit

The present invention relates to a technique for determining the concentration of each object in the image, and more particularly, a mobile communication suitable for capturing the iris of the viewer watching the provided image, and determining the concentration of each object in the image according to the captured visual direction A system and method for determining object concentration in an image using a terminal.

As is well known, a mobile communication terminal has a function of being extended to a multimedia terminal such as a digital camera photographing or an MP3 music file with a built-in camera or memory in addition to a simple voice call function. Due to the enhancement of functions, various additional services using the multimedia functions newly added to the mobile communication terminals are being developed, not only the service of the mobile communication terminal but also the communication service for the voice call.

The mobile communication terminal provides a specific additional service using a short range wireless communication module, for example, Radio Frequency IDentification (RFID), Bluetooth, Infrared Data Association (IRDA), Zigbee, etc.) MP3 viewing using a wireless headset, a voice call using a wireless microphone, and the like, and furthermore, various functions using a short range wireless communication module have been applied to a mobile communication terminal having a game function and a DMB function.

Meanwhile, when a DMB broadcasting service, a video streaming service, or the like is provided using a mobile communication terminal to which these additional functions are conventionally applied, the viewer simply watches the corresponding video service, and the viewer providing the video service has the interest of the viewer. Irrespective of the fact that the video service is uniformly provided, it is acting as a dissatisfaction factor of the viewer in using the mobile communication terminal providing the video service.

Accordingly, the present invention is to solve the above problems of the prior art, an image concentration determination apparatus using a mobile communication terminal capable of providing a video service including the object frame data for each object in the image, determination system and its The purpose is to provide a method.

Another object of the present invention is to provide a mobile communication terminal capable of capturing an iris of a viewer, determining a visual direction of the captured iris, and providing object information in the image according to an image service provided with object frame data. The present invention provides an apparatus for determining concentration in an image, a determination system, and a method thereof.

Another object of the present invention is to determine the concentration of each object in the image by using the object information in the image according to the viewing direction of the viewer iris, the concentration in the image using a mobile communication terminal that can provide a video service based on the user's concentration The present invention provides a judgment device, a judgment system, and a method thereof.

The present invention according to one aspect of the present invention for achieving the above object is a system for determining the concentration of each object in the image serviced using a mobile communication terminal having a camera function, the object frame data for each object in the image When an image service including a is provided, imaging the viewer's iris according to a predetermined period, determining a visual direction of the captured iris, and transmitting corresponding object information in the image according to the determined visual direction through a wireless communication means. Generating the object frame data and providing the video service including the generated object frame data to the mobile communication terminal through the wireless communication means, and transmitting the video according to the transmitted object information. A video service providing means for determining a concentration level for each object in the object; Intensity of objects in the image using the mobile communication terminal including the wireless communication means for transmitting the video service from the image service providing means to the mobile communication terminal, and the object information from the mobile communication terminal to the video service providing means. Provide a judgment system.

A method for determining the degree of concentration for each object in a serviced service using a mobile communication terminal having a camera function, the method comprising: requesting a video service through the mobile communication terminal and an object for each object in the image according to the video service request; Generating the frame data and providing the image service including the frame data; photographing the iris of the viewer according to a predetermined period when the image service is provided; and determining and determining the visual direction of the captured iris. Deriving object information in the image according to the visual direction, and receiving the determined object information when the derived object information is transmitted, and determining the degree of concentration for each object in the image. Provide a method of judgment.

According to another aspect of the present invention, there is provided a device for determining a concentration level for each object in an image serviced using a mobile communication terminal having a camera function. Object frame data generating means for generating the object frame data for each of the plurality of objects; and providing the generated object frame data and the requested corresponding image to the mobile communication terminal, and according to the visual direction of the captured iris and the object frame data. Control means for receiving object information from the mobile communication terminal for determining object concentration, receiving and storing determined concentration information for each object, and determining concentration level for each object in the image based on the provided object information. An object that provides object concentration information to the control means An object concentration determination apparatus in an image using a mobile communication terminal including a concentration determination unit is provided.

The above and other objects and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

According to a key technical aspect of the present invention, when a video service is requested through a mobile communication terminal having a camera function, an object frame data of each object in the image is generated accordingly, and a video service including the same is provided. When the iris of the viewer is photographed and the object information in the image is derived and transmitted according to the visual direction of the photographed iris, it is received and the concentration is determined for each object in the image. Easy to achieve.

1 is a block diagram of an image concentration determination system using a mobile communication terminal suitable for determining an object concentration in an image according to the present invention. The mobile communication terminal 102, the wireless communication network 104, and a mobile switching center (MSC) are shown in FIG. 106, a Home Location Register / Vistor Location Register (108), an Internet communication network (110), and a video service server (112). Here, the wireless communication network 104 includes a wireless base station 104a and a base station controller 104b.

1, the mobile communication terminal 102 is within the range of any wireless base station 104a, the information of the mobile communication terminal 102 is transmitted to the MSC 106 via the wireless communication network 104, Various information and service data transmitted from the MSC 106 are transmitted to the mobile communication terminal 102 via the wireless communication network 104.

In addition, the mobile communication terminal 102 requests an arbitrary video service, and when the requested video service is provided, the mobile communication terminal 102 uses the camera function to perform a predetermined period of time (eg, 1 second, 2 seconds, etc.). The iris is photographed, the visual direction of the photographed iris is determined, object information according to the determined visual direction is derived, and transmitted through the wireless communication network 104. Here, the requested video service includes object frame data in the image, the viewer's iris is captured through a camera zoom-in function, and predetermined software, for example, a wireless Internet platform for interoperability (WIPI), a Qualcomm BREW application, and the like. The visual direction of the iris is determined using.

Next, the wireless base station 104a of the wireless communication network 104 connects the mobile communication terminal 102 to the base station controller 104b to perform wireless communication with the mobile communication terminal 102, and wired with the base station controller 104b. Performs wired / wireless conversion function to perform communication. In addition, the base station controller 104b connects the wireless base station 104a to the MSC 106 to coordinate the connection between other base stations, and performs a signal processing function for communication between the wireless base station 104a and the MSC 106. Accordingly, various request signals, terminal information, and the like from the mobile communication terminal 102 are transmitted to the MSC 106, and various information data, additional service data, and the like from the MSC 106 are transmitted to the mobile communication terminal 102. do.

The MSC 106 connects a call call when the mobile communication subscriber makes or receives a call using the mobile communication terminal 102, and connects to the base station controller 104b of the wireless communication network 104 to connect the mobile communication terminal. Perform a call setup, release function, etc. of the 102, perform call processing in connection with the HLR / VLR 108, and perform an interworking function with another communication network, for example, an internet communication network (not shown). .

In addition, the MSC 106 transmits any video service request signal, object information in the video, etc. transmitted from the mobile communication terminal 102 through the wireless communication network 104 to the video service server 112 through the Internet communication network 110. The image data including the object frame data in the image transmitted from the image service server 112 through the internet communication network 110 is transmitted to the mobile communication terminal 102 through the wireless communication network 104.

On the other hand, the Home Location Register (HLR) of the HLR / VLR 108 is a home location register, and is a database that stores permanent information, location information, additional service information, etc. of the mobile communication terminal 102 and subscribers, and the MSC 106. Or interact with the VLR to perform and control various functions related to call processing and supplementary services, and the Visitor Location Register (VLR) is a visitor location register, which is used by the visitor in the area served by the MSC 106. It is a database for storing information, and performs a function of temporarily storing the mobile communication terminal 102 and the subscriber information registered to the area in charge, from the HLR (Home Location Register).

Next, the image service server 112 extracts the corresponding image according to the image service request signal transmitted from the MSC 106 through the Internet communication network 110, and generates object frame data for each object of the extracted image. Later, the image including the generated object frame data is transmitted to the MSC 106 through the Internet communication network 110, and the image is serviced according to the object information in the image transmitted from the MSC 106 through the Internet communication network 110 After comparing with, determine the concentration of each object in the image. Thereafter, the image service server 112 stores the determined concentration information for each object in the image to determine the object concentration for each predetermined period (for example, one week, two weeks, etc.) or a program.

Meanwhile, in the above-described present invention, the object frame data in the image is included in the image and provided to the mobile communication terminal. However, when the image is provided through the mobile communication terminal, the object frame data is transmitted through the wireless data communication. Of course, the terminal can be provided in real time.

In addition, in the above-described present invention, the object concentration of the video service using the mobile communication terminal having the camera function is described as being determined. However, even in a digital TV having an image cam that can be captured by zooming in while providing digital broadcasting, Of course, the object concentration determination system can be implemented.

Therefore, when the mobile communication terminal requests an arbitrary video service, the image is captured while providing the video service, the visual direction of the captured iris is determined, and the object information in the image is transmitted according to the determined visual direction. The concentration of each object in the serviced image may be determined according to the object information.

Next, when a video service is provided in a system for determining the object concentration in the image having the above-described configuration, the camera function is used to capture the viewer's iris, determine the visual direction of the captured iris, and determine the determined time. A mobile communication terminal for transmitting object information along a direction will be described.

2 is a block diagram of a mobile communication terminal suitable for deriving and transmitting object information based on object frame data in an image according to the present invention. The mobile communication terminal 102 includes a control unit 202, a key input unit 204, and a display unit. 206, a memory 208, a transmitter 210, a duplexer 212, a first receiver 214, an audio processor 216, and a camera 218.

2, the control unit 202 of the mobile communication terminal 102 controls the overall operation of the mobile communication terminal 102, and performs the operation control in accordance with the operation signal provided from the key input unit 204 And providing a control signal for displaying various information of the mobile communication terminal 102 to the display unit 206, and providing each control signal according to a predetermined program stored in the memory 208, from the audio processing unit 216. Provides a control signal for transmitting audio data of the transmitter 210.

In addition, the controller 202 displays the video data provided from the first receiver 214 through the display unit 206, and controls the audio data to be output through the audio processor 216. Perform the function.

Meanwhile, when there is an operation signal for requesting an arbitrary video service from the key input unit 204, the controller 202 wirelessly transmits a signal for requesting the corresponding video service according to the operation signal through the transmitter 210 and the duplexer 212. It controls to transmit to the base station 104a, receives the image according to the requested video service from the wireless base station 104a through the duplexer 212 and the first receiving unit 214, and signal-processes the image according to the display unit 206 and audio processing unit Control to play through (216).

In addition, when the image service is provided, the controller 202 uses the zoom-in function to zoom in the viewer's iris through the camera unit 218 according to a preset period (for example, 1 second, 2 seconds, etc.). When the captured iris image is transferred, the visual direction of the iris is determined by using predetermined software from the memory 208, for example, a wireless Internet platform for interoperability (WIPI), a BREW application of Qualcomm Corporation, or the like. . Here, the viewing direction of the iris is, for example, as shown in FIG. 5A, the viewing direction of each cell is determined in a grid manner with respect to the structure of an image or a keypad serviced according to an iris image captured using a zoom-in function. Done.

Accordingly, the control unit 202 derives object information in the image according to the determined visual direction of the iris and transmits it through the transmitter 210 and the duplexer 212. Here, the derivation of the object information in the image is an example of comparing the visual direction of the iris determined as shown in FIGS. 5B and 5C and the object, object, and background by comparing the object frame data transmitted in the service image. The object information in the image may include, for example, an object coordinate in the iris, an object name in the visual direction, and the like.

The key input unit 204 of the mobile communication terminal 102 includes a keypad, for example, and includes a plurality of numeric keys, and when the viewer selects a specific key for requesting a video service, the video is responsive to the video. The service request operation signal is generated and provided to the controller 202.

Next, the display unit 206 of the mobile communication terminal 102 displays various information (for example, time display, menu screen display, etc.) of the mobile communication terminal under the control of the control unit 202, and the key input unit 204 The control signal generated from the control unit and various information signals of the control unit 202 are input and displayed, and the corresponding image provided from the control unit 202 is processed and displayed according to the requested video service.

On the other hand, the memory 208 of the mobile communication terminal 102 stores a predetermined program for controlling the overall operation of the mobile communication terminal 10, and in particular, predetermined software for determining the visual direction of the iris, for example, For example, the Wireless Internet Platform for Interoperability (WIPI) and Qualcomm's BREW application are stored.

In addition, the duplexer 212 of the mobile communication terminal 102 communicates with the wireless base station 104a through an antenna ANT, and separates a transmitted / received signal and transmits a transmitted signal transmitted from the transmitter 210. Is transmitted to the wireless base station 104a through an antenna, and the received signal received from the wireless base station 104a through the antenna is transmitted to the first receiving unit 214.

In addition, the first receiver 214 of the mobile communication terminal 102 receives a radio signal input through the antenna ANT from the radio base station 104a, and receives a radio signal separated by the duplexer 212, The weak signal is amplified and filtered to be output to the control unit 202, and the transmitting unit 210 filters and amplifies the wireless signal output from the audio processing unit 216 and passes through the duplexer 212 through the antenna ANT through a wireless base station. Transmit to 104a.

Therefore, if the video service is provided through the mobile communication terminal, the camera function can be used to capture the viewer's iris by zoom-in, determine the visual direction of the captured iris, derive the object information in the image, and then transmit the object information. have.

Next, the audio processor 216 of the mobile communication terminal 102 modulates the voice signal input through the microphone MIC into a wireless signal, demodulates the wireless signal received through the first receiver 214, and then the speaker ( SPK) as an audio signal. In addition, when a ring signal is generated from the base station, the ring signal is detected by the first receiver 214 and then transmitted through a ringer.

Next, an image service is provided to the mobile communication terminal having the above-described configuration by including object frame data for each specific object in the image, and the image service determines the concentration level for each object according to the object information in the image from the mobile communication terminal. Describe the server.

3 is a block diagram of a video service server suitable for providing a video service including object frame data in a video according to the present invention and determining a concentration level for each object according to the object information in the video being transmitted. ) Includes a second receiver 302, a server controller 304, an image database 306, an object frame data generator 308, a transmitter 310, and an object concentration determiner 312.

Referring to FIG. 3, the second receiver 302 receives various request signals from the MSC 106 through the internet communication network 110, and requests a video service transmitted from the MSC 106 through the internet communication network 110. It receives a signal and transmits it to the server control unit 304, and receives the object information in the image serviced through the Internet communication network 110 from the MSC 106 and transmits it to the server control unit 304 and the like.

In addition, the server controller 304 performs overall operation control of the image service server, and extracts a corresponding image requested for service from the image database 306 according to the image service request signal transmitted from the second receiver 302. The control signal for generating the object frame data in the extracted image is provided to the object frame data generator 308, and the image including the generated object frame data is transmitted through the transmitter 310 and the internet communication network 110 connected thereto. Control to send to the MSC 106. Here, the image database 306 stores various image data serviced by the image service, and object concentration information for each object is stored for each image.

In addition, the server controller 304 provides a control signal for determining the concentration level for each object in the image to the object concentration determination unit 312 by using the object information in the image transmitted through the second receiver 302. The concentration of each object is provided and stored in the image database 306 as image information.

Next, the object frame data generation unit 308 receives the image extracted from the server control unit 304 generates the object frame data for this and delivers it to the server control unit 304. Here, the object frame data separately sets an object such as a person, an object, a background, and the like in the image of the service request, and generates object frame data including coordinate information for each object of the object. For example, as illustrated in FIG. 5C, an object is set as person 1, person 2, person 3, object 1, object 2, object 3, and the like, and these objects are x coordinate, y coordinate, width, height, and the like. object frame data including object region coordinate information such as height and the object region coordinate information is generated according to a preset condition (for example, one frame per second) for the corresponding image.

In addition, the transmission unit 310 transmits various images provided from the server control unit 304 to the MSC 106 through the Internet communication network 110, and transmits an image including object frame data from the server control unit 304. It transmits to the MSC 106 through the Internet communication network 110, and the like.

Meanwhile, the object concentration determining unit 312 determines the degree of concentration for each object of the image according to the object information in the image provided from the server controller 304 and transmits the object concentration information for each object to the server controller 304. Here, the determination of the concentration of each object is performed according to the object name, the coordinate information of the object, the time to observe the object, etc. according to the object information, and included in the object concentration information.

Accordingly, the image service server may provide an image including object frame data for each object in the image for the requested image service, and determine and store the concentration for each object in the image according to the transmitted object information.

Next, when the video service request is made by the object concentration determination system in the image using the mobile communication terminal having the above-described configuration, the image service includes the image including the object frame data in the image, and the image of the viewer is captured. The process of determining the visual direction of the iris and transmitting the object information according to the determined visual direction, and determining the concentration for each object in the image based on the transmitted object information.

4 is a flowchart illustrating a process of determining the degree of concentration for each object in an image serviced according to the present invention.

Referring to FIG. 4, in the standby mode of the object concentration determining system in the image using the mobile communication terminal (step 402), the control unit 202 of the mobile communication terminal 102 performs an arbitrary video service through the key input unit 204. If a request key is input, it is checked whether there is a video service request operation signal generated accordingly (step 404).

As a result of the check in the step 404, when there is a video service request operation signal, the control unit 202 of the mobile communication terminal 102 transmits the video service request signal through the transmitter 210 and the duplexer 212 to the wireless base station ( 104a), and the request signal is transmitted to the video service server 112 through the wireless communication network 104, the MSC 106 and the Internet communication network 110 including the wireless base station 104a, and the video service server ( The second receiving unit 302 of 112 receives the request signal and transmits it to the server control unit 304, and the server control unit 304 extracts the service request image from the image database 306 (step 406).

The server control unit 304 of the image service server 112 provides the extracted image to the object frame data generation unit 308, and the object frame data generation unit 308 provides object frame data for each object with respect to the image. Create (step 408). The object frame data separately sets, for example, an object such as a person, an object, a background, and the like in the image of the service request, and generates object frame data including coordinate information for each object of the object. For example, as illustrated in FIG. 5C, an object is set as person 1, person 2, person 3, object 1, object 2, object 3, and the like, and these objects are x coordinate, y coordinate, width, height, and the like. object frame data including object region coordinate information such as height and the object region coordinate information is generated according to a preset condition (for example, one frame per second) for the corresponding image.

Next, the server controller 304 includes the object frame data for the image from the object frame data generation unit 308 in the extracted image of the server request, and includes the MSC (through the transmission unit 310 and the Internet communication network 110). 106, and the MSC 106 transmits the image including the object frame data to the mobile communication terminal 102 through the wireless communication network 104 to provide the requested image service (step 410).

On the other hand, when the video service is provided through the mobile communication terminal 102, the camera unit 218 of the mobile communication terminal 102 by using a zoom-in function to zoom in the viewer's iris (for example, 1 second, 2 Image is taken in step 412). In this case, the present invention has been described as imaging the viewer's iris using a camera function when the video service is provided, but the iris imaging may allow or block the iris imaging as necessary by manipulating the mobile communication terminal. Of course.

In addition, the control unit 202 of the mobile communication terminal 102 stores predetermined software stored in the memory 208, for example, a wireless Internet platform for interoperability (WIPI), a BREW application of Qualcomm, etc. The visual direction of the iris is determined from the image of the iris captured by using the image (step 414). Here, the viewing direction of the iris is, for example, as shown in Figure 5a to determine the viewing direction for each cell in the grid method for the image or keypad serviced according to the iris image captured using the zoom-in function. .

In addition, the controller 202 of the mobile communication terminal 102 derives object information in the image by comparing the object frame data in the image with the image serviced according to the determined iris visual direction (step 416). Here, the derivation of the object information in the image is an example of comparing the visual direction of the iris determined as shown in FIGS. 5B and 5C and the object, object, and background by comparing the object frame data transmitted in the service image. The object information in the image may include, for example, an object coordinate in the iris, an object name in the visual direction, and the like.

Next, the control unit 202 of the mobile communication terminal 102 controls to transmit the derived object information in the image through the transmitter 210 and the duplexer 212, and the object information in the image controls the wireless communication network 104. Is sent to the MSC 106. In addition, the object information in the image is transmitted from the MSC 106 to the image service server 112 through the Internet communication network 110.

Meanwhile, the server controller 304 of the image service server 112 transmits the object information in the image received through the second receiver 302 to the object concentration determiner 312 while storing the object information in the image in the image database 306. The concentration determining unit 312 determines the object concentration for each object of the corresponding image according to the transmitted object information (step 420). Thereafter, the determined information on the object concentration is provided to the server controller 304, and the server controller 304 stores the object concentration information in the image database 306 as object-specific concentration information on the corresponding image. Here, the determination of the concentration of each object is performed according to the object name, the coordinate information of the object, the time to observe the object, etc. according to the object information, and the object name, the coordinate information of the object, the object observed according to the object information. The time to look at is included in the object concentration information.

Meanwhile, in the above-described present invention, the object frame data in the image is included in the image and provided to the mobile communication terminal. However, when the image is provided through the mobile communication terminal, the object frame data is transmitted through the wireless data communication. Of course, the terminal can be provided in real time. In addition, in the above-described present invention, the object concentration of the video service using the mobile communication terminal having the camera function is described as being determined. However, even in a digital TV having an image cam that can be captured by zooming in while providing digital broadcasting, Of course, the object concentration determination system can be implemented.

In addition, the present invention described above is limited to the video service. However, when providing the advertisement image, the object concentration level is determined to provide a service related to the advertisement image, for example, person information, object information, or product information. It can provide services such as providing.

Therefore, when the mobile communication terminal requests a video service, it provides a video service including the object frame data in the image, photographs the viewer's iris to determine the visual direction of the iris, and provides the object information in the image according to the determined visual direction. Derived and transmitted, it is possible to determine the concentration of each object in the image based on the object information.

In the foregoing description, the present invention has been described with reference to preferred embodiments, but the present invention is not necessarily limited thereto. Those skilled in the art will appreciate that the present invention may be modified without departing from the spirit of the present invention. It will be readily appreciated that branch substitutions, modifications and variations are possible.

As described above, in the present invention, unlike the conventional method of providing only the requested video service using the mobile communication terminal, when the video service is requested through the mobile communication terminal having a camera function, the object for each object in the image is accordingly. Providing an image service including frame data by generating the frame data, capturing the iris of the viewer according to a predetermined period, and extracting and transmitting object information in the image according to the visual direction of the captured iris, receiving the object and receiving the object information in the image. By determining the degree of concentration for each object, an image service including object frame data for each object in the image may be provided using the apparatus for determining the object concentration in the image.

In addition, when a video service including object frame data is provided by implementing an object concentration determination system in an image, an image of an iris of a viewer is photographed through a mobile communication terminal, and a visual direction of the photographed iris is determined to thereby determine object information in the image. Can be provided.

Accordingly, by determining the concentration of each object in the image using the object information in the image according to the visual direction of the viewer iris through the object concentration determination system in the image, it is possible to provide a variety of services based on the user concentration.

Claims (13)

A system for determining the concentration of each object in the image serviced using a mobile communication terminal having a camera function, When an image service including object frame data is provided for each object in the image, the image of the viewer is photographed according to a predetermined period, the visual direction of the captured iris is determined, and the corresponding image in the image is determined according to the determined visual direction. The mobile communication terminal for transmitting object information through a wireless communication means; The object frame data is generated, the image service including the generated object frame data is provided to the mobile communication terminal through the wireless communication means, and the concentration of each object in the image is determined based on the transmitted object information. Means for providing video services, The wireless communication means for transmitting the video service from the video service providing means to the mobile communication terminal and transferring the object information from the mobile communication terminal to the video service providing means. Object concentration determination system in the image using a mobile communication terminal comprising a. The method of claim 1, And the mobile communication terminal comprises a specific application for capturing the iris and determining the visual direction thereof. The method of claim 1, The video service providing means, Object frame data generating means for generating the object frame data separately set for each object according to a person, object or background in the image of the provided video service; According to the object name including the visual direction coordinates of the iris and the object information including the object name in the visual direction, the concentration of each object in the image according to the object name, the coordinate information of the object, and the time to observe the object Means of determining object concentration to judge and provide such object concentration information System for determining the object concentration in the image using a mobile communication terminal comprising a. A method for determining the concentration of each object in the serviced image using a mobile communication terminal having a camera function, Requesting a video service through the mobile communication terminal; Generating the object frame data of each object in the image according to the image service request and providing the image service including the same;  Photographing the iris of the viewer according to a preset period when the video service is provided; Determining a visual direction of the captured iris and deriving object information in the image according to the determined visual direction; When the derived object information is transmitted, receiving the same and determining the degree of concentration for each object in the image Method for determining the object concentration in the image using a mobile communication terminal comprising a. The method of claim 4, wherein The object frame concentration determination method of the image using the mobile communication terminal, characterized in that the object frame, the object is separated and set by the person, the object and the background is generated, including the coordinate information for each object. The method of claim 4, wherein The visual direction of the iris, after the image of the iris is determined by the grid method for the structure of the image or the keypad using a specific application method for determining the object concentration in the image using a mobile communication terminal. The method of claim 4, wherein The object information is derived as information about an object such as a person, an object, or a background according to the object frame data and the visual direction of the iris, and includes the visual direction coordinates of the iris and an object name according to the visual direction. An object concentration determination method in an image using a mobile communication terminal. The method of claim 4, wherein The object concentration is determined according to the object name, the coordinate information of the object and the time to look at the object according to the object information, the object concentration determination method in the image using the mobile communication terminal. An apparatus for determining the concentration of each object in the serviced image using a mobile communication terminal having a camera function, Object frame data generating means for generating the object frame data for each object in the corresponding video when an image service is requested; Provide the generated object frame data and the requested corresponding image to the mobile communication terminal, and receive object information according to the visual direction of the captured iris and the object frame data from the mobile communication terminal to determine object concentration. And control means for receiving and storing the determined concentration information for each object, Object concentration determining means for determining the concentration of each object in the image according to the object information provided to provide the object concentration information to the control means Device concentration determination apparatus in the image using a mobile communication terminal comprising a. The method of claim 9, And the mobile communication terminal includes a specific application for capturing the iris and determining a viewing direction thereof. The method of claim 9, The object frame data generating means separates and sets an object into a person, an object, and a background in the corresponding image to generate the object frame data including coordinate information for each object. Concentration judgment device. The method of claim 9, The object information is derived as object-specific information such as a person, an object, or a background in the image, and the object concentration in the image using the mobile communication terminal, characterized in that it includes the visual direction coordinates of the iris and the object name according to the visual direction. Judgment device. The method of claim 9, The object concentration determining means determines the object concentration according to the object name, the coordinate information of the object and the time to look at the object according to the object information, and provides the object concentration information accordingly. Object concentration determination device in the image using a terminal.

Images