JP2006260275A - Content management system, display control device, display control method and display control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a content management system capable of accurately comprehending and recording the viewing circumstances of content for each viewer. <P>SOLUTION: This content management system is provided with a display device 101 for displaying content; a viewer identifying device 102 for identifying a viewer who is located in the viewing region of content by a portable information storage medium; an imaging device 103 for photographing the viewer identified by the viewer-identifying device 102; and a display controller 110 for managing the content to be displayed at the display device 101 and controlling the display of the content. The display controller 110 is provided with a viewing circumstance recognizing means 111 for recognizing the viewing circumstances of the viewer, based on the information of the viewer identified by the viewer identifying device 102 and the image photographed by an imaging device 103; and a viewing circumstance storing means 116 for storing the content displayed by the display device 101 and the viewing circumstances recognized by the viewing circumstance recognizing means 11 being associated with them. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a content management system, a display control device, a display control method, and a display control program that manage content in association with a viewing situation of a viewer.

  Conventionally, as a technique for grasping the actual condition of a viewer who views content, an audience rating survey method is known in which viewing data is aggregated from a sensor or the like attached to a television receiver. With such a technique, it is difficult to grasp the viewing situation of each individual viewer because the actual state of viewing is grasped for each device such as a television receiver.

  As a method for identifying individual viewers, viewing images in a captured image by associating an image captured of the viewer with information acquired from a recording medium such as an IC card storing information related to the attributes of the viewer. A technique for identifying an individual person has been proposed (for example, Patent Document 1). In addition, in relation to the method of grasping the viewing status of viewers, a technology has been proposed for recognizing the face direction, line of sight, facial expression, etc. from an image of a human face and controlling the device accordingly. (For example, Patent Document 2).

JP 2004-194135 A JP 2003-196655 A

  However, although the technique of Patent Document 1 can identify individual viewers, there is a problem in that it cannot be determined whether or not the viewers are actually viewing specific content. In the technique of Patent Document 2, it is possible to determine whether the viewer is actually viewing the content by recognizing the orientation of the face or the like, but the image taken when there are a plurality of viewers. There is a problem that it is difficult to identify individual viewers only from the above.

  The present invention has been made in view of the above, and an object of the present invention is to provide a content management system capable of accurately grasping and recording content viewing status for each viewer.

  In order to solve the above-described problems and achieve the object, the invention according to claim 1 is present in a display device that displays content and a viewing area that allows viewing of the content displayed on the display device. A viewer identifying device that identifies the viewer to be viewed by a portable information storage medium possessed by the viewer, an imaging device that captures the viewer identified by the viewer identifying device, and content to be displayed on the display device And a display control device that controls display of content. The display control device includes information about the viewer identified by the viewer identification device and an image captured by the imaging device. The viewing status recognition means for recognizing the viewing status of the viewer, the content displayed by the display device, and the viewing status recognition means Viewing state storage means for storing in association with serial viewing situation, characterized by comprising a.

  According to a second aspect of the present invention, there is provided a portable device in which the viewer possesses a display device that displays content and a viewer that is present in a viewing area that is a region where the content displayed on the display device can be viewed. Viewer identification device identified by a type information storage medium, an imaging device that captures the viewer identified by the viewer identification device, and display control that manages content displayed on the display device and controls display of the content In a content management system comprising: a device; and a communication device that transmits and receives information about the viewer identified by the viewer identification device, information captured by the imaging device and content including content to be displayed, The display control device further includes communication means for transmitting / receiving information related to the content with at least one of the communication devices. A viewing status recognition means for recognizing the viewing status of the viewer based on the information of the viewer received by the communication means and an image taken by the imaging device, and content displayed by the display device, Viewing status storage means for storing the viewing status recognized by the viewing status recognition means in association with each other.

  According to a third aspect of the present invention, in the content management system according to the first or second aspect, the display control device displays on the display device based on the viewing status stored in the viewing status storage means. It is further characterized by further comprising a judging means for judging the content to be processed.

  According to a fourth aspect of the present invention, in the content management system according to the third aspect, the viewing status recognition means recognizes the viewer's face direction or line-of-sight direction as the viewing status, and the determination means. Is characterized in that content to be displayed on the display device is determined based on the orientation of the viewer's face or the direction of the line of sight stored in the viewing status storage means.

  Further, the invention according to claim 5 is the content management system according to claim 3, wherein the viewing status recognition means recognizes whether the viewer exists in the viewing area as the viewing status, The determining means determines content to be displayed on the display device based on whether or not the viewer exists in the viewing area.

  According to a sixth aspect of the present invention, in the content management system according to the third aspect, the viewing status recognition unit recognizes the facial expression of the viewer as the viewing status, and the determination unit includes the viewing mode. The content to be displayed on the display device is determined based on the facial expression of the viewer stored in the situation storage means.

  The invention according to claim 7 is the content management system according to claim 3, further comprising a voice input device that inputs a voice uttered by a viewer who is viewing the content, Based on the voice input by the voice input device, the viewer recognizes a response to the viewer's content as the viewing status, and the determining means is based on the response to the viewer's content stored in the viewing status storage means. The content to be displayed on the display device is determined.

  The invention according to claim 8 is the content management system according to any one of claims 3 to 7, wherein the display control device includes content to be displayed on the display device, priority for displaying the content, Content storage means for storing the information in association with each other, wherein the determination means determines the content to be displayed on the display device based on the priority order stored in the content storage means and the viewing status. It is characterized by.

  According to a ninth aspect of the present invention, in the content management system according to any one of the third to seventh aspects, the display control device is information that prompts viewing of the content that the determination means determines to display. Is further provided with notification means for notifying the viewer.

  According to a tenth aspect of the present invention, in the display control device, a viewer existing in a viewing area, which is an area where content displayed on the display device can be viewed, is represented by a portable information storage medium held by the viewer. The viewer information identified by the identified viewer identification device and the input of the image captured by the imaging device that captures the viewer are received, and the viewer is based on the received viewer information and the captured image. Viewing status recognition means for recognizing the viewing status, viewing content storage means for storing the content displayed on the display device and the viewing status recognized by the viewing status recognition means, and the viewing status Determining means for determining the content to be displayed on the display device based on the viewing status stored in the storage means; and a copy determined by the determining means to be displayed. And output means for outputting the Ceiling, characterized by comprising a.

  Further, the invention according to claim 11 is the display control device according to claim 10, further comprising communication means for transmitting and receiving the information of the viewer identified by the viewer identification device and the image taken by the imaging device. And the viewing status recognition means receives the viewer information received by the communication means and the input of the image taken by the imaging device, and based on the received viewer information and the taken image, It is characterized by recognizing the viewing situation of a person.

  The invention according to claim 12 is the display control device according to claim 10 or 11, wherein the viewing status recognition means recognizes the viewer's face direction or gaze direction as the viewing status, The judging means judges the content to be displayed on the display device based on the viewer's face orientation or line-of-sight direction stored in the viewing status storage means.

  The invention according to claim 13 is the display control device according to claim 10 or 11, wherein the viewing status recognition means recognizes whether the viewer exists in the viewing area as the viewing status. The determination means determines content to be displayed on the display device based on whether or not the viewer exists in the viewing area.

  The invention according to claim 14 is the display control device according to claim 10 or 11, wherein the viewing status recognition means recognizes the facial expression of the viewer as the viewing status, and the determination means includes: The content to be displayed on the display device is determined based on the facial expression of the viewer stored in the viewing status storage means.

  Further, the invention according to claim 15 is the display control device according to claim 10 or 11, wherein the viewing status recognizing means inputs an audio uttered by a viewer who is viewing the content input by the audio input device. Receiving and recognizing a reaction to the viewer's content as the viewing situation based on the received voice, and the determining means is based on the reaction to the viewer's content stored in the viewing situation storage means The content to be displayed on the screen is determined.

  According to a sixteenth aspect of the present invention, in the display control device according to any one of the tenth to fifteenth aspects, the content displayed on the display device and the priority order for displaying the content are stored in association with each other. Content storage means is further provided, wherein the determination means determines the content to be displayed on the display device based on the priority order stored in the content storage means and the viewing status.

  According to a seventeenth aspect of the present invention, in the display control device according to any one of the tenth to sixteenth aspects, the viewer is notified of information that prompts viewing of the content that the determination unit determines to display. The information processing device further includes notification means.

  The invention according to claim 18 is the display control method, wherein a viewer existing in a viewing area, which is an area where the content displayed on the display device can be viewed, is represented by a portable information storage medium held by the viewer. The viewer information identified by the identified viewer identification device and the input of the image captured by the imaging device that captures the viewer are received, and the viewer is based on the received viewer information and the captured image. The viewing status recognition step for recognizing the viewing status, the content displayed on the display device, and the viewing status recognized by the viewing status recognition step are stored in association with each other and stored in the viewing status storage means A determination step of determining the content to be displayed on the display device based on the viewing situation, and the content determined by the determination step to be displayed Characterized in that and an output step of outputting.

  The invention according to claim 19 is the display control method according to claim 18, further comprising a communication step of transmitting and receiving the information of the viewer identified by the viewer identification device and the image taken by the imaging device. And the viewing status recognition step receives the viewer information received in the communication step and the input of the image captured by the imaging device, and the viewing status is based on the received viewer information and the captured image. It is characterized by recognizing the viewing situation of a person.

  The invention according to claim 20 is the display control method according to claim 18 or 19, wherein the viewing status recognition step recognizes a direction of a face or a line of sight of the viewer as the viewing status, In the determining step, content to be displayed on the display device is determined based on a direction of the viewer's face or line of sight stored in the viewing status storage means.

  The invention according to claim 21 is the display control method according to claim 18 or 19, wherein the viewing status recognition step recognizes whether the viewer exists in the viewing area as the viewing status. The determining step determines contents to be displayed on the display device based on whether or not the viewer exists in the viewing area.

  The invention according to claim 22 is the display control method according to claim 18 or 19, wherein the viewing status recognition step recognizes the facial expression of the viewer as the viewing status, and the determination step includes: The content to be displayed on the display device is determined based on the facial expression of the viewer stored in the viewing status storage means.

  Further, the invention according to claim 23 is the display control method according to claim 18 or 19, wherein the viewing status recognition step receives an input of a voice uttered by a viewer who is viewing the content input by the voice input device. Receiving and recognizing a reaction to the viewer's content as the viewing situation based on the received voice, and the determining step includes the display device based on the reaction to the viewer's content stored in the viewing situation storage means The content to be displayed on the screen is determined.

  The invention according to claim 24 is the display control method according to any one of claims 18 to 23, wherein the determination step corresponds to the content to be displayed on the display device and the priority to display the content. The content to be displayed on the display device is determined based on the priority order stored in the content storage means to be added and the viewing status.

  According to a twenty-fifth aspect of the present invention, in the display control method according to any one of the eighteenth to twenty-fourth aspects, the viewer is notified of information that prompts viewing of the content that is determined to be displayed by the determination step. A notification step is further provided.

  The invention according to claim 26 is a program for causing a computer to execute the display control method according to any one of claims 18 to 25.

  According to the first aspect of the present invention, it is possible to store the content and the viewing status of each viewer who is viewing the content in association with each other. For this reason, there is an effect that the viewing situation of each content can be accurately recorded for each individual viewer.

  According to the second aspect of the present invention, the content and the viewing status of each viewer who is viewing the content on a plurality of display devices can be stored in association with each other. For this reason, the viewing status of each content on a plurality of display devices can be totaled and recorded accurately for each individual viewer.

  According to the invention of claim 3, since the content to be displayed can be determined based on the recorded viewing situation, the display content of the content can be controlled according to the viewing situation of each viewer. There is an effect that can be done.

  According to the fourth aspect of the present invention, it is possible to recognize the direction of the viewer's face or the direction of the line of sight, and determine the content to be displayed based on the recognition. For this reason, there is an effect that the display content of the content can be controlled based on whether or not the viewer has actually viewed the content.

  According to the invention of claim 5, it is possible to recognize whether or not the viewer exists in an area where the content can be viewed, and to determine the content to be displayed based on the recognition. For this reason, there is an effect that appropriate content can be displayed to a viewer who exists in an area where the content can be viewed.

  According to the invention of claim 6, it is possible to recognize the facial expression of the viewer and determine the content to be displayed based on the recognition. Therefore, it is possible to accurately record the content that attracts the viewer's interest and to display the content that attracts the viewer's interest to other viewers.

  Further, according to the seventh aspect of the present invention, it is possible to recognize the reaction to the viewer's content from the voice uttered by the viewer and determine the content to be displayed based on the reaction. Therefore, it is possible to accurately record the content that attracts the viewer's interest and to display the content that attracts the viewer's interest to other viewers.

  According to the eighth aspect of the present invention, the content to be displayed can be determined based on the priority for displaying the content and the viewing status. For this reason, there is an effect that the display content of the content can be controlled according to the priority order of the content as well as the viewing status of each viewer.

  In addition, according to the ninth aspect of the present invention, it is possible to notify the viewer of information that prompts viewing of the content to be displayed, so that it is possible to thoroughly view important content.

  According to the invention of claim 10, the content and the viewing status of each viewer who is viewing the content are stored in association with each other, and the content to be displayed is determined based on the stored viewing status. be able to. Therefore, the viewing situation of each content can be accurately recorded for each individual viewer, and the display contents of the content can be controlled according to the viewing situation of each individual viewer.

  According to the invention of claim 11, the content and the viewing status of each viewer who is viewing the content on the plurality of display devices are stored in association with each other and displayed based on the stored viewing status. The content to be determined can be determined. Therefore, the viewing status of each content on a plurality of display devices can be aggregated and accurately recorded for each viewer, and the display content of the content can be controlled according to the viewing status of each viewer There is an effect that can be.

  According to the twelfth aspect of the present invention, it is possible to recognize the orientation of the viewer's face or the direction of the line of sight, and determine the content to be displayed based on the recognition. For this reason, there is an effect that the display content of the content can be controlled based on whether or not the viewer has actually viewed the content.

  According to the invention of claim 13, it is possible to recognize whether or not the viewer exists in an area where the content can be viewed, and to determine the content to be displayed based on the recognition. For this reason, there is an effect that appropriate content can be displayed to a viewer who exists in an area where the content can be viewed.

  According to the fourteenth aspect of the invention, it is possible to recognize the facial expression of the viewer and determine the content to be displayed based on the recognition. Therefore, it is possible to accurately record the content that attracts the viewer's interest and to display the content that attracts the viewer's interest to other viewers.

  According to the fifteenth aspect of the present invention, it is possible to recognize the reaction to the viewer's content from the voice uttered by the viewer and determine the content to be displayed based on the reaction. Therefore, it is possible to accurately record the content that attracts the viewer's interest and to display the content that attracts the viewer's interest to other viewers.

  According to the sixteenth aspect of the present invention, the content to be displayed can be determined based on the priority for displaying the content and the viewing status. For this reason, there is an effect that the display content of the content can be controlled according to the priority order of the content as well as the viewing status of each viewer.

  According to the seventeenth aspect of the present invention, it is possible to notify the viewer of information that prompts viewing of the content to be displayed, so that it is possible to thoroughly view important content.

  According to the invention of claim 18, the content and the viewing status of each viewer who is viewing the content are stored in association with each other, and the content to be displayed is determined based on the stored viewing status. be able to. Therefore, the viewing situation of each content can be accurately recorded for each individual viewer, and the display contents of the content can be controlled according to the viewing situation of each individual viewer.

  According to the nineteenth aspect of the invention, the content and the viewing status of each viewer who is viewing the content on the plurality of display devices are stored in association with each other and displayed based on the stored viewing status. The content to be determined can be determined. Therefore, the viewing status of each content on a plurality of display devices can be aggregated and accurately recorded for each viewer, and the display content of the content can be controlled according to the viewing status of each viewer There is an effect that can be.

  According to the twentieth aspect of the present invention, it is possible to recognize the orientation of the viewer's face or the direction of the line of sight and determine the content to be displayed based on the recognition. For this reason, there is an effect that the display content of the content can be controlled based on whether or not the viewer has actually viewed the content.

  According to the invention of claim 21, it is possible to recognize whether or not the viewer exists in an area where the content can be viewed, and to determine the content to be displayed based on the recognition. For this reason, there is an effect that appropriate content can be displayed to a viewer who exists in an area where the content can be viewed.

  According to the invention of claim 22, it is possible to recognize the facial expression of the viewer and determine the content to be displayed based on the recognition. Therefore, it is possible to accurately record the content that attracts the viewer's interest and to display the content that attracts the viewer's interest to other viewers.

  According to the twenty-third aspect of the present invention, it is possible to recognize the reaction to the viewer's content from the voice uttered by the viewer and determine the content to be displayed based on the reaction. Therefore, it is possible to accurately record the content that attracts the viewer's interest and to display the content that attracts the viewer's interest to other viewers.

  According to the twenty-fourth aspect of the present invention, the content to be displayed can be determined based on the priority for displaying the content and the viewing status. For this reason, there is an effect that the display content of the content can be controlled according to the priority order of the content as well as the viewing status of each viewer.

  In addition, according to the invention of claim 25, since it is possible to notify the viewer of information that prompts viewing of the content to be displayed, it is possible to thoroughly view important content.

  According to the invention of claim 26, there is an effect that the computer can execute the display control method according to claims 18 to 25.

  Exemplary embodiments of a content management system according to the present invention will be explained below in detail with reference to the accompanying drawings.

(First embodiment)
The content management system according to the first embodiment recognizes the viewing status of the viewer using information input from the viewer identification device, the imaging device, and the audio input device, and manages the information in association with the displayed content. In addition, the display content of the content on the display device is accurately controlled.

  FIG. 1 is a block diagram showing a configuration of a content management system 100 according to the first embodiment of the present invention. As shown in the figure, the content management system 100 includes a display device 101, a viewer identification device 102, an imaging device 103, a voice input device 104, a display control device 110, and an ID card 120. .

  The display device 101 includes a display such as a cathode ray tube (CRT) or a liquid crystal monitor (LCD), and is a device that displays image information such as a moving image and a still image, and content such as character information. The purpose of the present invention is to grasp the viewing status of content viewed by a plurality of viewers, and therefore the display device 101 is a display device that can be viewed by a plurality of viewers. A large display device installed in a common space such as a place is assumed.

  The ID card 120 uses an RFID (Radio Frequency Identification), a Bluetooth compatible mobile phone, a wireless IC (Integrated Circuit) card, a wireless function PDA (Personal Digital Assistance), an infrared tag, a barcode, a two-dimensional barcode, and the like. A portable information storage medium that stores information for identifying a viewer. The ID card 120 stores at least a viewer ID that can uniquely identify the viewer as information for identifying the viewer.

  The viewer identification device 102 is a non-contact type identification device that identifies a viewer by reading viewer information stored in the ID card 120. The viewer identification device 102 is installed in the vicinity of the display device 101 so as to identify a viewer who has entered a region where content displayed on the display device 101 can be viewed (hereinafter referred to as a viewing region).

  The imaging device 103 is installed in the vicinity of the display device 101 and photographs a viewer who enters the viewing area of the display device 101, and is configured by any commonly used imaging device such as a digital camera or a video camera. be able to.

  The voice input device 104 is installed in the vicinity of the display device 101 and inputs voices such as cheers, laughter, and applause uttered by the viewer. The voice input device 104 includes any commonly used voice input device such as a microphone. be able to.

  The display control device 110 stores and manages the content to be displayed on the display device 101 in a storage unit, and controls the content to be displayed according to the viewing status of the viewer. As shown in FIG. 1, the display control apparatus 110 includes a viewing status recognition unit 111, a storage control unit 112, a determination unit 113, a notification unit 114, a content storage unit 115, and a viewing status storage unit 116. ing.

  The viewing status recognition unit 111 recognizes whether or not the viewer exists in the viewing area as the viewing status depending on whether or not the viewer identification device 102 has identified the viewer. In addition, the direction and line of sight of the viewer's face and facial expression are recognized as the viewing situation from the image captured by the imaging device 103. Furthermore, a response to the viewer's content such as cheers or applause is recognized as a viewing situation from the voice input by the voice input device 104.

  Whether or not the viewer exists in the viewing area can be determined based on whether or not the viewer is identified by the above-described viewer identification device 102. As a method for recognizing a face direction / line of sight from an image, any generally used method such as the method described in Patent Document 2 described above can be applied. By recognizing the face direction and line of sight, it is possible to determine whether or not the viewer is actually viewing the displayed content.

  As a method for recognizing facial expressions from an image, a method using an optical flow, a method using a hidden Markov model, or the like can be applied. In addition, as a method for recognizing cheers or applause from speech input by a microphone or the like, a spectrum analysis method, an LPC method, or the like can be applied. Note that these are merely examples, and the present invention can be configured so as to apply any other conventionally used method.

  The storage control unit 112 executes processing for reading out the content to be displayed from the content storage unit 115 and outputting it, and processing for storing the content and the viewing status of the viewer for the content in the viewing status storage unit 116 in association with each other. is there. The storage control unit 112 corresponds to the output unit in the present invention.

  The determination unit 113 extracts the viewing status of the viewers existing in the viewing area from the viewing status storage unit 116, and from the extracted viewing status and the priority order for displaying the content acquired from the content storage unit 115, next The content to be displayed to the viewer is determined.

  The notification unit 114 notifies the viewer of information that prompts the viewing of the content that the determination unit 113 determines to display, and can be configured to notify by e-mail, for example. This is merely an example, and any method can be applied as long as it notifies the viewer of information that prompts viewing of the content.

  The content storage unit 115 is a storage unit that stores content to be displayed on the display device 101, and can be configured by any commonly used storage unit such as an HDD (Hard Disk Drive), an optical disk, or a memory card. The content storage unit 115 stores the content to be displayed by the content management table 115a.

  FIG. 2 is an explanatory diagram showing an example of the data structure of the content management table 115a. As shown in the figure, the content management table 115a stores the content ID for uniquely identifying the content, the content name, the content length (shooting time), and the display priority in association with each other. ing.

  The viewing status storage unit 116 is a storage unit that stores the content stored in the content storage unit 115 and the viewing status of the content in association with each other, and is used for all commonly used storage such as an HDD, an optical disc, and a memory card. It can be configured by means. The viewing status storage unit 116 stores the viewing status of content by a viewing time table 116a, a viewing status table 116b, and an audio table 116c.

  The viewing time table 116a manages content displayed during the time from when the viewer enters the viewing area to when he leaves. The viewing situation table 116b stores the details of the viewing situation such as how the viewer was viewing the content within the time stored in the viewing time table 116a. The sound table 116c stores the result of recognizing the viewer's reaction to the content by sound.

  FIG. 3 is an explanatory diagram showing an example of the data structure of the viewing time table 116a. As shown in the figure, the viewing time table 116a has entered the viewing area, the viewing status ID for uniquely identifying the viewing status, the content ID, the viewer ID for uniquely identifying the viewer. The position (relative value with respect to the length of the content) and the position (relative value with respect to the length of the content) exiting from the viewing area are stored in association with each other.

  For example, in the figure, during the display of the content identified by the content ID = 0001, the viewer identified by the viewer ID = 1001 starts from the beginning of the content (viewing area entry = 0 minutes) to the end of the content. The data stored in the viewing time table 116a when the user is in the viewing area until the viewing area exit = 15 minutes is the same as the content length = 15 minutes is shown.

  FIG. 4 is an explanatory diagram showing an example of the data structure of the viewing situation table 116b. As shown in the figure, the viewing status table 116b includes a viewing status ID for uniquely identifying the viewing status, a position where viewing is started (relative value to the length of the content), and a position where viewing is ended (content) Relative to the length of the video) and the viewing status are stored in association with each other.

  For example, in the figure, the viewing start position is divided into three parts of 0 minutes, 5 minutes, and 10 minutes corresponding to the data represented by the viewing state ID = 2001 in the viewing time table 116a. The viewing status is stored. Specifically, when the viewing start / end is from 0 to 5 minutes, the viewing status “not viewing” is indicated because the viewer's line of sight is not facing the display device 101. When the viewing situation “sadness” is 10 to 15 minutes from the facial expression, the viewing situation “surprise” is stored from the facial expression.

  FIG. 5 is an explanatory diagram showing an example of the data structure of the voice table 116c. As shown in the figure, the voice table 116c includes a content ID, a viewer ID, a voice recognition start position (a relative value with respect to the length of the content), and a voice recognition end position (a relative value with respect to the length of the content). The voice recognition result is stored in association with each other.

  For example, in the same figure, the content represented by content ID = 0001 is viewed by the viewer represented by viewer ID = 1001, and cheers scream from 3 minutes to 4 minutes from the start of content display. The viewing status is stored.

  Next, content display / viewing status storage processing by the content management system 100 according to the first embodiment configured as described above will be described. FIG. 6 is a flowchart showing an overall flow of the content display / viewing status storage process according to the first embodiment.

  First, the viewer identification device 102 stores the viewer in front of the display device 101, that is, the viewer in the viewing area of the display device 101, in the ID card 120 held by the viewer. Identification is made by reading the information (step S601). For example, by storing the viewer ID in the ID card 120, the viewer identification device 102 can identify the viewer by reading the viewer ID.

  Next, the determination unit 113 of the display control apparatus 110 extracts the viewing status of the viewer recognized in step S601 from the viewing status storage unit 116 using the viewer ID as a search key (step S602). Specifically, data including a viewer ID that matches the viewer ID of the viewer recognized in step S601 is retrieved from the viewing time table 116a, and data including the viewing status ID included in the retrieved data is obtained. Extracted from the viewing status table 116b.

  Next, the determination unit 113 determines the content to be displayed on the display device 101 from the viewing status extracted in step S602 and the content display priority stored in the content management table 115a (step S603).

  For example, in the example shown in FIGS. 2 to 4, since the viewer with viewer ID = 1001 is extracted from the viewing status of “not viewing” content from 0 minutes to 5 minutes of the content with content ID = 0001, It can be configured to determine that the content with content ID = 0001 should be displayed again. For example, when it is determined that the content with content ID = 0002 is “not viewed”, content ID = 0001 (priority = 1) stored in the content management table 115a should be displayed. Select as content.

  In this way, the viewing status such as “not viewing” is obtained from the viewer's face orientation / gaze recognized by the viewing status recognition unit 111, and which content is to be displayed next depending on the obtained viewing status. It can be configured to determine whether or not. Here, the content to be displayed is determined using the past viewing situation. However, the viewer recognizes whether or not the viewer is currently looking at the display device 101, and the view is turned according to the result. The content to be displayed for the viewer may be determined.

  Further, the content to be displayed may be determined using only the viewing time table 116a. For example, as shown in FIG. 3, when data represented by content ID = 0001 and viewer ID = 1003 does not exist in the viewing time table 116a, the viewer identified by the viewer ID is content ID = 0001. Means that the content is not present in the viewing area at the time of displaying the content identified by, that is, the content is not viewed at all.

  Therefore, it may be determined that the content identified by the content ID = 0001 should be displayed next for the viewer identified by the viewer ID = 1003. At this time, the content identified by the viewer identified by the viewer ID = 1003 may be displayed regardless of whether the viewer is currently looking at the display device 101 or not. This is because, since the content that has already been viewed is displayed, the viewer may not be looking at the display device 101 in some cases.

  In this way, it can be configured to determine which content should be displayed next only by whether or not the viewer is in the viewing area. In addition, the content to be displayed next may be determined based on the facial expression of the viewer or the viewer's reaction obtained as a result of voice recognition.

  For example, select the content that most appeals to the viewer from the facial expressions of other viewers and the voice response such as cheers and applause. However, it can be configured to display with priority.

  In step S603, after the determination unit 113 determines the content to be displayed, the storage control unit 112 acquires the content from the content storage unit 115 and outputs the content to the display device 101 (step S604).

  Next, the display device 101 displays the content output from the storage control unit 112 (step S605), and the imaging device 103 captures a viewer who is viewing the content (step S606), and voice input is performed. The device 104 inputs a voice uttered by the viewer (step S607).

  Next, the viewing status recognition unit 111 recognizes the viewing status of the viewer from the image captured by the imaging device 103 and the audio input by the audio input device 104 (step S608). Specifically, as described above, the orientation and line of sight of the viewer's face are recognized from the image to determine whether or not the viewer is actually viewing, and the facial expression of the viewer is recognized. In addition, the voice recognizes a reaction such as cheers / applauses shown to the content by the viewer.

  When the viewer leaves the viewing area while displaying the content, the viewing state recognition unit 111 uses the result that the viewer identification device 102 can no longer identify the viewer, It is possible to recognize the viewing situation that the area no longer exists.

  Next, the storage control unit 112 associates the content ID of the displayed content, the viewer ID of the viewer existing in the viewing area, and the viewing status recognized by the viewing status recognition unit 111, thereby viewing the viewing status. It memorize | stores in the memory | storage part 116 (step S609). In this way, the viewing status of the displayed content can be accurately stored for each individual viewer, and can be used as a reference for evaluation of the content content and determination when the content is next displayed. .

  For example, it is possible to recognize and memorize that the viewer has gone away while the content is displayed, the facial expression of the viewer, the voice response, which part of the content attracted the viewer's interest, It is possible to determine which part should be improved.

  Next, the viewer identification device 102 determines whether or not there is a viewer in front of the display device 101, that is, in the viewing area (step S610), and if present (step S610: YES), step S601. Return to and repeat the process. If there is no viewer (step S610: NO), the content display / viewing status storage process is terminated.

  Note that the notification unit 114 may notify the viewer of information that prompts viewing of the content that the determination unit 113 determines to display by mail or the like. For example, after the content to be displayed is determined in step S603 and until it is displayed on the display device 101 in step S605, the display of the content will be started for the viewer who should view the content. The notification mail 114 can be configured to transmit the described mail. At this time, the mail may be transmitted only when the priority is higher than a certain threshold.

  By providing such a notification function, it is possible not only to accurately store the viewing status and accurately determine the content to be displayed to the viewer, but also to ensure that important content can be viewed thoroughly. is there.

  If there are a plurality of viewers in front of the display device 101, the content to be displayed is determined for each viewer, and the content determined to be displayed to the largest number of viewers is next. The content may be selected as content to be displayed on the screen. In addition, when there is content with a high priority, the content may be displayed with priority regardless of the number of viewers determined to be displayed.

  As described above, in the content management system according to the first embodiment, the viewing status of the content displayed on the display device, the face direction / line of sight recognized from the image captured by the imaging device, facial expression, It can be obtained as a response to the viewer's content such as cheers and applause recognized from the voice input device, and these can be accurately stored in association with the content for each viewer individually identified by the viewer identification device. . Further, the content to be displayed next can be accurately determined using the stored viewing status of each individual viewer.

(Second Embodiment)
The content management system according to the second exemplary embodiment includes one communication device for each set of display device, viewer identification device, imaging device, and audio input device, and displays viewing statuses transmitted from a plurality of communication devices. The display control device provided with the receiving communication means collectively manages the viewing status of the content on the plurality of display devices and accurately controls the display contents of the content on the plurality of display devices.

  FIG. 7 is a block diagram showing a configuration of a content management system 700 according to the second embodiment of the present invention. As shown in the figure, the content management system 700 includes a display device 101, a viewer identification device 102, an imaging device 103, a voice input device 104, a communication device 705, a display control device 710, and an ID card 120. And. Further, the communication device 705 and the display control device 710 are connected via a network 730. As shown in the figure, in the second embodiment, a set of five devices, a display device 101, a viewer identification device 102, an imaging device 103, a voice input device 104, and a communication device 705, is provided. Are connected to one display control device 710.

  The display control device 710 includes a viewing status recognition unit 111, a storage control unit 112, a determination unit 113, a notification unit 114, a content storage unit 115, a viewing status storage unit 116, and a communication unit 717. .

  The content management system 700 in the second embodiment differs from the content management system 100 in the first embodiment in that a communication device 705 is added and a communication unit 717 is added to the display control device 710. Other configurations and functions are the same as those in FIG. 1, which is a block diagram showing the configuration according to the first embodiment, and thus are denoted by the same reference numerals and description thereof is omitted here.

  The communication device 705 transmits the viewer information identified by the viewer identification device 102, the viewer's image captured by the imaging device 103, and the voice uttered by the viewer input by the audio input device 104 to the display control device 710. To do. In addition, it receives content data to be displayed transmitted from the display control device 710.

  The communication unit 717 receives viewer information, images, and sound transmitted from the communication device 705 and transmits data of content to be displayed to the communication device 705. The communication unit 717 receives data from a plurality of communication devices and transmits data to the plurality of communication devices.

  Note that the network 730 may be a wired LAN (Local Area Network), a wireless LAN, or the Internet, or any other network configuration may be applied. As a communication protocol between the communication device 705 and the communication unit 717, any generally used protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol) can be applied.

  Next, content display / viewing status storage processing by the content management system 700 according to the second embodiment configured as described above will be described. FIG. 8 is a flowchart showing the overall flow of the content display / viewing status storage process in the second embodiment. The second embodiment is different from the content display / viewing status storage processing in the first embodiment in that data is transmitted to and received from the display control device 710 via the communication device 705.

  Specifically, first, the communication device 705 transmits the viewer information identified by the viewer identification device 102 in step S801 to the display control device 710 (step S802), and the communication unit 717 of the display control device 710 then transmits it. Is different (step S803).

  In addition, the communication unit 717 transmits the content output by the storage control unit 112 in step S806 to each display device (step S807), and the communication device 705 corresponding to each display device receives the content (step S808). ) Is different.

  Further, the communication device 705 transmits the image captured by the imaging device 103 in step S810 and step S811 and the sound input by the audio input device 104 (step S812), and the communication unit 717 receives it (step S813). Is different.

  Other processes include step S601 in step S801, steps S604 to S806 in steps S602 to S604, steps S809 to S811 in steps S605 to S607, steps S814 to S815 in steps S608 to S609, and steps S816. Corresponds to step S610, and the processing contents thereof are the same, and the description thereof is omitted.

  As described above, in the second embodiment, the communication units 717 of the plurality of communication devices 705 and the display control device 710 transmit and receive information related to content display. It is possible to manage the viewing status of the viewers collectively. Therefore, there is an advantage that the display content can be controlled such that the content displayed on one display device is not displayed on another display device.

  In addition, instead of displaying the same content on a plurality of display devices, viewers present in the viewing area of each display device are identified by the viewer identification device 102, and each display device is identified according to the identified viewer. Display control such as changing the content to be displayed on the screen is possible.

(Modification)
The present invention is not limited to the first embodiment and the second embodiment described above, and can be variously modified as exemplified below.

  Up to now, the content was considered as one unit as a unit for managing the viewing situation, but as described below, the viewing situation may be managed with a scene obtained by further subdividing the content as one unit. This makes it possible to more accurately grasp the viewing status of each viewer for each content.

  9 to 11 are explanatory diagrams illustrating examples of the content storage unit 115 and the viewing state storage unit 116 when the viewing state is managed for each scene. FIG. 9 is an explanatory diagram showing an example of the data structure of the content management table 915a.

  As shown in FIG. 9, the content management table 915a includes a content ID for uniquely identifying content, a scene ID for uniquely identifying a scene included in the content, a scene name, a scene length, and the like. , And the priority order are stored in association with each other. In this way, the content management table 915a divides one content into a plurality of scenes identified by scene IDs, and manages the name, length, and priority for each scene. Is different. Note that a table for managing the content name, content length, and priority order may be provided separately for each content.

  FIG. 10 is an explanatory diagram showing an example of the data structure of the viewing time table 1016a. As shown in the figure, the viewing time table 1016a has entered the viewing area, the viewing status ID for uniquely identifying the viewing status, the scene ID, the viewer ID for uniquely identifying the viewer. The position and the position where the user leaves the viewing area are stored in association with each other. It differs from the viewing time table 116a described above in that a scene ID is stored instead of a content ID. With such a data structure, it is possible to store the viewing status for each scene.

  FIG. 11 is an explanatory diagram showing an example of the data structure of the voice table 1116c. As shown in the figure, the voice table 1116c stores a scene ID, a viewer ID, a voice recognition start position, a voice recognition end position, and a voice recognition result in association with each other. It differs from the audio table 116c described above in that a scene ID is stored instead of a content ID. With such a data structure, it is possible to store a speech recognition result for each scene.

  FIG. 12 is an explanatory diagram illustrating a hardware configuration of the display control device according to the first and second embodiments. As shown in the figure, a display control device according to the first and second embodiments includes a control device such as a CPU (Central Processing Unit) 1201, a ROM (Read Only Memory) 1202, and a RAM (Random Access Memory) 1203. In addition to a storage device such as a communication I / F 1204 and a bus 1210 for connecting these components, an external storage device such as an HDD and a CD drive device, a display device such as a display device, and an input such as a keyboard and a mouse The apparatus is provided with a hardware configuration using a normal computer.

  The display control program executed by the display control apparatus according to the first and second embodiments is a file in an installable format or an executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD ( The program is recorded on a computer-readable recording medium such as Digital Versatile Disk).

  The display control program executed by the display control apparatus according to the first and second embodiments is stored on a computer connected to a network such as the Internet, and is provided by being downloaded via the network. You may do it. Further, the display control program executed by the display control devices of the first and second embodiments may be provided or distributed via a network such as the Internet.

  Further, the display control programs of the first and second embodiments may be provided by being incorporated in advance in a ROM or the like.

  The display control program executed by the display control devices of the first and second embodiments has a module configuration including the above-described units (viewing state recognition unit, determination unit, storage control unit, notification unit, communication unit). As actual hardware, a CPU (processor) reads out and executes a display control program from the storage medium, so that each unit is loaded onto the main storage device and generated on the main storage device. Yes.

  As described above, the content management system, the display control apparatus, the display control method, and the display control program according to the present invention manage the content viewing status and control the content to be displayed according to the viewing status, Suitable for display control device.

It is a block diagram which shows the structure of the content management system concerning 1st Embodiment. It is explanatory drawing which shows an example of the data structure of a content management table. It is explanatory drawing which shows an example of the data structure of a viewing-and-listening time table. It is explanatory drawing which shows an example of the data structure of a viewing condition table. It is explanatory drawing which shows an example of the data structure of an audio | voice table. It is a flowchart which shows the whole flow of the content display and viewing condition memory | storage process in 1st Embodiment. It is a block diagram which shows the structure of the content management system concerning 2nd Embodiment. It is a flowchart which shows the flow of the whole content display and viewing condition memory | storage process in 2nd Embodiment. It is explanatory drawing which shows an example of the data structure of a content management table. It is explanatory drawing which shows an example of the data structure of a viewing-and-listening time table. It is explanatory drawing which shows an example of the data structure of an audio | voice table. It is explanatory drawing which shows the hardware constitutions of a display control apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Content management system 101 Display apparatus 102 Viewer identification apparatus 103 Imaging apparatus 104 Audio | voice input apparatus 110 Display control apparatus 111 Viewing condition recognition part 112 Storage control part 113 Judgment part 114 Notification part 115 Content storage part 115a Content management table 116 Viewing condition memory | storage Unit 116a Viewing time table 116b Viewing status table 116c Audio table 120 ID card 700 Content management system 705 Communication device 710 Display control device 717 Communication unit 730 Network 915a Content management table 1016a Viewing time table 1116c Audio table 1201 CPU
1202 ROM
1203 RAM
1204 Communication I / F
1210 Bus

Claims (26)

A display device for displaying content;
A viewer identification device for identifying a viewer existing in a viewing area, which is an area where the content displayed on the display device is viewable, by a portable information storage medium held by the viewer;
An imaging device for photographing the viewer identified by the viewer identification device;
In a content management system comprising: a display control device that manages content displayed on the display device and controls display of the content;
The display control device includes:
Viewing status recognition means for recognizing the viewing status of the viewer based on the information of the viewer identified by the viewer identification device and the image taken by the imaging device;
Viewing status storage means for storing the content displayed by the display device and the viewing status recognized by the viewing status recognition means in association with each other;
A content management system comprising: A display device for displaying content;
A viewer identification device for identifying a viewer existing in a viewing area, which is an area where the content displayed on the display device is viewable, by a portable information storage medium held by the viewer;
An imaging device for photographing the viewer identified by the viewer identification device;
A display control device that manages content to be displayed on the display device and controls display of the content;
In a content management system comprising: a communication device that transmits and receives information about content including the information of the viewer identified by the viewer identification device and the image captured by the imaging device and the content to be displayed;
The display control device includes:
Communication means for transmitting / receiving information related to the content with at least one of the communication devices;
Viewing status recognition means for recognizing the viewing status of the viewer based on the information of the viewer received by the communication means and the image taken by the imaging device;
Viewing status storage means for storing the content displayed by the display device and the viewing status recognized by the viewing status recognition means in association with each other;
A content management system comprising:   3. The display control device according to claim 1, further comprising a determination unit that determines a content to be displayed on the display device based on the viewing status stored in the viewing status storage unit. Content management system. The viewing status recognition means recognizes the viewer's face direction or line-of-sight direction as the viewing status,
The said determination means determines the content which should be displayed on the said display apparatus based on the direction of the said viewer's face memorize | stored in the said viewing condition memory | storage means, or the direction of eyes | visual_axis. Content management system. The viewing status recognition means recognizes whether the viewer exists in the viewing area as the viewing status,
The content management system according to claim 3, wherein the determination unit determines content to be displayed on the display device based on whether or not the viewer exists in the viewing area. The viewing status recognition means recognizes the facial expression of the viewer as the viewing status,
The content management system according to claim 3, wherein the determination unit determines a content to be displayed on the display device based on the facial expression of the viewer stored in the viewing state storage unit. A voice input device for inputting voice uttered by a viewer who is watching the content;
The viewing status recognition means recognizes a reaction to the viewer's content as the viewing status based on the voice input by the voice input device;
The content management system according to claim 3, wherein the determination unit determines a content to be displayed on the display device based on a reaction to the content of the viewer stored in the viewing state storage unit. The display control device further includes content storage means for storing the content to be displayed on the display device and the priority order for displaying the content in association with each other,
8. The determination unit according to claim 3, wherein the determination unit determines a content to be displayed on the display device based on the priority order stored in the content storage unit and the viewing status. The content management system described in 1.   9. The display control apparatus according to claim 3, further comprising notification means for notifying a viewer of information prompting the viewer to view content that the determination means determines to display. The content management system described. Information of the viewer identified by the viewer identifying device that identifies a viewer existing in a viewing area, which is an area where content displayed on the display device can be viewed, by a portable information storage medium possessed by the viewer; and Viewing status recognition means for receiving an input of an image captured by an imaging device that captures the viewer, and recognizing the viewing status of the viewer based on the received viewer information and the captured image;
Viewing status storage means for storing the content displayed by the display device and the viewing status recognized by the viewing status recognition means in association with each other;
Determination means for determining content to be displayed on the display device based on the viewing situation stored in the viewing situation storage means;
Output means for outputting the content determined by the determination means to be displayed;
A display control apparatus comprising: Further comprising communication means for transmitting and receiving information of the viewer identified by the viewer identification device and an image captured by the imaging device;
The viewing status recognition means receives the viewer information received by the communication means and the input of the image taken by the imaging device, and based on the received viewer information and the taken image, the viewer's information The display control apparatus according to claim 10, wherein a viewing situation is recognized. The viewing status recognition means recognizes the viewer's face direction or line-of-sight direction as the viewing status,
The said determination means determines the content which should be displayed on the said display apparatus based on the direction of the said viewer's face memorize | stored in the said viewing condition memory | storage means, or the direction of eyes | visual_axis. The display control apparatus described. The viewing status recognition means recognizes whether the viewer exists in the viewing area as the viewing status,
The display control apparatus according to claim 10, wherein the determination unit determines a content to be displayed on the display device based on whether or not the viewer exists in the viewing area. The viewing status recognition means recognizes the facial expression of the viewer as the viewing status,
The display control according to claim 10 or 11, wherein the determination unit determines a content to be displayed on the display device based on a facial expression of the viewer stored in the viewing state storage unit. apparatus. The viewing status recognition means accepts an input of audio uttered by a viewer who is viewing content input by an audio input device, recognizes a reaction to the viewer's content as the viewing status based on the received audio,
The display control according to claim 10 or 11, wherein the determination unit determines a content to be displayed on the display device based on a reaction to the content of the viewer stored in the viewing state storage unit. apparatus. Content storage means for storing the content to be displayed on the display device and the priority for displaying the content in association with each other;
16. The determination unit according to claim 10, wherein the determination unit determines a content to be displayed on the display device based on the priority order stored in the content storage unit and the viewing status. The display control device according to one.   The display control apparatus according to any one of claims 10 to 16, further comprising notification means for notifying a viewer of information prompting the viewer to view content determined to be displayed by the determination means. Information of the viewer identified by the viewer identifying device that identifies a viewer existing in a viewing area, which is an area where content displayed on the display device can be viewed, by a portable information storage medium possessed by the viewer; and A viewing state recognition step of receiving an input of an image captured by the imaging device that captures the viewer and recognizing the viewing state of the viewer based on the received information of the viewer and the captured image;
The content displayed on the display device and the viewing status recognized in the viewing status recognition step should be displayed on the display device based on the viewing status stored in the viewing status storage means for storing the content in association with each other. A determination step for determining content;
An output step for outputting the content determined to be displayed by the determination step;
A display control method comprising: A communication step of performing transmission / reception of the information of the viewer identified by the viewer identification device and the image captured by the imaging device;
The viewing status recognition step receives the viewer information received in the communication step and the input of the image captured by the imaging device, and based on the received viewer information and the captured image, the viewer's information The display control method according to claim 18, wherein a viewing situation is recognized. The viewing status recognition step recognizes the viewer's face direction or line-of-sight direction as the viewing status,
20. The determination step according to claim 18 or 19, wherein the content to be displayed on the display device is determined based on a direction of a face or a line of sight of the viewer stored in the viewing status storage unit. The display control method described. The viewing status recognition step recognizes whether the viewer exists in the viewing area as the viewing status,
The display control method according to claim 18, wherein the determination step determines content to be displayed on the display device based on whether or not the viewer exists in the viewing area. The viewing status recognition step recognizes facial expressions of the viewer as the viewing status,
20. The display control according to claim 18, wherein the determination step determines content to be displayed on the display device based on facial expressions of the viewer stored in the viewing status storage unit. Method. The viewing status recognition step accepts an audio input from a viewer who is viewing the content input by the audio input device, recognizes a reaction to the viewer's content as the viewing status based on the received audio,
The display control according to claim 18 or 19, wherein the determination step determines a content to be displayed on the display device based on a reaction to the content of the viewer stored in the viewing status storage unit. Method.   The determining step displays the content on the display device based on the priority order stored in the content storage means for storing the content to be displayed on the display device and the priority order for displaying the content in association with each other. The display control method according to any one of claims 18 to 23, wherein content to be determined is determined.   The display control method according to any one of claims 18 to 24, further comprising a notification step of notifying a viewer of information that prompts viewing of the content that is determined to be displayed by the determination step.   A program for causing a computer to execute the display control method according to any one of claims 18 to 25.

Images