JP4393454B2 - Information presentation system, information presentation method, and information presentation device - Google Patents

Description

  The present invention relates to an information presentation system that presents information related to content that has been viewed by a user in the past, and more particularly, to an information presentation system that presents information related to content that has been viewed according to the current state of the user.

  The experience of watching content such as TV is a pseudo-experience, but the location of the restaurant found on the TV program or the product you wanted, such as the situation where the user is actually concerned, such as passing near the restaurant In order to recall a product at a certain place, it is necessary to be aware of its usage by taking notes in advance.

  Conventionally, as a method of recommending / presenting when a user is placed in an appropriate situation, a method has been proposed in which a user model representing a user's preference is created from viewing results and unviewed content is recommended. .

In this method based on the user model, the user's preference is learned from the user's operation history without considering the marking, and the content is selected prior to the user. For example, Patent Literature 1 proposes a method of selecting and displaying a program recommended to a user from a program guide based on a user preference based on a viewing history in a television program.
JP 2003-114903 A (9th to 14th pages, FIGS. 4 and 5)

  However, the recommendation based on the user model is intended to select unviewed content that the user is likely to like, and is not intended to further utilize the viewed content.

  The present invention has been made in view of the above and presents the user with a past viewing experience by presenting information related to the content that the user has viewed in the past according to the current situation of the user later. An object is to provide an information presentation system, an information presentation method, and an information presentation apparatus.

  The first invention is a content storage means for storing content that has already been viewed, a viewing attribute storage means for storing a viewing attribute of the content, and an input for inputting current situation information of the user who has viewed the content or the surrounding area. Means for collating the input current situation information of the user or surroundings with the viewing attribute of the content, and the collating means at least partially matches the current situation information of the user itself or surroundings. It is an information presentation system comprising presentation means for presenting collated content information that has been viewed to a user.

  According to a second aspect of the present invention, the current status information of the user himself or his / her surroundings input by the input means is the current location information of the user himself / herself or information displayed on a display device being browsed by the user. There is provided an information presentation system according to the first invention.

  According to a third aspect of the invention, the presenting means generates and presents an image clip or message data from the image data or text data in the collated viewed content information. Information provision system.

  According to a fourth aspect of the invention, the viewing attribute storage means stores the identifier of the viewed content, the viewing date and time, and voice or text information as a pair as the viewing attribute. It is an information provision system of description.

  The fifth invention stores the viewed content, stores the viewing attribute of the content, inputs the current status information of the user who has viewed the content or the surroundings, and the input user itself or the surroundings Information comparing current status information and viewing attributes of the content, and presenting the viewed content information that has been verified to match at least partially the current status information of the user or the surroundings to the user It is a presentation method.

  According to a sixth aspect of the present invention, there is provided content storage means for storing the viewed content, viewing attribute storage means for storing the viewing attribute of the content, and reception for receiving current status information of the user who viewed the content or the surrounding area. Means for collating the input current situation information of the user or surroundings with the viewing attribute of the content, and the collating means at least partially matches the current situation information of the user itself or surroundings. The information presenting apparatus includes a transmitting unit that displays the collated and viewed content information on the display device.

  According to the present invention, the information presentation system, the information presentation method, and the information that make the user recall the past viewing experience by presenting information related to the content that the user has viewed in the past according to the current situation of the user later. A presentation device can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The information presentation system according to the present embodiment presents information related to content based on viewing attributes of viewed content managed on a computer.

  An information presentation system according to the present embodiment includes a control device such as a CPU, a storage device such as a ROM and a RAM, an external storage device such as an HDD, a display device such as a display device, and an input device such as a keyboard and a mouse. It can be applied to a general computer equipped with

  In the following, an example is shown in which video or video viewing attributes are presented when work other than television viewing is performed using video content of a television program that the user has viewed in the past. In this embodiment, the video content of the TV program is targeted as the viewing content, but it is not limited to the TV program, but is used as the viewing content. Other video media such as a DVD, audio content, text, Web You may comprise so that electronic data, such as a page, may be made into object.

  FIG. 1 is a block diagram showing a schematic configuration of the information presentation system according to the present embodiment. As shown in the figure, the information presentation system includes a content reproduction unit 110 that reproduces content, a viewed content storage unit 120 that stores the reproduced content, and a viewing attribute acquisition unit 130 that acquires attributes such as viewing date and time. The voice recognition unit 140 and the image recognition unit 150 that perform voice recognition processing and image recognition processing on the reproduced content, the semantic analysis unit 160 that assigns a semantic attribute to the recognition result, and the acquired viewing attribute are stored. A viewing attribute storage unit 170, a situation information input unit 180 for inputting the current situation of the user, a viewing attribute matching unit 190 for matching the inputted situation information and the viewing attribute information, and the user according to the checked viewing attribute Display content generation unit 200 for generating information to be presented, display unit 210 for displaying the generated information, and history actually presented to the user And a display history control unit 220 to manage. Each storage unit can be configured by any commonly used storage means such as an HDD, an optical disk, a memory card, and a RAM.

  Hereinafter, each functional block will be described. The data structure and processing flow constituting each functional block will be described later as necessary.

  The content reproduction unit 110 reproduces a television program that the user views. In addition to the video of the television broadcast itself, the content includes metadata delivered by superimposing the video signal such as EPG, data broadcast, and caption. The viewed content is stored and stored in the viewed content storage unit 120 each time, and information that can be acquired by video recognition processing or the like from the video and superposed metadata are extracted from the video by the viewing attribute acquisition unit 130.

  The viewing attribute acquisition unit 130 receives text data obtained from the recognition results of the voice recognition unit 140 and the image recognition unit 150, and uses keywords such as names and place names included in the text data of the viewing date and time and each recognition result as a semantic analysis unit. After extracting using 160, the metadata is superimposed on the video information, the appearance time, and the ID of the original video content and stored in the viewing attribute storage unit 170.

  The voice recognition unit 140 recognizes voice or music in the video information, and outputs the recognized voice or the music title of the recognized music as text data.

  The image recognition unit 150 recognizes partial images such as a person, a building, and a telop in the video, and outputs text data representing the recognized partial image range and the content of the recognition result.

  The semantic analysis unit 160 assigns semantic attributes such as a person name and a place name to words included in the text data.

  The viewing attribute storage unit 170 stores a combination of the keyword and metadata acquired by the viewing attribute acquisition unit 130, the appearance time, and the content ID.

  The status information input unit 180 inputs information that can be measured in real time on a device used by the user, such as a current location of the user and a display device around the user. For example, a display device around the user, a device worn by the user such as a GPS or a wireless tag, or a device that identifies the user by face image recognition or the like may be used.

  The viewed content storage unit 120 stores the video content itself viewed by the user.

  The viewing attribute collation unit 190 collates the information input by the situation information input unit 180 with the information stored in the viewing attribute storage unit 170, and whether there is a corresponding viewing attribute, that is, at least a partially matching viewing attribute. Please check.

  The display content generation unit 200 generates the content to be presented from the viewed content information corresponding to the viewing attribute verified by the viewing attribute verification unit 190. That is, an image clip is generated from the image data in the content information, or message data is generated from the text data in the content information.

  The display unit 210 presents the presentation content determined by the display content generation unit 200 to the user.

  The display history control unit 220 sets a presented flag for content corresponding to information actually presented to the user.

  Next, information presentation processing by the information presentation system according to the present embodiment configured as described above will be described.

  FIG. 2 shows the flow of processing until the viewing attributes are extracted and stored when viewing the television in the present embodiment. When the user reproduces the content (S210) and views it (Yes in S220), the content is sequentially stored in the viewed content storage unit 120 (S230). Further, speech recognition and image recognition are performed on the content being viewed (S240), semantic analysis is performed on the recognized text data, and keywords having semantic attributes such as names of persons and places are extracted at each time ( S250). In addition to these data, the content ID assigned to the viewing content and the metadata superimposed on the program are combined and stored in the viewing attribute storage unit 170 (S250). The above processing is continuously performed while the user views the television program.

  FIG. 3 shows an example of viewing attributes stored in the viewing attribute storage unit 170. When a program is viewed, the content ID, program name, program genre metadata, and date and time actually viewed by the user are stored for each content. In addition, for each chapter in the program, a keyword recognized and detected from voice, telop, and subtitle and an attribute of a semantic analysis result are stored. Further, a presentation flag indicating that the viewing attribute has been presented is also stored as will be described later.

  FIG. 4 shows an example of content stored in the viewed content storage unit 120. A video file corresponding to a content ID for specifying a program is stored, and the stored content can be called and reproduced by referring to the content ID.

  When the video file is recorded in another storage unit (for example, a recording storage unit) and the recorded content is viewed, the viewed content storage unit 120 stores the video corresponding to the content ID for specifying the program. Location information of another storage unit (for example, recording storage unit) in which the file is stored is stored, and content stored in another storage unit (for example, recording storage unit) is called by referring to the content ID , It may be possible to reproduce.

  FIG. 5 shows a flow of processing for presenting information related to a television program that was previously viewed when other activities are being performed in this embodiment.

  First, information input from the status information input unit 180 such as a device used by a user such as a PC, a mobile phone, or a digital TV is received (S510). The input information includes the text of the Web browser displayed on the PC and the location information from the GPS tower mobile phone.

  The input information is collated with each viewing attribute stored in the viewing attribute storage unit 170 by the viewing attribute collation unit 190 (S520).

  FIG. 6 shows a flow of viewing attribute matching corresponding to S530 of FIG. When the input information is text data (Yes in S610), matching is performed by matching with the keyword of each item (S620) (S630). On the other hand, in the case of position information (Yes in S640), by converting the place name and address information into latitude and longitude (S650), the distance is calculated (S660), and it is determined whether or not it exists within a predetermined range. (S670), the collation is performed between the input information and the viewing attribute. The verified viewing attribute is sent to the display content generation unit 200 (S680), and how it is actually displayed is determined.

  FIG. 7 shows an example of determining display contents corresponding to S540 of FIG. In the present embodiment, the content that has been viewed for a certain period of time (Yes in S710) is regarded as the content that the user has viewed with interest, and only the content that has not been presented yet is displayed (No in S720).

  As for the display content, since the user can view the content that has not been watched since it was viewed (No in S730) by simply presenting it like “the restaurant you watched in the other day xx program” without viewing the video, It is determined that only the viewing attribute is displayed (S740). Regarding the content that has been viewed since the viewing (Yes in S730), there is a high possibility that it cannot be remembered only by the viewing attribute, so the video content itself is also presented (S750). In addition, the display method may be determined according to the display device operated by the user.

  The display content generated by the display content generation unit 200 is displayed on the display device being used by the user using the display unit 210 (S550).

  In this way, for example, after watching a restaurant introduction program, for example, when you walk around the restaurant with a mobile phone with built-in GPS, "L When you are viewing a website that displays a list of restaurant information, you can see "The restaurant you saw on the XX program" next to the "△△ restaurant" item you watched on the program. A display like this is added.

  After the information is presented, the viewing history control unit 220 assigns a viewed flag to the viewing attribute in order to prevent the viewing attribute once presented from being displayed many times (S560).

Example 1
FIG. 8 is an explanatory diagram of a usage scene according to the first embodiment. The information presentation system according to the first embodiment includes an HDD recorder and a portable terminal having a GPS function, and presents information related to content viewed in the past based on location information.

  That is, among the functional blocks described in FIG. 1, the mobile terminal side includes a status information input unit 180, a display unit 210, and a display history control unit 220, and other functional blocks are provided on the HDD recorder side. ing.

  (A) A user views the content reproduced by the content reproduction unit 110 on the HDD recorder side on a television.

  (B) The portable terminal side status information input unit 180 having a GPS function transmits GPS information to the HDD recorder side viewing attribute matching unit 190. Then, when the user passes by the shop viewed with the content, the viewing attribute collation unit 190 collates the corresponding viewing attribute from the viewing attribute storage unit 170.

  (C) The display content generation unit 200 generates content for image clip playback or message playback, and transmits the content to the display unit 210 on the mobile terminal side for presentation to the user.

(Example 2)
FIG. 9 is an explanatory diagram of a usage scene according to the second embodiment. The information presentation system according to the second embodiment includes an HDD recorder and a digital television, and presents information related to content viewed in the past based on keywords.

    That is, among the functional blocks described in FIG. 1, the digital television side includes a status information input unit 180, a display unit 210, and a display history control unit 220, and other functional blocks are provided on the HDD recorder side. ing.

  (A) A user views content reproduced by the content reproduction unit 110 on the HDD recorder side on a digital television.

  (B) The status information input unit 180 on the digital television side with the Web browser function transmits text information of the Web page being browsed by the user to the viewing attribute matching unit 190 on the HDD recorder side. Then, using the received text information as a keyword, the user searches for the sights viewed by the content, and the viewing attribute matching unit 190 matches the corresponding viewing attribute from the viewing attribute storage unit 170.

  (C) The display content generation unit 200 generates content for image clip reproduction and presents it to the user on the display unit 210 on the mobile terminal side.

  As described above, in the information presentation system according to the present embodiment, it is possible to easily link the current situation with the user's experience by presenting the content viewed in the past by changing the display format according to the situation. The reason for presentation can be easily explained by specializing in experienced content.

  The information presentation program executed by the information presentation system according to the present embodiment is an installable or executable file that is read by a computer such as a CD-ROM, floppy (R) disk, CD-R, or DVD. It is provided by being recorded on a possible recording medium.

  In addition, the information presentation program executed by the information presentation apparatus according to the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. . The information presentation program executed by the information presentation apparatus according to the present embodiment may be provided or distributed via a network such as the Internet.

  Further, the information presentation program of the present embodiment may be provided by being incorporated in advance in a ROM or the like.

  The information presentation program executed by the information presentation system according to the present embodiment has a module configuration including the above-described units, and as actual hardware, the CPU reads and executes the information presentation program from the storage medium. As a result, the above-described units are loaded on the main storage device, and the above-described units are generated on the main storage device.

  The above-described embodiment is a preferable specific example of the present invention, and thus various technically preferable limitations are attached. However, the embodiments are appropriately combined and changed within a range not departing from the gist of the present invention. It goes without saying that it can be done.

The block diagram which shows schematic structure of the information presentation system concerning this embodiment. The flowchart until a viewing attribute is extracted and stored at the time of television viewing. The figure which shows the example of the viewing-and-listening attribute stored in the viewing-and-listening attribute storage part 170. The figure which shows the example of the content stored in the viewed content storage part. The flowchart which presents the information regarding the television program watched in the past. The flowchart of viewing attribute collation corresponding to S530. The flowchart of the display content determination corresponding to S540. Explanatory drawing of the utilization scene of Example 1. FIG. Explanatory drawing of the utilization scene of Example 2. FIG.

Explanation of symbols

110 content playback unit 120 for playing back content viewed content storage unit 130 viewing attribute acquisition unit 140 speech recognition unit 150 image recognition unit 160 semantic analysis unit 170 viewing attribute storage unit 180 status information input unit 190 viewing attribute matching unit 200 display content generation Unit 210 display unit 220 display history control unit

Claims (5)

Content storage means for storing the viewed content;
Viewing attribute storage means for storing the content identifier, viewing date and time, and audio or text information as the viewing attribute of the content ;
Input means for inputting the current time and situation information of the user himself / herself who viewed the content or the surroundings;
Collation means for collating the input user's own or surrounding current time and situation information with the viewing date and time in the viewing attribute of the content , and voice or text information ;
For the content that has been verified by the verification means to at least partially match the user's own or surrounding current time and situation information , (1) If the date is shallow after viewing, (2) An information presentation system comprising: presentation means for presenting a viewing attribute of the content and the already viewed content to a user when days have passed since the viewing. The user's own or surrounding current time and status information input by the input means is displayed on the position information of the user's own current time or on a display device that the user is browsing at the current time . The information presentation system according to claim 1, wherein the information presentation system is information. 2. The information providing system according to claim 1, wherein the presenting means generates and presents an image clip or message data from the image data or text data in the collated content . The content storage means stores the viewed content,
The viewing attribute storage means stores the content identifier, viewing date and time, and audio or text information as the viewing attribute of the content ,
The input means inputs the current time and situation information of the user himself / herself who viewed the content or the surroundings,
The collation means collates the input user's own or surrounding current situation information with the viewing date and time in the viewing attribute of the content , and voice or character information ,
For the content that has been verified that the presenting means is at least partially matched with the user's own or surrounding current time and situation information , (1) If the date is shallow after viewing, (2) An information presentation method comprising presenting a viewing attribute of the content and the viewed content to a user when days have passed since the viewing. Content storage means for storing the viewed content;
Viewing attribute storage means for storing the content identifier, viewing date and time, and audio or text information as the viewing attribute of the content ;
Receiving means for receiving the current situation information of the user himself or herself who has watched the content;
Collation means for collating the input user's own or surrounding current time and situation information with the viewing date and time in the viewing attribute of the content , and voice or text information ;
For the content that has been verified by the verification means to at least partially match the user's own or surrounding current time and situation information , (1) If the date is shallow after viewing, (2) An information presenting apparatus comprising: a transmission unit that displays a viewing attribute of the content and the viewed content when the number of days has elapsed since viewing.

Images