JP2015154195A - Information processing apparatus, information processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus capable of recommending suitable information in good timing as needed by a user, an information processing method and a program.SOLUTION: The information processing apparatus includes: preference management means for managing the preference of a user with respect to an object included in content; and associated information management means for managing object associated information associated with the object preferred more stronger than a predetermined reference in an associated manner for each user. When the object corresponding to the object associated information is displayed in the content being viewed by the user, an icon for displaying the object associated information is displayed together with main content.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

Broadcast programs are recorded using an information processing apparatus and displayed as a list of thumbnails (see, for example, Patent Document 1).
The invention described in Patent Document 1 relates to “an information processing apparatus, a method thereof, a program thereof, a recording medium recording the program, and a display control apparatus”. Specifically, a plurality of pieces of image information are arranged in series. Video information acquisition means for acquiring video information configured as a data string structure, specific information acquisition means for acquiring specific information for specifying video information, and whether or not the specific information is included in part of the image information A determination means for determining the image information, an image information acquisition means for acquiring the image information including the specific information when the determination means determines that the specific information is included in the image information, and the acquired image information as the video information. And a representative image acquisition means for acquiring a representative image associated with.

JP 2006-140603 A

By the way, the invention described in Patent Document 1 displays a list of one screen of the main part in which CMs are deleted from the contents of recording programs and the like that the user is interested in.
However, when a user searches for a program that he wants to watch from among thumbnails, the user himself has to classify the files into files in advance, and the number of thumbnails increases every day. It was inconvenient.

  Therefore, an object of the present invention is to be able to recommend appropriate information in a timely manner when the user wants it.

  The invention according to claim 1 is a display means for displaying at least content, a user specifying means for specifying a user viewing the content displayed on the display means, and an object for specifying an object included in the content A specifying unit, a preference managing unit that manages a user's preference with respect to the specified object, and a relationship for acquiring object-related information related to the object that is preferred more strongly than a predetermined reference and managing the related information for each user When the object corresponding to the object-related information is displayed on the content viewed by the user linked to the object-related information, the object-related information is selected and executed. An icon for displaying the peripheral edge of the display means Characterized by comprising an icon display means for displaying such it can be seen selected is executable, the.

  According to the present invention, it is possible to recommend appropriate information in a timely manner when the user desires, instead of recommending the content to the dark clouds.

It is a block diagram which shows the hardware constitutions which concern on one Embodiment. It is an example of a block diagram of the software used for the information processing apparatus 100 shown in FIG. It is an example of the flowchart which shows operation | movement of the information processing apparatus shown in FIG. FIG. 2 is an external view of an information processing apparatus 100 and a remote controller 40 as the information processing apparatus illustrated in FIG. 1. It is explanatory drawing about a personal viewer. It is explanatory drawing about a shopping channel. It is explanatory drawing about a personal channel. FIG. 8 is an enlarged view of FIG. 7.

Embodiments of the present invention will be described.
<Overview>
This information processing apparatus does not recommend content to the user in a dark cloud, but recommends appropriate information in a timely manner when the user wants it.
That is, it includes displaying an icon for displaying object-related information together with the main content corresponding to the display of the object in the main content.

<Configuration>
[Hardware]
FIG. 1 is a block diagram illustrating a hardware configuration according to an embodiment.
An information processing apparatus (for example, a television receiver) 100 shown in FIG. 1 includes a receiving unit (tuner) 11, a stream separation unit (DEMUX: demultiplexer) 12, a video decoding unit 13, and a display processing unit (scaler) 14. , Display unit (monitor) 15, personal DB (database) 16, service 17, GPS (Global Positioning System) 18, reception control unit 19, sensor 20, remote control reception unit 21, input means 22, camera 23 And a network connection unit 24.

The receiving unit 11 is a circuit that functions as a tuner that receives terrestrial digital broadcasting, BS (broadcasting satellite) broadcasting, or CS (communication satellite) broadcasting and inputs the received stream to the stream separation unit 12. is there. The reception unit 11 has a function of changing a channel to be received under the control of the reception control unit 19.
The stream separation unit 12 performs DEMUX processing that separates multiplexed streams of video, audio, data, and the like. The stream separation unit 12 inputs a stream related to video among the separated streams to the video decoding unit 13. Since other streams are not directly related to the present invention, the description is omitted.
The video decoding unit 13 decodes a stream related to the input video and inputs it as video data to a subsequent processing block. The stream is not limited. For example, MPEG (Moving Picture Experts Group), H.264. H.264 or the like.
The display processing unit 14 controls the displayable range and size of the stream image (also referred to as content) and the side menu (also referred to as icon) on the display unit 15.
The display unit 15 is a monitor capable of displaying, for example, an HDTV (high-definition television), for example, a liquid crystal display device.

The reception control unit 19 has a function of performing various processes based on data from the reception unit 11, display processing unit 14, personal DB 16, service 17, GPS 18, sensor 20, remote control reception unit 21, input means 22, and camera 23. For example, a microprocessor. The reception control unit 19 includes an extraction unit 19a, a narrowing unit 19b, a collection unit 19c, an image processing unit 19d, a search unit 19e, an analysis unit 19f, a user identification unit 19g, an object identification unit 19h, a preference management unit 19i, and a related information management unit. 1j and icon display means 19k.
The reception control unit 19 has a function of controlling power on / off, channel switching, and the like based on instructions such as power on / off, program switching, and volume control input from the input unit 22 or a remote controller (not shown).

The extraction means 19a has a function of extracting a keyword from data stored in the personal DB 16.
The narrowing-down means 19b has a function of narrowing down interest information by ranking keywords by frequency.
The collection unit 19c has a function of collecting content related to the narrowed interest information.
The image processing means 19d is a first side menu for visual display and search of a user's past life log, and a second side menu for online shopping for products according to the user's preference in cooperation with a shopping site. , And a third side menu for the channels collected for each content collected according to the user's preference is displayed on the display unit 15 together with the main screen for displaying the content.
The selection of the side menu is performed by the operation of the remote controller by the user.
The search unit 19e has a function of searching data related to the user's interest information from the network site connected by the network connection unit 24 based on the user's interest information.
The analysis unit 19f has a function of analyzing the genre, frequency, etc. of the extracted keyword.
The user specifying unit 19g has a function of specifying a user who is viewing the content displayed on the display unit 15 as a display unit. The user specifying means 19g always shoots the front surface of the display unit 15 with the camera 23, specifies that the person is a user when the number of persons watching is singular, and if there are a plurality of persons watching Recognizes that the person holding the remote control is the user.
The object specifying unit 19h has a function of specifying an object included in the content displayed on the display unit 15. The object is of interest to the user who views the main content, and the user's interest information is accumulated separately.
The preference management unit 19i has a function of managing user preferences for the specified object.
The related information management unit 19j has a function of acquiring object related information related to an object that is preferred more strongly than a predetermined standard, and managing the related information for each user.
The icon display means 19k is an icon for displaying the object related information by being selected and executed when the object corresponding to the object related information is displayed on the content viewed by the user linked to the object related information. Is displayed on the periphery of the display means so that it can be seen that it can be selected and executed.
These extracting means 19a, narrowing means 19b, collecting means 19c, image processing means 19d, searching means 19e, analyzing means 19f, user specifying means 19g, object specifying means 19h, preference management means 19i, related information management means 19j, and icon display The means 19k is constituted by software.

The content classification performed in the reception control unit 19 generates a thumbnail that displays a part of the acquired content data, summarizes it for each attribute assigned to each piece of interest information, and basics of processing for information having the same attribute Judgment is made based on whether or not the priority is high for the user based on the instruction history.
Also, high priority means that the number of viewing times and viewing time are measured for each genre, performer, or group of the program viewed by the user, and the program with a large number of viewing times and viewing time is considered highly interested. .

The personal DB 16 as storage means stores interest information divided into files for each user.
The service 17 is an apparatus that stores information obtained when the information processing apparatus 100 is connected to the network by the network connection apparatus 24 in the figure.
The GPS 18 is a device that searches for information related to the current position of the information processing apparatus 100.
The sensor 20 determines whether or not there is a person in the remote control usable area on the front surface of the information processing apparatus 100 and the distance.
The remote control receiving unit 21 exchanges control signals and response signals such as channel switching and volume control with a remote control not shown in the figure.
The input means 22 is, for example, a power button, a channel switching button, a volume button, or an input switching button.
The camera 23 has a function of capturing an image to recognize a user who operates a remote controller (not shown) on the front surface of the information processing apparatus 100 and converting it into an electrical signal. This is used for recognizing a face for each user when there are a plurality of users and associating interest information.
The network connection unit 24 has a function of connecting to a network (not shown).

〔Software〕
FIG. 2 is an example of a configuration diagram of software used in the information processing apparatus 100 illustrated in FIG.
The user's action 31 and the user's state 32 are analyzed according to TPO (time position occasion) and stored in the personal DB (database) 16. For example, an HDD (hard disk drive) is used for the personal DB 16.
The TPO includes a user action 31 and a user state 32 in addition to who the user is. Examples of the user behavior 31 include TV / recorded content, SNS / Twitter (Twitter “registered trademark”), mail / browser, search, scheduler, and shopping.
TV / recorded content means broadcast time, channel, program name, genre, performer name, recording time, recording mode, and the like.
SNS is an abbreviation for social networking service, and is a website that promotes and supports connections between people. It is a membership-based service that provides means and places to facilitate communication between friends and acquaintances, and provides new relationships through hobbies and preferences, residential areas, and schools of origin. Twitter is an information service that allows you to post short sentences called “tweets” of up to 140 characters, and is provided by Twitter.
The user's interest information can be obtained by analyzing keywords from topics using SNS or Twitter.
The mail is information that the user exchanges with another person. If the mail is analyzed, the user's interest information can be obtained.
The browser is software for searching for and displaying information on the Internet, and examples thereof include Netscape Navigator and Internet Explorer. Interesting information can be obtained by analyzing keywords when the user uses the browser.
The search uses the keyword to obtain information that the user wants to know, so that the user's interest information can be obtained from the keyword.
The scheduler is software for managing a personal schedule, and can obtain user interest information from a keyword of the schedule.
Since shopping remains in the history of when and how many products are purchased by the user, the user's interest information can be obtained.

On the other hand, examples of the user state 32 include a position, movement detection means, facial expression (degree of concentration), and emotional state.
The position is a position when the user is using the information processing apparatus 100, and the position information when the user is using the information processing apparatus 100 can be grasped from the GPS 18 of the information processing apparatus 100.
The movement detection means is means for grasping, for example, whether the user is moving on a train, moving on a car, or moving on foot, such as an acceleration sensor or a vibration sensor. Sensor. This movement detection means is used when the user uses a smart phone as a remote control.
The facial expression (concentration) is determined by image recognition processing such as whether the user's facial expression is hard or soft, or whether the user is staring at a specific part of the screen, bored, or dozing.
The emotional state is determined by image recognition processing, such as whether the user shows emotion, emotional expression, or expressionlessness (true face).

The data stored in the personal DB 16 is sent to the recommendation engine 34 as necessary. The recommendation engine 34 is software for providing data determined to be necessary to the user, and is connected to the service 17. The recommendation engine 34 performs a search query and a search result with the service 17.
The recommendation engine 34 includes an important keyword extracting unit 35 that extracts important keywords, and a narrowing unit 36 that narrows down by user ranking. Important keywords are keywords that have different interests and interests for each user, and have a high frequency of proper nouns (for example, personal names, character names, song names, program names, country names, city names, place names, competition names, game names, etc.) Is mentioned. The user ranking is a ranking of the keywords extracted for each user by statistical mathematical processing in order of frequency. The narrowing down means ensuring that the ranked keywords are selected from the top to a predetermined rank and can be provided immediately.

  The recommendation result 37 is information provided to the user when it is determined that the recommendation should be recommended to the user. For example, an event related to the user's favorite talent, singer, luxury goods, sports, travel, broadcast program, goods, etc. Information.

<Operation>
FIG. 3 is an example of a flowchart showing the operation of the information processing apparatus shown in FIG.
First, when the TPO determination is started, the information extraction engine is operated (step S1), and information is exchanged with the personal DB (steps S2 and S5).
Next, the search engine is activated (step S3), and a search query and a search result are performed with the service (step S6).
The matching engine is activated (step S3), important keywords are extracted, narrowing down by user ranking is performed, and a recommendation result is obtained (step S4).

<Personal functions>
When the information processing apparatus 100 shown in FIG. 1 is turned on, what the user wants to see is prepared without being divided into broadcast programs, recorded programs, and web contents.
Such screen transition of the information processing apparatus 100 will be described with reference to FIGS.
FIG. 4 is an external view of the information processing apparatus 100 and the remote controller 40 shown in FIG.
A screen 103 of the information processing apparatus 100 includes a main screen 101 that reproduces content such as a broadcast program and a recorded program, and a side menu 102. The side menu 102 includes, for example, a personal viewer 102a as a first side menu, a shopping channel 102b as a second side menu, and a personal as a third side menu. A channel (hereinafter referred to as a personal channel) 102c is provided, and any one of them can be selected by operating a button on the remote controller 40.
Since each side menu 102a to 102c is associated with content corresponding to the user's preference, usually, for example, as shown in FIG. 4, "Personal Viewer", "Shopping Channel", and "Personal Channel" Although only casual characters and human symbols are displayed, the user can obtain information desired by the user by selecting any one of these side menus 102a to 102c.

  The personal viewer 102a is a function that can visually display and search a user's past life log. The shopping channel 102b is a function that enables online shopping of products according to user preferences in cooperation with the shopping hub. The personal channel 102c is arranged to change the arrangement so that the user can easily select it. The personal channel 102c is collected according to the user's preference, the video system is collected on the main frame of the main screen, and other related products are sub-windows of the main screen. It is a channel to arrange in.

On the other hand, the remote control 40 has a “like button” in addition to the channel switching button and the volume control button. For example, when the user is interested in what the performer has while viewing the program, the remote controller 40 operates the cursor. When the “like button” is pressed, the information is stored in, for example, the personal DB 16 of the information processing apparatus 100 as a storage unit.
Note that reference numeral 104 in FIG. 4 denotes a reproduction start icon for the recorded program “Angry”. A recorded program is played by moving a cursor (not shown) to the playback start icon 104 and clicking it by operating the buttons on the remote controller 40.

The personal viewer, shopping channel, and personal channel will be described below. The contents of these side menus are switched according to the TPO.
<Personal viewer>
FIG. 5 is an explanatory diagram of the personal viewer.
When the personal viewer 102a is selected from the side menu 102 of the information processing apparatus 100 shown on the left in FIG. 5 by operating the buttons on the remote controller 40, the main screen 101 shown in the lower right of FIG. Displayed on the device 100. On the main screen 101, thumbnails of programs that the user has viewed in the past are displayed. When the user thinks "There is something familiar, what is this?" When the user drops a thumbnail familiar to the user by operating the remote control 40, a thumbnail like " [Disc 1 “Like the shining sun / The Bird with Wings”… Observed… Viewing 3:29 [4:12] ”is displayed. When the user purchases the CD, the user can easily purchase the CD by selecting the side menu 102b to shift to the shopping channel site screen.

<Shopping channel>
FIG. 6 is an explanatory diagram of a shopping channel.
As shown in FIG. 6, it is assumed that the pastry kitchen is displayed on the main screen 101 of the information processing apparatus 100-1.
When the user U1 who is viewing this screen thinks that he / she wants to eat when he / she looks at the Apple Pie every week, and selects the shopping channel 102b in the side menu 102 with the remote control 40, “Mamazon” or “Rakuo” The main screen 101-1 acquired by the partner service such as the above is obtained. On the upper left of the main screen 101-1, a mail order site for "Apple Pie" is displayed. If the user U1 wants to purchase the apple pie, he can purchase it at the mail order site.
Also, thumbnails are displayed on the main screen 101-2 in FIG. 6, and when the user U2 finds an icon of a program theme song for which “Like” was pressed with the remote controller 40 while viewing the program, the user U2 shopping. When channel 102b is selected with remote control 40, main screen 101-2 is displayed. It is assumed that “Like a shining sun / The Bird with Wings… approximately ... in stock” is displayed on the main screen 101-2.
The purchase is facilitated by the user U2 selecting the shopping channel 102b with the remote control 40 and changing to the shopping channel site screen.

<Personal channel>
FIG. 7 is an explanatory diagram of the personal channel, and FIG. 8 is an enlarged view of FIG.
In the lower left of FIG. 7, a recording screen of the broadcast program “Angry” is displayed on the main screen 101 together with the side menu 102, and thumbnails of programs that the user has previously viewed, downloaded, or recorded are arranged around the main screen 101. ing. These are images of broadcast programs recorded in the information processing apparatus 100.
For these programs, when the personal channel 102c in the side menu 102 is selected by operating a button on the remote controller 40, a channel “Ori” is formed as a user-preferred channel as shown in the upper right.
That is, when the information processing apparatus is turned on as shown in FIG. 8, the main screen 101 displays the headline 101a, the main frame TV program 101b, the subframe 101c, the favorite frame 101d, the product frame 101e related to the favorite frame 101d, and the previous time. Are recorded into a recorded program 101f and a moving image site 101g.

  As described above, according to the present embodiment, it is possible to recommend appropriate information in a timely manner when the user desires, instead of recommending the content to the dark clouds.

<Program>
The information processing apparatus according to the present invention described above is realized by a program that causes a computer to execute processing. Examples of the computer include general-purpose computers such as personal computers and workstations, but the present invention is not limited to this. Therefore, as an example, a case where the function of the present invention is realized by a program will be described below.

For example,
In the computer of the information processing device,
A procedure in which the display means displays at least the content;
A procedure in which the user specifying means specifies a user who is viewing the content displayed on the display means;
A procedure by which the object identification means identifies an object included in the content;
A procedure in which the preference management means manages the user's preference for the identified object;
A procedure in which related information management means acquires object related information related to an object that is preferred more strongly than a predetermined standard, and manages the information related to each user,
When the icon display means displays an object corresponding to the object related information on the content viewed by the user linked to the object related information, an icon for displaying the object related information is selected and executed. , A procedure for displaying on the periphery of the display means so that it can be selected and executed,
A program for executing

Thus, the information processing apparatus according to the present invention can be realized anywhere as long as there is a computer environment capable of executing the program.
Such a program may be stored in a computer-readable storage medium.

<Storage medium>
Here, examples of the storage medium include computer-readable storage media such as CD-ROM, flexible disk (FD), and CD-R, semiconductor memories such as flash memory, RAM, ROM, and FeRAM, and HDD.

  CD-ROM is an abbreviation for Compact Disc Read Only Memory. A flexible disk means Flexible Disk: FD. CD-R is an abbreviation for CD Recordable. RAM is an abbreviation for Random-Access Memory. ROM is an abbreviation for Read-Only Memory. FeRAM is an abbreviation for Ferroelectric RAM and means a ferroelectric memory. HDD is an abbreviation for Hard Disc Drive.

  The above-described embodiment shows an example of a preferred embodiment of the present invention, and the present invention is not limited thereto, and various modifications can be made without departing from the scope of the invention. is there. For example, in the above-described embodiment, the case where the object is displayed together with the main content has been described. However, the present invention is not limited to this, and may be a side or an overlay. Further, objects that have not been displayed may be displayed, or display attributes (size, brightness, hue, etc.) may be changed.

11 Receiver (Tuner)
12 Stream separator (DEMUX)
13 Video decoding unit 14 Display processing unit (scaler)
15 Display (Monitor)
16 Personal DB
17 Services 18 GPS (Global Positioning System)
DESCRIPTION OF SYMBOLS 19 Reception control part 19a Extraction means 19b Narrowing means 19c Collection means 19d Image processing means 19e Search means 19g User specification means 19h Object specification means 19i Preference management means 19j Related information management means 19k Icon display means 20 Sensor 21 Remote control reception part 22 Input means DESCRIPTION OF SYMBOLS 23 Camera 24 Network connection part 31 User action 32 User state 34 Recommendation engine 35 Important keyword extraction part 36 Narrowing part 37 Recommendation result 40 Remote control 100 Information processing apparatus (television receiver)
101 Main screen 102 Side menu (icon)
103 screens

Claims (6)

Display means for displaying at least content;
User specifying means for specifying a user who is viewing the content displayed on the display means;
An object specifying means for specifying an object included in the content;
Preference management means for managing user preferences for the identified object;
Related information management means for acquiring object related information related to the object that is preferred more strongly than a predetermined standard and managing the related information for each user;
An icon for displaying the object related information by being selected and executed when the object corresponding to the object related information is displayed on the content viewed by the user linked to the object related information. Icon display means for displaying so that it can be selected and executed on the periphery of the display means,
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the icon display unit changes a display attribute of the icon before and after displaying the object.   The information processing apparatus according to claim 1, wherein the icon display unit displays the icon in an icon display area set at a periphery.   The information processing apparatus according to claim 1, wherein the icon display unit displays the icon as an overlay on content in a peripheral portion of the display unit.   An information processing method, wherein an icon for displaying object related information is displayed together with the main content in correspondence with display of the object in the main content. In the computer of the information processing device,
A procedure in which the display means displays at least the content;
A procedure in which user specifying means specifies a user who is viewing the content displayed on the display means;
A procedure in which an object specifying means specifies an object included in the content;
A procedure in which the preference management means manages the user's preference for the identified object;
A procedure in which the related information management means acquires object related information related to the object that is preferred more strongly than a predetermined standard and manages the related information for each user,
When the object display unit displays the object corresponding to the object related information on the content viewed by the user associated with the object related information, the object display information is selected and executed. A procedure for displaying an icon for display so that it can be selected and executed on the periphery of the display means;
A program for running

Images