JP2015154247A - Information processing equipment, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide information processing equipment that facilitates shopping, an information processing method, and a program.SOLUTION: Information associated with keywords matching a user is accumulated. Content having attribute information and the information associated with the keywords matching the user are displayed. When a predetermined operation is performed during the display of the content, a list of the information accumulated as the information associated with the keywords, most consistent with the attribute information of the displayed content, of the keywords matching the identified user is displayed on a display screen.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

There is a program redisplay method capable of redisplaying a scene in which a viewer is interested in a TV program on the Web, and a TV Web information service system linked with detailed information related to partial images in the redisplayed scene. (For example, refer to Patent Document 1).
The invention described in Patent Document 1 includes a step of receiving a television program, a step of broadcasting the received television program, a step of designating a scene in the program being broadcast, and a scene position at the time when the scene is designated , A step of detecting the end of the TV program, a step of storing an image corresponding to each scene of the TV program in the server, and an image of a plurality of scenes of the TV program stored after the program end operation. The method includes a step of sending scene position information to the server and requesting transmission of an image including the corresponding scene, a step of receiving an image from the server, and a step of displaying the received image.

Japanese Patent Laid-Open No. 2003-9023

By the way, the invention described in Patent Document 1 is connected to a link destination site related to a partial image and browses a Web page related to the partial image, or shopping or the like when the link destination site is a transaction site that conducts a commercial transaction. You can make transactions.
However, in the technique described in Patent Document 1, although a scene in which the user is interested is retained, whether the user wants to watch, wants to eat, wants to go, the user's favorite genre, performer, team, etc. Since they are not classified, the amount of Web pages related to the partial images becomes enormous over time, which causes inconvenience that the user must view all thumbnails when shopping.

  Therefore, an object of the present invention is to provide an information processing apparatus, an information processing method, and a program that are easy to shop.

  In order to solve the above-mentioned problem, the invention according to claim 1 is characterized in that information storage means for storing information related to a keyword associated with a user, content having attribute information, information stored in the information storage means, Display means capable of displaying, a user identification means for identifying a user facing the display means, and a keyword associated with the identified user when the display means performs a predetermined operation while displaying the content Information list display means for displaying on the display screen a list of information stored as related to the keyword that best matches the attribute information of the content that has been displayed.

  ADVANTAGE OF THE INVENTION According to this invention, provision of the information processing apparatus, the information processing method, and program which a user can shop easily is realizable.

It is an example of the front view of the information processing apparatus which concerns on one embodiment of this invention, a remote control, and the front view of a smart phone. It is a block diagram which shows the hardware constitutions of the information processing apparatus 100 shown in FIG. FIG. 2 is an example of a configuration diagram of software at a preparation stage for using a shopping channel of the information processing apparatus 100 illustrated in FIG. 1. It is an example of the flowchart which shows the operation | movement of the preparation stage for utilizing the shopping channel by the information processing apparatus shown in FIG. It is explanatory drawing when a user sticks a tag. It is an example of the flowchart for performing the list display of the shopping information in the information processing apparatus shown in FIG. It is another example of the flowchart for performing the list display of the shopping information in the information processing apparatus shown in FIG. It is a figure which shows an image at the time of selecting the side menu 102b of a shopping channel. It is a figure which shows the image in the case of purchasing the Apple pie displayed when the user is viewing content (drama).

This information processing apparatus checks information in which the user is interested in advance and displays it in a form that facilitates shopping.
FIG. 1 is an example of a front view of an information processing apparatus according to an embodiment of the present invention, a remote controller, and a front view of a smart phone.
On the screen 103 of the display unit of the information processing apparatus 100, a main screen 101 and a side menu 102 are usually displayed. The screen 103 can display the main screen 101 in an enlarged manner. The screen 103 can also enlarge the main screen 101 by defaulting the side menu 102 and display a screen relating to shopping information to be described later.
The side menu 102 includes a side menu 102a for a personal viewer (Personal Viewer in the figure), a side menu 102b for a shopping channel (Shopping Channel in the figure), and a side menu 102c for a personal channel (Personal Channel in the figure).
The personal viewer is a side menu for displaying a list of digital content including broadcast program content and Web content personally stored (recorded) by the user. The shopping channel searches for information related to programs and scenes that have been tagged by pressing a “Like” button such as a remote control on the digital content that the user is viewing in advance, and displays a list of accumulated shopping information It is a side menu. The personal channel is a side menu for analyzing digital content viewed by the user, learning performers, genres and the like that the user likes, and recommending digital content.

The remote controller 40 has a fixed button arrangement, but buttons frequently used for viewing recorded programs and the like are arranged on the upper side. When software for remote control is installed in the smart phone 41, the user's behavior pattern is learned, and buttons extracted according to the TPO are arranged.
Operations such as ON / OFF operation of the information processing apparatus 100, channel switching, volume adjustment, “Like” button ON operation, side menu selection, and the like can be performed by the remote control 40 or the smart phone 41.

[Hardware]
FIG. 2 is a block diagram showing a hardware configuration of the information processing apparatus 100 shown in FIG.
An information processing apparatus 100 (for example, a television receiver) illustrated in FIG. 2 includes a reception unit (tuner) 11, a stream separation unit (DEMUX: demultiplexer) 12, a video decoding unit 13, and a display processing unit (scaler) 14. , Display unit (monitor) 15, personal DB (database) 16, service 17, GPS (Global Positioning System) 18, reception control unit 19, sensor 20, remote control reception unit 21, input means 22, camera 23 And a network connection unit 24.

The receiving unit 11 is a circuit that functions as a tuner that receives terrestrial digital broadcasting, BS (broadcasting satellite) broadcasting, or CS (communication satellite) broadcasting and inputs the received stream to the stream separation unit 12. is there. The reception unit 11 has a function of changing a channel to be received under the control of the reception control unit 19.
The stream separation unit 12 performs DEMUX processing that separates multiplexed streams of video, audio, data, and the like. The stream separation unit 12 inputs a stream related to video among the separated streams to the video decoding unit 13. Since other streams are not directly related to the present invention, the description is omitted.
The video decoding unit 13 decodes a stream related to the input video and inputs it as video data to a subsequent processing block. The stream is not limited. For example, MPEG (Moving Picture Experts Group), H.264. H.264 or the like.
The display processing unit 14 controls the display range and size of the stream image and side menu that can be displayed on the display unit 15.
The display unit 15 is a monitor capable of displaying, for example, an HDTV (high-definition television), for example, a liquid crystal display device.

The reception control unit 19 has a function of performing various processes based on data from the reception unit 11, display processing unit 14, personal DB 16, service 17, GPS 18, sensor 20, remote control reception unit 21, input means 22, and camera 23. For example, a microprocessor. The reception control unit 19 includes an extraction unit 19a, a narrowing unit 19b, a collection unit 19c, an image processing unit 19d, a search unit 19e, an analysis unit 19f, an information storage unit 19g, a user identification unit 19h, and an information list display unit 19i.
The reception control unit 19 has a function of controlling power on / off, channel switching, and the like based on instructions such as power on / off, program switching, and volume control input from the input unit 22 or a remote controller (not shown).

The extraction means 19a has a function of extracting a keyword from data stored in the personal DB 16.
The narrowing-down means 19b has a function of narrowing down interest information by ranking keywords by frequency.
The collection unit 19c has a function of collecting content related to the narrowed interest information.
The image processing means 19d includes a first side menu for visually displaying and searching a user's past life log, and a second side for online shopping for products according to the user's preference in cooperation with a shopping site. The display unit 15 has a function of displaying a menu and a third side menu for channels collected for each content collected according to the user's preference, together with a main screen for displaying the content.
These side menus are selected by operating the remote controller 40 by the user.
The search unit 19e has a function of searching data related to the user's interest information from the network site connected by the network connection unit 24 based on the user's interest information.
The analysis unit 19f has a function of analyzing the genre, frequency, etc. of the extracted keyword.
The information storage unit 19g has a function of storing information related to a keyword associated with the user.
The user identification unit 19h has a function of identifying a user who faces the display unit 15 as a display unit. That is, the user identification unit 19h always takes a picture of the front surface of the display unit 15 with the camera 23, specifies that the person is a user when the number of people who are viewing is singular, and a plurality of people who are viewing. In the case of, the person holding the remote control is recognized as a user.
When the display unit 15 performs a predetermined operation while the content is being displayed, the information list display unit 19i relates to the keyword that best matches the attribute information of the displayed content among the keywords associated with the identified user. It has a function of displaying a list of information stored as a list on the display screen. The information list display means 19i displays a list of keywords associated with the user identified in one of the display areas of the display screen, and displays the list in at least another area of the display area of the display screen. It may have a function of displaying a list of information accumulated as related to the keyword selected by the user among the keywords that have been selected. Furthermore, the information list display unit 19j may display the specified information on the display unit 15 when the user performs a second operation of specifying one of the information displayed in the list.
The information stored in the information storage unit 19g is preferably shopping information for ordering products.
These extraction means 19a, narrowing means 19b, collection means 19c, image processing means 19d, search means 19e, analysis means 19f, information storage means 19g, user identification means 19h, and information list display means 19i are configured by software. .

The content classification performed in the reception control unit 19 generates a thumbnail that displays a part of the acquired content data, summarizes it for each attribute assigned to each piece of interest information, and basics of processing for information having the same attribute Judgment is made based on whether or not the priority is high for the user based on the instruction history.
Also, high priority means that the number of viewing times and viewing time are measured for each genre, performer, or group of the program viewed by the user, and the program with a large number of viewing times and viewing time is considered highly interested. .

The personal DB 16 stores the interest information divided into files for each user.
The service 17 is a device that stores information obtained when the information processing apparatus 100 is connected to the network by the network connection unit 24.
The GPS 18 is a device that searches for information related to the current position of the information processing apparatus 100.
The sensor 20 determines whether or not there is a person in the remote control usable area on the front surface of the information processing apparatus 100 and the distance.
The remote control receiving unit 21 exchanges control signals and response signals such as channel switching and volume control with a remote control not shown in the figure.
The input means 22 is, for example, a power button, a channel switching button, a volume button, or an input switching button.
The camera 23 has a function of capturing an image to recognize a user who operates a remote controller (not shown) on the front surface of the information processing apparatus 100 and converting it into an electrical signal. This is used for recognizing a face for each user when there are a plurality of users and associating interest information. Although the camera 23 is provided on a support column that supports the display unit 15 in the figure, the present invention is not limited to this, and may be provided on the outer periphery of the display unit 15.
The network connection unit 24 has a function of connecting to a network (not shown) using wireless or wired communication.

<Operation>
[Preparation stage]
FIG. 3 is an example of a configuration diagram of software at a preparation stage for using the shopping channel of the information processing apparatus 100 illustrated in FIG. 1.
The user's action 31 and the user's state 32 are analyzed according to TPO (time position occasion) and stored in the personal DB (database) 16. For example, an HDD (hard disk drive) is used for the personal DB 16.
The TPO includes a user action 31 and a user state 32 in addition to who the user is. Examples of the user behavior 31 include TV / recorded content, SNS / Twitter (Twitter “registered trademark”), mail / browser, search, scheduler, and shopping.
TV / recorded content means broadcast time, channel, program name, genre, performer name, recording time, recording mode, and the like.
SNS is an abbreviation for social networking service, and is a website that promotes and supports connections between people. It is a membership-based service that provides means and places to facilitate communication between friends and acquaintances, and provides new relationships through hobbies and preferences, residential areas, and schools of origin. Twitter is an information service that allows you to post short sentences called “tweets” of up to 140 characters, and is provided by Twitter.
The user's interest information can be obtained by analyzing keywords from topics using SNS or Twitter.
The mail is information that the user exchanges information with other companies, and the user's interest information can be obtained by analyzing the mail.
The browser is software for searching for and displaying information on the Internet, and examples thereof include Netscape Navigator and Internet Explorer. Interesting information can be obtained by analyzing keywords when the user uses the browser.
The search uses the keyword to obtain information that the user wants to know, so that the user's interest information can be obtained from the keyword.
The scheduler is software for managing a personal schedule, and can obtain user interest information from a keyword of the schedule.
Since shopping remains in the history of when and how many products are purchased by the user, the user's interest information can be obtained.

On the other hand, examples of the user state 32 include a position, movement detection means, facial expression (degree of concentration), and emotional state.
The position is a position when the user is using the information processing apparatus 100, and the position information when the user is using the information processing apparatus 100 can be grasped from the GPS 18 of the information processing apparatus 100.
The movement detection means is means for grasping, for example, whether the user is moving on a train, moving on a car, or moving on foot, such as an acceleration sensor or a vibration sensor. Sensor. This movement detection means is used when the user uses a smart phone as a remote control.
The facial expression (concentration) is determined by image recognition processing such as whether the user's facial expression is hard or soft, or whether the user is staring at a specific part of the screen, bored, or dozing.
The emotional state is determined by image recognition processing, such as whether the user shows emotion, emotional expression, or expressionlessness (true face).

The data stored in the personal DB 16 is sent to the recommendation engine 34 as necessary. The recommendation engine 34 is software for providing data determined to be necessary to the user, and is connected to the service 17. The recommendation engine 34 performs a search query and a search result with the service 17.
The recommendation engine 34 includes an important keyword extracting unit 35 that extracts important keywords, and a narrowing unit 36 that narrows down by user ranking. Important keywords are keywords that have different interests and interests for each user, and have a high frequency of proper nouns (for example, personal names, character names, song names, program names, country names, city names, place names, competition names, game names, etc.) Is mentioned. Important keywords include keywords related to the program or scene to which the tag is attached. The user ranking is a ranking of the keywords extracted for each user by statistical mathematical processing in order of frequency. The narrowing down means ensuring that the ranked keywords are selected from the top to a predetermined rank and can be provided immediately.

  The information is extracted by a shopping information extracting unit 37 that extracts shopping information from information output from the recommendation engine 34. The information processing apparatus 100 includes a list display unit 38 that displays a list of shopping information when there is a request from the user. The list is displayed in a state of being sorted and arranged by the list display unit 38.

FIG. 4 is an example of a flowchart illustrating an operation in a preparation stage for using a shopping channel by the information processing apparatus illustrated in FIG. 1.
First, when the TPO determination is started, the information extraction engine is operated (step S1), and information is exchanged with the personal DB (step S5).
Next, the search engine is activated (step S2), a search query and a search result are performed with the service, and information related to a tagged scene or program is searched (step S6).
The matching engine is activated (step S3), shopping information related to shopping is extracted using important keywords (step S4), classified and prepared so as to be displayed as a list, and prepared (step S5).

Here, the tag will be described with reference to the drawings.
FIG. 5 is an explanatory diagram when a user attaches a tag.
When the user views the digital content on the information processing apparatus 100, if the user thinks that the hat shown in the broken circle that the performer wears is “I want”, the user presses the like button 41a on the smartphone 41. When pressed, the same image as the main screen 101 of the information processing apparatus 100 is displayed on the screen 41b of the smartphone 41, and a Wants button 41c is displayed in the screen 41b. When the user surrounds the hat of the screen 41b with a fingertip (when checked), the trajectory is displayed, and the Wants button 41c is enlarged. When “wanted” is checked in the Wants button 41c, a tag is attached to one scene of the program and recorded in the personal DB 16 (see FIG. 2). After checking “I want”, the trajectory disappears from the screen 41b, and after a predetermined time elapses, the screen 41b returns to the original remote control screen. In the case where the digital content is a live broadcast, it may not be possible to check if the timing is missed during viewing, but it goes without saying that it is preferable to pause while viewing the recorded program as the digital content.

[List display 1]
FIG. 6 is an example of a flowchart for displaying a list of shopping information in the information processing apparatus shown in FIG.
The digital content with the tag attached is accumulated (step S1).
Information regarding the digital content to which the tag is attached is searched (step S2).
Information obtained by the search is stored in the personal DB 16 (step S3).
Shopping information related to shopping is extracted from the accumulated information (step S4).
It is determined whether or not there is a request for viewing the shopping channel via the side menu 102b (step S5). If there is no request, the process waits (step S5 / N). If there is a request (step S5 / Y), a list of shopping information is displayed on the main screen 101 (see FIG. 1) and the process ends (step S6).

FIG. 7 is another example of a flowchart for displaying a list of shopping information in the information processing apparatus shown in FIG.
The difference between the flowchart shown in FIG. 7 and the flowchart shown in FIG. 6 is that the selection history and display history of shopping information are displayed.
That is, the digital content with the tag attached is accumulated (step S11).
Information regarding the digital content to which the tag is attached is searched (step S12).
Information obtained by searching is stored in the personal DB 16 (step S13).
Shopping information related to shopping is extracted from the accumulated information (step S14).
It is determined whether or not there is a request for viewing the shopping channel via the side menu 102b (step S15). If there is no request, the system waits (step S15 / N). If there is a request (step S15 / Y), a list of shopping information is displayed on the main screen 101 (see FIG. 1) (step S16).
It is determined whether something has been selected from the list display (step S17).
When something is selected from the list display (step S17 / Y), the history of the selected shopping information is displayed (step S18), and when nothing is selected (step S17 / N), the process ends.

<When a user purchases a dress>
FIG. 8 is a diagram showing an image when the shopping channel side menu 102b is selected, and shows a main screen 1010 enlarged as compared with the information processing apparatus.
In FIG. 8, the information processing apparatus 100 is shown in the lower left, and when the side menu 102 b is selected, the main screen 101 of the information processing apparatus 100 is switched to the shopping channel screen 1010. On the screen 1010, a party SHOP website window 110-1, Oi Ri SHOP website window 110-2, minicar SHOP window 110-3, etc. are displayed in a superimposed manner.
In this way, on the main screen 101, products on the Internet are displayed according to the user's preference and schedule (party), and shopping (until purchase) can be enjoyed on the spot. On the main screen 101, related products and service information based on user preferences are displayed together as recommendations according to the TPO.
Further, when a user looks into a virtual store on the Internet, if a user's desired or necessary items are lined up as a store dedicated to the user, the purchase can be supported as it is.
For example, when a friend's wedding is approaching the user's schedule two weeks later and the dress to be worn is purchased, the user's preference is that the color is blue / black / pink, The design is No. 9 / A line, the budget is around 10,000 yen, and as information recorded in the personal DB 16 (see Fig. 2), there are two black dresses in the closet at home and pink dresses If there is one, there is a blue flower hair ornament as an accessory, and the back / shoes are black, a dress / accessory for a wedding two weeks later is displayed on the main screen 101. Since the user owns black and pink dresses, the party SHOP 110-1 selling blue dresses is recommended.

<When a user purchases an Apple pie>
FIG. 9 is a diagram showing an image when the user purchases an Apple pie displayed while viewing a content (drama).
When an Apple pie appears on the content that the user is viewing on the main screen 101 of the information processing apparatus 100 every week, if the user thinks “I want to eat if I watch the Apple pie every week”, the user When the side menu 102b of the shopping channel is selected, the content of the main screen 101 of the information processing apparatus 100 is switched to the screen 1011. On the screen 1011, the information processing apparatus 100 searches in advance and stores the Web sites 111-1 to 111-6 displayed. In this case, a site related to the content being viewed on the main screen 101 is displayed. The content scene is a patisserie kitchen, with an apple pie placed on the table. For this reason, the Apple Pie sales website 111-1 is displayed at the top of the main screen 1011 after switching. The other websites 111-2 to 111-6 are singer photo collections and CD sales websites related to the theme music of the content. These Web sites 111-1 to 111-6 are affiliated with an alliance-service 112. For this reason, the user can order the Apple Pie immediately by operating the smart phone 41 with the remote controller.

<Program>
The information processing apparatus according to the present invention described above is realized by a program that causes a computer to execute processing. Examples of the computer include general-purpose computers such as personal computers and workstations, but the present invention is not limited to this. Therefore, as an example, a case where the function of the present invention is realized by a program will be described below.

For example,
In a computer of an information processing apparatus having information storage means, display means, user identification means, and information list display means,
A procedure in which information storage means stores information related to a keyword associated with a user;
A procedure in which the display means displays the content having the attribute information and the information stored in the information storage means;
A procedure in which the user identification means identifies the user facing the display means;
When the information list display means performs a predetermined operation while the display means is displaying the content, the information list display means relates to the keyword that best matches the attribute information of the displayed content among the keywords associated with the identified user. The procedure for displaying a list of information accumulated as a thing on the display screen,
A program for executing

Thus, the information processing apparatus according to the present invention can be realized anywhere as long as there is a computer environment capable of executing the program.
Such a program may be stored in a computer-readable storage medium.

<Storage medium>
Here, examples of the storage medium include computer-readable storage media such as CD-ROM, flexible disk (FD), and CD-R, semiconductor memories such as flash memory, RAM, ROM, and FeRAM, and HDD.

  CD-ROM is an abbreviation for Compact Disc Read Only Memory. A flexible disk means Flexible Disk: FD. CD-R is an abbreviation for CD Recordable. RAM is an abbreviation for Random-Access Memory. ROM is an abbreviation for Read-Only Memory. FeRAM is an abbreviation for Ferroelectric RAM and means a ferroelectric memory. HDD is an abbreviation for Hard Disc Drive.

  The above-described embodiment shows an example of a preferred embodiment of the present invention, and the present invention is not limited thereto, and various modifications can be made without departing from the scope of the invention. is there.

11 Receiver (Tuner)
12 Stream separator (DEMUX)
13 Video decoding unit 14 Display processing unit (scaler)
15 Display (Monitor)
16 Personal DB
17 Services 18 GPS (Global Positioning System)
DESCRIPTION OF SYMBOLS 19 Reception control part 19a Extraction means 19b Narrowing means 19c Collection means 19d Image processing means 19e Search means 19f Analysis means 19g Information storage means 19h User identification means 19i Information list display means 20 Sensor 21 Remote control receiver 22 Input means 23 Camera 24 Network connection Part 35 important keyword extraction part 36 narrowing part 37 shopping information extraction part 40 remote control 41 smart phone 100 information processing apparatus (television receiver)
101 Main screen 102 Side menu 103 screen

Claims (6)

Information storage means for storing information related to keywords associated with the user;
Display means capable of displaying content having attribute information and information stored in the information storage means;
User identification means for identifying a user facing the display means;
When the display unit performs a predetermined operation while displaying the content, it is stored as a keyword related to the keyword that best matches the attribute information of the content that has been displayed among the keywords associated with the identified user. Information list display means for displaying a list of information on the display screen;
An information processing apparatus comprising:   The information list display means displays a list of keywords associated with the identified user in one area of the display area of the display screen, and displays the keyword in at least another area of the display area of the display screen. The information processing apparatus according to claim 1, wherein information stored as related to the keyword selected by the user among the displayed keywords is displayed in a list.   The information list display means displays the specified information on the display means when the user performs a second operation to specify one of the information displayed in the list. The information processing apparatus described.   4. The information processing apparatus according to claim 1, wherein the information stored in the information storage means is shopping information for ordering a product.   Information related to the keyword associated with the user is accumulated, content having attribute information and information related to the keyword associated with the user are displayed, and a predetermined operation is performed while the content is being displayed. Information stored as related to the keyword that best matches the attribute information of the content displayed among the keywords associated with the identified user is displayed on the display screen as a list. Method. In a computer of an information processing apparatus having information storage means, display means, user identification means, and information list display means,
A procedure for the information storage means to store information related to a keyword associated with the user;
A procedure in which the display means displays content having attribute information and information stored in the information storage means;
A procedure for the user identifying means to identify a user facing the display means;
If the information list display means performs a predetermined operation while the display means is displaying the content, the keyword that most closely matches the attribute information of the content displayed among the keywords associated with the identified user A procedure for displaying a list of information accumulated as related to the display screen,
A program for running

Images