JP2015153140A - information processing apparatus, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus, information processing method, and program with which a user is only required to put a mark on a content the user is viewing or browsing to easily utilize the content later.SOLUTION: An information processing apparatus includes display means capable of displaying a content associated with attribute information, user identification means for identifying a user facing the display means, specified image storage means for storing, when the identified user performs a first operation, a still image of the content displayed on the display means in association with the attribute information associated with the content and the user, and information searching means for searching for information on the basis of the stored still image and storing the information searched for in association with the attribute information and the user.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

Some information processing apparatuses can assist a user in efficiently grasping important scenes in one or more moving image contents (see, for example, Patent Document 1).
The invention described in Patent Document 1 relates to an information processing apparatus, an information processing method, a program, and a monitoring system. Specifically, the thumbnail display unit is at least part of a thumbnail image time series of one moving image content. Time series parts are arranged side by side in time order and displayed as a horizontal thumbnail line. In a thumbnail video time series of a plurality of video contents, important thumbnail images with bookmarks are arranged vertically, and are used as horizontal thumbnails and operation target thumbnails. A vertical thumbnail line is displayed so that two thumbnail images intersect. When the user gives an instruction to move up and down with respect to the operation target thumbnail, the thumbnail display unit displays the horizontal thumbnail line as a time-series portion of thumbnail images continuous from the important thumbnail image to be moved on the vertical thumbnail line. Is to be updated.

JP 2012-95118 A

However, in the technique described in Patent Document 1 described above, although an important scene can be simply grasped, even if the user has an interest in personal belongings, food and drinks, or location locations that appeared in the important scene, It is inconvenient because you have to inquire and check. In addition, if it is unclear whether or not it has been checked if there are interests in belongings, foods and drinks that have reappeared in other scenes, it must be checked again.
On the other hand, not only viewing of a personal computer or a television receiver (TV) as an information processing apparatus but also browsing of an SNS (social area network) using a smart phone can be mentioned. For example, when browsing a friend's tweet on SNS, if you find a comment “○ Iri Discovery (with photo)”, the data that you pressed even if you clicked the general “Like” button is sent to the provider via the network. Is transmitted to the user's information processing apparatus as it is, but it is inconvenient when it is desired to view related articles later.

  Accordingly, an object of the present invention is to provide an information processing apparatus, an information processing method, and a program that can be easily used at a later date simply by adding a mark to content being viewed or browsed.

  In order to solve the above problem, the invention according to claim 1 is characterized in that display means capable of displaying content associated with attribute information, user identification means for identifying a user facing the display means, and the identified When the user performs a first operation, a designated image storage unit that stores a still image of the content displayed on the display unit in association with the attribute information associated with the content and the user, and the storage Information search means for searching for information based on the still image and storing the attribute information in association with the user.

  According to the present invention, it is possible to provide an information processing method, an information processing apparatus, and a program that can be easily used at a later date simply by adding a mark to content being viewed or viewed.

(A) is a front view of the information processing apparatus which concerns on one embodiment of this invention, (b) is a front view of a remote control, (c) is a front view of a smart phone. It is a block diagram which shows the hardware constitutions of the information processing apparatus 100 shown in FIG. FIG. 2 is an example of a configuration diagram of software at a preparation stage for using the information processing apparatus 100 illustrated in FIG. 1. It is an example of the flowchart which shows the operation | movement of the preparation stage for utilizing the information processing apparatus shown in FIG. It is an example of the flowchart about operation | movement in case a user has an object of interest while viewing a content. It is explanatory drawing for demonstrating a specific button. FIG. 3 is an explanatory diagram for explaining transition of individual states when the TV as the information processing apparatus 100 shown in FIG. (A)-(f) is explanatory drawing in the case of displaying my catalog DB10 on the information processing apparatus 100 by operation of the smart phone 41. FIG. It is explanatory drawing about the output of my catalog. It is explanatory drawing about the case where the item to be worried about which was registered into my catalog DB is purchased. It is a conceptual diagram which shows the whole image of the my catalog registered into my catalog DB10.

<Overview>
This information processing apparatus registers items of interest to the user in a catalog format. That is, when the user performs a “like” operation while viewing content such as a TV, the information processing apparatus stores the still image (entire or part) at that time in association with the content tag / viewing user. To do. Further, the information processing apparatus searches for information based on the still image and stores the information in association with the tag user. Furthermore, when the my catalog display operation is performed, the information processing apparatus displays information associated with the viewing user for each tag.
<Configuration>
1A is a front view of an information processing apparatus according to an embodiment of the present invention, FIG. 1B is a front view of a remote control, and FIG. 1C is a front view of a smartphone. is there.
On the screen 103 of the display unit of the information processing apparatus 100, a main screen 101 and a side menu 102 are usually displayed. The screen 103 can display the main screen 101 in an enlarged manner. On the screen 103, the side menu 102 can be reduced and the main screen 101 can be enlarged and displayed.

  The side menu 102 includes a side menu 102a for a personal viewer (Personal Viewer in the figure), a side menu 102b for a shopping channel (Shopping Channel in the figure), and a side menu 102c for a personal channel (Personal Channel in the figure).

  The personal viewer is a side menu for displaying a list of digital content including broadcast program content and web content that the user has personally stored (recorded). The shopping channel searches for information related to a program or a scene of interest by pressing a “like” button as a first button of a remote control or the like in advance on digital content that the user is viewing. It is a side menu for displaying a list of accumulated shopping information. The personal channel is a side menu for analyzing digital content viewed by the user, learning performers, genres and the like that the user likes, and recommending digital content.

The information processing apparatus 100 is used for registering items of interest to the user while viewing content in a catalog format by remote control operation.
The remote controller 40 has a fixed button arrangement, but buttons frequently used for viewing recorded programs and the like are arranged on the upper side. In particular, the button 40a is a mark button as a mark means. Reference numeral 40b denotes a playback button. Reference numeral 40c denotes a determination button also used as a pause / playback button, and reference numeral 40d denotes a cross key. 40h is a volume control button, and 40i is a channel switching button.
When software for remote control is installed in the smart phone 41, a button pattern similar to that of the remote control 40 is displayed on the touch panel. That is, the button 41a corresponds to the button 40a, the button 41b corresponds to the button 40a, the button 41c corresponds to the button 40c, and hereinafter, the cross key 41d corresponds to the cross key d. The button 41h corresponds to the button 40h, and the button 41i corresponds to the button 40i.
Operations such as on / off operation of the information processing apparatus 100, channel switching, volume adjustment, “like” button, side menu selection, and the like can be performed by the remote control 40 or the smart phone 41.

[Hardware]
FIG. 2 is a block diagram showing a hardware configuration of the information processing apparatus 100 shown in FIG.
An information processing apparatus 100 (for example, TV) shown in FIG. 2 includes a my catalog DB 10, a receiving unit (tuner) 11, a stream separating unit (DEMUX: demultiplexer) 12, a video decoding unit 13, and a display processing unit (scaler). 14, display unit (monitor) 15, personal DB (database) 16, service 17, GPS (Global Positioning System) 18, reception control unit 19, sensor 20, remote control reception unit 21, input means 22, camera 23, and a network connection unit 24.

The receiving unit 11 is a circuit that functions as a tuner that receives terrestrial digital broadcasting, BS (broadcasting satellite) broadcasting, or CS (communication satellite) broadcasting and inputs the received stream to the stream separation unit 12. is there. The reception unit 11 has a function of changing a channel to be received under the control of the reception control unit 19.
The stream separation unit 12 performs DEMUX processing that separates multiplexed streams of video, audio, data, and the like. The stream separation unit 12 inputs a stream related to video among the separated streams to the video decoding unit 13. Since other streams are not directly related to the present invention, the description is omitted.
The video decoding unit 13 decodes a stream related to the input video and inputs it as video data to a subsequent processing block. The stream is not limited. For example, MPEG (Moving Picture Experts Group), H.264. H.264 or the like.
The display processing unit 14 controls the display range and size of the stream image and side menu that can be displayed on the display unit 15.
The display unit 15 is a monitor capable of displaying, for example, an HDTV (high-definition television), for example, a liquid crystal display device.

The reception control unit 19 performs various processes based on data from the My Catalog DB 10, the reception unit 11, the display processing unit 14, the personal DB 16, the service 17, the GPS 18, the sensor 20, the remote control reception unit 21, the input unit 22, and the camera 23. A circuit having a function of performing, for example, a microprocessor. The reception control unit 19 includes an extraction unit 19a, a narrowing unit 19b, a collection unit 19c, an image processing unit 19d, a search unit 19e, a classification unit 19f, a selection unit 19g, a user identification unit h, a designated image storage unit 19i, and a coordinate designation unit. 19j.
The reception control unit 19 has a function of controlling power on / off, channel switching, and the like based on instructions for power on / off, program switching, volume control, and the like input from the input unit 22 or a remote controller.

The extraction means 19a has a function of extracting a keyword from data stored in the personal DB 16.
The narrowing-down means 19b has a function of narrowing down interest information by ranking keywords by frequency.
The collecting unit 19c has a function of collecting contents and search results related to the narrowed interest information.
The image processing means 19d is a first side menu for visually displaying and searching a user's past life log, and a second side menu for shopping online for products according to the user's preference in cooperation with a shopping site. , And a third side menu for the channels collected for each content collected according to the user's preference is displayed on the display unit 15 together with the main screen for displaying the content.
The search unit 19e has a function of connecting to the Internet via the network connection unit 24 and searching for information related to the item selected by the user's mark unit operation.
The classifying unit 19f has a function of classifying the searched information based on a predetermined condition. Examples of the predetermined condition include time, preference, freshness, source, tag, or media type.
The selecting unit 19g has a function of selecting information about an item that is marked when the user next views the content and information on a matching item among the accumulated items and displaying the information on the display unit in a catalog format.
The user identification unit 19h has a function of specifying a user who is viewing the content displayed on the display unit 15 as a display unit. The user specifying means 19g always shoots the front surface of the display unit 15 with the camera 23, specifies that the person is a user when the number of persons watching is singular, and if there are a plurality of persons watching Recognizes that the person holding the remote control is the user.
The designated image storage unit 19i has a function of storing a still image of the content displayed on the display unit 15 in association with the attribute information associated with the content and the user when the identified user performs the first operation. Have. The “first operation” includes, for example, selecting any of the side menus 102 a to 102 c with the remote controller 40. The designated image storage means 19i associates a part of the still image of the content displayed on the display unit 15 specified by the coordinates designated by the coordinate designation means 19j with the attribute information associated with the content and the user. You may have the function to memorize.
The coordinate designating means 19j has a function of designating coordinates on the display unit 15.
In addition, when the identified user performs the second operation, the information stored in association with the user may be displayed in a list for each attribute information. The “second operation” refers to, for example, an operation after the first operation, and includes browsing the contents of My Catalog or using a shopping site.

  These extraction means 19a, narrowing means 19b, collection means 19c, image processing means 19d, search means 19e, classification means 19f, selection means 19g, user identification means 19h, designated image storage means 19i, and coordinate designation means 19j are software software. Consists of.

The content classification performed in the reception control unit 19 generates a thumbnail that displays a part of the acquired content data, summarizes it for each attribute assigned to each piece of interest information, and basics of processing for information having the same attribute Judgment is made based on whether or not the priority is high for the user based on the instruction history.
Also, high priority means that the number of viewing times and viewing time are measured for each genre, performer, or group of the program viewed by the user, and the program with a large number of viewing times and viewing time is considered highly interested. .

The personal DB 16 as storage means stores interest information divided into files for each user.
The service 17 is a device that stores information obtained when the information processing apparatus 100 is connected to the network by the network connection unit 24.
The GPS 18 is a device that searches for information related to the current position of the information processing apparatus 100.
The sensor 20 determines whether or not there is a person in the remote control usable area on the front surface of the information processing apparatus 100 and the distance. Examples of the sensor 20 include an infrared sensor and an ultrasonic sensor. The sensor 20 is not limited to a single sensor, and a plurality of sensors may be combined.
The remote control receiving unit 21 exchanges control signals and response signals such as item marks, channel switching, and volume control with the remote control 40 (see FIG. 1).
The input means 22 is, for example, a power button, a channel switching button, a volume button, or an input switching button.
The camera 23 has a function of photographing and recognizing a user who operates a remote controller 40 or a smart phone 41 (see FIG. 1) not shown in the drawing on the front surface of the information processing apparatus 100 and converting the information into an electrical signal. This is used for identifying a face for each user when there are a plurality of users and associating interest information. Although the camera 23 is provided on a support column that supports the display unit 15 in the drawing, the present invention is not limited to this and may be provided on the outer peripheral portion of the display unit 15.
The network connection unit 24 has a function of connecting to a network (not shown) using wireless or wired communication.

<Operation>
[Preparation stage]
FIG. 3 is an example of a configuration diagram of software at a preparation stage for using the information processing apparatus 100 illustrated in FIG. 1.
Since the information processing apparatus 100 does not record any user information at the time of factory shipment, the user preference information is accumulated after purchase.
The user's action 31 and the user's state 32 are analyzed according to TPO (time position occasion) and stored in the personal DB (database) 16. For example, an HDD (hard disk drive) is used for the personal DB 16.
The TPO includes a user action 31 and a user state 32 in addition to who the user is. Examples of the user behavior 31 include TV / recorded content, SNS / Twitter (Twitter “registered trademark”), mail / browser, search, scheduler, and shopping.
TV / recorded content means broadcast time, channel, program name, genre, performer name, recording time, recording mode, and the like.
SNS is an abbreviation for social networking service, and is a website that promotes and supports connections between people. It is a membership-based service that provides means and places to facilitate communication between friends and acquaintances, and provides new relationships through hobbies and preferences, residential areas, and schools of origin. Twitter is an information service that allows you to post short sentences called “tweets” of up to 140 characters, and is provided by Twitter.
The user's interest information can be obtained by analyzing keywords from topics using SNS or Twitter.
The mail is information that the user exchanges with another person. If the mail is analyzed, the user's interest information can be obtained.
The browser is software for searching for and displaying information on the Internet, and examples thereof include Netscape Navigator and Internet Explorer. Interesting information can be obtained by analyzing keywords when the user uses the browser.
The search uses the keyword to obtain information that the user wants to know, so that the user's interest information can be obtained from the keyword.
The scheduler is software for managing a personal schedule, and can obtain user interest information from a keyword of the schedule.
Since shopping remains in the history of when and how many products are purchased by the user, the user's interest information can be obtained.

On the other hand, examples of the user state 32 include a position, movement detection means, facial expression (degree of concentration), and emotional state.
The position is a position when the user is using the information processing apparatus 100, and the position information when the user is using the information processing apparatus 100 can be grasped from the GPS 18 of the information processing apparatus 100.
The movement detection means is means for grasping, for example, whether the user is moving on a train, moving on a car, or moving on foot, such as an acceleration sensor or a vibration sensor. Sensor. This movement detection means is used when the user uses the smart phone 41 as a remote control.
The facial expression (concentration) is determined by image recognition processing such as whether the user's facial expression is hard or soft, or whether the user is staring at a specific part of the screen, bored, or dozing.
The emotional state is determined by image recognition processing, such as whether the user shows emotion, emotional expression, or expressionlessness (true face).

The data stored in the personal DB 16 is sent to the recommendation engine 34 as necessary. The recommendation engine 34 is software for providing data determined to be necessary to the user, and is connected to the service 17. The recommendation engine 34 performs a search query and a search result with the service 17.
The recommendation engine 34 includes an important keyword extracting unit 35 that extracts important keywords, and a narrowing unit 36 that narrows down by user ranking. Important keywords are keywords that have different interests and interests for each user, and have a high frequency of proper nouns (for example, personal names, character names, song names, program names, country names, city names, place names, competition names, game names, etc.) Is mentioned. Important keywords include keywords related to the program or scene to which the tag is attached. The user ranking is a ranking of the keywords extracted for each user by statistical mathematical processing in order of frequency. The narrowing down means ensuring that the ranked keywords are selected from the top to a predetermined rank and can be provided immediately.

  The information is extracted by a shopping information extracting unit 37 that extracts shopping information from information output from the recommendation engine 34. The information processing apparatus 100 includes a list display unit 38 that displays a list of shopping information when there is a request from the user. The list is displayed in a state of being sorted and arranged by the list display unit 38. In addition, information about the item selected by the user is stored in the recommendation engine 34 so as to be readable.

FIG. 4 is an example of a flowchart showing an operation in a preparation stage for using the information processing apparatus shown in FIG.
First, when the TPO determination is started, the information extraction engine is operated (step S1), and information is exchanged with the personal DB (step S5).
Next, the search engine is activated (step S2), a search query and a search result are performed with the service, and information related to a tagged scene or program is searched (step S6).
The matching engine is activated (step S3), shopping information related to shopping is extracted using important keywords (step S4), classified and prepared so as to be displayed as a list, and prepared (step S5).
The recommendation result is stored in the my catalog DB 10 so as to be readable (step S7).

[Item check and My catalog display stage]
FIG. 5 is an example of a flowchart of the operation when the user is interested in viewing the content. It is assumed that data such as contents that the user is interested in is stored in the My Catalog DB 10 in advance.
The subject of the operation is the reception control unit 19.

When the information processing apparatus 100 displays the content (step S11), it is determined whether or not the button that the user wants to go has been pressed (step S12). If the user wants to go to the button (step S12 / Yes), the map of the place you want to go to or the accompanying information will show the tourist information home page if you want to go to the tourist information center, or if the place you want to go is a store or concert venue And the website of the venue, word-of-mouth information, and surrounding area information are searched (step S23), and the process proceeds to step S18.
If the button that the user wants to go to is not pressed (step S12 / No), it is determined whether or not the button that the user wants to watch has been pressed (step S13). If the user wants to watch the button (Step S13 / Yes), if the user wants to watch is a TV program, the official homepage of the TV program is searched and the recording of the program is reserved. In the case of sculpture, etc., search homepages such as movie theaters, art museums, museums, ticket offices, etc., and search for word-of-mouth information as supplementary information (step S24), and proceed to step S18.
When the button that the user wants to watch has not been pressed (step S13 / No), it is determined whether or not the button that the user wants to eat has been pressed (step S14). If the user wants to eat the button (step S14 / Yes), the recipe, the store, the homepage of the mail order site, and how to eat, how to drink, eating and drinking manners, etc. are searched (step S25), step S18 Proceed to
If the button that the user wants to eat has not been pressed (No at Step S14), it is determined whether or not the desired button has been pressed (Step S15). If the user has pressed the desired button (step S15 / Yes), the product information of the desired item, the store (actual store), the address of the shopping site, the word-of-mouth information as incidental information, etc. are searched (step S25), Proceed to S18.
If the desired button has not been pressed by the user (step S15 / No), it is determined whether or not the like button has been pressed (step S16). If the user presses the like button (step S16 / Yes), the program, actor, singer, entertainer or other person, product, and word-of-mouth information are searched as supplementary information (step S17), and the process proceeds to step S18.

In step S18, it is registered in my catalog DB 10 (see FIG. 2), classified (step S19), organized (step S20), and whether or not there is an item in the my catalog DB 10 that matches an item previously marked by the user. (Step S21). If there is an item in the my catalog DB 10 that matches the marked item (Yes at Step S21), the list is displayed on the screen of the display unit 15 of the information processing apparatus 100 and the process ends (Step S22).
When the like button is not pressed (step S16 / No), or when there is no item in the my catalog DB 10 that matches the marked item (step S21 / No), the process returns to step S11.

[Specific button]
FIG. 6 is an explanatory diagram for explaining the specific button.
The specific button 41c includes a like button 51 as a first button, a button 52 that you want to watch as a second button, a button 53 that you want to eat, a button 54 that you want to go, and a button you want to go as shown in the lower right of FIG. 55. The Wants button has a button 52 that wants to watch, a button 53 that wants to eat, a button 54 that wants to go and a button 55 that wants to go.

The first button is a button for registering items that the user is interested in. The second button is a button for selecting an action including purchase, eating and drinking, viewing, and a visit that the user performs next when the user selects an item.
These buttons 51 to 55 are buttons for pasting to an item of interest in the main screen 101 of the information processing apparatus 100 in the upper part of the figure and registering it in the My Catalog DB 10. For example, when watching the drama 1, pressing the “like” button 51 in the “○ Iri” appearance scene makes it so that it can be collected by a smartphone camera.
Also, when viewing other dramas 2, pressing the desired button 53 in the bag that Yuko Take had has registered in the My Catalog DB10.
When viewing a friend's tweet on SNS (social networking site) when viewing the upper TV, pressing the Like button 51 for a comment (with a photo) of “Ori discovered” is registered in the My Catalog DB10. Moreover, about the bag which the above-mentioned bamboo ○ Yuko had, when a friend tells the name of the store selling near by SNS, it is registered as a tag.

[Individual state transition TV screen]
FIG. 7 is an explanatory diagram for explaining the transition of the individual state when the TV as the information processing apparatus 100 shown in FIG. 1 is used to mark an item on the screen using the remote controller 40.
In the upper part of FIG. 7, when the determination button 40c of the remote controller 40 is pressed during playback of the content rewind scene of the information processing apparatus 100, the information processing apparatus 100 is temporarily stopped and the sound is muted. A thumbnail 101 a is displayed in a film shape in the main screen 101 of the information processing apparatus 100. In the thumbnail 101a, the words 15S, 30S, 60S from the stop and the stop position, the dawn of the CM, and the head are described. These notations are extracted from the caption data and displayed. By pressing the cross key 40d, an arbitrary scene can be selected from the film-like thumbnail 101a. The remote control 40 is provided with a playback button 40b, which can be restarted by pressing the playback button 40b. Even if the reproduction button 101b in the main screen 101 is designated and the enter button 40c is pressed, the restart can be performed.

Next, Wants registration will be described.
Wants registration refers to marking an item with the remote control 40 or the smart phone 41. Marking means pasting data such as “Like”, “I want to see”, “I want”, “I want to go”, “I want to eat” to an item. An item refers to an item that can be a user's interest such as a person, an article, a place, or a food displayed on the main screen 101 of the information processing apparatus 100.

As shown in the lower part of FIG. 7, when the camera mark button 40a is pressed when the target scene is displayed during playback of the scene, the target scene is paused, and the cursor 101c is displayed on the main screen 101. An operation guide is displayed on the side menu 102. In the side menu 102, icons for marking items, for example, an eraser icon 121, a pencil icon 122, and a confirmation icon 123 as shown in the figure are displayed.
When the cursor 101c is displayed on the main screen 101 and the determination button 40c is released, the information processing apparatus 100 enters the presentation mouse mode. By moving the remote controller 40, the cursor 101c moves in accordance with the movement of the remote controller 40. The pencil icon 122 is selected with the cross key 40d, and the item (in this case, a bag) is marked with the decision button 40c. When marking is completed, the confirmation icon 123 is selected with the cross key 40d.
The presentation mouse mode is canceled, and the Wants designation boxes 124 and 125 and shopping information are displayed on the side menu 102. Marking is performed by selecting with the cross key 40d and checking the Wants designation boxes 124 and 125 with the decision button 40c.

  Here, Table 1 shows the objects input to the My Catalog DB.

Table 1 shows what, what, and how to paste additional information (tag). Items exist in TV and SNS, and TV programs include TV programs, My Channel program guides, and personal channels. SNS includes images (screen shots) and tweets / RT (tweet sharing).
EPG is an abbreviation for Electronic Program Guide and is an electronic program guide.

[My Catalog Viewer]
FIGS. 8A to 8F are explanatory diagrams when the my catalog DB 10 is displayed on the information processing apparatus 100 by operating the smart phone 41.
My catalog DB 10 can be displayed by time, taste, freshness, source, tag, and media type. Each slide bar 41s can be adjusted according to the user's search level.
FIG. 8A shows a state in which thumbnails of data registered in the my catalog DB 10 are viewed. The size of each thumbnail corresponds to the degree of interest of the user, and is arranged in order from the back toward the front. The remote control image of the smart phone 41 at this time is shown in FIG. The level of the slide bar on the time axis, the preference axis, and the freshness axis is 80, the source level is TV, and the tag is neither “Iri”, “Soccer”, nor “XILE”. Media types are all videos, music, images, and text.
FIG. 8B shows a case where data registered in the my catalog DB 10 is searched. Drama thumbnails with high user interest are arranged. The remote control image of the smart phone 41 at this time is shown in FIG. The level of the slide bar for time, taste and freshness is 80, and the position of the source slide bar is TV. The position of the tag slide bar is Oi, and the position of the media type slide bar is all.
FIG. 8C shows one scene of a drama when selecting “Wants” and tags from the data registered in the My Catalog DB 10 and organizing them. At this time, one scene of the drama “Winter Rescue”, recording date and time, a specific button 41c, and a tag are displayed on the display unit 41b of the smart phone.
For example, when the “○ Iri” tag is selected, item information with the corresponding tag is displayed as a search result. When FIG. 8C as a specific item is selected, automatically added tag information is displayed. By organizing this information, automatic recording, reminder, and recommendation are activated at the necessary timing.
Here, “arrangement” means checking automatically arranged items, selecting and inputting appropriate items, and deleting unsuitable items.

[My catalog OUT PUT]
FIG. 9 is an explanatory diagram of the output of my catalog.
Items registered in the My Catalog DB 10 lead to services related to Wants (want to see, want, etc.).
For example, “Oi Ri” with the tag “I want to see” is registered in My Catalog DB10, so that “Winter Rescue” starring O Ri can be recorded, or the movie “GIRLS” (Ri Ii Recording).
Also, for example, “Rina's dress that came” with the tag “I want” is registered in My Catalog DB10. To do. Another option is to purchase a blue dress because you bought a pink dress before.

[Shopping channel]
FIG. 10 is an explanatory diagram for the case of purchasing an item that has been registered in the My Catalog DB.
Since the personal viewer of the information processing apparatus 100 is developed on the main screen 101, a large number of thumbnails are arranged. When a user who is inclined to “purchase the program theme song 113 whose favorite button was previously pressed, to purchase” selects the side menu 102 b of the shopping channel, a shopping site screen 1012 is displayed on the main screen 101. Is done. This is because the program theme song, which is an item that the user is interested in, is marked in advance, and the theme song icon 113 can be found when viewing the My Catalog with a personal viewer. Since the shopping site screen 1012 is set up with a mail order company and an affiliated service 112, online shopping can be performed immediately.

[Overview of My Catalog]
FIG. 11 is a conceptual diagram showing an overall image of a my catalog registered in the my catalog DB 10.
In FIG. 11, the upper stage mainly shows input (INPUT), the middle stage shows my catalog DB, and the lower stage shows output (OUT PUT).
Describe input. When the user presses any one of the specific buttons 41e as the mark means while viewing the content on the TV as the information processing apparatus 100, the date, program name, person, product information, etc. are input to the My Catalog DB 10 and registered. Is done.
When there is a tweet to the My Catalog DB 10 by an SNS terminal as the information processing apparatus 100, it is registered when, where and who tweeted (STEP 1).
In STEP2 and later, search, browser, scheduler, and mail functions are provided, but the search function is utilized.
The My Catalog DB 10 uses a specific button 41e and a tag 41f to select a button and a tag that are pressed among a like button, a desired button, a desired button, a desired button, and a desired button for an item that the user is interested in. It is registered in association with the item of concern in the scene of concern. The data registered in the my catalog DB 10 is organized by the specific button 41e.
The output will be described. For items that the user wants to watch, a TV program recording reservation or the like is performed, and for the desired items, product information or the like is displayed, thereby facilitating shopping (STEP 1).
In STEP 2 and later, if you want to go somewhere, the travel site is displayed. If you want to eat something, the gourmet site is displayed linked to the item you are interested in.

<Program>
The information processing apparatus according to the present invention described above is realized by a program that causes a computer to execute processing. As an example, the case where the function of the present invention is realized by a program will be described below.

For example,
A computer of an information processing apparatus having a display unit, a mark unit, a search unit, a storage unit, and a selection unit, and an item in the screen of the display unit is marked by a specific button of a remote control,
The display unit displays the content;
A procedure for the search means to search for information about the marked item;
A procedure for classifying means to classify searched information based on a predetermined condition;
A procedure for storing means for storing classified information;
A procedure in which the selecting means selects information about the item that is marked when the user next views the content and the matched item among the accumulated items and displays the information on the display unit in a catalog format;
A program for executing

  Such a program may be stored in a computer-readable storage medium.

<Storage medium>
Here, examples of the storage medium include computer-readable storage media such as CD-ROM, flexible disk (FD), and CD-R, semiconductor memories such as flash memory, RAM, ROM, and FeRAM, and HDD.

  CD-ROM is an abbreviation for Compact Disc Read Only Memory. A flexible disk means Flexible Disk: FD. CD-R is an abbreviation for CD Recordable. RAM is an abbreviation for Random-Access Memory. ROM is an abbreviation for Read-Only Memory. FeRAM is an abbreviation for Ferroelectric RAM and means a ferroelectric memory. HDD is an abbreviation for Hard Disc Drive.

  The above-described embodiment shows an example of a preferred embodiment of the present invention, and the present invention is not limited thereto, and various modifications can be made without departing from the scope of the invention. is there.

11 Receiver (Tuner)
12 Stream separator (DEMUX)
13 Video decoding unit 14 Display processing unit (scaler)
15 Display (Monitor)
16 Personal DB
17 Services 18 GPS (Global Positioning System)
DESCRIPTION OF SYMBOLS 19 Reception control part 19a Extraction means 19b Narrowing means 19c Collection means 19d Image processing means 19e Search means 19f Classification means 19g Selection means 19h User identification means 19i Designated image storage means 19j Coordinate designation means 20 Sensor 21 Remote control reception section 22 Input means 23 Camera 24 Network connection unit 31 User behavior 32 User state 34 Recommendation engine 35 Important keyword extraction unit 36 Narrowing unit 37 Recommendation result 40 Remote control 41 Smartphone 100 Information processing device (television receiver, TV, SNS terminal)
101 Main screen 102 Side menu 103 screen

Claims (5)

Display means capable of displaying content associated with attribute information;
User identification means for identifying a user facing the display means;
When the identified user performs a first operation, designated image storage means for storing a still image of the content displayed on the display means in association with the attribute information associated with the content and the user When,
An information processing apparatus comprising: information search means for searching for information based on the stored still image and storing the attribute information in association with the user. A coordinate designating unit capable of designating coordinates on the display unit;
The designated image storage means includes the attribute information associated with the content, the attribute information associated with the content, the user, and a still image of a part of the content displayed on the display means specified by the coordinates designated by the coordinate designation means. The information processing apparatus according to claim 1, wherein the information processing apparatus is stored in association with the information processing apparatus.   3. The information processing apparatus according to claim 1, wherein when the identified user performs a second operation, a list of information stored in association with the user is displayed for each attribute information. 4. Identify the user facing the display means that can display the content associated with the attribute information,
When the identified user performs a first operation, the still image of the content displayed on the display means is stored in association with the attribute information associated with the content and the user,
An information processing method, wherein information is retrieved based on the stored still image and stored in association with the attribute information and the user. A computer of an information processing apparatus provided with display means, user identification means, designated image storage means, and information search means,
Displaying the content associated with the attribute information on the display means;
A procedure for identifying a user facing the display means on the user identification means;
When the identified user performs a first operation in the designated image storage unit, the still image of the content displayed on the display unit is associated with the attribute information associated with the content and the user. Procedure to remember,
A procedure for searching the information search means for information based on the stored still image and storing the attribute information in association with the user;
A program for running

Images