JP2014154073A - Information processing device, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily acquire television relevant information without missing a television program.SOLUTION: An information processing device connected to the Internet includes means that receives image information, means that analyzes the received image information, means that creates, from the analyzed image information, a keyword relevant to the image information, means that retrieves, on the basis of the created keyword, information relevant to the keyword through the Internet, and display means that displays the retrieved relevant information and the received image information separately.

Description

  The present invention relates to an information processing apparatus, a control method, and a program.

  With the advancement of IT (Information Technology) technology, we are able to instantly obtain the information we want from the world through the Internet. For example, if a search engine is used to search for information that is of interest in television, advertising, or daily life using a personal computer (PC), information related to the information can be acquired in an instant. It was. However, in fact, after a while after worrying about the information of interest, it is overwhelmingly performed to search related information using a PC. In many cases, you can forget and go through without searching.

  In particular, as a result of postponing search execution, there is an environment in which search execution cannot be performed immediately at the point of interest or interest in the information of interest as a cause of forgetting without performing the search. Can be considered. In other words, since it is not possible to retrieve information immediately when it becomes interested, the opportunity to acquire information is lost.

  As another reason, there is a case where the opportunity to acquire information is lost due to the trouble of inputting the search character string to the PC. With the drop in the price of a personal computer accompanying an improvement in the computing power of a CPU (Central Processing Unit) of the PC and a reduction in the cost of memory and the like, opportunities for general users to touch the PC are also increasing. However, general users who are unfamiliar with PC operations need to become familiar with input using a keyboard or mouse operation required for GUI (Graphical User Interface) operation, which is much easier to handle than before. Nevertheless, PCs are not easily handled by general users.

  Thus, even from the viewpoint of information input, there is a need for a means that enables direct information retrieval at the point of interest in interested information without imposing a burden on general users. Yes.

  Another factor that makes it difficult to search and acquire information is that what is needed to search for information is limited to character strings for searching using a search engine. In conventional search engines that mainly search for information, there is no means for obtaining information on what cannot be expressed in characters.

  For example, even if you are interested in a food sampled by a celebrity appearing on a TV program, you may be directly interested in the name or food of the restaurant that provides the food to that celebrity. For example, you must record the TV program and check it for later playback, or write down a note while watching the broadcasted program. I often forget. The same thing often happens even when watching a program such as TV shopping. As described above, since there is no means for acquiring information at the moment when the user feels that he / she wants the information, he often misses the opportunity to acquire information with interest and interest.

  In this way, things that we are interested in in daily life are not only those expressed by character strings, but also what we see with our eyes, what we hear with our ears, what we touch with our hands, etc. Therefore, it is strongly desired to construct an environment in which information on the object can be easily acquired in real time on the spot.

  In other words, if you can get information in real time while you are on the spot, such as what you see with your eyes, what you hear with your ears, what you touch with your hands, etc. It is possible to satisfy intellectual curiosity on the spot without having to search, and to enjoy the benefits of the information society without being conscious of search operations using a PC.

  As described above, the conventional information acquisition means mainly performs processing such as input of a search character string to a search engine using a PC and execution of the search, and for a general user who is unfamiliar with the operation of the PC, the search character string. It is difficult to perform operations such as input and search execution, and there is no means for acquiring information related to information that is of interest and interest in real time on the spot. Furthermore, there have been various problems in conventional information retrieval systems, such as a method for acquiring information based on elements that cannot be represented by character strings, such as shape, sound, and touch.

JP 2002-074290 A

  As described above, conventionally, information acquisition has been mainly performed by searching for information using a character string, and has been difficult and unwieldy for general users who are unfamiliar with PCs. In addition, a method for acquiring information related to what appears in front of the eyes has not been established. In particular, there is no information acquisition means that uses information other than character strings that can be acquired in a more natural form for humans, such as the shape of a three-dimensional object and the touch.

  Moreover, in the information acquisition apparatus described in Patent Document 1, when a user touches an object displayed on the screen with a finger, the object is specified from registration information embedded in the object using digital watermark technology. The identification information is extracted, and the transmission / reception unit of the information acquisition device receives the result (related homepage) searched by the service providing server from the registration database corresponding to the identification information, and displays the related information on the screen.

  However, Patent Document 1 does not clearly specify at what timing the searched information is notified to the user, and the information searched while watching the TV program is assumed to be TV. If it appears on the screen, the TV program and the search information are simultaneously displayed on the same screen, and there is a problem that the user is distracted by the search information and misses the TV program. Further, in order to display the search information on the TV screen so as not to be covered by the program, there is a problem that the search information must be displayed small on the TV screen, which makes it difficult to view.

  Therefore, the present invention has been made in view of the above-described conventional problems, and analyzes program information during program broadcasting, performs an Internet search based on keywords related to the program information, and searches for information as a TV program. It is an object to provide an information processing apparatus, a control method, and a program that can prevent a TV program from being missed or forgetting to acquire information to be searched by displaying .

  In order to solve the above problem, the information processing apparatus according to the present invention is an information processing apparatus connected to the Internet, wherein the information processing apparatus receives video information and analyzes the received video information. Means for creating a keyword relevant to the video information from the analyzed video information; and searching for related information related to the keyword using the Internet based on the created keyword And display means for displaying the related information retrieved and the received video information separately.

  The information processing apparatus according to the present invention is the information processing apparatus according to claim 1, wherein the display unit separates and displays the video information and the related information, and displays the video information on the entire surface. The divided display mode displays the related information as a main screen and the video information as a sub-screen.

  Furthermore, the information processing apparatus according to the present invention further includes means for detecting presence / absence of a CM (Commercial Message) from the video information in the information processing apparatus according to claim 2, wherein the CM is started. When detected, the display means shifts from the full display mode to the split display mode, and when it is detected that the CM is finished, the display means shifts from the split display mode to the full display mode. It is characterized by doing.

  The information processing apparatus according to the present invention further includes means for detecting access to the related information in the information processing apparatus according to claim 3, and when access to the related information is detected in the divided display mode. Even if it is detected that the CM is finished, the split display mode does not shift to the full display mode.

  And in order to solve the said subject, the control method in this invention of Claim 5 is a control method of the information processing apparatus connected to the internet, Comprising: The process of receiving video information, The said receiving process Based on the step of analyzing the received video information, the step of creating a keyword related to the video information from the video information analyzed by the step of analyzing, and the keyword created by the step of creating A step of searching for related information related to the keyword using the Internet, and a step of displaying the related information searched by the searching step and the received video information separately. , Including.

  In order to solve the above problem, a program according to the present invention described in claim 6 is a computer-readable program that is executed by an information processing apparatus connected to the Internet, and includes a process of receiving video information. A process of analyzing the video information received by the process of receiving, a process of creating a keyword related to the video information from the video information analyzed by the process of analyzing, and a process of creating Based on the created keyword, the process of searching for related information related to the keyword using the Internet, and the display means distinguishes the related information searched by the searching process and the received video information And a process of displaying the information.

  According to the present invention, it is possible to obtain an information processing apparatus, a control method, and a program that can easily acquire TV-related information without missing a TV program.

It is a block diagram for demonstrating the operation | movement outline | summary of the information processing apparatus in embodiment of this invention. It is a schematic block diagram explaining the structure of the information processing apparatus in embodiment of this invention. In the information processing apparatus according to the embodiment of the present invention, as a display display method, (a) a diagram for explaining a display state when only a television image is displayed, and (b) a combination of the television image and related information is displayed. It is a figure explaining the display state when doing. It is a flowchart figure for demonstrating operation | movement of the information processing apparatus in embodiment of this invention.

  Next, embodiments for carrying out the present invention will be described in detail with reference to the drawings. In addition, in each figure, the same code | symbol is attached | subjected to the part which is the same or it corresponds, The duplication description is simplified thru | or abbreviate | omitted suitably. Briefly describing the contents of the present invention, a received television image is analyzed, a search is performed based on a keyword related to the television program, and the search result is presented to the user at a predetermined position and at a predetermined timing. Is possible. In the embodiment described below, a method for receiving a current television image is described as an example of a method for receiving a video. However, the method for receiving a video is not particularly limited, for example, the Internet or the like. Of course, the video information may be acquired via the.

  First, the configuration of the information processing apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a configuration diagram for explaining an outline of the operation of the information processing apparatus according to the embodiment of the present invention. Referring to FIG. 1, the information processing apparatus 20 receives and analyzes a television image transmitted from the broadcast station 10 ((1) TV image reception and analysis). In other words, the information processing apparatus 20 receives and plays back a TV video from the broadcast station 10, and at that time, analyzes the image and sound of the program and creates a word (video keyword) related to the video from the analysis result. To do. For example, when an Olympic swimming competition is being aired, the video keyword “Swimming Breaststroke” is created based on the text “Swimming” in the caption subtitle on the screen and the voice of the actual announcer “Future 100m Breaststroke”. . This video keyword will be described later.

  Next, the information processing apparatus 20 connected to the Web (Internet) 30 acquires related information using the video keyword based on the analysis result ((2) acquires related information using the video keyword). That is, search execution is performed using the Web keyword (Internet) using the video keyword, and information highly relevant to the video keyword is acquired. In addition, search execution may be performed using a video keyword in a specific Web site.

  Finally, the acquired related information is presented to the user 40 so as not to disturb the television viewing ((3) the relevant information is presented so as not to disturb the television viewing). That is, the related information acquired in (2) is presented to the user 40 at a display position and display timing that do not interfere with TV viewing. Details will be specifically described in the related information presentation method described later.

  Next, the configuration of the information processing apparatus 20 will be described with reference to FIG. FIG. 2 is a schematic block diagram illustrating the configuration of the information processing apparatus according to the embodiment of the present invention. In FIG. 2, the information processing apparatus 20 includes a tuner unit 21 that receives broadcast waves transmitted from the broadcast station 10, a content recording unit 22 that records content received by the tuner unit 21, and moving image content on a display 24. A video display processing unit 23 that performs video display processing for display, a video analysis processing unit 28 that analyzes video that has been subjected to video display processing, and a video keyword that is connected to the Internet and analyzed by the video analysis processing unit 28 A network connection processing unit 25 that connects to the Internet and executes search, a related information recording unit 26 that records related information searched by the network connection processing unit 25, and a video analyzed by the video analysis processing unit 28. The related information is recorded on the display 24 based on the related information recorded in the related information recording unit 26. And related information display part 27 for displaying a moving image display processing section 23, based on the related information display unit 27, a display 24 for displaying the moving image and associated information, and a.

  Next, a method for displaying television images and related information will be described. FIG. 3 shows (a) a diagram for explaining a display state when only a television image is displayed, and (b) a television image and related information as display methods in the information processing apparatus according to the embodiment of the present invention. It is a figure explaining the display state when displaying together.

  FIG. 3A is a diagram for explaining a display state when only a television image is displayed, and this display state is displayed while the main video image is being displayed (when CM distribution is not being performed). In this display state, a television image is displayed on the full screen (full screen) on the display 24 (FIG. 2). If the related information exists, the display state of FIG. 3B to be described later is automatically set during CM distribution, and automatically returns to the display state of FIG. 3A when the CM distribution ends.

  FIG. 3B is a diagram for explaining a display state when a TV image and related information are displayed together. This is the display state when a portion other than the main video is being displayed (when CM is being distributed). In this display state, related information is displayed in a display form that does not interfere with the television image. Specifically, a television image is displayed on the upper left of the display 24, a table of contents of related information is displayed below it, and details of the related information are displayed in the area of the right third of the display 24. Split display is made. That is, the details of the related information are displayed as the main screen, and the television video is displayed as the sub screen.

  In the case of FIG. 3B, the space observation in the related information table of contents is selected, and the detailed information related to space observation is displayed in the related information detail display section. If the user 40 operates the related information once, even if the video shifts to the main content display state (the state where the CM distribution is finished), unless the user 40 explicitly performs the operation of closing the related information, FIG. It does not return to the display state of (a).

  Next, the operation of the information processing apparatus in the embodiment of the present invention will be described. FIG. 4 is a flowchart for explaining the operation of the information processing apparatus according to the embodiment of the present invention. In FIG. 4, first, in the moving image display process of step (hereinafter referred to as “S”) 41, content data received from broadcast waves by the tuner unit 21 (FIG. 2) is accumulated in the content recording unit 22. In the moving image display processing unit 23, the content data is decoded and displayed on the display 24.

  In the video analysis (video keyword creation) processing in S42, the video analysis processing unit 28 accesses the decoding result, which is the processing result in S41 of the moving image display processing unit 23, and analyzes the video (characters, audio, etc.). The analysis results are aggregated, and a word that is highly related to the analyzed video (referred to as “video keyword”) is created.

  In the process of S43, it is determined whether or not a video keyword has been created. When it is determined that the video keyword has been created (S43: YES), the process proceeds to S44, and when it is determined that the video keyword cannot be created (S43: NO), the process proceeds to S45.

  In the related information acquisition process of S44, the network connection processing unit 25 performs an Internet search based on the video keyword created in the process of S42, acquires related information related to the video keyword, and acquires the related information recording unit 26. Accumulated in.

  In the video analysis (CM detection) process in S45, the video analysis processing unit 28 accesses the decoding result, which is the process result in S41, and detects CM distribution. The video analysis processing unit 28 distinguishes the start and end of CM distribution.

  In the process of S46, it is determined whether or not CM distribution is started. When it is determined that the CM distribution is started (S46: YES), the process proceeds to S49, and when it is determined that the CM distribution is not started (S46: NO), the process proceeds to S47.

  In the related information display process (display) in S49, the related information stored in the related information recording unit 26 acquired in the related information acquisition process in S44 is displayed on the display 24 so as not to interfere with the television image.

  In the process of S47, it is determined whether or not the CM distribution is finished. When it is determined that the CM distribution is complete (S47: YES), the process proceeds to S48, and when it is determined that the CM distribution is not complete (S47: NO), the process returns to S41.

  In the related information display process (end) of S48, when the user 40 does not show interest in the related information displayed on the display 24 in the process of S49 (for example, for the related information on which the user 40 is displayed). If it is determined that the CM distribution has ended in the process of S47 (S47: YES), the related information display process is ended. That is, the related information display is closed from the display 24, and the television image is displayed on the full screen (full screen) of the display 24. Further, when the user 40 is operating the related information (for example, when the user 40 accesses the related information displayed), until the user 40 explicitly closes the related information. After the split display state is maintained and the user 40 performs an operation of closing the related information, the television image is displayed on the full screen (full screen) of the display 24.

  As described above, according to the present invention, the related information related to the television image obtained using the image analysis result is displayed so as not to obstruct the television viewing, thereby maintaining the conventional television viewing state as it is. In addition, it is possible to provide an information processing apparatus, a control method, and a program that can make the information more meaningful by displaying the related information on the divided display screen.

  Note that each operation flow of the information processing apparatus 20 in the embodiment of the present invention shown in FIG. 4 can be executed by a program on a computer. That is, a CPU (not shown) incorporated in a control unit (not shown) loads a program stored in a storage unit (not shown) including a ROM (Read Only Memory), a RAM (Random Access Memory), etc. Are performed by sequentially executing.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments thereof, various modifications and changes can be made to these embodiments without departing from the broader spirit and scope of the invention as defined in the claims. is there.

DESCRIPTION OF SYMBOLS 10 Broadcasting station 20 Information processing apparatus 21 Tuner part 22 Content recording part 23 Movie display processing part 24 Display 25 Network connection processing part 26 Related information recording part 27 Related information display part 28 Image | video analysis processing part 30 Web (Internet)
40 users

Claims (6)

An information processing apparatus connected to the Web,
Means for receiving video information;
Means for analyzing the received video information;
Means for creating a keyword relevant to the video information from the analyzed video information;
Means for searching related information related to the keyword using the Web based on the created keyword;
Display means for displaying the retrieved related information and the received video information separately;
An information processing apparatus comprising:   The display means has a split display mode for displaying the video information and the related information separately, and a full display mode for displaying the video information over the entire surface, and the split display mode displays the related information. The information processing apparatus according to claim 1, wherein the information processing apparatus is displayed as a main screen and the video information is displayed as a sub-screen.   It further includes means for detecting a CM (Commercial Message) from the video information. When it is detected that the CM is started, the display means shifts from the full display mode to the split display mode, and 3. The information processing apparatus according to claim 2, wherein when it is detected that a commercial has ended, the display unit shifts from the divided display mode to the full display mode.   Means for detecting access to the related information, and when the access to the related information is detected in the split display mode, the full display from the split display mode is detected even if it is detected that the CM has ended. The information processing apparatus according to claim 3, wherein the information processing apparatus does not shift to a mode. A method for controlling an information processing apparatus connected to the Web,
Receiving video information; and
Analyzing the video information received by the receiving step;
Creating a keyword related to the video information from the video information analyzed by the analyzing step;
Searching related information related to the keyword using the Web based on the keyword created by the creating step;
A display means for displaying the related information searched in the searching step and the received video information separately;
The control method characterized by including. A computer-readable program that is executed by an information processing apparatus connected to the Web,
Processing to receive video information;
A process of analyzing the video information received by the receiving process;
A process of creating a keyword related to the video information from the video information analyzed by the analyzing process;
A process of searching related information related to the keyword using the Web based on the keyword created by the creating process;
A process in which the display means classifies and displays the related information searched by the searching process and the received video information;
The program characterized by including.

Images