JP2013059038A - Information processing device and information display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device capable of displaying a list of keywords related to topics, words and the like which interest a user within various information pieces appearing in broadcast program data in viewing, and capable of retrieving information from the Internet by using the list of the keywords.SOLUTION: In viewing processing of broadcast program data, sentence information is acquired from subtitles, electronic program information, a telop, and sound data, and stored in a database 309. When an operation such as depression of an "interesting" button is executed in the viewing processing of the broadcast program data, a keyword extraction part 306 extracts keywords by performing morphological analysis on the sentence information stored in the database 309 in a certain period immediately before the depression of the "interesting" button. The list of the extracted keywords is displayed as a keyword list. When a keyword is selected from the keyword list by a user, information related to the selected keyword is acquired from the Internet.

Description

  The present invention relates to an information processing apparatus capable of receiving broadcast program data and an information display method applied to the information processing apparatus.

  In recent years, personal computers having the same AV function as audio / video (AV) devices such as DVD (Digital Versatile Disc) players, video recorders, and TV apparatuses have been developed.

  Such a personal computer has a tuner for receiving a television broadcast signal, and can view and record broadcast program data.

  Broadcast program data includes various genres such as news, dramas, movies, sports broadcasts, education, variety, and the user can obtain various information from broadcast program data being viewed.

  Recently, a technology for providing viewers with information related to broadcast program data has begun to be developed.

  For example, Patent Document 1 receives a keyword for Internet search transmitted together with program data by broadcast waves, displays a list of received keywords, and displays information related to the keyword selected by the user on the Internet. A broadcast receiver having a function of acquiring from is disclosed.

JP 2004-86754 A

  However, in Patent Document 1, keywords displayed in the keyword list are prepared in advance for each program by the broadcaster side. For this reason, the content of the keyword displayed in the keyword list is fixed for each program, and only the keyword having the same content can always be displayed.

  In general, various kinds of information appear in a program, but the matter of interest in the program differs for each individual user. Therefore, instead of displaying a fixed list of keywords sent from the broadcaster side, keywords related to topics, words, or contents that the user actually cares about while watching broadcast programs It is necessary to realize a new mechanism for displaying the list of

  The present invention has been made in view of the above circumstances, and can display a list of keywords related to topics, words, etc. that the user was interested in among various information appearing in the broadcast program data being viewed, It is another object of the present invention to provide an information processing apparatus and an information display method capable of performing information retrieval from the Internet using the keyword list.

  In order to solve the above-described problem, an information processing apparatus according to claim 1 includes a receiving unit that receives program data, a communication unit, a unit that displays video data included in the program data on a display unit, and the program Text information acquisition means for acquiring text information from data and storing it in a storage device, and words extracted from text information stored in the storage device when a predetermined user operation is performed during display of the program data Are generated in order from the latest stored in the storage device, list display means for displaying the generated list on the display device, and a word selected by the user from the displayed list Is transmitted as a search word to a predetermined server device on the Internet via the communication unit, so that information matching the search word is transmitted to the Internet. Gets, characterized by comprising an information acquisition processing means for displaying the acquired information on the display device.

  According to the present invention, it is possible to display a list of keywords related to topics, words, etc. that the user is interested in among various information appearing in the broadcast program data being viewed, and from the Internet using the keyword list. It is possible to perform information retrieval.

1 is a perspective view illustrating an example of an overview of an information processing apparatus according to an embodiment of the present invention. 2 is an exemplary block diagram showing an example of the system configuration of the information processing apparatus of the embodiment. FIG. 2 is an exemplary block diagram illustrating a functional configuration of a program used in the information processing apparatus of the embodiment. FIG. The figure for demonstrating the data flow of the search assistance service process performed by the information processing apparatus of the embodiment. 6 is an exemplary view showing an example of a keyword list and a search result page used in a search assistance service process executed by the information processing apparatus of the embodiment. 2 is a diagram showing an example of a display screen of the information processing apparatus of the embodiment. FIG. 2 is an exemplary view showing an example of a TV viewing window used in the information processing apparatus of the embodiment. FIG. 6 is an exemplary flowchart illustrating a procedure of search assistance service processing executed by the information processing apparatus of the embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First, with reference to FIG. 1 and FIG. 2, the structure of the information processing apparatus which concerns on one Embodiment of this invention is demonstrated. The information processing apparatus according to the present embodiment is realized by, for example, a notebook portable personal computer 10.

  The personal computer 10 has a TV function for viewing and recording broadcast program data broadcast by a television broadcast signal. This TV function is realized by, for example, a TV application program installed in the personal computer 10 in advance.

  Furthermore, the personal computer 10 has a search assistance service function for acquiring further information on topics and words that appear in the broadcast program during the viewing process of the broadcast program data from the Internet. This search assistance service function is provided by a memo function that displays a list of keywords related to topics, words, matters to be remembered, etc. that the user appears in the broadcast program data being viewed as memo information, and the user. And an information display function for acquiring and displaying information related to the selected keyword from the Internet when the keyword is selected. These memo function and information display function are incorporated in the TV application program.

  FIG. 1 is a perspective view of the computer 10 with the display unit opened. The computer 10 includes a computer main body 11 and a display unit 12. The display unit 12 incorporates a display device including a TFT-LCD (Thin Film Transistor Liquid Crystal Display) 17.

  The display unit 12 is attached to the computer main body 11 so as to be rotatable between an open position where the upper surface of the computer main body 11 is exposed and a closed position covering the upper surface of the computer main body 11. The computer main body 11 has a thin box-shaped housing, and has a keyboard 13 on its upper surface, a power button 14 for powering on / off the computer 10, an input operation panel 15, a touch pad 16, and a speaker. 18A, 18B, etc. are arranged.

  The input operation panel 15 is an input device that inputs an event corresponding to a pressed button, and includes a plurality of buttons for starting a plurality of functions. These button groups also include operation button groups for controlling TV functions (viewing, recording, and reproduction of recorded broadcast program data / video data). In addition, the button group of the input operation panel 15 includes an “interesting” button. This “interesting” button is an operation button for starting the memo function described above. The user appeared in the broadcast program just before the “worried” button was operated by pressing the “worried” button when a topic, word, or the like of interest appeared in the broadcast program being watched You can see a list of various keywords related to topics, words, etc.

  In addition, a remote control unit interface unit 20 for executing communication with a remote control unit for remotely controlling the TV function of the computer 10 is provided on the front surface of the computer main body 11. The remote control unit interface unit 20 includes an infrared signal receiving unit and the like.

  On the right side of the computer main body 11, for example, an antenna terminal 19 for TV broadcasting is provided. Further, on the back surface of the computer main body 11, for example, an external display connection terminal corresponding to the HDMI (high-definition multimedia interface) standard is provided. The external display connection terminal is used to output video data (moving image data) included in video content data such as broadcast program data to an external display.

  Next, the system configuration of the computer 10 will be described with reference to FIG.

  As shown in FIG. 2, the computer 10 includes a CPU 101, a north bridge 102, a main memory 103, a south bridge 104, a graphics processing unit (GPU) 105, a video memory (VRAM) 105A, a sound controller 106, a BIOS- ROM 109, LAN controller 110, hard disk drive (HDD) 111, DVD drive 112, network controller 114, IEEE 1394 controller 115, embedded controller / keyboard controller IC (EC / KBC) 116, TV tuner 117, EEPROM 118, etc. .

  The CPU 101 is a processor that controls the operation of the computer 10 and executes various application programs such as an operating system (OS) 201 and a TV application program 202 that are loaded from the hard disk drive (HDD) 111 to the main memory 103. . The TV application program 202 is software for executing a TV function. This TV application program 202 is a live process for viewing broadcast program data received by the TV tuner 117, a recording process for recording the broadcast program data in the HDD 111, and a reproduction for reproducing the recorded broadcast program data / video data. Execute processing etc. The CPU 101 also executes a BIOS (Basic Input Output System) stored in the BIOS-ROM 109. The BIOS is a program for hardware control.

  The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The north bridge 102 also has a function of executing communication with the GPU 105 via a PCI EXPRESS standard serial bus or the like.

  The GPU 105 is a display controller that controls the LCD 17 used as a display monitor of the computer 10. A display signal generated by the GPU 105 is sent to the LCD 17. The GPU 105 can also send a digital video signal to the external display device 1 via the HDMI control circuit 3 and the HDMI terminal 2.

  The HDMI terminal 2 is the above-described external display connection terminal. The HDMI terminal 2 can send an uncompressed digital video signal and a digital audio signal to the external display device 1 such as a television with a single cable. The HDMI control circuit 3 is an interface for sending a digital video signal to the external display device 1 called an HDMI monitor via the HDMI terminal 2.

  The south bridge 104 controls each device on an LPC (Low Pin Count) bus and each device on a PCI (Peripheral Component Interconnect) bus. The south bridge 104 includes an IDE (Integrated Drive Electronics) controller for controlling the hard disk drive (HDD) 111 and the DVD drive 112. Further, the south bridge 104 has a function of executing communication with the sound controller 106.

  Furthermore, a video processor 113 is connected to the south bridge 104 via a PCI EXPRESS standard serial bus or the like.

  The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speakers 18A and 18B or the HDMI control circuit 3.

  The network controller 114 executes communication with a wired or wireless network. The network controller 114 functions as a communication unit that performs communication with the Internet via an external router or the like.

  The embedded controller / keyboard controller IC (EC / KBC) 116 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard (KB) 13 and the touch pad 16 are integrated. . The embedded controller / keyboard controller IC (EC / KBC) 116 has a function of powering on / off the computer 10 in accordance with the operation of the power button 14 by the user. Further, the embedded controller / keyboard controller IC (EC / KBC) 116 has a function of executing communication with the remote control unit interface 20.

  The TV tuner 117 is connected to the antenna terminal 19 and receives a television (TV) broadcast signal and selects a channel. The TV tuner 117 is realized as a digital TV tuner capable of receiving digital broadcast program data such as terrestrial digital TV broadcast.

  Next, the functional configuration of the TV application program 202 will be described with reference to FIG.

  The TV application program 202 includes a main processing unit 301, a user interface unit (UI) 302, a viewing processing unit 303, a recording / playback processing unit 304, a text information acquisition unit 305, a keyword extraction unit 306, a keyword list display unit 307, and an information An acquisition processing unit 308 and the like are provided.

  The main processing unit 301 is a control unit that controls the operation of the TV application program 202. The viewing processing unit 303, the recording / playback processing unit 304, the text information acquisition unit 305, the keyword extraction unit 306, the keyword list display unit 307, and the information By controlling the acquisition processing unit 308 and the like, processing corresponding to various events accepted by the user interface unit (UI) 302 is executed.

  The viewing processing unit 303 displays video data included in broadcast program data carried by a television broadcast signal of a predetermined channel selected by the TV tuner 117 on a display device such as the LCD 17 under the control of the main processing unit 301. The viewing process to be executed is executed. In this viewing process, a process of reproducing audio data included in the broadcast program data is also executed.

  The recording / playback processing unit 304 records the broadcast program data carried by the television broadcast signal of the predetermined channel selected by the TV tuner 117 under the control of the main processing unit 301 in the HDD 111 and the HDD 111. A reproduction process for reproducing the recorded broadcast program data is executed.

  The text information acquisition unit 305 acquires text information from the television broadcast signal of the channel to be viewed that is selected by the TV tuner 117 during the viewing process of the broadcast program data under the control of the main processing unit 301. The acquired text information is stored in the database 309. The database 309 includes a part of the storage area in the storage area of the HDD 111.

  The text information acquisition unit 305 acquires various data usable as text information from a television broadcast signal of a channel to be viewed. Data usable as text information includes, for example, subtitle information included in broadcast program data being viewed, electronic program information related to broadcast program data being viewed, and telop included in video data of broadcast program data being viewed. Audio data included in broadcast program data being viewed. The caption information included in the broadcast program data being viewed is included in, for example, table information called EIT that is carried by the television broadcast signal of the channel being viewed. The text information acquisition unit 305 selects at least one of the caption information, electronic program information, telop, and audio data as text information acquisition data, and acquires text information from each of the selected data. For example, at least one of caption information and electronic program information is used as default text information acquisition data. When acquiring text information from audio data, that is, when using audio data as text information acquisition data, the text information acquisition unit 305 recognizes voice data included in broadcast program data being viewed. The processing is executed, and the recognition result is stored in the database 309 as text information.

  The keyword extraction unit 306 extracts keywords from the sentence information by performing morphological analysis on the sentence information stored in the database 309 under the control of the main processing unit 301. The keyword extraction processing by the keyword extraction unit 306 is executed, for example, when the “interesting” button is operated by the user. In this case, not all text information stored in the database 309 is subject to keyword extraction processing, but text information stored in the database 309 during a certain period immediately before the “interesting” button is operated. Is selected as a processing target. In other words, only text information stored in the database 309 during a predetermined period from a time point a predetermined time before the “worried” button is operated to a time point when the “worried” button is operated. Will be processed. Thereby, it is possible to process only text information including topics, words, etc., which the user is actually interested in, among text information accumulated during viewing of the broadcast program.

  The keyword extraction unit 306 not only extracts a plurality of keywords by performing morphological analysis on the text information to be processed, but also outputs words or priorities related to the keywords as additional information for each keyword. The word related to the keyword is, for example, a word representing an upper / lower concept of the meaning (category) of the extracted keyword. For example, if the keyword is “wine”, words such as “drink”, “France”, “red wine” are output as related words, and the priority is used for displaying a keyword list described later. Of keywords to be processed, keywords extracted from sentence information stored in the database 309 with a later timing, that is, extracted from sentence information stored at a timing closer to the point in time when the “interesting” button is operated. The higher the priority, the higher the keyword.

  The keyword list display unit 307 generates a keyword list indicating a list of keywords extracted by the keyword extraction unit 306 under the control of the main processing unit 301, and uses the generated keyword list as a topic that the user is interested in. The memo information in which the words or the matters to be remembered are written down is displayed on the display device such as the LCD 17. In this case, the keyword list display unit 307 gives priority to the keyword extracted from the sentence information stored in the database 309 with the latest timing among the keywords extracted from the sentence information to be processed based on the above-described priority. To generate a keyword list. For example, a keyword list in which keywords are arranged in descending order of priority is generated. In addition, since the upper limit of the number of keywords that can be displayed in the keyword list is determined in advance, when keywords exceeding the predetermined number n are extracted by the keyword extraction unit 306, a higher priority is assigned. A keyword list is generated from only n keywords.

  The information acquisition processing unit 308 is selected by the user from the displayed keyword list by executing communication with a predetermined server device on the Internet via the network controller 114 under the control of the main processing unit 301. Get information related to the keyword from the Internet. Specifically, when a keyword is selected by the user from the keyword list, the information acquisition processing unit 308 uses the selected keyword as a search term to a predetermined server device on the Internet via the network controller 114. By transmitting, information matching the search term is acquired from the Internet, and the acquired information is displayed on a display device such as the LCD 17.

  In this case, in order to obtain more accurate information from the Internet, the information acquisition processing unit 308 uses not only the selected keyword but also a word added as additional information to the selected keyword as a search term. Send to.

  The server device requests a search for information matching the search word received from the computer 10 to a predetermined search server on the Internet, so that information matching the search word from the search server (for each WEB page matching the search word). A location information URL and a title / summary of each WEB page are acquired, and a search result page is generated based on the acquired information, and the search result page is transmitted to the computer 10.

  Next, with reference to FIG. 4 and FIG. 5, the flow of processing executed during viewing processing of broadcast program data will be described. FIG. 4 shows a data flow, and FIG. 5 shows an example of a keyword list and a search result page.

  As described above, during viewing processing of broadcast program data, text information is acquired from subtitles, electronic program information, telop, audio data, and the like, and stored in the database 309. For example, as shown in FIG. 5A, when the broadcast program data being viewed is included in the caption information, the caption information is decoded and stored in the database 309 as text information. Each acquired text information is stored in the Daders 309 together with time information, for example.

  When a predetermined user operation such as pressing the above-mentioned “interesting” button is performed during the viewing process of the broadcast program data, the keyword extracting unit 306 executes the keyword extracting process. As described above, the sentence information to be subjected to the keyword extraction process is the sentence information accumulated in the database 309 for a certain period immediately before the time when a predetermined user operation such as pressing the “worried” button is performed. It is. The keyword extraction unit 306 divides the sentence information into words by performing morphological analysis on the sentence information using a morphological analysis engine, and thereby extracts a plurality of keywords. Further, the keyword extraction unit 306 performs semantic analysis of each keyword using a semantic analysis engine, and adds and outputs additional information such as a related word to each keyword. The extracted keyword list is displayed on the LCD 17 as a keyword list. FIG. 5B shows an example of a keyword list. Each keyword is displayed with an icon indicating the category of the keyword attached.

  When a keyword is selected from the keyword list by the user, the selected keyword and a word related to the keyword are transmitted to the server device 411 as a search word. For example, the server device 411 converts the search term into a URL for transmitting a search request including the search term to a predetermined search server 412, and searches for a search for information that matches the search term using the URL. Request to server 412. Then, the server device 411 receives the search result from the search server 412, generates a predetermined search result page that can be handled by the TV application 202 based on the received search result, and stores the search result page in the computer 10. Send to.

  FIG. 5C shows an example of a search result page displayed on the LCD 17 of the computer 10. This search result page corresponds to the case where the selected keyword “wine” and the related words “France”, “buy”, and “drink” are transmitted as search terms to the server device. is there. For example, the server device transmits an AND search request for “wine” and “France”, an AND search request for “wine” and “buy”, and an AND search request for “wine” and “drink” to the search server. Based on the search result, a search result page as shown in FIG. 5C is generated and transmitted to the computer 10. When the user selects the “French” and “Search” tab on the search result page, a search result corresponding to an AND search request for “wine” and “France” is displayed. When the “Buy” tab on the page is selected, search results corresponding to AND search requests for “Wine” and “Buy” are displayed, and the “Drink” tab on the search results page is selected Displays a search result corresponding to the AND search request “wine” and “drink”.

  FIG. 6 shows an example of a display screen including a TV viewing window, a keyword list, and a search result page. On the display screen of the LCD 17, a TV viewing window 501 for displaying video data in broadcast program data being viewed is arranged. In the TV viewing window 501, as shown in FIG. 7, an “interesting” button 601 can be displayed. When this “worried” button 601 is clicked, the keyword list 502 extracted from the text information immediately before the “worried” button 601 is clicked is displayed on the display screen of the LCD 17. Furthermore, when a certain keyword in the keyword list 502 is selected by the user, the search result page 503 related to the selected keyword, the WEB site page linked to the search result page 503, or the like is used as information related to the selected keyword. It is displayed on the display screen of the LCD 17.

  Note that the contents of the keyword list 502 are updated each time the “interesting” button 601 is operated. That is, the keyword extraction process and the keyword list generation process are executed each time the “interesting” button 601 is operated. The keyword list once generated is stored. For this reason, the user can call and view a keyword list generated in the past as necessary.

  Next, the procedure of the search assistance service process executed by the TV application program 202 will be described with reference to the flowchart of FIG.

  When the viewing process of the broadcast program data of a certain channel is started, the main processing unit 301 controls the text information acquisition unit 305 to acquire data usable as text information from the broadcast signal being received, and the database 309. (Step S101). That is, the main processing unit 301 executes a process of acquiring sentence information from subtitles, electronic program information, telop, and audio data included in the broadcast signal being received, and accumulates the acquired sentence information in the database 309. In step S101, subtitles and electronic program information are acquired from the broadcast signal being received, and the subtitles and electronic program information are decoded and stored in the database 309 as text information. Also, a telop is extracted from the video data in the broadcast program, the telop is decoded and stored as text information in the database 309, and the audio data in the broadcast program is extracted, and the extracted audio data is converted into audio. Processing for storing sentence information obtained by recognition in the database 309 is executed.

  When the user performs a predetermined user operation such as the click operation of the above-described “interesting” button 601 during the broadcast program data viewing process (YES in step S102), the main processing unit 301 executes the memo function. In order to do this, the keyword extraction unit 206 and the keyword list display unit 307 are activated. Then, the main processing unit 301 controls the keyword extraction unit 206 to execute keyword extraction processing (step S103). In step S103, the sentence information stored in the database 309 for a certain period immediately before the point of time when the “interesting” button 601 is clicked is selected as a processing target, and morphological analysis and semantic analysis of the processing target sentence information is performed. Etc., the keyword and additional information are output. Next, the main processing unit 301 controls the keyword list display unit 307 to generate and display a keyword list (step S104). In the keyword list, the keywords are displayed in order of priority. When a keyword in the keyword list is selected by the user's operation of the mouse or the keyboard 13 (YES in step S105), the main processing unit 301 controls the information acquisition processing unit 308 to select the selected keyword and related items. By transmitting a word or the like as a search term to the server device, information related to the selected keyword (search result page) is acquired from the Internet and displayed on the LCD 17 (step S106).

  As described above, in this embodiment, it is possible to display a list of keywords related to topics, words, etc. that the user is interested in among various information appearing in the broadcast program data being viewed. Can be used to search information from the Internet. In addition, since the keyword list displays various keywords related to topics, words, etc. that appear in the broadcast program data during a certain period immediately before the “worried” button is operated, the keyword list contains user memo information. It can also be used as

  Note that all the search assistance service processing procedures of this embodiment can be realized by software, so that the same effect as this embodiment can be obtained by introducing this software into a normal computer through a computer-readable storage medium. It can be easily realized.

  Further, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine a component suitably in different embodiment.

    DESCRIPTION OF SYMBOLS 10 ... Computer, 117 ... TV tuner, 301 ... Main processing part, 303 ... Viewing processing part, 305 ... Text information acquisition part, 306 ... Keyword extraction part, 307 ... Keyword list display part, 308 ... Information acquisition processing part

Claims (6)

Receiving means for receiving program data;
A communication department;
Means for displaying video data included in the program data on a display device;
Text information acquisition means for acquiring text information from the program data and storing it in a storage device;
When a predetermined user operation is performed during the display of the program data, a list in which words extracted from the sentence information stored in the storage device are arranged in order from the latest stored in the storage device is generated. List display means for displaying the generated list on the display device;
Information matching the search word is acquired from the Internet by transmitting a word selected by the user from the displayed list as a search word to a predetermined server device on the Internet via the communication unit. An information processing apparatus comprising: information acquisition processing means for displaying the acquired information on the display device.   The information processing apparatus according to claim 1, wherein the list display unit extracts a word from sentence information stored in the storage device during a predetermined period before the user operation is performed.   The predetermined server device requests the search for information that matches the search word received from the information processing device to the predetermined search server on the Internet, thereby causing the location information of the information that matches the search word from the search server. The information processing apparatus according to claim 1, further comprising: generating a search result page based on the acquired location information and transmitting the search result page to the information processing apparatus.   The information processing apparatus according to claim 1, wherein the text information acquisition unit acquires the text information from caption information and telop included in the program data.   2. The information processing according to claim 1, wherein the text information acquisition means includes means for acquiring text information from the voice data by executing voice recognition processing on the voice data included in the program data. apparatus. An information display method for displaying information related to program data by controlling the operation of an information processing apparatus capable of receiving program data,
During the display of the program data, text information is acquired from the program data and stored in the storage device of the information processing device,
When a predetermined user operation is performed during the display of the program data, a list in which words extracted from the sentence information stored in the storage device are arranged in order from the latest stored in the storage device is generated. , Displaying the generated list on the display device,
A word selected by the user from the displayed list is matched with the search word by transmitting it as a search word to a predetermined server device on the Internet via a communication unit provided in the information processing apparatus. An information display method for acquiring information from the Internet and displaying the acquired information on the display device.

Images