JP2019074949A - Retrieval device and program - Google Patents

Abstract

To provide the ease for users to obtain information pertaining to a broadcast at which they are watching.SOLUTION: A terminal device 10 obtains speeches of a broadcast at which a user is watching on a television receiver 30. The terminal device 10 obtains a digital program list of a television broadcasting and extracts information pertaining to a program at which the user is watching from the obtained digital program list. The terminal device 10 extracts words by conducting speech recognition on the obtained speeches, determines keywords for retrieving on the basis of the extracted words and the information extracted from the digital program list, and transmits the determined keywords to a server device 20. The server device 20 retrieves information by using the keywords transmitted from the terminal device 10 and transmits the retrieval result to the terminal device 10. The terminal device 10 receives the retrieval result transmitted from the server device 20 and outputs the received retrieval result.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a search device and program.

  Patent Document 1 discloses a television that transmits feature data of a song currently being watched by the user to a search server, receives song information from the search server, and displays the content of the received song information. According to this television, it is possible for the user to easily obtain the information of the song that has flowed during viewing.

JP 2012-53722 A

  While watching a broadcast, various voices such as narrations and talks of performers may be output, and a user watching a broadcast may want to obtain information related to the content of the broadcast voice. . However, when searching for words in a conversation, miscellaneous information may be displayed.

  An object of the present invention is to allow a user to easily obtain information on a broadcast being viewed.

  The present invention provides a first acquisition unit for acquiring audio and / or video of a broadcast viewed by a user, and second acquisition for acquiring information related to the broadcast viewed by the user or information related to the user of the own apparatus Search unit for searching based on the unit, an extraction unit for extracting a keyword from the audio and / or video acquired by the first acquisition unit, the keyword extracted by the extraction unit and the information acquired by the second acquisition unit And an output unit for outputting the search result of the search unit.

  In the present invention, the information related to the broadcast may be information extracted from an electronic program guide of the broadcast.

  Further, in the present invention, the information related to the user may be an attribute of the user, and the search unit may be configured to search based on the keyword extracted by the extraction unit and the attribute.

  Further, in the present invention, the information related to the user may be a viewing history of the broadcast by the user, and the searching unit may perform a search based on the keyword extracted by the extracting unit and the viewing history. .

  Further, in the present invention, the output unit may set an output destination of the search result as an output destination according to the information used for the search by the search unit.

  Further, in the present invention, the output unit may set the output destination of the search result as the output destination according to the content of the broadcast being viewed by the user.

  Furthermore, the present invention provides a computer with a first acquisition unit for acquiring audio and / or video of a broadcast being viewed by a user, information concerning a broadcast being viewed by the user, or information concerning the user of the own apparatus. Based on a second acquisition unit to be acquired, an extraction unit to extract a keyword from the audio and / or video acquired by the first acquisition unit, a keyword extracted by the extraction unit and information acquired by the second acquisition unit A program for functioning as a search unit for searching and an output unit for outputting a search result of the search unit is provided.

  According to the present invention, a user can easily obtain information on a broadcast being viewed.

The figure which showed the apparatus which concerns on the search system 1 of one Embodiment of this invention. FIG. 2 is a block diagram showing a hardware configuration of a terminal device 10. FIG. 2 is a block diagram showing the configuration of functions implemented in the terminal device 10; The flowchart which showed the flow of the process which the terminal device 10 performs.

[Embodiment]
(overall structure)
FIG. 1 is a diagram showing an apparatus according to a search system 1 which is an embodiment of the present invention. In the following description, the term "device" can be read as a circuit, a device, a unit, or the like. The communication network 2 includes the Internet, a fixed telephone network, a mobile communication network and the like. The terminal device 10 accesses the communication network 2 by wire or wirelessly. Also, the server device 20 accesses the communication network 2 by wire.

  The terminal device 10 according to the present embodiment is a device having a microphone and a speaker, and is a stationary computer device called a so-called smart speaker. The terminal device 10 performs voice communication and / or data communication via the communication network 2. The terminal device 10 has a search function, recognizes a voice collected by a microphone, searches information based on a word extracted from the recognized voice, and performs a process of outputting a search result to the user. The terminal device 10 is an example of a search device according to the present invention. The terminal device 10 is not limited to a stationary type, and may be a portable type device such as a smartphone, a tablet terminal, or a feature phone. The terminal device 10 may be a subscriber station, a mobile unit, a subscriber unit, a wireless unit, a remote unit, a mobile device, a wireless device, a wireless communication device, a remote device, a mobile subscriber station, an access terminal, a mobile terminal, by a person skilled in the art. It may also be called a wireless terminal, a remote terminal, a handset, a user agent, a mobile client, a client, or some other suitable term. The number of terminal devices 10 included in the search system 1 is not limited to the number illustrated in FIG. 1, and may be equal to or more than the number illustrated in FIG. 1.

  The television receiver 30 is a receiver that receives radio waves of television broadcasting and outputs video and audio of a selected channel, and is installed in a room in which the terminal device 10 is installed. The server device 20 is a so-called search server. The server device 20 communicates with the terminal device 10 via the communication network 2. The server device 20 searches for information in response to access from the terminal device 10, and transmits information hit by the search to the terminal device 10.

(Configuration of terminal device 10)
FIG. 2 is a diagram showing an example of the hardware configuration of the terminal device 10. As shown in FIG. The operation unit 103 includes an operation element for operating the terminal device 10. The terminal device 10 operates in accordance with the operated operator. The communication unit 105 is hardware (transmission / reception device) for performing communication between computers in a wired and / or wireless manner, and is also called, for example, a network device, a network controller, a network card, a communication module, or the like. The communication unit 105 performs voice communication and data communication via the communication network 2. The audio processing unit 107 has a microphone 107A and a speaker 107B. The audio processing unit 107 outputs a signal representing an audio to the speaker 107B. The speaker 107B outputs the sound represented by the supplied signal. Further, the voice processing unit 107 generates data (hereinafter, referred to as sound collection data) representing the sound collected by the microphone 107A, and supplies the generated sound collection data to the control unit 101.

  The storage unit 102 stores a program that the control unit 101 executes. The storage unit 102 is a computer-readable recording medium, and for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magnetooptical disk (for example, a compact disk, a digital versatile disk, Blu-ray disc) The disk may be configured of at least one of a ray (registered trademark) disk, a smart card, a flash memory (for example, a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, and the like. The storage unit 102 may be called an auxiliary storage device.

  The control unit 101 includes a CPU (Central Processing Unit) and a memory. The functions implemented in the terminal device 10 are calculated by loading a program (software) stored in the storage unit 102 onto hardware such as a CPU, a memory, etc., and the CPU performs an operation to control the storage unit 102, and the communication unit 105. Control of the audio processing unit 107, and control of reading and / or writing of data in the memory and storage unit 102. The various processes described later performed by the control unit 101 are not limited to execution by one CPU, and may be performed simultaneously or sequentially by two or more CPUs. The CPU may be implemented by one or more chips. The control unit 101 may be configured by a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic device, a register, and the like. Further, the control unit 101 includes hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), and a field programmable gate array (FPGA). It may be configured, and part or all of each functional block may be realized by the hardware. The memory is a computer readable recording medium, and includes, for example, at least one of a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be The memory may be called a register, a cache, a main memory (main storage device), and the like. The memory can store a program (program code), a software module, etc. that can be executed to carry out the process according to an embodiment of the present invention.

  FIG. 3 is a functional block diagram showing the configuration of the function according to the present invention among the functions realized by the control unit 101 executing the program stored in the storage unit 102. These functional blocks (components) may be realized by any combination of hardware and / or software. Moreover, the implementation means of each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly two or more physically and / or logically separated devices. It connects (for example, wired and / or wirelessly), and may be realized by these multiple devices.

  The first acquisition unit 1001 acquires audio and / or video of a broadcast viewed by the user. The second acquisition unit 1002 acquires information related to a broadcast being viewed by the user or information related to the user of the own apparatus. The extraction unit 1003 extracts keywords from the audio and / or video acquired by the first acquisition unit 1001. The search unit 1004 performs a search based on the keyword extracted by the extraction unit 1003 and the information acquired by the second acquisition unit 1002. The output unit 1005 outputs the search result of the search unit.

(Operation Example of Embodiment)
Next, an operation example of the present embodiment will be described. FIG. 4 is a flowchart showing an example of the flow of processing performed by the terminal device 10. First, the terminal device 10 acquires an electronic program guide (step SA1). Here, the terminal device 10 acquires an electronic program guide via the communication network 2 from a server device (not shown) that provides an electronic program guide, for example. The terminal device 10 may communicate with the television receiver 30 in a wired or wireless manner to acquire the electronic program guide from the television receiver 30. Further, the terminal device 10 may receive radio waves of television broadcast and acquire an electronic program guide from the received radio waves.

  The terminal device 10 having acquired the electronic program guide specifies the channel number of the broadcast being viewed on the television receiver 30 (step SA2). The terminal device 10 specifies the channel number being viewed, for example, by the channel number input by the user using the operation unit 103. The terminal device 10 may specify the channel number of the broadcast being viewed by communicating with the television receiver 30 and acquiring the channel number of the broadcast being viewed from the television receiver 30. Alternatively, the user may input the channel number of the broadcast being viewed to the terminal device 10 by voice, and the terminal device 10 may recognize the input voice to specify the channel number.

  When the terminal device 10 specifies the channel number of the broadcast being viewed on the television receiver 30, the terminal device 10 refers to the acquired electronic program guide, and uses the date and time at this time and the specified channel number to make the program being viewed by the user. Are identified (step SA3). Next, the terminal device 10 (second acquisition unit 1002) extracts information of the program being viewed by the user specified in step SA3 from the acquired electronic program guide (step SA4). Here, the terminal device 10 extracts, for example, a word in the description of the program included in the program guide as the information of the program. For example, when the program being viewed is a music program, words such as the name of a performer of the program, the name of a song to be broadcast in the program, etc. are being viewed from the description of the program included in the program guide Extracted as program information of

  The terminal device 10 performs speech recognition processing in parallel with the processing shown in FIG. Specifically, in the audio processing unit 107, the microphone 107A picks up the audio output from the television receiver 30. The sound processing unit 107 generates sound collection data according to the sound collected by the microphone 107A. The control unit 101 (first acquisition unit 1001) acquires sound collection data. The terminal device 10 (extraction unit 1003) that has extracted the information from the electronic program guide performs speech recognition processing on the collected sound data generated by the speech processing unit 107, and uses the words included in the sound collected by the microphone 107A. Extract. The word extracted here is an example of the keyword according to the present invention.

  The terminal device 10 (search unit 1004) that has extracted words from the sound of television broadcast performs a search based on the words extracted in the speech recognition process and the words extracted from the electronic program guide in step SA4. For example, when a cast name is introduced by voice in a broadcast that a user is viewing and listening to, the terminal device 10 extracts the introduced cast name by voice recognition. The terminal device 10 determines whether the same performer name as the performer name extracted by speech recognition is present in the words extracted from the electronic program guide (step SA5). If there is the same cast name as the cast name extracted by speech recognition in the word extracted from the electronic program guide (YES in step SA5), the terminal device 10 is a character string of the cast name extracted by speech recognition The (word) is transmitted to the server device 20 (step SA6). That is, the terminal device 10 (search unit 1004) performs a search using the server device 20).

  The server device 20 receives the character string transmitted from the terminal device 10, and searches for information using the received character string as a search keyword. As described above, when the character string transmitted from the terminal device 10 is a cast name, the server device 20 searches for information using the cast name as a search key. When the search of information is completed, the server device 20 transmits the information hit by the search to the terminal device 10. For example, when the server device 20 searches for information by a performer name, the server device 20 acquires a profile of a person specified by the performer, and transmits text information representing the acquired profile to the terminal device 10.

  The terminal device 10 (search unit 1004) receives the information transmitted from the server device 20 (step SA7). The terminal device 10 (output unit 1005) converts the text information received by the search unit 1004, that is, the search result of the search performed by the search unit 1004 using the server device 20 into, for example, a voice signal and outputs it from the speaker 107B. (Step SA8). For example, when the terminal device 10 receives text information of the above-described profile, the terminal device 10 converts the text information of the profile into an audio signal and outputs the signal from the speaker 107B. The user can know the profile of the performer introduced in the program by listening to the sound output from the terminal device 10.

  As described above, according to the present embodiment, the user can easily obtain information on the broadcast being viewed even if the user does not designate the search keyword and the execution of the search while viewing the broadcast. it can. Further, according to the present embodiment, the information search is performed according to the result of the matching between the word extracted by speech recognition and the word extracted from the program guide. Compared with, it can be suppressed that miscellaneous information is retrieved.

[Modification]
Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and can be practiced in various other forms. For example, the above-described embodiment may be modified as follows to implement the present invention. The above-described embodiment and the following modifications may be combined with each other.

  In the embodiment described above, the terminal device 10 recognizes a voice output from the television receiver 30, and searches for information using a word obtained by recognizing the voice. Is not limited to the configuration of the embodiment. For example, the terminal device 10 may be configured to have an imaging element and to search for information using information obtained by recognizing an image obtained by the imaging element. The terminal device 10 provided with an imaging device captures an image of the screen of the television receiver 30 with the imaging device, and generates an image of a video captured by the television receiver 30. The terminal device 10 performs image recognition on the generated image, and generates text information indicating the recognized object. The terminal device 10 performs a search based on text information obtained by image recognition and a word extracted from the electronic program guide.

  For example, when the performer of the variety program shown on the television receiver 30 is photographed by the imaging device, the terminal device 10 recognizes the performer by image recognition and specifies the performer's name. Next, the terminal device 10 determines whether the same performer name as the performer name obtained by image recognition is in the words extracted from the electronic program guide. When the same cast name as the cast name obtained by image recognition is in the word extracted from the electronic program guide, the terminal device 10 transmits the character string of the cast name obtained by image recognition to the server device 20 Search for information. According to this modification, even if the user does not instruct the search keyword and the execution of the search while watching the program, the user can easily obtain the information on the program being watched. Further, according to the present modification, the information search is performed according to the result of the matching between the word obtained by image recognition and the word extracted from the program guide. Compared with, it can be suppressed that miscellaneous information is retrieved.

  Further, in the present invention, in the configuration in which the terminal device 10 includes the imaging device, the terminal device 10 uses the word obtained by speech recognition, the word obtained by image recognition, and the word extracted from the electronic program guide. It may be configured to perform a search. For example, it is assumed that the user is watching a soccer game on the television set 30. In this case, the terminal device 10 extracts, for example, the names of teams competing in the electronic program guide. In addition, when the player shown in the television receiver 30 is photographed by the imaging device, the terminal device 10 recognizes the player by image recognition and specifies the player name. In addition, when a plurality of players are displayed on the television receiver 30, the terminal device 10 identifies the player names of the plurality of players displayed. In addition, when the voice of the player name flows in the real state, the terminal device 10 extracts the player name from the sound collection data by voice recognition. If there is a player name corresponding to the player name obtained by speech recognition in the player name obtained by image recognition, the terminal device 10 has a character string of the player name obtained by speech recognition and the team extracted from the electronic program guide The character string of the name is sent to the server device 20 to search for information. According to this modification, even if the user does not instruct the search keyword and the execution of the search while watching the program, the user can easily obtain the information on the broadcast being watched. Further, according to the present modification, information search is performed using words obtained by image recognition, words obtained by speech recognition, and words extracted from a program guide, so that words obtained by image recognition are sequentially searched As compared with the configuration described above, it is possible to suppress retrieval of miscellaneous information.

  In the embodiment described above, the terminal device 10 searches for information using the word specified by voice recognition and the word obtained from the electronic program guide, but the aspect of searching for information is an aspect of the embodiment It is not limited to For example, the terminal device 10 may store an attribute of the user of the terminal device 10, and search for information using the stored user attribute and a word extracted from the electronic program guide. The attribute of the user is an example of information related to the user in the present invention. The terminal device 10 stores, for example, the user's age, gender, address, hobbies, favorite sports team, favorite food, and the like as attributes of the user.

  For example, it is assumed that the user is watching a soccer game on the television set 30. In this case, when the team name flows from the television receiver 30 in the real situation, the terminal device 10 extracts the team name from the sound collection data by voice recognition. The terminal device 10 transmits the character string of the team name obtained by voice recognition to the server device 20 when the team name matching the team name obtained by voice recognition is in the stored user attribute. Do a search for According to this modification, even if the user does not designate the search keyword and the execution of the search while watching the broadcast, the user can easily obtain the information on the broadcast being watched. Further, according to the present modification, the information search is performed using the word extracted by speech recognition and the attribute stored in the terminal device 10, so that a comparison is made with a configuration in which the word extracted by speech recognition is searched sequentially Then, searching for miscellaneous information can be suppressed.

In the present invention, the terminal device 10 may be configured to store information of a program viewed by the user as a viewing history. Further, in the case where information of a program viewed by the user is stored as a viewing history, the terminal device 10 may be configured to search for information using the stored viewing history. For example, it is assumed that the user is watching a soccer game on the television set 30. In this case, when the team name flows from the television receiver 30 in the real situation, the terminal device 10 extracts the team name from the sound collection data by voice recognition. The terminal device 10 is obtained by voice recognition when the same team name as the team name extracted from the sound collection data is stored as a viewing history and the number of stored team names is equal to or more than a predetermined threshold. The character string of the team name may be transmitted to the server device 20 to search for information.
According to this modification, even if the user does not designate the search keyword and the execution of the search while watching the broadcast, the user can easily obtain the information on the broadcast being watched. Further, according to the present modification, the information search is performed using the word obtained by speech recognition and the viewing history stored in the terminal device 10, so that a configuration for sequentially searching the word obtained by speech recognition By comparison, it is possible to suppress the retrieval of miscellaneous information.

  In the embodiment described above, the terminal device 10 searches for information using the character string extracted from the sound of television broadcast and the character string extracted from the electronic program guide for television broadcast. Is not limited to those related to television broadcasting. For example, for a broadcast performed via the communication network 2 as in the so-called Internet broadcast, the terminal device 10 acquires the audio of the broadcast and the electronic program guide, and extracts and extracts the words from the acquired audio and the electronic program guide Information may be searched based on words. According to this modification, even if the user does not designate the search keyword and the execution of the search while watching the broadcast, the user can easily obtain the information on the broadcast being watched. Further, according to this modification, information retrieval is performed using words extracted by speech recognition and words extracted from a program guide, so compared to a configuration in which words retrieved by speech recognition are sequentially searched, miscellaneous characters It is possible to suppress the retrieval of sensitive information.

  In the present invention, the terminal device 10 may receive the broadcast via the communication network 2 and the terminal device 10 may output the received audio and / or video related to the broadcast. Further, in the present invention, the terminal device 10 receives a broadcast via the communication network 2 and outputs audio and / or video related to the broadcast selected by the user to the television receiver 30, and the television receiver 30 outputs the video and It may be configured to view audio. Further, in the present invention, the terminal device 10 has a tuner function for receiving television broadcast, outputs video and audio of a channel selected by the user to the television receiver 30, and the television and receiver 30 outputs video and audio. It may be configured to view and listen.

  In the present invention, the terminal device 10 receives a broadcast, outputs video and / or audio related to the broadcast selected by the user to the television receiver 30, and views the video and audio on the television receiver 30, The terminal device 10 may superimpose the information acquired from the server device 20 by the search process on the video to be output to the television receiver 30, and the information acquired by the search may be displayed on the television receiver 30 as a video. . Further, in the present invention, the terminal device 10 transmits the information acquired by the search to a portable terminal such as a tablet terminal or a smartphone possessed by the user by wire or wireless, and the portable terminal is information transmitted from the terminal device 10 May be displayed. According to this modification, the information obtained by the search is displayed on the screen, and the user can easily know the information obtained by the search.

  In the configuration in which the terminal device 10 outputs the information obtained by the search to another device as in the modification described above, the output destination of the information obtained by the search may be determined according to a predetermined rule. . For example, when the terminal device 10 uses the attribute of the user for the search as in the modification described above, the output destination of the information obtained by the search is a portable terminal owned by the user, and the word extracted from the recognized voice When the information is searched by the words extracted from the electronic program guide, the information obtained by the search may be output from the speaker 107B.

  Further, in the present invention, as described above, in the configuration in which the information obtained by the search is superimposed on the video of the television broadcast, the terminal device 10 is obtained by the search when the attribute of the user is used for the search. When the information output destination is a portable terminal owned by the user and information is searched based on the words extracted from the recognized speech and the words extracted from the electronic program guide, the information obtained by the search is output to the television receiver 30 It may be configured to be superimposed on the video. According to this modification, the information using the user's attribute as the search key is displayed on the portable terminal possessed by the user, so that the information retrieved by the user's personal attribute is not known to anyone other than the user Can be

  In the present invention, the output destination of the information obtained by the search may be determined according to the content of the broadcast being viewed by the user. For example, when the content of the broadcast being viewed by the user is sports relay, the terminal device 10 outputs the information obtained by the search to the television receiver 30 or both the television receiver 30 and the portable terminal, and the user When the content of the program being viewed by the player is a horse racing relay, a user may possess a portable terminal in which the user holds the output destination of the information obtained by the search. According to this modification, for example, in the case of a broadcast that enjoys viewing and listening by a large number of people, such as sports broadcasting, information on the broadcast being viewed is displayed on the television receiver 30, and Each can know the information obtained by the search, and if the broadcast being viewed is a program that enjoys viewing personally, the information regarding the broadcast being viewed is displayed on the portable terminal, so The information obtained can only be obtained by the individual enjoying the program.

  In the present invention, when the terminal device 10 stores user attributes, the terminal device 10 may store each attribute of a plurality of users. In addition, when storing the attributes of each of a plurality of users, the terminal device 10 may be configured to transmit the search result of the information to the portable terminal of the user corresponding to the attribute used for the search.

  For example, it is assumed that the terminal device 10 stores the team name A of the sports team A as the attribute of the user A, and stores the team name B of the sports team B as the attribute of the user B. In this case, when the team name A flows from the television receiver 30 in the real condition of sports relay, the terminal device 10 extracts the team name A from the sound collection data by voice recognition. Since the terminal device 10 includes the team name A matching the team name A obtained by speech recognition in the stored attribute of the user A, the character string of the team name A obtained by speech recognition is used as a server device Send to 20 to search for information. In this case, the terminal device 10 transmits the information obtained from the server device 20 by the search to the portable terminal possessed by the user A. In addition, when the team name B flows from the television receiver 30 in the real condition of sports relay, the terminal device 10 extracts the team name B from the sound collection data by voice recognition. Since the terminal device 10 includes the team name B matching the team name B obtained by voice recognition in the stored attribute of the user B, the character string of the team name B obtained by voice recognition is used as a server device Send to 20 to search for information. In this case, the terminal device 10 transmits the information obtained from the server device 20 by the search to the portable terminal possessed by the user B. According to this modification, for example, even when a program is watched by a large number of people, the information searched based on the attribute of the user is presented to the corresponding user, so that the user can select only the information related to himself. You can get it.

  In the present invention, the terminal device 10 may move the process flow to step SA2 when the channel number of the broadcast being viewed by the user is changed. For example, when the user inputs a new channel number at the operation unit 103, the terminal device 10 determines that the program viewed by the user has changed. In addition, the terminal device 10 communicates with the television receiver 30, acquires the channel number of the broadcast being viewed from the television receiver 30, and determines the change of the channel number, thereby the program being viewed by the user. It may be determined that has changed. In addition, the user inputs the channel number of the broadcast being viewed to the terminal device 10 by voice, and the terminal device 10 recognizes the input voice and judges the change of the channel number to allow the user to view It may be determined that the current program has changed. In addition, although the channel that the user is watching does not change, the terminal device 10 views the next program after the program being watched is finished, and the process being watched changes. May be moved to step SA3.

  Each aspect / embodiment described in the present specification is LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA (Registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-Wide Band), The present invention may be applied to a system utilizing Bluetooth (registered trademark), other appropriate systems and / or an advanced next-generation system based on these.

  As long as there is no contradiction, the processing procedure, sequence, flow chart, etc. of each aspect / embodiment described in this specification may be reversed. For example, for the methods described herein, elements of the various steps are presented in an exemplary order and are not limited to the particular order presented.

  In the present invention, information etc. may be output from the upper layer (or lower layer) to the lower layer (or upper layer). Input and output may be performed via a plurality of network nodes.

  In the present invention, input / output information may be stored in a specific place (for example, a memory) or may be managed by a management table. Information to be input or output may be overwritten, updated or added. The output information etc. may be deleted. The input information or the like may be transmitted to another device.

  In the present invention, the determination may be performed by a value (0 or 1) represented by one bit, or may be performed by a true / false value (Boolean: true or false), or a comparison of numerical values. (For example, comparison with a predetermined value) may be performed.

  Each aspect / embodiment described in this specification may be used alone, may be used in combination, and may be switched and used along with execution. In addition, notification of predetermined information (for example, notification of "it is X") is not limited to what is explicitly performed, but is performed by implicit (for example, not notifying of the predetermined information) It is also good.

  For the purposes of this disclosure, programs are referred to as instructions, instruction sets, codes, code segments, program codes, subprograms, whether they are called software, firmware, middleware, microcode, hardware description language, or by other names. Should be interpreted broadly to mean software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc.

  Also, programs, instructions, etc. may be transmitted and received via a transmission medium. For example, the program may use a wireline technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or a website, server, or other using wireless technology such as infrared, wireless and microwave When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

  The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips etc that may be mentioned throughout the above description may be voltage, current, electromagnetic waves, magnetic fields or particles, light fields or photons, or any of these May be represented by a combination of

  The terms described herein and / or the terms necessary for the understanding of the present specification may be replaced with terms having the same or similar meanings. For example, the channels and / or symbols may be signals. Also, the signal may be a message. Also, the component carrier (CC) may be called a carrier frequency, a cell or the like.

  The terms "system" and "network" as used herein are used interchangeably.

  In addition, the information, parameters, and the like described in the present specification may be represented by absolute values, may be represented by relative values from predetermined values, or may be represented by corresponding other information. . For example, radio resources may be indexed.

  The terms "determining", "determining" as used herein may encompass a wide variety of operations. "Judgment", "decision" are, for example, judging, calculating, calculating, processing, processing, deriving, investigating, looking up (for example, a table) (Searching in a database or another data structure), ascertaining may be regarded as “decision”, “decision”, etc. Also, "determination" and "determination" are receiving (e.g. receiving information), transmitting (e.g. transmitting information), input (input), output (output), access (Accessing) (for example, accessing data in a memory) may be regarded as “judged” or “decided”. Also, "judgement" and "decision" are to be considered as "judgement" and "decision" that they have resolved (resolving), selecting (selecting), choosing (choosing), establishing (establishing), etc. May be included. That is, "judgment" "decision" may include considering that some action is "judged" "decision".

  The terms "connected", "coupled" or any variation thereof in the present disclosure means any direct or indirect connection or coupling between two or more elements. It may include the presence of one or more intermediate elements between two elements which are "connected" or "coupled" with one another. The coupling or connection between elements may be physical, logical or a combination thereof. As used herein, the two elements are by using one or more electrical wires, cables and / or printed electrical connections, and radio frequency as some non-limiting and non-inclusive examples. It can be considered "connected" or "coupled" to one another by using electromagnetic energy such as electromagnetic energy having wavelengths in the region, microwave region and light (both visible and invisible) regions.

  As used herein, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

  As long as “including”, “comprising”, and variations thereof are used in the present specification or claims, these terms as well as the term “comprising” are inclusive. Intended to be Further, it is intended that the term "or" as used in the present specification or in the claims is not an exclusive OR.

  Throughout the disclosure, for example, when articles are added by translation, such as a, an, and the in English, these articles are not clearly indicated by the context, unless the article clearly indicates otherwise. It shall contain several things.

  Although the present invention has been described above in detail, it is apparent to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be implemented as modifications and changes without departing from the spirit and scope of the present invention defined by the description of the claims. Accordingly, the description in the present specification is for the purpose of illustration and does not have any limiting meaning on the present invention.

DESCRIPTION OF SYMBOLS 1 ... Search system, 10 ... Terminal device, 20 ... Server apparatus, 101 ... Control part, 102 ... Storage part, 103 ... Operation part, 105 ... Communications part, 107 ... Speech processing part, 107A ... Microphone, 107B ... Speaker, 1001 ... first acquisition unit, 1002 ... second acquisition unit, 1003 ... extraction unit, 1004 ... search unit, 1005 ... output unit.

Claims (7)

A first acquisition unit for acquiring audio and / or video of a broadcast being viewed by a user;
A second acquisition unit that acquires information related to a broadcast viewed by a user or information related to a user of the own apparatus;
An extraction unit that extracts a keyword from the audio and / or video acquired by the first acquisition unit;
A search unit for performing a search based on the keyword extracted by the extraction unit and the information acquired by the second acquisition unit;
A search unit that outputs a search result of the search unit. The search apparatus according to claim 1, wherein the information related to the broadcast is information extracted from an electronic program guide of the broadcast. The information related to the user is an attribute of the user,
The search device according to claim 1, wherein the search unit performs a search based on the keyword extracted by the extraction unit and the attribute. The information related to the user is a viewing history of the broadcast by the user,
The search device according to claim 1, wherein the search unit performs a search based on the keyword extracted by the extraction unit and the viewing history. The search device according to any one of claims 1 to 4, wherein the output unit sets an output destination of the search result as an output destination according to the information used for the search by the search unit. The search apparatus according to claim 1, wherein the output unit sets an output destination of the search result as an output destination according to the content of the broadcast being viewed by the user. Computer,
A first acquisition unit for acquiring audio and / or video of a broadcast being viewed by a user;
A second acquisition unit that acquires information related to a broadcast viewed by a user or information related to a user of the own apparatus;
An extraction unit that extracts a keyword from the audio and / or video acquired by the first acquisition unit;
A search unit for performing a search based on the keyword extracted by the extraction unit and the information acquired by the second acquisition unit;
A program for functioning as an output unit which outputs a search result of the search unit.

Images