JP2016062560A - Electronic apparatus and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus and a control method thereof capable of refining a searching keyword, or switching a provider which supplies a program to view or a storage unit which stores a program as a search object to reproduce.SOLUTION: The electronic apparatus includes input voice processing means and search control means. The input voice processing means identifies a search condition of a search object based on an input voice. The search control means switches a search region of the search object based on the search condition identified by the input voice processing means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an electronic device and a control method thereof.

  A recorder device connected to a television receiver (hereinafter referred to as a television device) or a display device reproduces a program broadcast by a broadcaster, a program supplied by a distributor, or a content (program) that can be acquired through a network. . In addition, a television device capable of recording a program when a recorder device or a storage device is connected can record an arbitrary number of programs broadcast (supplied) in the same time zone, including a program (content) being played back. .

  The program is recorded in various recording forms such as time shift recording, normal recording, and automatic recording. Time-shift recording records all programs in a specific channel (broadcaster or distributor) specified by the user and a time period for a certain period. In normal recording, a user designates a channel (or program name) and time, and records in units of programs. Automatic recording automatically records programs that the user expects to play based on information that the user has watched or played back recorded programs, information on programs reserved for normal recording, etc. Record on.

  From such a background, there are a considerable number of programs that can be viewed or reproduced by the user, including those recorded by the recorder device or television device and those currently broadcast (supplied). For this reason, various support methods have been proposed for the user to specify a program to be viewed or reproduced.

  One of the support methods is to recognize the user's voice (utterance) for identifying the program that the user intends to view or play by inputting the playback conditions for identifying the program, and the recognized keyword, etc. A method of referencing has been proposed.

JP 2014-109897 A JP 2014-109889 A

  However, if the program specified by voice recognition is not found, further narrowing down the keywords or switching the storage device storing the program to be played or the provider supplying the program to be viewed is considered. It has not been.

  An object of the present invention is to automatically search a storage device to be searched for a program that supplies a program to be narrowed down or watched programs or a program to be played back when searching for a program specified by voice recognition. Electronic device and a control method thereof are provided.

  The electronic apparatus according to the embodiment includes an input voice processing unit and a search control unit. The input voice processing means specifies a search condition to be searched based on the input voice. The search control means switches the search target search destination based on the search condition specified by the input voice processing means.

An example of the connection of the electronic device which concerns on embodiment and the electronic device connected with an electronic device is shown. 1 illustrates an example of an electronic apparatus (video playback apparatus) according to an embodiment. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of the display example of the search result by the electronic device which concerns on embodiment is shown. An example of the display example of the search result by the electronic device which concerns on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of the display example of the search result by the electronic device which concerns on embodiment is shown. An example of a technique for switching search engines of an electronic device according to the embodiment is shown in software. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown. An example of operation | movement and screen display of the electronic device (search function) which concern on embodiment is shown.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 illustrates an example of connection between an electronic device according to the embodiment and an electronic device connected to the electronic device.

  As shown in FIG. 1, for example, a video playback device (first electronic device) 1 that is a television receiver (hereinafter referred to as a television device) is a video recording device (second electronic device) that is a recorder device, for example. 2 and the home network controller (home server) 3. The home server 3 can be connected to, for example, a recorder device 4 and other electronic devices such as a display device 5 connected to the recorder device 4. In addition, a storage device 6 connected via, for example, a USB (Universal Serial Bus) interface is connected to the video reproduction device 1. The storage device 6 holds a program recorded by the time shift machine function. Of course, the storage device 6 can also have a storage area for normal recording and automatic recording. In that case, an arbitrary size (storage capacity) can be assigned by setting.

  The home server 3 may be integrated with either the video playback device 1 or the video recording device 2. In that case, it can be considered that the video reproduction device 1, the storage device 6, the recorder device 4 (display device 5), and the recorder device 2 are connected to each other.

  The video playback device 1 is also operated via an external network (Internet network) NTW, for example, a service server 7 operated by a database provider, and a service server operated by a service company that provides a special service according to a contract with the video playback device 1. 8 and various service servers such as a content server 9 (for example, Youtube (registered trademark)) operated by a content providing service company.

  Note that character information, moving images, still images, or image data including them can be exchanged between each device, and control signals or control data can be exchanged. In addition, the above-described various data can be exchanged between individual apparatuses using either a wired system using an optical fiber or a conventional communication network or a wireless system using a spatial wave.

  FIG. 2 shows an example of the configuration of the video playback apparatus (first electronic device) according to the embodiment.

  The television apparatus (first electronic device) 1 includes an input unit (tuner) 11, a signal processing unit (TS separation unit) 12, a video processing block 21, an audio processing block 31, a main control block 51, and the like. In the television apparatus 1, the display unit (display) may be a separate body. That is, the display unit may display a program that the video storage device transmits in a wireless manner without contact with the television device 1. The elements and configurations described below may be realized by software by a processing device, that is, a microcomputer (CPU (Central Processing Unit)), or may be realized by hardware. In the following description, broadcasting is a distribution business through what is provided by a broadcaster (broadcasting station) as radio waves propagating in space, or a network such as a cable (including optical fiber) network or an IP (Internet Protocol) network. Including those distributed by the user. In addition, broadcasting indicates a form in which various programs including video and audio and / or music and providing a certain time (broadcast time) as a unit are provided. A program may be referred to as a content or a stream. In addition, the video includes a moving image, a still image, text (information represented by characters or symbols indicated by a coded code string), and any combination thereof.

  The input unit 11 is connected to an antenna ANT that receives a broadcast provided using a spatial wave (a ground wave or a satellite wave). For example, an STB (Set Top Box) or a video camera device is connected to the input unit 11 as an external video supply source. The video camera device may be a portable terminal device capable of taking an image, such as a tablet PC (Personal Computer) device.

  A signal processing unit (TS separation unit) 12 controls a TS (Transport Stream), that is, a video signal (video) and an audio signal (audio), and controls an external input image from a broadcast or a video camera device input to the input unit 11. Separate into information. The control information includes, for example, SI (Service Information, program arrangement information) describing TS distribution rules and contents, schedule or timing, and the like.

  The video signal (video) is decoded by the video decoder 22 of the video processing block 21 and output as a digital video signal (video output).

  A display 26 and a speaker 36 are connected to the video processing block 21 and the audio processing block 31, respectively.

The video processing block 21 includes a video (video) decoder 22, a video (video) processing unit 23,
An OSD (On Screen Display) processing unit 24, a display control unit 25, and the like are included.

  The video processing unit 23 converts the digital video signal decoded by the video decoder 22 into a predetermined resolution and output method that can be displayed on the display 26. The display control unit 25 converts the video signal converted by the video processing unit 23 into a display drive signal capable of suitable display (video reproduction) on the display 26. The display control unit 25 also synthesizes an OSD (On Screen Display) signal from the OSD processing unit 24 and a display drive signal. The output of the display control unit 25 may be output to the output terminal 27 to which an external monitor device or a projection device (projector device) connected to the outside can be connected, for example.

  The audio processing block 31 includes an audio (audio) decoder 32, an audio (audio) processing unit 33, a delay unit 34, a DA (Digital to Analog) converter 35, and the like.

  As for the audio signal (audio), the audio signal decoded by the audio decoder 32 in the audio processing unit 33 is converted into a predetermined format that can be suitably reproduced by the speaker 36. The DA converter 35 converts the audio signal converted by the audio processing unit 33 into an analog audio output signal. Thereby, when the speaker 36 is connected to the DA converter 35, the speaker 36 outputs an audible sound (analog voice (audio) output). Note that the output of the DA converter 35 may be branched to an output terminal 37 to which an AV (Audio Visual) amplifier or the like can be connected, for example. The audio signal input to the DA converter 35 is controlled to be delayed by a predetermined amount (time) by the delay unit 34 in accordance with the type of content. For example, when the content is a game, the size (length) of the delay (time) defined by the delay unit 34 is the size (length) of the delay (time) applied when the broadcast signal (program) is reproduced. Smaller (shorter).

  The operation unit 61 inputs a control command corresponding to a direct operation by the user to the main control block 51.

  The receiving unit 62 inputs a command corresponding to an instruction (operation input) from the remote control terminal (remote controller) 71 to the main control block 51. The remote control terminal 71 has a “voice” key 71a and a microphone 71b.

  The communication interface 63 realizes wireless communication with a short-range wireless communication device compliant with, for example, the WiFi (Wireless Fidelity) standard. In addition, as the near field communication standard, for example, Bluetooth (registered trademark) standard, NFC (Near Field Communication), or the like can be used. The communication interface 63 may be either a wired system or a wireless system. For example, a communication unit capable of exchanging signals with a wireless keyboard, a mouse, or the like is connected. The communication interface 63 performs direct communication with, for example, a tablet terminal (smart phone or portable PC (personal computer)).

  The network control unit 64 controls access to the network NTW, acquisition of information from various services (web pages) or servers on the network NTW, transmission of input information for acquiring information, and the like. Thereby, it is possible to exchange information between the service server 7, the service server 8, and the content server 9 described with reference to FIG. 1, various searches, and the like.

  The USB interface 65 can use, for example, a storage device (USB HDD) corresponding to the USB standard, for example, an external device compliant with the USB standard, such as a keyboard. Note that the storage device 6 already described is connected to the USB interface 65 to record all the programs in a specific channel (broadcaster or distribution operator) and time zone designated by the user for a certain period. Time-shift recording is possible. The storage device 6 also stores programs recorded by normal recording or automatic recording.

  The HDMI interface (control unit) 66 enables wired communication between devices using the HMDI (High-definition Digital Media Interface (registered trademark)) standard or the MHL (Mobile High-definition Link) standard. Note that the HDMI interface 66 is connected to the recorder device 2 or the recorder device 4 shown in FIG. 1, thereby recording the program received by the television device 1 by the recorder device 2 or the recorder device 4 or recording the recorder device 2 or the recorder. The television apparatus 1 can also view programs held by the apparatus 4.

  A storage device (HDD (Hard Disk Drive)) 67 stores a received (acquired) program (content). The storage device 67 mainly stores a recorded program by normal recording in which a user designates a channel (or program name) and time, and records in units of programs, or information that has been viewed or reproduced by a user. It is used for storing a recorded program by automatic recording that automatically records a program expected to be reproduced by a user based on information of a program reserved for normal recording. A part of the storage capacity of the storage device 67 can be allocated to save a recorded program by time shift recording. Further, the video signal, the audio signal, and the like held by the storage device 67 can be output to other devices or the network NTW via the network control unit 64. Note that video signals, audio signals, and the like from other devices input via the network control unit 64 can be reproduced as they are on the display 26 and the speaker 36 without being held in the storage device 67.

  The main control block 51 is connected to the operation unit 61, the receiving unit 62, the communication interface 63, the network control unit 64, the USB interface 65, the HDMI interface 66, the storage device 67, and the like described above, and controls the operations thereof.

  The main control block 51 includes, for example, a CPU (main processing circuit) 52, a ROM (read only memory) 53, a RAM (random access memory (work memory)) 54, an NVM (nonvolatile (rewritable) memory) 55, and a voice search control. Part 56, and the like.

  The CPU (main processing circuit) 52 executes processing corresponding to an input signal and a control signal based on a control program held in the ROM 53 in a work area provided by the RAM 54.

  The NVM 55 holds various setting information, an operation program for executing a voice search function by the voice search control unit 56, an intention determination database referred to by an intention analysis unit 58 described later, and the like.

  The voice search control unit 56 is connected to the input voice processing unit 57 and the intention analysis unit 58. The input voice processing unit 57 and the intention analysis unit 58 may be integrated with the voice search control unit 56. The intention determination database held by the NVM 55 may be prepared independently as the intention determination database 59. In that case, it is preferable that the intention determination database 59 prepared independently is connected to the intention analysis unit 58. The voice search control unit 56 and the intention analysis unit 58 may be prepared in the home server 3 or may be prepared in any external service server connected via the network NTW.

  The input speech processing unit 57 performs input speech processing such as phrase breaks and word recognition on the input speech input from the microphone 71b of the remote controller 71 when the speech search control unit 56 executes speech search. When the microphone 71 b is not prepared in the remote controller 71 or when the microphone 68 is prepared in the television apparatus 1, the input voice processing unit 57 inputs the voice captured by the microphone 68 when performing the voice search. Perform audio processing.

  The input voice from the microphone 71 b or the microphone 68 is converted into a digital signal by the AD converter 69 and supplied to the voice search control unit 56.

The intention analysis unit 58 uses a character string (utterance content) obtained as a result of phrase breaks, word recognition, and the like specified by the input speech processing by the input speech processing unit 57 when the speech search control unit 56 performs speech search. The content of the intended voice instruction (control input) of the user is analyzed (hereinafter referred to as intention analysis). By this intention analysis, it is possible to improve the search accuracy by voice search of a program (or content) to be searched or a content of a scene or an external network intended by the user's voice instruction. At the time of intention analysis in the intention analysis unit 58, the database held in the intention determination database (or intention determination database 59) is compared with the utterance content (character string specified in the input voice processing). ,
Note that the voice search control unit 56, the input voice processing unit 57, and the intention analysis unit 58 may be firmware of the CPU 52. In addition, the operation programs of the voice search control unit 56, the input voice processing unit 57, and the intention analysis unit 58, data to be referred to, and the like can be rewritten or updated (upgraded) from the outside. Note that the intention determination database (intention determination database 59), the voice search control unit 56, the input voice processing unit 57, and the operation program of the intention analysis unit 58 stored in the NVM 55 are stored in a predetermined area of the storage device 67. Also good. The intention determination database (intention determination database 59) held by the NVM 55 may be stored in a storage unit on the external network such as the service server 8.

  The main control block 51 controls the above-described respective elements by the CPU 52 based on operation information (control input) from the operation unit 61 and operation information (control input) from the remote control terminal 71 received by the reception unit 62.

  The main control block 51 can record the video signal, the audio signal, and the like output from the video decoder 22 and the audio decoder 32 in the storage device 67 based on a user operation instruction (control input). When recording a video signal, an audio signal, or the like in the storage device 67, the main control block 51 encrypts the video signal, the audio signal, etc., and converts it into a predetermined recording format. The main control block 51 reads out a desired video signal or audio signal from the storage device 67 based on an instruction input from the remote control terminal 71 or the like by the user, decodes it, and supplies it to the video decoder 22 and the audio decoder 32. Execute video display and audio playback.

  The main control block 51 also includes subtitle information (sound uttered by the anchor (announcer) in the news program) from the TS separated by the signal processing unit (TS separation unit) 12 by the program or application stored in the NVM 55 or the ROM 53 or the firmware of the CPU 52. And EPG (electronic program guide) information can be acquired.

  The main control block 51 also presses the “voice” button display 321 (see FIG. 3) on the setting screen displayed on the display 26 of the television apparatus 1 when the “voice” key 71a of the remote control terminal 71 is turned on. The voice search function of the voice search control unit 56 is activated according to the input control input (operation instruction). In place of the “voice” button display 321, any one of the “blue” button 71 B / “red” button 71 R / “green” button 71 G to which the function of the “voice” button is assigned is turned on in the remote control terminal 71. It is also possible to transmit a control command for starting the voice search function. In the remote control terminal 71, the “yellow” button 71Y corresponds to a control command corresponding to a “cancel” button capable of inputting an instruction to cancel the voice search function or a “return” button for returning to the previous screen display. It is assumed that a function capable of inputting a control command is assigned.

  FIG. 3 shows an example of search control that applies the voice search function in the television apparatus (first electronic device) 1.

  For example, the “voice” key 71a of the remote control terminal 71 is turned on or “voice” in the voice search function activation selection screen display 311 of the screen display 301 shown in FIG. 3 on the setting screen displayed on the display 26 of the television apparatus 1. The voice search function by the voice search control unit 56 is started based on a control input (operation instruction) input by pressing the button display (“Yes” button in the start selection display 311) 321.

  When the voice search function is activated, as shown in FIG. 4, a keyword or search condition used for presenting to the user a program that the user will watch or play from among the programs that the user can watch or play is expressed by voice. An inputable voice search input screen display 401 is displayed. Note that the program that can be viewed or reproduced by the user is, for example, a program that is currently being received by the television device 1 or a program that can be received by the channel selection, a recorded program that is stored in the storage device 6 or the storage device 67 (or the recorder device 2). Or a recorded program held by the recorder device 4). For this reason, as will be described below, in the voice search function, a search for a program based on the character string (utterance content) specified in the input voice processing (of the voice search function) It is preferable to search in the order of the normally recorded program and the automatically recorded program. In the voice search function, when it is possible to specify that the character string (utterance content) specified in the input voice processing is related to the program recording reservation, the recording reservation for reserved recording (normal recording) is performed. It is also possible to set (register). In the voice search function, a scene search (using the service server 8) for searching for a specific scene in a recorded program based on the character string (utterance content) specified in the input voice processing or on the network NTW The content (program) held by the content server 9 that provides the content can also be searched.

  In the screen display 401 shown in FIG. 4, activation of the voice search function is instructed (by turning on the “voice” key 71 a of the remote control terminal 71 or “voice” button display 321 in the screen display of the television apparatus 1 (see FIG. 3). When a control input (operation instruction) is performed, a status icon (microphone icon) 421 simulating a microphone (microphone), for example, is displayed at the top of the center of the screen.

  The status icon 421 is shown as an example in FIGS. 5A to 5E. For example, the first pattern display 521 indicating “preparing (starting up)” and the second indicating “recordable state”. Pattern display 522, third pattern display 523 indicating “volume of input volume during recording”, fourth pattern display 524 indicating “recording end (input acceptance stopped), content recognition and intention analysis in progress”, “recognition result and It is assumed that a transition is made to the fifth pattern display 525 indicating “analysis result display in progress”.

  As shown in FIG. 5A, the first pattern display 521 is a fixed display in which the displayed pattern does not change during activation (preparation). In order to clearly indicate that the recording is not possible (not yet possible to record), it is preferable to use a technique such as a tone down that darkens the brightness of the background color and the display of the microphone icon itself within a certain range. .

  As shown in FIG. 5B, the second pattern display 522 is displayed when the voice search function activation process is completed (preparation is completed), that is, in the “recordable state”, and the display of the microphone icon 421 is displayed. The brightness is toned up (changed to the normal brightness where the brightness is set), the set brightness flashes as the maximum brightness, or the background color changes, etc. It is assumed that the display during startup indicated by a) changes to a dynamic display that prompts the user to speak. When the preparation is completed, for example, [melody (alarm)] can be sounded (a melody sound output is output and a melody sound is output from the speaker 36).

  As shown in FIG. 5C, the third pattern display 523 visualizes and displays the loudness of the user's voice input in the “recordable state”. For example, the third pattern display 523 displays a microphone icon (status icon) 421. The height direction of the display area is divided into a predetermined number, and the loudness of the voice is displayed in an intuitively visible manner within the range divided according to the loudness of the input voice. When the number of divisions of the display area is 16, for example, 6 to 11 when the loudness of the user's voice input to the microphone 71b (remote control terminal 71) or the microphone 68 of the television apparatus 1 is appropriate. It is preferable to set the input sensitivity of the microphone and the conversion count of the A-D converter so as to be displayed in the range. That is, the third pattern display 523 is approximately the center (center) of the divided display area when the size of the input speech (user's utterance (voice)) is suitable for speech recognition in the speech search function. Is set to display the level of the input voice. Of course, the display method may be a bar graph shape in which the display range (display height from the lowest position of the number of divisions) is continuously changed based on the loudness (intensity) of the sound. In addition, a display function indicating the maximum intensity (volume) in the bar graph display may be prepared temporarily (for example, about 1 second), a hold function for maintaining the lighting state without immediately disappearing, and the like.

  As shown in FIG. 5 (d), the fourth pattern display 524 analyzes the recorded input voice, and shows the program specified during the input voice processing such as phrase break and word recognition or by the input voice processing. For example, the background color of the display of the microphone imitating the microphone displayed in the second pattern display 522 changes sequentially, or for the changing color, for example, 12 hours of the clock The fact that some processing is being executed is displayed by a display pattern such that the display position sequentially changes (appears to rotate) in units of 30 °.

  As shown in FIG. 5E, the fifth pattern display 525 displays the operation of the television device 1 corresponding to the search result of the program specified based on the analysis processing after the input sound processing (the screen display 401 of the television device 1). When the operation of the television apparatus 1 that has received the intention determination result is displayed in the second line (corresponding state / search condition display) field 433 of the message display field 431, or when the search condition cannot be specified, etc. As an example of display, for example, when a search condition that can be detected is displayed, the background color is blue or green, etc. If the search condition cannot be detected or the input voice cannot be recognized, the background color is set to a color that is likely to attract the user's attention, such as red or yellow, etc. Table of Is preferred. Further, flashes the entire display or the background, it is also possible to use various display and the like.

  FIG. 6 shows a display example of the screen display of the television apparatus when preparation for the voice search function is completed (activation process is completed).

  When the activation process of the voice search function ends, the display of the status icon (microphone icon) 421 shown in FIG. 4 is toned up (changed to the normal brightness where the brightness is set). At this time, as shown in FIG. 6, a message display field 431 and a hint display field 441 are displayed on the right side of the status icon 421 of the screen display in the television apparatus 1.

  The message display field 431, which will be described below, specifies the content of the input voice by input voice processing, and displays the intention determination result obtained by analyzing the intention by comparison with the intention determination database by the intention analysis unit 58. (Speech recognition result display / search condition display) ”display column 432 and“ second line (corresponding state / search condition display) ”display column 433 for displaying the operation of the television apparatus 1 that has received the intention determination result.

  The “first line” display field 432 recognizes and analyzes the utterance when the user's voice (utterance) is, for example, [s a k ka ga mi t a i (sakaka ga mi)]. As a result, the user's utterance content “I want to watch soccer” is displayed.

  The “second line” display field 433 displays, for example, [: soccer] as a search target when it is determined that the user's utterance content is “I want to watch soccer” as a result of recognizing the user's voice (utterance), for example. indicate. At this time, the search range (search engine) is searched, for example, from [<Zanmai Play>. ] Is also displayed in the “second line” display field 433. Note that <Zanmai Play> is a function for presenting to the user a program that the user will watch or play, with a program subjected to time-shift recording as a search target. Therefore, the search engine is time-shift recording (storage device 6).

  The display (message) displayed in the first line display field 432 and the second line display field 433 can be guided by voice from the television apparatus 1 by voice synthesis, for example (can be set by the user).

  FIG. 7 shows an example of a screen display that displays a program searched for <Zanmai Play> described with reference to FIG. 6 as a search target. That is, FIG. 7 shows an example of a screen display on which the search engine displays a result of searching for a program with the time shift machine as a search target.

  In FIG. 7, an image of a currently broadcast program is displayed on the screen display 701.

  It should be noted that the time shift machine Zanmai play screen display 711 is displayed for a predetermined time in a predetermined area below the screen display 701, for example, in a range of about 1/4 or 1/5 in the height direction of the screen display 701. Is displayed. Further, after a predetermined time has elapsed, or when the user selects an arbitrary program or when the user inputs an instruction to delete the display, the time shift machine Zanmai play screen display 711 is deleted.

  The time shift machine Zanmai play screen display 711 displays the genre of the currently displayed program and the genre display area 712 (712a-712c) that prompts the user to input an instruction to display another genre, and the current program genre display in the genre display area 712. The related program display part 713 which displays the program relevant to the genre which 712a displays is included.

  The genre display area 712 includes a current program genre display (genre display bar) 712a, another candidate genre display (other candidate display bar) 712b that displays one name of another genre that can be selected by the user, and a program display of another category. A category display (category switching bar) 712c that prompts an instruction to display is displayed. In the other candidate genre display (other candidate display bar) 712b, a program genre highly related to the program genre designated by the user by voice (utterance) is displayed as another candidate. That is, in the example of FIG. 7, since the genre specified in the voice search function shown in FIG. 6 is [soccer], a program of a sports genre is presented as another candidate.

  The related program display unit 713 displays preview videos of the respective programs in, for example, six related program display areas 713-1 to 713-6. The related program display unit 713 displays a [→ (right arrow / forward)] display 713f and a [← (left arrow / back)] display 713b when the number of related programs is larger than the number of display areas. To do. [→ (Right arrow / Advance)] display 713f can input an instruction input (control signal) for enabling display of a preview video of an undisplayed program. The [← (left arrow / return)] display 713b is hidden by the display of the preview video of the program after the preview video of the undisplayed program is displayed by the [→ (right arrow / forward)] display 713f. It is possible to input an instruction input (control signal) for displaying a preview video of the program that has become.

  FIG. 8 shows an example of a screen display of an example of a past program table including a recorded program displayed by a preview video in FIG. 7 as a result of searching for a program using <Zanmai Play> described with reference to FIG. Show.

  From the past program table shown in FIG. 8, individual programs 811-1 to 811-6 displayed in the related program display areas 713-1 to 713-6 displayed by the related program display unit 713 in FIG. (Timetable) display allows viewing in a list.

  FIG. 9 shows a search by the next search engine when a program specified by the input voice processing of the voice search function cannot be searched as a result of searching for a program using <Zanmai Play> described with reference to FIG. An example of a screen display in the case of (switching the storage device holding the search target to the storage device 67 holding the program reserved and recorded by the recording reservation) is shown.

  FIG. 10 shows an example of a list display (recorded program list) of recorded programs specified in the result of searching for a program with the <recorded program list> described with reference to FIG.

  The recorded program list screen display 1001 shown in FIG. 10 includes recorded program display columns 1021 to 1030 (the display example indicates that six programs are recorded, and the recorded programs are displayed in the display columns 1021 to 1026. Among the recorded programs displayed in the display columns 1021 to 1030, a preview display area 1011 for displaying a preview video of the currently focused program, and information on the program displayed for preview, for example, The name of the broadcasting station (channel name) that broadcasts the program is displayed.

  In the recorded program list screen display 1001 shown in FIG. 10, the display column in which recorded programs are displayed in the recorded program display columns 1021 to 1030 is focused (an arbitrary display column is displayed by the remote control terminal 71). Each time, the preview video displayed in the preview display area 1011 is switched to the preview video prepared in each of the corresponding recorded programs. In addition, the channel name display and the like are also updated.

  In the case of searching by the next search engine shown as an example in FIG. 9, as shown in an example in FIG. 11, when a search engine can be specified by input speech processing, for example, the search engine is used. Shall. For example, when the specified character string is intended as content (program) held by a service server on the network NTW, such as <YouTube>, a corresponding search engine is used. When the specified character string is intended for a recording reservation such as <9:00 pm tomorrow>, the search engine is specified as an EPG (Electric Program Guide).

  That is, as shown in FIG. 11, the search engine is switched according to input speech processing subsequent to the voice search function activation [01] and search target specification [02] by intention understanding analysis, A) External server [03], (search target) recording reservation [04], (search target) time shift machine [05], (search target) recorded program list (recording list) [06] , (Search target) is recommended search [07], (search target) is scene search [08], etc.

  Accordingly, when the search target is an external server [03-YES], the content server 9 becomes the search engine [101]. When the search target is a recording reservation [04-YES], EPG data (for example, held by the firmware of the CPU 52 of the main control block 51) or a recording reservation list held by the NVM becomes the search engine [106]. Similarly, when the search target is a time shift machine [05-YES], the storage device 6 (time shift recording storage device) becomes the search engine [105]. Further, when the search target is a recorded program list (recording list) [06-YES], the storage device 67 (HDD) becomes the search engine [107]. If the search target is recommended [07-YES], the service server 8 becomes the search engine [102]. Similarly, when the search target is a scene [08-YES], the service server 7 (database provider) becomes the search engine [103]. Note that the search engine switching determination is not limited to the order shown in FIG. In addition, it is preferable that the determination of switching the search engine with the external server as a search target is executed at the timing of all the determinations between the individual switching determinations.

In other words, as a search engine,
Future program guide (EPG / recording reservation)
Zanmai (time shift recording)
Past program guide (time-shift recording)
Recording list (recorded program list / normal recording / automatic recording)
Scene search (service server / time shift recording / normal recording / automatic recording)
Recommended search (service server / time shift recording / normal recording / automatic recording)
Youtube (external server (content server))
Etc.

  The scene search follows the attribute (scene attribute / classification) provided by the service server 7 of the database provider. For example, a voice scene, that is, “talk (conversation)”, “music (singing)”, or “commercial ( Identification examples for the main part) ”, etc. can be used as search conditions.

  As for the recommended search, a recommended program that matches the user's preference provided by the service server 8 among the programs recorded in the recording device 67 is a search target.

  If the search conditions are different for each search engine, it is necessary to change to an appropriate search condition when the search engine is switched.

  For example, in the program guide (EPG), search conditions can be specified in units of days of the week, such as [Wednesday] and [Friday], but when moving (switching) to another search engine, [Wednesday to Friday] It is preferable to round to the form of.

  FIG. 12 shows an example of the input voice processing of the utterance from the user for the display (hint) displayed in the hint display field 441 in the input voice processing after the end of the voice search function starting process outlined in FIG. The example shown in FIG. 12 is referred to as <refine search>.

  7, 9, and 11, when the program specified in the input voice processing cannot be searched, the search is performed by the next search engine (the storage device holding the search target is switched to another storage device). However, there are cases where the corresponding program can be searched by narrowing down the search conditions.

  FIG. 12 shows an example. For example, in the hint display field 441 or the “second line” display field 433 displayed by the image display 1201, say “If you want to add more conditions, say“ Filter by XX ”” <Intent The display of the operation of the television device 1 that has received the result of understanding (TV action) ”is displayed. In addition, as operation | movement of the television apparatus 1, it is also possible to guide by voice by voice synthesis.

  When the user utters (speaks) a keyword, a genre, or a person's name, the television apparatus 1 identifies the content of the input voice by input voice processing, and analyzes the intention by comparison with an intention determination database. The intention determination result is displayed in the display field 432.

  Note that keywords that can be used for <refined search> include, for example, program names, performer names, or genres. However, the genre is based on the broadcasting classification (major classification / medium classification) prescribed by the Association of Radio Industries and Businesses (ARIB). For example, news (reporting), sports, drama, music, variety , Movie or animation (special effects), etc. can be specified. On the other hand, in the genre, “sports”, “news”, and “sports news” are automatically distinguished by comparison with the intention determination database.

  In addition, as information that can be used for <refined search> similar to a keyword, for example, there is “program symbol”. The “program symbol” can be used for searching for [new]... New program, [re]... Rebroadcast and [end]. In addition, the broadcast station name, broadcast type (terrestrial / satellite broadcast, etc.) and date (yesterday, this week, Monday, etc.) can be used. However, the day of the week is converted into a date and used by referring to an EPG or a built-in calendar. As for the broadcasting station name and broadcasting type, it is also possible to distinguish abbreviations, call signs and their abbreviated forms (for example, two letter codes such as CX, EX, etc.), BS, CS, and the like.

  For character strings and words specified by input voice processing, there are names that are displayed differently with the same sound. For this reason, the operation described below is possible as the <re-search / narrow down> function.

[Refine / Research]
Understand the intention and search again
Refine
Filter when there is a specific utterance intended to be filtered
Speaking example: “Narrow down in the J League (Japanese professional soccer)”
“(Professional baseball) ○ × □ only”
Etc., words and character strings can be used. At that time, if a word or a character string suggesting that the search engine is switched can be specified, a <search engine switching> operation described below can be performed.

[Search engine switching]
Switch search engine when utterance includes another engine
Example of utterance: “Search again by scene search”
Etc., words and character strings can be used.

<Search engine switching> can follow the recognized keyword.
For example, "Zanmai", "Scene", "Recommendation (automatic recording)", "Program information (currently receiving / currently playing)", "Recorded program (recorded / yesterday (this week)) (should be) ) / Past program guide ”,“ recording reservation (with program guide ...) / EPG ... ”, and the like, a search engine that can be specified from the specified word or character string. It is preferable to switch.

  In addition, when a characteristic word representing a scene search can be specified as a character string or word specified by the input voice processing, the scene search is activated (switching the search engine).

For example, “Weather Corner” → (“Corner”)
“Scene of the goal” → (“Scene”)
“A place where ○ □ comes out” → (“A place where” is)
If a word such as "" can be specified, the process proceeds to (searches for) a scene search.

  In addition, as an example of prompting the selection of the same sound candidates (names that are displayed differently in the same sound, etc.), when there are multiple candidates for the same sound keyword, the candidates are displayed and selected by the user (specification of another candidate). Is preferred. Note that it is also possible to execute selection of the same sound candidate based on a user's specific utterance (utterance). For example, when a word or a character string such as “characters are different”, “different”, “different display”, or the like can be specified, it is preferable to execute [Research].

  FIG. 13 shows a display example of a screen display when a search engine, that is, a storage device or a service server storing content to be searched can be specified in the input voice processing of the voice search function described with reference to FIG.

  For example, when the search target specified by the user's utterance (voice) is, for example, [y u cy u bu], the “first line” display field 432 recognizes the utterance. As a result of the analysis, “Youtube” which is the content of the user's utterance is displayed.

  In this case, the “second line” display field 433 moves to, for example, [<Youtube] for the search range (search engine). ] Is displayed.

  Thereafter, the search target is switched to the content server (service server) 9 on the network NTW.

  In the search by <YouTube>, in the keyword definition, from the character string (utterance content) obtained as a result of the phrase break and word recognition specified by the input speech processing described with reference to FIGS. For example, delete extra words such as “I want to see”, “Find”, or “No”, separate them, and combine the separated words with “”, “,” and “” ”as a single keyword It is preferable to search.

  For example, “I would like to see the concert of AZB Tokyo Dome” → “AZB, Tokyo Dome, Concert”. If the keyword is empty (undecided), a character string such as “Please enter a keyword” is displayed in the message display field (“first line” display field 432) to prompt the keyword.

  FIG. 14 shows an example of supporting a user who has activated the voice search function.

  When the user activates the voice search function, if there is no utterance (detected silence) for a certain period of time, for example, 5 seconds, a message supporting the user is displayed in another window 451, and the voice search function It is possible to support program search using. Alternatively, a message explaining the usage method may be displayed in the hint display field 441 to support program search using the voice search function.

For example, after 5 seconds have passed since the start of the voice search function,
I want to see ○○.
I want to see the scene of ○○.
I want to book ○○.
And the like are displayed in another window 451, and the user can be prompted to start using the voice search function. The message to be displayed is related to the operation status of the voice search function. For example, when the character input screen is displayed, “Please speak the character string you want to input.” Or when the search result is displayed, “If you want to narrow down Please say “Filter by ○○”. It is preferable that the wording is related to the operation at that time (character string).

  When defining a keyword, for example, “I want to see”, “Look for” or “No” from a character string (utterance content) obtained as a result of phrase breaks or word recognition specified by input speech processing. Eliminating and separating words such as “”, “,”, and “” ”to make the search target as a single keyword also applies to searches using any search engine Is possible.

  FIG. 15 shows another example of supporting a user who has activated the voice search function.

  When the user activates the voice search function, if there is no utterance (silence is detected) for a certain period of time, a message explaining how to use is displayed in the hint display field 441 to support program search using the voice search function can do.

For example, when the voice search function startup process is completed and recording is possible,
“Speak the text you want to enter.”
“Would you like to introduce today ’s recommendations?”
By displaying various hint messages that can be used to conceive what the user should say, the user can be encouraged to use the voice search function effectively.

  Note that the hint message is divided according to the status (operating state) of the television apparatus 1. The hint message is preferably displayed by shuffling a plurality of types of messages, for example, every 3 seconds.

  Note that the hint message can be guided by voice from the television apparatus 1 by voice synthesis.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 1 ... Television receiver (video reproduction device / first electronic device), 2 ... Recorder device (video recording device / second electronic device), 3 ... Network controller, 6 ... Time shift storage device, 7-9 ... Service server 51 ... Main control block 55 ... Intention discrimination database (non-volatile memory) 56 ... Voice search control unit 57 ... Input voice processing unit 58 ... Intention analysis unit 59 ... Intention discrimination database 67 ... Storage device 71 ... Remote control terminal (remote controller).

Claims (11)

An input voice processing means for specifying a search condition to be searched based on the input voice;
Search control means for switching a search destination of the search target based on the search condition specified by the input voice processing means;
An electronic device comprising:   The electronic apparatus according to claim 1, further comprising an analysis unit for the input voice processing unit to specify the search condition.   The analysis unit is configured to select a keyword or a character string or a word from which the search control unit can switch a search destination to be searched or a search destination from a character string or a word specified by the input voice processing unit from the input voice. The electronic device according to claim 2 for determination.   The analysis unit determines that the character string or word specified by the input voice processing unit from the input voice is a character string or word that can specify an external server as a search destination of the search target. Electronics.   The electronic device according to claim 1, further comprising a search unit that searches based on the search condition from the switched search destination.   2. The electronic apparatus according to claim 1, further comprising display control means for outputting a display signal capable of displaying an image corresponding to the search destination of the search target switched by the search control means.   The electronic apparatus according to claim 5 or 6, further comprising an analysis unit for the input voice processing unit to specify the search condition.   The analysis unit is configured to select a keyword or a character string or a word from which the search control unit can switch a search destination to be searched or a search destination from a character string or a word specified by the input voice processing unit from the input voice. The electronic device according to claim 7 for determination.   The analysis unit determines that the character string or word specified by the input voice processing unit from the input voice is a character string or word that can specify an external server as a search destination of the search target. Electronics.   The electronic apparatus according to claim 5, further comprising display means for displaying an image corresponding to the display signal output by the display control means. Identify search criteria based on the input voice,
A control method for an electronic device that switches a search target to be searched based on a search condition specified by an input voice processing unit.

Images