JP2021015180A - Electronic apparatus, program and voice recognition method - Google Patents

Abstract

To selectively use a plurality of microphones according to a situation of a speaker and to use voice collected by the respective microphones while sound collection sections are provided on both an external terminal and an electronic apparatus and instruction operability of the speaker is improved.SOLUTION: An electronic apparatus comprises a first voice acquisition section, a second sound collection section, a second voice acquisition section, a voice recognition section, and a control section. The first voice acquisition section acquires, from an external terminal, a first voice collected by a first sound collection section of the external terminal. The second sound collection section collects a second voice at a self-periphery. The second voice acquisition section acquires the second voice collected by the second sound collection section. The voice recognition section performs voice recognition processing on the inputted voice. The control section inputs the voice matched with a previously set condition in the first voice and the second voice to the voice recognition section to perform voice recognition processing.SELECTED DRAWING: Figure 1

Description

Embodiments of the present invention relate to electronic devices, programs and speech recognition methods.

In recent years, there has been an increasing need for a service (voice interactive content search service by AI) for operating a device by voice and searching for information and contents. This search service is rapidly becoming widespread because of the convenience of being able to operate and search for information simply by talking to a device without having to pick up a remote controller (hereinafter referred to as "remote control").

Since the devices to be operated are not only the devices spoken by the speaker but also all devices in the home, it is expected that the number of businesses and device manufacturers that provide such search services will increase in the future. To.

On the other hand, when giving instructions to a device equipped with a device capable of displaying information such as a television device (hereinafter referred to as "TV") or a personal computer (hereinafter referred to as "PC") at a position away from the device. , Remote control operation is basic, but it is conceivable to use the remote control as a sound collecting means when searching for contents or inputting characters.

As a specific example of utilizing the sound collected by the TV, for example, the remote control has a built-in microphone, and the voice emitted by the speaker is collected by the microphone and transmitted from the remote control to the TV main body for processing (voice recognition). ), Or the TV main body directly collects and processes the voice emitted by the user by incorporating a microphone in the TV main body.

In the former remote control with a built-in microphone, the distance between the microphone and the speaker is short, so high-quality voice can be collected and the collected voice can be recognized and processed with high accuracy, while the speaker holds the remote control by hand. There is a disadvantage that it is necessary.

In addition, the latter example of incorporating a microphone in the TV body is the opposite of the former, and although the speaker can speak without holding the remote control, the distance between the microphone and the speaker is large, so the voice collected by the microphone I can't expect high quality.

Therefore, it is conceivable to provide microphones in the good points of both, that is, both the remote controller and the TV main body.

Japanese Unexamined Patent Publication No. 2006-319797

However, when microphones (sound collectors) are provided on both the remote control (external terminal) and the TV main unit (electronic device), there are cases (audio collision) in which the sound collected by each microphone is input to the TV main unit at the same time. There is a problem that it occurs and the collected voice cannot be used well.

For example, when the speaker has a remote control, it is better to use the voice collected by the microphone of the remote control, and when the speaker does not have the remote control, it is better to use the voice collected by the microphone of the TV main unit. Is good. In this way, it is necessary to use different microphones depending on the situation of the speaker.

The problem to be solved by the present invention is to provide sound collectors on both the external terminal and the electronic device to improve the instruction operability of the speaker, and to use a plurality of sound collectors properly according to the situation of the speaker. The purpose of the present invention is to provide electronic devices, programs, and voice recognition methods that can utilize the voice collected by the sound unit.

The electronic device of the embodiment is an electronic device that is wirelessly or wiredly connected to an external terminal having a first sound collecting unit that collects the first sound around itself, and is a first sound acquisition unit and a second sound collecting unit. A unit, a second voice acquisition unit, a voice recognition unit, and a control unit are provided. The first voice acquisition unit acquires the first voice collected by the first sound collecting unit of the external terminal from the external terminal. The second sound collecting unit collects the second sound around itself. The second voice acquisition unit acquires the second sound collected by the second sound collection unit. The voice recognition unit performs voice recognition processing on the input voice. The control unit inputs a voice that matches a preset condition among the first voice and the second voice into the voice recognition unit and performs voice recognition processing.

It is a figure which shows the structure of the recording / reproduction apparatus of embodiment. It is a flowchart which shows the 1st operation example of a recording / reproduction apparatus. It is a flowchart which shows the 2nd operation example of a recording / reproduction apparatus. It is a flowchart which shows the 3rd operation example of a recording / reproduction apparatus.

Hereinafter, embodiments will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing an example of a schematic configuration of a recording / reproducing device 1 according to an embodiment relating to an electronic device. In the present embodiment, the recording / reproducing device 1 provided with the video display unit 14 will be described, but the video display unit 14 is not an essential configuration. When the electronic device is, for example, a digital recorder or the main body of a computer, the electronic device does not include the video display unit 14 and outputs display information to an external video display unit (display) via various cables or the like. To do. In addition, the electronic device may be, for example, an air conditioner, a refrigerator, or the like.

The configuration of the recording / reproducing device 1 will be described with reference to FIG. As shown in FIG. 1, the recording / playback device 1 is an electronic device wirelessly connected to a remote controller 20 (hereinafter referred to as “remote control 20”) as an external terminal, and provides a content search service by voice on a network. A recording / playback device main body 100 connected to a service server (servers 200, 201, etc.) as one or more computers via a network NTW is provided. The recording / playback device 1 may be connected to the remote controller 20 by wire.

The recording / playback device main body 100 is connected to the remote controller 20 by wireless communication such as Bluetooth (registered trademark) and infrared communication. The remote controller 20 may be a unit dedicated to the recording / playback device 1 as in this example, or may be a unit having a communication function with an information terminal such as a smartphone or a tablet or a microphone.

The remote controller 20 includes a plurality of buttons 21 for operating the functions of the recording / playback device main body 100, a signal processing unit 22, an IR transmitting unit 23 as a first transmitting unit, a microphone 24 as a first sound collecting unit, and a voice processing unit. 25, It has a Bluetooth communication unit 26 (hereinafter referred to as “BT communication unit 26”) and the like as a second transmission unit. One of the plurality of buttons 21 includes a setting button 21a which is a button for calling the setting function and a voice button 21b which is a button for operating the voice function.

The signal processing unit 22 generates a signal corresponding to the pressing of a plurality of buttons 21. The IR transmission unit 23 outputs a signal generated by the signal processing unit 22 by infrared communication in response to the operation of the voice button 21b. The signal processing unit 22 is a signal that causes the voice function of the recording / reproducing device main body 100 to start a recording operation by pressing the voice button 21b, that is, an instruction signal (specific) that instructs the recording / reproducing device main body 100 to start recording. Trigger signal) is generated.

The microphone 24 has a narrow sound collecting range (directivity of about 90 °, sound collecting distance of about several tens of centimeters), becomes active by operating the voice button 21b, and is the first around itself (microphone 24). Since one voice (mainly the voice spoken by the speaker into the microphone 24) is collected, a relatively high quality voice can be obtained.

The voice processing unit 25 digitizes the analog voice collected by the microphone 24 and passes it to the BT communication unit 26. The BT communication unit 26 transmits the voice digitized by the voice processing unit 25 to the Bluetooth communication. That is, the BT communication unit 26 and the voice processing unit 25 transmit the voice collected by the microphone 24 to the recording / playback device main body 100.

The recording / playback device main body 100 includes an interface 50 for receiving terrestrial digital broadcasting, a tuner 51, an OFDM demodulator 52, a signal processing unit 53, a graphic processing unit 58, an audio processing unit 59, an OSD signal generation unit 61, and a video display unit 14. Speaker 15, operation unit 16, various terminals (video output terminal, audio output terminal, etc.) not shown, various interfaces (IR receiver 18, BT communication unit 19, communication interface 73 with LAN or external network NTW (hereinafter referred to as "communication I"). / F73 ”)), a main body microphone 81, a control module 65, a hard disk drive 101 (hereinafter referred to as“ HDD 101 ”), and the like. The HDD 101 provided inside the device is also referred to as an internal HDD.

The antenna 50 supplies the received terrestrial digital television broadcast signal to the tuner 51 for terrestrial digital broadcasting. The tuner 51 selects a broadcast signal of a designated channel from the supplied broadcast signals and supplies the broadcast signal to the OFDM (orthogonal frequency division multiplexing) demodulator 52.

The OFDM demodulator 52 demodulates the broadcast signal of the input channel into a digital video signal and an audio signal, and then outputs the signal to the signal processing unit 53.

The signal processing unit 53 performs predetermined digital signal processing on the digital video signal and audio signal input from the OFDM demodulator 52, and outputs them to the graphic processing unit 58 and the audio processing unit 59.

The graphic processing unit 58 superimposes the OSD signal generated by the OSD (on screen display) signal generation unit 61 on the digital video signal supplied from the signal processing unit 53 and outputs it to the video processing unit 62. The graphic processing unit 58 selectively outputs the output video signal of the signal processing unit 53 and the output OSD signal of the OSD signal generation unit 61, or outputs both outputs in combination.

The video processing unit 62 applies processing such as brightness, brightness, and saturation to the digital video signal input from the graphic processing unit 58, and sends the video signal to the video display unit 14 and the video output terminal (not shown). Supply. The video processing unit 62 functions as an output unit that outputs a video of the content to the screen.

The video display unit 14 is, for example, a display, a display panel, or the like, and displays a video based on a video signal on the display panel. When an external device is connected to the video output terminal, the video signal supplied to the video output terminal is output to the external device.

The audio processing unit 59 converts the input digital audio signal into an analog audio signal that can be reproduced by the speaker 15, and then outputs the output to the speaker 15 to output the audio. The analog audio signal is output to the outside via an audio output terminal (not shown) such as a headphone terminal.

The operation unit 16 is buttons and switches provided on the recording / playback device main body 100, and can perform operations substantially equivalent to those of the remote controller 20 for each function of the recording / playback device main body 100.

More specifically, the operation unit 16 is directly operated by the user, for example, an EPG (electronic program guide) display for viewing a program and making a recording reservation, and a channel (broadcast station) from the EPG (electronic program guide) to a television broadcast (program). Selection, program recording start (REC), program list display for playing recorded programs (past program guide), selection for playing programs recorded from the past program guide (up / down / left / right direction instructions) And a control command corresponding to playback start (PLAY) and the like are input to the control module 65.

The main body microphone 81 collects the second sound (speaker's sound) around itself (main body microphone 81) (a range of several meters having directivity at a certain angle in front of the screen of the image display unit 14). It is a sound collecting unit and collects sound in a sound collecting range (directivity of about 120 °, sound collecting distance of about several meters) wider than the microphone 24 of the remote control 20.

The input voice processing unit 64 digitizes the analog voice collected by the main body microphone 81 and outputs it to the control module 65. The input voice processing unit 64 functions as a second voice acquisition unit that acquires the second voice collected by the main body microphone 81.

Normally, while the recording / playback device main body 100 is operating, the main body microphone 81 always collects sound in a state where sound can be collected (active state), and when the voice button 21b of the remote controller 20 is pressed, the sound collecting operation is performed. It is switched to the stopped state), the microphone 24 of the remote controller 20 is activated, and the voice (first voice) collected by the microphone 24 is acquired from the remote controller 20.

In addition, even when the voice button 21b of the remote control 20 is pressed, the main body microphone 81 is maintained in a state in which sound can be collected (active state), and the pressure of the sound collected from the two microphones 24 and 81 is strong ( Voice recognition of the sound collected from the microphone (higher sound pressure) or the sound collected (higher clarity) (as a result, the higher voice recognition rate) or the recorded sound. You may output to unit 71.

Speech intelligibility can be evaluated, for example, by the intelligibility index (SII: Speech Intelligibility Index), for example. SII is standardized as "ANSI S3.5-1997", and basically, by frequency from the signal-to-noise ratio and the coefficient by frequency (contribution rate to clarity by frequency) for each divided frequency band. The intelligibility index of is calculated, and the total intelligibility index is calculated from the sum of them.
This may be simplified and the intelligibility index may be obtained by limiting the frequency band to a frequency band (for example, 1000 Hz to 3,000 Hz) that greatly contributes to the intelligibility of speech.

At this time, the level of the voice recognition rate can be evaluated from either the sound pressure Pv or the intelligibility index SII.
The level of the voice recognition rate may be evaluated by the combination of the sound pressure Pv and the intelligibility index SII. For example, the speech recognition rate can be evaluated by the linear addition of the sound pressure Pv and the intelligibility index SII as in the following equation (1).
R = K1 * Pv + K2 * SII ... Equation (1)
Here, the counts K1 and K2 are proportional coefficients.
That is, the voice with the larger value R determined by the equation (1) can have a higher voice recognition rate.

The IR receiver 18 receives instructions (operation input) from the remote controller 20, for example, channel (broadcasting station) selection (channel selection), recording start (REC), recorded program playback (PLAY), pause (PAUSE), and the like. A command corresponding to special playback, menu display, or the like is input to the control module 65 by infrared communication.

The BT communication unit 19 performs Bluetooth communication (short-range wireless communication) with the remote controller 20. The BT communication unit 19 receives the audio signal transmitted from the remote controller 20 and inputs it to the control module 65. The BT communication unit 19 functions as a first voice acquisition unit that acquires the first voice collected by the microphone 24 of the remote controller 20 from the remote controller 20.

In addition, by providing a WiFi (Wireless Fidelity) communication unit or the like, wireless communication may be performed with a short-range wireless communication device conforming to the WiFi standard or the like. Further, a short-range wireless communication unit of a standard such as NFC (Near Field Communication) may be provided to communicate with an external device of the same standard.

The USB I / F76 communicates data and signals with an external connection device (input device or storage device) or the like that supports the USB standard. Examples of the input device include a keyboard and a mouse. The storage device is an HDD 102 or the like connected to the USB terminal as in this example. The HDDs 101 and 102 can use various storage areas depending on the settings.

The HDD 101 is set to schedule or manually record a program individually specified by the user from the electronic program guide (EPG), and the HDD 102 is set to a specific channel (broadcaster or distributor) specified in advance by the user. ) And a time shift machine function (also referred to as "all program recording function" or "loop recording function") that records all programs in a predetermined time zone for a certain period of time can be set. The reverse setting is also possible.

In this example, the HDD 101 is provided inside the device and the HDD 102 is connected to the outside of the device. However, a plurality of externally connected HDD 102s may be connected.

The communication I / F73 is controlled by the control module 65 to access the external network NTW and communicate with various service servers (servers 200, 201, etc. that provide a content search service by voice recognition) on the external network NTW. I do. Specifically, the communication I / F 73 is controlled by the control module 65 to perform a search request (transmission of input information) for acquisition of information, reception of search results (acquisition of information), and the like.

The server 200 manages program information used for watching TV programs, making recording reservations, storing a history of recorded contents, etc., and using the AI assistant function to search for programs by utterance (voice) and search for contents related to the programs. Provides services (hereinafter referred to as "A service", "first search service", etc.).

The server 201 is a computer that provides an AI assistant function for searching content on the Internet by utterance (voice) (hereinafter referred to as "B service", "second search service", etc.), and is used for traffic information, weather information, and the like. It is possible to search a wide range of contents such as Internet programs and dictionaries.

The services of these service servers support not only the search by voice but also the search by character data in which voice is converted into characters. Here, it is called audio data including digital audio signals and their character data.

The control module 65 includes a ROM (read only memory) 66 that stores a control program that controls the operation of this device, a RAM (random access memory) 67 that provides a work area for processing signals and data, recording reservation information, and various types. A flash memory 68, a setting unit 69, a recording unit 70, a voice recognition unit 71, a control unit 72, etc., which store the setting information and control information of the above, and a recording / playback device main body including the above-mentioned signal processing and the like. It comprehensively controls all 100 functions (broadcast reception function, program recording / playback function, setting function, voice function, communication function with network) and operation. The voice function is a voice recognition function of the voice recognition unit 71 including a voice / character conversion function and a syntax analysis function.

As a result, the recording / playback device main body 100 receives the terrestrial digital broadcast by the broadcast receiving function, and reproduces the program (video data including audio) recorded in the HDDs 101 and 102 by the recording function by the playback function, so that the user can use the program. Will be available for viewing. Further, by connecting to the home network, the recording / reproducing device main body 100 can reproduce a program stored (recorded) in another recorder or a home server connected to the home network.

The flash memory 68 stores a recording reservation table for scheduled recording by the reserved recording function, a recording reservation table for individual programs, recording information which is attribute information of recorded programs, setting information of voice function, and the like. .. The setting information may be set in advance, or may be set by a user's selection operation from the setting menu screen displayed by the setting unit 69. The setting information includes selection conditions for selecting one from search services by one or more service servers (servers 200, 201, etc.).

That is, the flash memory 68 is a condition for making any one of the two microphones 24 and 81 active (operating state) or inactive (operating stopped state), or two acquired by the two microphones 24 and 81. It can be said that it is a storage unit that stores the conditions for using any of the voices.

The setting unit 69 displays a screen for setting the setting information in the flash memory 68, and stores the confirmed setting information in the flash memory 68 after the setting operation by the user.

The recording unit 70 uses the flash memory 68, HDD 101, etc. for the first voice acquired by the BT communication unit 1 (first voice acquisition unit) and the second voice acquired by the input voice processing unit 64 (second voice acquisition unit). To memorize (record).

The voice recognition unit 71 reads the voice recorded by the recording unit 70 from the flash memory 68, the HDD 101, or the like and analyzes it, that is, performs voice recognition processing.

If the processing capacity of the recording / playback device main body 100 is high, the recorded voice is not read out and processed, but the voice from the remote controller 20 (first voice) received by the BT communication unit 26 or the main body microphone 81 is used. The collected voice (second voice) may be analyzed in real time. To analyze a voice is to convert the voice (voice uttered by the user) into characters, analyze the syntax of the converted voice data using a preset analysis dictionary, and analyze words, meaningful characters, or character strings. Refers to voice recognition processing that extracts (keywords).

The control unit 72 inputs to the voice recognition unit 71 a voice that matches a preset condition among the first voice of the microphone 24 of the remote control 20 and the second voice of the main body microphone 81, and performs voice recognition processing.

Here, the conditions include the following conditions "1." to "3.".
Condition of "1." ... For example, when a signal is received by operating the voice button 21b of the remote controller 20, the operation of the main body microphone 81 is stopped.
Condition of "2." ... When a signal is received by operating the voice button 21b of the remote controller 20, the voice recognition unit 71 is made to recognize the first voice obtained from the remote controller 20.
Condition of "3." ... Use the voice with the better sound quality of the two recorded voices.
And so on.

The control unit 72 calls the control program held in the ROM 66 into the work area provided by the RAM 67, and executes the processing corresponding to the input signal and the control signal based on the called control program.

The control unit 72 controls, for example, a recording / playback function and a voice function, and acquires various information (attribute information) related to the content (program).

The control unit 72 is based on the operation information (control input) from the operation unit 16 and the operation information (control input) from the remote controller 20 received by the IR reception unit 18, and each unit (setting unit 69, recording unit 70) of this device. , Voice recognition unit 71, etc.).

In addition, the control unit 72 writes various setting information and management information about other recorders and television devices connected to the home server in the home network to the flash memory 68.

The control unit 72 controls the recording / playback function based on, for example, an operation instruction (control input) by the user or recording reservation information for scheduled recording, and outputs a video signal, an audio signal, or the like to the HDD on the side designated in advance. Record (record) on (either HDD 101 or 102).

The control unit 72 sends the character or character string of the recognition result by the voice recognition unit 71 and the acquired voice (first voice or second voice) to the service server (any of the servers 200 and 201) that provides the search service. Have the content searched using (voice) and receive the search results.

That is, the control unit 72 sends a search request (sending input information) for acquiring the content, receiving the search result (acquiring the content), and the like to the service server (either the server 200 or 201). Do.

More specifically, the control unit 72 has acquired the characters or character strings of the recognition result by the voice recognition unit 71 from the service server (any of the servers 200 and 201) via the communication I / F73. A content search request is made using at least a part of the voice, and the search result received from the server in response to the search request is output to the video display unit 14.

Further, the control unit 72 transmits / receives information to / from a service server (servers 200, 201, etc.) connected to the external network NTW via the communication I / F73. Further, the control unit 72 transmits information to a USB compatible device via the USB I / F76.

Further, the control unit 72 displays the content (program) of the channel received and selected by the tuner 51. Further, the control unit 72 refers to the recording reservation information included in the recording reservation list stored in the flash memory 68, and controls the recording operation of the content (program) based on the signal received by the tuner 51. The recording operation includes manual recording and the like. The recording destination of the content (program) during the recording operation is, for example, the HDD 101 provided inside the device, the HDD 102 connected via the USB I / F76, or the like.

Hereinafter, the operation according to the above conditions "1." to "3." will be described with reference to FIGS. 2 to 4. First, a first operation example according to the condition of "1." of the recording / reproducing device 1 will be described with reference to the flowchart of FIG.
In the case of this first operation example, when the recording / playback device main body 100 is activated, the control unit 72 activates the main body microphone 81 and collects sound from the vicinity of the main body microphone 81 (step S101 in FIG. 2).

If the voice button 21b of the remote control 20 is not operated and a signal is not received (No in step S102) during sound collection by the main body microphone 81, the control unit 72 controls the recording unit 70 and the voice recognition unit 71. , The voice collected by the main body microphone 81 is recorded (step S103), and the recorded voice is subjected to voice recognition processing (step S104).

Then, the control unit 72 searches the service server (either server 200 or 201) set in advance as the request destination based on the result of the voice recognition process (word (character), character string, keyword, etc.) and the voice. Make a request (step S105). The search request includes at least a part of the recorded voice, and if necessary, a word of the analysis result and the like.

The service server (either the server 200 or 201) that received the search request searches for the content based on the received voice or word, and sends the search result (content) to the recording / playback device main body 100.

When the search result (content) transmitted from the server is received (step S106), the recording / playback device main body 100 outputs the content to the video display unit 14 (step S107) and displays the content.

On the other hand, when the button 21 of the remote controller 20 is operated by the user during sound collection by the main body microphone 81 (step S101), the signal processing unit 22 in the remote controller 20 generates a signal corresponding to the button 21 and generates the signal. The signal is transmitted from the IR transmission unit 23.

Here, for example, when the voice button 21b, which is a specific button of the remote controller 20, is pressed, the signal processing unit 22 activates the microphone 24, and the sound collection by the microphone 24 is started.

Here, when the user speaks into the microphone 24 of the remote controller 20, the voice is collected by the microphone 24, processed by voice, and then transmitted from the BT communication unit 26.

In the recording / reproducing device main body 100, when the IR signal transmitted from the remote controller 20 is received by the IR receiving unit 18 (Yes in step S102), the control unit 72 determines whether or not the signal is the signal of the voice button 21b. (Step S108).

If the result of the determination is not the signal of the voice button 21b (No in step S108), the function is controlled according to the signal (step S109).

On the other hand, when the received signal is the signal of the voice button 21b (Yes in step S108), the control unit 72 then refers to the condition of the flash memory 68. Since the condition "1." at the time of this operation is a condition that the operation of the main body microphone 81 is stopped when a signal is received by the operation of the voice button 21b of the remote controller 20, the control unit 72 controls the main body microphone. The 81 is deactivated (step S110), and the collection of the second voice by the main body microphone 81 is stopped.

Then, when the first voice from the remote controller 20 is received (step S111), the control unit 72 controls the recording unit 70 to record the first voice from the remote controller 20 (step S112).

According to this first operation example, when the recording / reproducing device main body 100 is provided with the setting unit 69, the recording unit 70, the voice recognition unit 71 and the control unit 72, and the voice button 21b of the remote control 20 is pressed and the signal is received. By deactivating the main body microphone 81 and using the first voice acquired from the microphone 24 of the remote control 20 for the voice recognition process, the accuracy of voice recognition can be improved.

For example, normally, when sound collection and voice recognition processing are performed by the main body microphone 81 and the voice button 21b of the remote control 20 is pressed and a trigger signal for starting recording is received, the control unit 72 triggers the trigger. A story in which the remote control 20 is operated by deactivating the main body microphone 81, activating the microphone 24 of the remote control 20, and using the first voice collected by the remote control 20 that is close to the speaker for voice recognition processing. It is possible to acquire high-quality voice of a person (user) and perform voice recognition processing with high accuracy.

Next, a second operation example according to the condition of “2.” of the recording / reproducing device 1 will be described with reference to the flowchart of FIG. In this second operation example, the same operation as that of the first operation example is designated by the same reference numerals, and the description thereof will be omitted.

In the case of this second operation example, when the recording / playback device main body 100 is activated, the control unit 72 activates the main body microphone 81 and collects sound from the vicinity of the main body microphone 81 (step S101 in FIG. 3).

If the voice button 21b of the remote controller 20 is not operated and a signal is not received (No in step S102) during sound collection by the main body microphone 81, the control unit 72 operates in the same manner as in the first operation example (step S103). ~ S107).

On the other hand, when the button 21 of the remote controller 20 is operated by the user during sound collection by the main body microphone 81 (step S101), the signal processing unit 22 in the remote controller 20 generates a signal corresponding to the button 21 and generates the signal. The signal is transmitted from the IR transmission unit 23.

Here, for example, when the voice button 21b, which is a specific button of the remote controller 20, is pressed, the signal processing unit 22 activates the microphone 24, and the sound collection by the microphone 24 is started.

Then, when the user speaks into the microphone 24 of the remote controller 20, the voice is collected by the microphone 24, processed by voice, and then transmitted from the BT communication unit 26.

In the recording / reproducing device main body 100, when the IR signal transmitted from the remote controller 20 is received by the IR receiving unit 18 (Yes in step S102), the control unit 72 determines whether or not the signal is the signal of the voice button 21b. (Step S108).

If the result of the determination is not the signal of the voice button 21b (No in step S108), the function is controlled according to the signal (step S109).

On the other hand, when the received signal is the signal of the voice button 21b (Yes in step S108), the control unit 72 subsequently waits for the reception of the voice from the remote controller 20, and when the voice of the remote controller 20 is received (step). S121), the recording unit 70 is controlled to record the voice from the remote controller 20 (step S122). Since the main body microphone 81 remains active during this period, the recording of the sound collected by the main body microphone 81 can be continued (step S103).

Next, the control unit 72 refers to the conditions of the flash memory 68. The condition "2." of this operation is a condition that the voice recognition unit 71 recognizes the first voice obtained from the remote control 20 when a signal is received by operating the voice button 21b of the remote control 20. The control unit 72 inputs the first voice obtained from the remote control 20 out of the two voices recorded by the recording unit 70 to the voice recognition unit 71, and causes the voice recognition unit 71 to perform voice recognition processing (S123). After that, the operation of using the voice recognition result of the voice recognition unit 71 is the same as that of the first embodiment.

According to this second operation example, when a signal is received by operating the voice button 21b of the remote control 20, the control unit 72 receives two voices (first voice and second voice) recorded by the recording unit 70, respectively. Of these, the recorded first voice of the remote control 20 is input to the voice recognition unit 71, and the voice recognition unit 71 is made to perform voice recognition processing.

For example, when the trigger for starting recording is the activation of the recording / playback device main body 100 or the pressing of the voice button 1b of the remote controller 20, the trigger triggers the recording of the second voice of the main body microphone 81 and the microphone 24 of the remote controller 20. The recording of the first voice of is performed at the same time. Then, if the trigger generation source is the remote controller 20 that is close to the speaker (user), the voice collected by the microphone 24 of the remote controller 20 is acquired and the voice recognition process is performed. The voice recognition accuracy can be improved by recognizing and processing high-quality voice from the remote controller 20 because the distance to the speaker is short from the plurality of voices recorded at the same time.

Next, a third operation example according to the condition of “3.” of the recording / reproducing device 1 will be described with reference to the flowchart of FIG. In this third operation example, the same operation as that of the second operation example is designated by the same reference numerals, and the description thereof will be omitted.

In the case of this third operation example, the operation from the start of the recording / playback device main body 100 to the recording of the sound collected by each microphone is the same as that of the second operation example, and the description thereof will be omitted.

The control unit 72 refers to the condition of the flash memory 68 while the two sounds are recorded respectively. Since the condition "3." of this operation is that the voice having the better sound quality is used among the two recorded voices, the control unit 72 uses the two voices recorded by the recording unit 70, respectively. Of the two voices whose sound quality has been checked, the voice having the higher voice recognition rate is input to the voice recognition unit 71, and the voice recognition unit 71 is made to perform voice recognition processing (S131, S132). After that, the operation of using the voice recognition result of the voice recognition unit 71 is the same as that of the first and second embodiments.

According to this third operation example, the control unit 72 checks and records the quality of each of the plurality of voices (first voice and second voice) acquired and recorded from the microphone 24 of the remote control 20 and the main body microphone 81, respectively. Since the highest quality voice is used for the voice recognition process, the accuracy of voice recognition can be improved.

In this third operation example, the trigger for starting the sound collection of the microphone 24 is the same as that of the second operation example, but the sound collection itself is always performed by each microphone, and the timing of the voice recognition process is set by the remote controller 20. It may be when the voice button 21b is pressed, that is, when the signal of the voice button 21b is received.

As described above, according to the recording / reproducing device 1 of this embodiment, microphones (sound collecting units) are provided on both the remote controller 20 (external terminal) and the recording / reproducing device main body 100 (electronic device) to collect sound. By configuring the collected sounds that meet the conditions of "1." to "3." to be used for voice recognition processing, the speaker can improve the instruction operability of the operator (speaker). Depending on the situation, a plurality of microphones 24 and 81 can be used properly and the sound collected by the respective microphones 24 and 81 can be utilized.
Further, in the present embodiment, high-quality voice data can be acquired by properly using a plurality of microphones 24 and 81 depending on the situation of the speaker, for example, by switching the sound collecting unit to the microphone 24 close to the speaker. In addition, it is possible to prevent the main body microphone 81 from reacting erroneously while collecting sound with the microphone 24 of the remote controller 20.

In the above embodiment, an example in which microphones 24, 81, etc. are provided on the recording / playback device main body 100 and the remote controller 20, respectively, is shown, but each of a plurality of external terminals (first remote controller and second remote controller) is provided with microphones. A plurality of voices may be transmitted from the remote controller to the recording / playback device main body 100.

That is, the recording / playback device main body 100 acquires the first sound collected by the microphone of the first remote controller and the second sound collected by the microphone of the second remote controller, and is preset inside the recording / playback device main body 100. A voice that matches the above-mentioned conditions may be selected and used for voice recognition processing.

Although embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. This novel embodiment can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The above-described embodiment and its modifications are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof.

Further, each component of the recording / reproducing device 1 shown in the above embodiment may be realized by a program installed in a storage such as a hard disk device of a computer, or the above program may be realized by a computer-readable electronic medium: electronic media. The function of the present invention may be realized by the computer by storing the program and causing the computer to read the program from the electronic medium.

Examples of electronic media include recording media such as CD-ROMs, flash memories, removable media: removable media, and the like. Further, it may be realized by distributing and storing the components in different computers connected via the network and communicating each component between the functioning computers.

1 ... Recording / playback device, 14 ... Video display unit, 15 ... Speaker, 16 ... Operation unit, 18 ... IR receiving unit, 19 ... BT communication unit, 20 ... Remote controller (remote control), 21 ... Button, 21a ... Setting button, 21b ... Voice button, 22 ... Signal processing unit, 23 ... IR transmission unit, 24 ... Microphone, 25 ... Voice processing unit, 26 ... BT communication unit, 50 ... Antenna, 51 ... Tuner, 52 ... OFDM demodulator, 53 ... Signal Processing unit, 58 ... Graphic processing unit, 59 ... Audio processing unit, 61 ... OSD signal generation unit, 62 ... Video processing unit, 64 ... Input audio processing unit, 65 ... Control module, 68 ... Flash memory, 69 ... Setting unit, 70 ... Recording unit, 71 ... Voice recognition unit, 72 ... Control unit, 73 ... Communication interface (communication I / F), 76 ... USB interface (USB I / F), 81 ... Main unit microphone, 100 ... Recording / playback device main unit, 101, 102 ... Hard disk drive (HDD), 200, 201 ... Server, NTW ... Network.

Claims (7)

An electronic device that is wirelessly or wiredly connected to an external terminal having a first sound collecting unit that collects the first sound around itself.
A first voice acquisition unit that acquires the first sound collected by the first sound collection unit of the external terminal from the external terminal, and
The second sound collecting part that collects the second sound around you,
A second sound acquisition unit that acquires the second sound collected by the second sound collection unit, and a second sound acquisition unit.
A voice recognition unit that performs voice recognition processing on the input voice,
An electronic device including a control unit that inputs a voice that matches a preset condition among the first voice and the second voice into the voice recognition unit and performs voice recognition processing. A recording unit for recording the first voice acquired by the first voice acquisition unit and the second voice acquired by the second voice acquisition unit is provided.
The control unit
The electronic device according to claim 1, wherein the voice recognition unit recognizes a voice that meets the above conditions among the first voice and the second voice recorded by the recording unit. A receiver for receiving an instruction signal transmitted from the external terminal is provided.
The condition is the reception of a specific instruction signal from the external terminal.
The control unit
When a specific instruction signal from the external terminal is received by the receiving unit, the first voice obtained from the external terminal among the obtained first voice and the second voice is sent to the voice recognition unit. The electronic device according to claim 2, further comprising a control unit for (inputting) recognition. A receiver for receiving an instruction signal transmitted from the external terminal is provided.
The condition is the reception of a specific instruction signal from the external terminal.
The control unit
When a specific instruction signal from the external terminal is received by the receiving unit, the operation of the second sound collecting unit is stopped (the first voice obtained from the external terminal is subjected to voice recognition processing). , The electronic device according to claim 1. The above condition is a condition that "the voice having the higher voice recognition rate is used".
The control unit
The electronic device according to claim 1 or 2, wherein the voice recognition unit performs voice recognition processing on the voice having the higher voice recognition rate among the first voice and the second voice. A program that operates an electronic device that is wirelessly or wiredly connected to an external terminal that has a first sound collecting unit that collects the first sound around itself.
The electronic device
A first voice acquisition unit that acquires the first sound collected by the first sound collection unit of the external terminal from the external terminal, and
A second sound acquisition unit that acquires a second sound collected from the surroundings of the second sound collection unit by a second sound collection unit provided in the electronic device, and a second sound acquisition unit.
A voice recognition unit that performs voice recognition processing on the input voice,
A program that functions as a control unit that inputs a voice that matches a preset condition among the first voice and the second voice into the voice recognition unit and performs voice recognition processing. A voice recognition method in an electronic device that is wirelessly or wiredly connected to an external terminal having a first sound collecting unit that collects the first voice around itself.
The first sound collected by the first sound collecting unit of the external terminal is acquired from the external terminal, and the first sound is acquired.
The second sound collection unit provided in the electronic device acquires the second sound collected from the surroundings of the second sound collection unit.
A voice recognition method for performing voice recognition processing on voices that meet preset conditions among the first voice and the second voice.

Images