US10490192B2 - Apparatus, method, non-transitory computer-readable medium and system for modifying voice recognition information - Google Patents

Apparatus, method, non-transitory computer-readable medium and system for modifying voice recognition information Download PDF

Info

Publication number
US10490192B2
US10490192B2 US15/307,621 US201515307621A US10490192B2 US 10490192 B2 US10490192 B2 US 10490192B2 US 201515307621 A US201515307621 A US 201515307621A US 10490192 B2 US10490192 B2 US 10490192B2
Authority
US
United States
Prior art keywords
voice recognition
recognition information
information
activation word
stored
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/307,621
Other languages
English (en)
Other versions
US20170053650A1 (en
Inventor
Hiroaki Ogawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Assigned to SONY CORPORATION reassignment SONY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OGAWA, HIROAKI
Publication of US20170053650A1 publication Critical patent/US20170053650A1/en
Application granted granted Critical
Publication of US10490192B2 publication Critical patent/US10490192B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
    • G10L15/063—Training
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
    • G10L15/063—Training
    • G10L2015/0635—Training updating or merging of old and new templates; Mean values; Weighting
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L2015/088—Word spotting

Definitions

  • the present disclosure relates to an information processing apparatus, an information processing method, and a program.
  • Patent Literature 1 discloses a method of recognizing voice only for a fixed period of time after a user utters a specific keyword.
  • methods of enabling voice recognition by utterance include, for example, a method of enabling voice recognition for a fixed period of time by uttering a predetermined keyword and a method of enabling voice recognition of voice following after a predetermined keyword is uttered.
  • activating voice recognition enabling to acquire voice to be recognized when the voice recognition function is used.
  • the activation of voice recognition by voice can be expected to reduce, when compared with the switch operation, user's burdens.
  • the plurality of devices may react simultaneously when the voice recognition is activated.
  • the voice recognition function be usable by each device without causing any problem by preventing a malfunction of the voice recognition function.
  • a first apparatus including a communication unit configured to transmit information permitting a second apparatus to modify stored voice recognition information based on a relationship between the first apparatus and the second apparatus.
  • a method including transmitting information from a first apparatus to a second apparatus to permit the second apparatus to modify stored voice recognition information based on a relationship between the first apparatus and the second apparatus.
  • a non-transitory computer-readable medium having embodied thereon a program, which when executed by a processor of a first apparatus causes the first apparatus to perform a method, the method including transmitting information permitting a second apparatus to modify stored voice recognition information based on a relationship between the first apparatus and the second apparatus.
  • a system including a first apparatus and a second apparatus, wherein the first apparatus transmits information permitting the second apparatus to modify stored voice recognition information based on a relationship between the first apparatus and the second apparatus.
  • the voice recognition function can be used by each device without causing any problem by preventing a malfunction of the voice recognition function.
  • FIG. 1 is a conceptual diagram illustrating the exchange of dictionary information used for voice recognition between devices equipped with a voice recognition function.
  • FIG. 2 is an explanatory view showing a relationship between devices equipped with a voice recognition function according to a first embodiment of the present disclosure.
  • FIG. 3 is a function block diagram showing a function configuration of an information processing apparatus according to an embodiment.
  • FIG. 4 is an explanatory view showing a configuration example of another device activation word dictionary DB.
  • FIG. 5 is a flow chart showing a network monitoring process of the information processing apparatus according to an embodiment.
  • FIG. 6 is a flow chart showing a checking process of an activation word dictionary according to an embodiment.
  • FIG. 7 is a function block diagram showing the function configuration of an information processing apparatus according to a second embodiment of the present disclosure.
  • FIG. 8 is a flow chart showing an activation word recognition process by the information processing apparatus of a voice recognition device according to an embodiment.
  • FIG. 9 is an explanatory view showing the relationship between devices equipped with the voice recognition function according to a third embodiment of the present disclosure.
  • FIG. 10 is a flow chart showing an exchange process of an activation word by, among voice recognition devices according to an embodiment, devices connected to a fixed network or by ad hoc communication.
  • FIG. 11 is a flow chart showing the exchange process of the activation word by, among voice recognition devices according to an embodiment, devices connected to the fixed network and capable of performing ad hoc communication.
  • FIG. 12 is an explanatory view illustrating an information exchange process by voice recognition devices according to a fourth embodiment of the present disclosure.
  • FIG. 13 is a hardware configuration diagram showing an example of the hardware configuration of the voice recognition device in the present disclosure.
  • FIG. 1 is a conceptual diagram illustrating the exchange of dictionary information used for voice recognition between devices equipped with the voice recognition function.
  • Devices equipped with the voice recognition function store an activation word to activate voice recognition and words used for voice recognition as dictionary information. Based on the dictionary information, devices may be enabled to acquire voice to be recognized or may identify a thing or a process corresponding to a word uttered by the user.
  • the information processing apparatus controls process content of voice recognition from the physical relationship between devices equipped with the voice recognition function. Accordingly, erroneous recognition of utterance content of other devices for voice recognition can be prevented and also the word set by the user for the voice recognition function is made available for other devices equipped with the voice recognition function.
  • each of the devices A to D can acquire voice within respective ranges indicated by broken lines. If, in this case, the distances between devices are larger than respective predetermined distances, each of the devices A to D can use the voice recognition function without being affected by other devices.
  • the device A and the device B move closer to the device D and voice can mutually acquired between the device A and the device D and between the device B and the device D. In this case, a word uttered for one device can also be acquired by the other device and thus, the other device may malfunction.
  • an information processing apparatus exercises control not to perform an erroneous process by accepting dictionary information including words used for voice recognition from other devices when a plurality of devices equipped with the voice recognition function move closer to each other. If, for example, the same or similar word is also used by another device, the user may be warned and the voice recognition may be disabled while the device is within a close range.
  • dictionary information of the other may be made acquirable via the device D. Accordingly, dictionary information of more devices can be acquired.
  • Such an information processing apparatus may be provided in each device or on a server.
  • the configuration of the information processing apparatus in each embodiment and processes thereby will be described.
  • FIG. 2 is an explanatory view showing the relationship between devices equipped with the voice recognition function.
  • FIG. 3 is a function block diagram showing a function configuration of an information processing apparatus according to an embodiment.
  • FIG. 4 is an explanatory view showing a configuration example of another device activation word dictionary DB.
  • FIG. 5 is a flow chart showing a network monitoring process of the information processing apparatus according to an embodiment.
  • FIG. 6 is a flow chart showing a checking process of an activation word dictionary according to an embodiment.
  • three voice recognition devices 100 A, 100 B, 100 M are present as devices equipped with the voice recognition function.
  • the voice recognition devices 100 A, 100 B, 100 M are terminals that can be carried by the user like smartphones, glass type terminals, head-mounted displays, pendant type terminals, bracelet type terminals, and finger ring type terminals.
  • the voice recognition devices 100 A, 100 B, 100 M send out an activation word that activates voice recognition.
  • the voice recognition devices 100 A, 100 B, 100 M can acquire the distance to other devices.
  • Bluetooth (registered trademark) 4.0 is used for communication of the voice recognition devices 100 A, 100 B, 100 M and information about the activation word is stored and transmitted by an advertise packet. If, for example, the information transmitted by the voice recognition device 100 M is acquired by the voice recognition devices 100 A, 100 B, the voice recognition devices 100 A, 100 B can know the activation word of the voice recognition device 100 M and the distance to the voice recognition device 100 M.
  • each of the voice recognition devices 100 A, 100 B. 100 M includes an information processing apparatus that controls a process concerning voice recognition.
  • the information processing apparatus of the voice recognition devices 100 A, 100 B, 100 M controls the process concerning voice recognition based on the activation words received from other devices to activate voice recognition and the distance to such devices so that the voice recognition function is made available to each device without causing any problem.
  • the voice recognition devices 100 A, 100 B, 100 M include, as shown in FIG. 3 , a communication unit 110 , a control unit 120 , a similarity determination unit 130 , a microphone 140 , an activation word recognition unit 150 , an output unit 160 , an activation word dictionary DB 170 , and another device activation word dictionary DB 180 .
  • FIG. 3 only functional units that function to perform a process related to recognition of the activation word in each of the voice recognition devices 100 ( 100 A, 10 B, 100 M) are shown.
  • the voice recognition device 100 may include other functional units than those shown in FIG. 3 .
  • An information processing apparatus according to an embodiment of the present disclosure includes, among functional units shown in FIG. 3 , at least the control unit 120 and in an embodiment, the information processing apparatus is provided in the voice recognition device 100 .
  • the communication unit 110 is a functional unit that transmits and receives information.
  • the communication unit 110 can be configured by, for example, radio communication technology such as Bluetooth (registered trademark) 4.0. If Bluetooth (registered trademark) 4.0 is used, the distance to other communication objects can also be acquired. When another voice recognition device is positioned closer than a predetermined distance, the communication unit 110 exchanges information with the other voice recognition device.
  • the control unit 120 controls a process related to voice recognition of the voice recognition device. For example, the control unit 120 records the activation word of another voice recognition device acquired by the communication unit 110 in the other device activation word dictionary DB 180 or, after the acquisition of the activation word, causes the similarity determination unit 130 to determine the similarity thereof to activation words of other voice recognition devices. The control unit 120 controls the process related to voice recognition based on the similarity to the activation word of other voice recognition devices.
  • the similarity determination unit 130 determines the similarity of an activation word to activation words of other voice recognition devices.
  • the similarity determination unit 130 calculates, under instructions of the control unit 120 , similarities of the activation word to activation words of voice recognition devices within a predetermined range by referring to the activation word dictionary DB 170 and the other device activation word dictionary DB 180 . If the calculated similarity is equal to a predetermined value or more, the similarity determination unit 130 determines that the activation words are similar or the same. A similarity determination result by the similarity determination unit 130 is output to the control unit 120 .
  • the microphone 140 is a functional unit to acquire voice and acquires activation words of the voice recognition function uttered by users and voice to be recognized.
  • the voice acquired by the microphone 140 is output to the activation word recognition unit 150 .
  • the activation word recognition unit 150 recognizes whether any activation word is contained in voice acquired by the microphone 140 . If recognized that an activation word is input by referring to the activation word dictionary DB 170 , the activation word recognition unit 150 notifies the control unit 120 that the activation word is input.
  • the output unit 160 is a functional unit that outputs information and is, for example, a display that displays information or a speaker that outputs sound.
  • the output unit 160 outputs a warning notified from the control unit 120 when, for example, the activation word is similar to an activation word of another voice recognition device within a predetermined range.
  • the activation word dictionary DB 170 is a storage unit that stores activation words that activate voice recognition.
  • the activation word may be set by the user or preset by the device. Other voice recognition devices are notified of activation words stored in the activation word dictionary DB 170 via the communication unit 110 .
  • the other device activation word dictionary DB 180 is a storage unit that stores activation words acquired from other voice recognition devices via the communication unit 110 .
  • the other device activation word dictionary DB 180 may store, for example, as shown in FIG. 4 , the device name, identification information, and activation word of a voice recognition device together with the update date and time recorded in the other device activation word dictionary DB 180 .
  • the identification information may be information capable of uniquely identifying the device like, for example, the serial number.
  • the other device activation word dictionary DB 180 stores the presence of other voice recognition devices whose voice recognition is activated by the activation words of “Joey” and “Bobby”.
  • the activation word may be stored, as shown in FIG. 4 , as a character string or phonetic symbols.
  • the other device activation word dictionary DB 180 is updated in predetermined timing.
  • the voice recognition device 100 M is focused on and a case when the other voice recognition devices 100 A, 100 B are present will be described.
  • the voice recognition device 100 M is normally prevented from accepting voice to be recognized and the voice recognition is activated by inputting the activation word. If the other voice recognition devices 100 A, 100 B are present within a predetermined range, the voice recognition device 100 M receives respective activation words of these devices to determine whether the activation words are the same or similar to the activation word thereof.
  • the voice recognition device 100 M determines whether any other voice recognition device is detected (S 100 ). While no other voice recognition device is detected, the process in step S 100 is repeated. When another voice recognition device is detected, the voice recognition device 100 M determines whether the other detected voice recognition device is present within the predetermined range (S 102 ).
  • the voice recognition device 100 M may estimate the presence of another voice recognition device within a predetermined range based on communication radio field intensity between devices, the magnitude of a sound wave output from each device or voice acquired by the microphone 140 , or closeness of voice content. Also, the voice recognition device 100 M may recognize the positions of other voice recognition devices by acquiring beacon information.
  • step S 102 If it is determined in step S 102 that another voice recognition device is present in the predetermined range, the voice recognition device 100 M accepts the activation word sent out by the other voice recognition device (S 104 ). On the other hand, if no voice recognition device is present in the predetermined range, no activation word is accepted. Then, the voice recognition device 100 M checks whether, among activation words stored in the other device activation word dictionary DB 180 , there is any old activation word that is not updated for a fixed period of time (S 106 ). If there is such an old activation word, the voice recognition device 100 M deletes the applicable activation word from the other device activation word dictionary DB 180 (S 108 ).
  • step S 108 After information stored in the other device activation word dictionary DB 180 is updated in steps S 104 , S 108 , the process starting with step S 100 is repeated. Also when it is determined in step S 108 that there is no old activation word, the process in FIG. 5 is repeated while the voice recognition device 100 M is active by returning to the process in step S 100 .
  • the voice recognition device 100 M performs a similarity determination process that determines the similarity between the activation word of the voice recognition device 100 M and the activation word of another voice recognition device.
  • the similarity determination process is the process shown in FIG. 6 and the similarity is determined when the activation word of the voice recognition device 100 M is changed or the activation word of another voice recognition device is added or corrected and the other device activation word dictionary DB 180 is updated. For example, when the process in step S 104 in FIG. 5 is performed, the similarity is determined.
  • step S 110 first whether the activation word of the voice recognition device 100 M is changed is determined. If, the example, the activation word is changed by the user, the process proceeds to step S 114 to determine the similarity. On the other hand, if the activation word of the voice recognition device 100 M is not changed, whether the activation word of another voice recognition device is added or corrected and the other device activation word dictionary DB 180 is updated is determined (S 112 ). If the other device activation word dictionary DB 180 is not updated, the process starting with step S 110 in FIG. 6 is repeated.
  • the similarity is calculated by the similarity determination unit 130 by comparing the activation word of the voice recognition device 100 M and the activation word of the other voice recognition device (S 14 ).
  • the similarity between activation words is calculated by using a publicly known technology.
  • the activation word may be converted into a phonetic symbol string to represent the similarity based on an edit distance between phonetic symbols.
  • the phonetic symbol of “Joe” is “jo:” and the phonetic symbol of “Joey” is “jo:i” and if “i” at the end is deleted, the pronunciation is the same as that of “Joe” and thus, the edit distance of 1 is obtained.
  • the edit distance is equal to a predetermined value or less, activation words may be considered to be similar or the same.
  • the similarity may be calculated by using an acoustic characteristic quantity.
  • step S 114 the similarity between activation words is calculated
  • the similarity determination unit 130 determines whether these are the same or similar (S 116 ). Then, if it is determined in step S 116 that another voice recognition device of the activation word that is the same or similar to the activation word of the voice recognition device 100 M, the control unit 120 issues a warning to the user via the output unit 160 (S 118 ).
  • the control unit 120 outputs a warning like “Device “Smartphone01” nearby is named “Joey”” to the output unit 160 .
  • the user having received such a warning can recognize that there is the possibility of voice recognition of the voice recognition device 100 M being activated by another user uttering “Joey”.
  • a warning is issued to the user by displaying a message, but the present disclosure is not limited to such an example.
  • a warning may be issued to the user by a sound or vibration.
  • a warning may be issued to the user via another terminal other than the voice recognition device.
  • the voice recognition device 100 M is a bracelet type terminal, a warning may be issued from the smartphone held by the user through a message, a sound, or vibration.
  • the control unit 120 of the voice recognition device 100 M may perform a predetermined process so that voice recognition is not activated without being intended by the user. For example, while a warning is issued, the control unit 120 may stop the voice recognition function of the voice recognition device 100 M and even if the activation word of the voice recognition device 100 M is uttered, the voice recognition may be prevented from functioning. Alternatively, when a warning is issued based on a registration or correction of the activation word of another voice recognition device, the control unit 120 may prompt a temporary change of the activation word of the voice recognition device 100 M while the warning is issued. In this case, an activation word that is not the same or similar to the activation word of the other voice recognition device may be presented by the control unit 120 so that the presented activation word is temporarily used.
  • the control unit 120 may prompt registration of another activation word without accepting the change of the activation word of the voice recognition device 100 M. In this manner, when another voice recognition device to which the same or similar activation word is set is present within a predetermined range of the voice recognition device 100 M, the voice recognition can be prevented from being activated without being intended by the user by a predetermined process being performed by the control unit 120 .
  • the control unit 120 determines whether the other voice recognition device is now positioned outside the predetermined range of the voice recognition device 100 M (S 120 ). While the other voice recognition device to which the same or similar activation word is set is within the predetermined range of the voice recognition device 100 M, the warning in step S 118 continues to be issued. Then, when the other voice recognition device is positioned outside the predetermined range of the voice recognition device 100 M, the control unit 120 terminates the issuance of the warning (S 122 ). Accordingly, the user can recognize that the possibility of voice recognition being activated by utterance of another user is eliminated. At this point, if there is any predetermined process performed by the control unit 120 when a warning is output, the process is also terminated. The process in FIG. 6 is repeated while the voice recognition device 100 M is active.
  • the process related to activation of voice recognition in a voice recognition device has been described.
  • the similarity of activation words that activate the voice recognition is determined.
  • the activation words are determined to be the same or similar, there is the possibility of the voice recognition of the voice recognition device 100 M being unintentionally activated and therefore, a warning is issued to the user of the voice recognition device 100 M. Accordingly, the user can be prompted to be careful.
  • the control unit 120 may perform a predetermined process so that the voice recognition of the voice recognition device 100 M is not unintentionally activated. Therefore, by including an information processing apparatus according to an embodiment of the present disclosure in a voice recognition device, a malfunction during voice recognition can be suppressed.
  • the information processing apparatus of the voice recognition device according to an embodiment is different from the first embodiment in that the activation word recognition unit 150 refers to, in addition to the activation word dictionary DB 170 , the other device activation word dictionary DB 180 . Accordingly, recognition performance of the activation word recognition unit 150 can be improved.
  • FIG. 7 shows the function configuration of the voice recognition device 100 according to an embodiment.
  • the voice recognition device 100 includes the communication unit 110 , the control unit 120 , the similarity determination unit 130 , the microphone 140 , the activation word recognition unit 150 , the output unit 160 , the activation word dictionary DB 170 , and the other device activation word dictionary DB 180 .
  • the above configuration is the same as the function configuration of the voice recognition device 100 according to the first embodiment shown in FIG. 3 . Therefore, a detailed description of each functional unit here is omitted.
  • the activation word recognition unit 150 also refers to the other device activation word dictionary DB 180 .
  • the activation word recognition unit 150 in an embodiment determines how close is the activation word of the voice recognition device 100 M to activation words stored in the other device activation word dictionary DB 180 . Accordingly, recognition errors of the activation word are reduced.
  • the activation word of “Joe” is set to the voice recognition device 100 M.
  • the activation word of “Joe” is stored in the activation word dictionary DB 170 .
  • the presence of the device whose activation word is “Joey” is stored in the other device activation word dictionary DB 180 . If the user of the voice recognition device 100 M utters “Joe”, the activation word recognition unit 150 determines whether the input voice is the same or similar to the set activation word by referring to the activation word dictionary DB 170 . Further, the activation word recognition unit 150 calculates how close the input voice to activation words of other voice recognition devices by referring to the other device activation word dictionary DB 180 .
  • the activation word recognition unit 150 determines to which of the activation word of the voice recognition device 100 M and activation words of other voice recognition devices the input voice is closer. It is determined that the input voice is closer to the activation voice of another voice recognition device, the activation word recognition unit 150 determines that the input voice is likely not to be the activation word of the voice recognition device 100 M and the input of the activation word is canceled. Accordingly, recognition errors of the activation word are reduced.
  • voice recognition device 100 An activation word recognition process by an information processing apparatus of the voice recognition device 100 according to an embodiment will be described below. Also in an embodiment, like in the first embodiment, the voice recognition device 100 M is focused on and a case when the other voice recognition devices 100 A, 100 B are present will be described.
  • the activation word recognition unit 150 monitors to check whether the microphone 140 has acquired voice (S 200 ). The activation word recognition unit 150 repeats the process in step S 200 until voice is acquired. Then, when voice is acquired, the activation word recognition unit 150 matches the input voice to the activation word of the voice recognition device 100 M stored in the activation word dictionary DB 170 to determine whether the input voice is the activation word to activate voice recognition (S 202 ). The result of matching is represented as a similarity to the activation word.
  • the activation word recognition unit 150 determines whether the input voice is close to the activation word of the voice recognition device 100 M (S 204 ). That is, the activation word recognition unit 150 determines whether the similarity of the input voice to the activation word of the voice recognition device 100 M is equal to a predetermined value or more. If the similarity is smaller than the predetermined value, the input voice is determined not to be the activation word of the voice recognition device 100 M and the process starting with step S 200 is repeated. On the other hand, if the similarity is equal to the predetermined value or more, the activation word recognition unit 150 further matches the input voice to the activation word of another voice recognition device stored in the other device activation word dictionary DB 180 (S 206 ). In step S 206 , the similarity between the input voice and the activation word of another voice recognition device is calculated. When activation words of a plurality of voice recognition devices are entered in the other device activation word dictionary DB 180 , the similarity is calculated for each.
  • the activation word recognition unit 150 determines whether the input voice is the closest to the activation word of the voice recognition device 100 M rather than activation words of other voice recognition devices (S 208 ). In step S 208 , the activation word recognition unit 150 makes sure that the similarity to the voice recognition device 100 M calculated in step S 202 is larger than the similarity to the activation word to the other voice recognition device calculated in step S 206 . If the input voice is determined to be the closest to the activation word of the voice recognition device 100 M, the activation word recognition unit 150 notifies the control unit 120 that the activation word has been input to cause the control unit to activate voice recognition (S 210 ).
  • step S 200 is repeated.
  • the process in FIG. 8 is repeated while the voice recognition device 100 M is active.
  • the process to recognize the activation word of the voice recognition function according to the second embodiment of the present disclosure has been described.
  • the input voice is determined to be closer to the activation word of the voice recognition device 100 M than activation words of other voice recognition devices Accordingly, recognition errors of the activation word can be reduced.
  • the calculation of similarity of the input voice to the activation word of the voice recognition device 100 M and the calculation of similarity of the input voice to activation words of other voice recognition devices are done separately, but the present disclosure is not limited to such an example.
  • similarities of the input voice to the activation words of the voice recognition device 100 M and other voice recognition devices may be calculated to determine whether to activate voice recognition based on whether the activation word of the largest similarity is that of the voice recognition device 100 M.
  • FIG. 9 a case when one or a plurality of voice recognition devices 100 A, 100 B connected to a network is present and the voice recognition device 100 M connected to the voice recognition device 100 A of these recognition devices in ad hoc mode is present is considered.
  • the ad hoc communication can be performed based on the standard of Wi-Fi (registered trademark), Bluetooth (registered trademark), or ZigBee (registered trademark).
  • the voice recognition device 100 M when connected to the voice recognition device 100 A via ad hoc communication, can also acquire the activation word of the voice recognition device 100 B in a network to which the voice recognition device 100 A is connected via the voice recognition device 100 A.
  • the activation word of the voice recognition device 100 M is sent out to the voice recognition device 100 B via the voice recognition device 100 A. That is, the voice recognition device 100 A connected to a fixed network and accepting connection of ad hoc communication acts as a gateway to send out the activation word of each voice recognition device to other voice recognition devices via ad hoc communication and the fixed network.
  • respective activation words are shared among the voice recognition devices 100 A, 100 B, 100 M by simply connecting the voice recognition device 100 A and the voice recognition device 100 M.
  • activation words can be shared when voice recognition devices in a network are increased or voice recognition devices connected by an ad hoc network are increased.
  • the function configuration of the voice recognition device 100 may be the same as the function configuration in the first embodiment shown in FIG. 3 or the same as the function configuration in the second embodiment shown in FIG. 7 . Therefore, the description of the function configuration of the voice recognition device 100 here is omitted.
  • the communication unit 110 is implemented based on Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark) 4.0 or the like.
  • FIG. 10 is a flow chart showing an exchange process of an activation word by, among voice recognition devices according to an embodiment, devices connected to a fixed network or by ad hoc communication (that is, the voice recognition devices 100 B, 100 M in FIG. 9 ).
  • FIG. 11 is a flow chart showing the exchange process of the activation word by, among voice recognition devices according to an embodiment, devices connected to the fixed network and capable of performing ad hoc communication (that is, the voice recognition device 100 A in FIG. 9 ).
  • the voice recognition devices 100 B, 100 M first determine whether or not connected to a network (S 300 ). If not connected to a network, information in the other device activation word dictionary DB 180 is cleared (S 302 ) and the process starting with step S 300 is repeated. On the other hand, if connected to a network, whether a fixed time has passed after the activation word is sent out (S 304 ) and the process starting with step S 300 is repeated until the fixed time passes.
  • step S 304 If it is determined in step S 304 that the fixed time has passed after the activation word is sent out, the control unit 120 sends out the addition of the activation words of the voice recognition devices 100 B, 100 M to the other voice recognition devices via the communication unit 110 (S 306 ). Accordingly, for example, the voice recognition device 100 A connected to the fixed network receives an addition request of the activation word of the voice recognition device 100 B and the activation word of the voice recognition device 100 B is recorded in the other device activation word dictionary DB 180 of the voice recognition device 100 A.
  • the voice recognition device 100 A connected by ad hoc communication receives an addition request of the activation word of the voice recognition device 100 M and the activation word of the voice recognition device 100 M is recorded in the other device activation word dictionary DB 180 of the voice recognition device 100 A.
  • the voice recognition device 100 A determines whether or not connected to a network (S 310 ). If not connected to a network, information in the other device activation word dictionary DB 180 is cleared (S 312 ) and the process starting with step S 310 is repeated. On the other hand, if connected to a network, whether a fixed time has passed after the activation word is sent out (S 314 ) and the process starting with step S 310 is repeated until the fixed time passes.
  • the control unit 120 sends out the addition of the activation words of the voice recognition device 100 A and the voice recognition device 100 M connected by ad hoc communication to the fixed network via the communication unit 110 (S 316 ). Accordingly, the voice recognition device 100 B connected to the fixed network receives the activation words of the voice recognition devices 100 A, 100 M and the activation words are recorded in the other device activation word dictionary DB 180 of the voice recognition device 100 B. Also, the control unit 120 sends out information recorded in the activation word dictionary DB 170 and the other device activation word dictionary DB 180 of the voice recognition device 100 A to the voice recognition device 100 M connected by ad hoc communication via the communication unit 110 (S 318 ).
  • the information sent out to the voice recognition device 100 M does not contain the activation word of the voice recognition device 100 M as the destination of the information.
  • the voice recognition device 100 M records the information received from the voice recognition device 100 A in the other device activation word dictionary DB 180 of the voice recognition device 100 M.
  • the exchange process of the activation word shown in FIG. 11 is also repeated while the voice recognition devices 100 A is active.
  • the exchange process of the activation word between voice recognition devices has been described.
  • the voice recognition device 100 M and the voice recognition devices 100 A, 100 B connected by a fixed network are present, if the voice recognition devices 100 A, 100 M are connected by ad hoc communication, the voice recognition device 100 A sends information including information of the voice recognition device 100 B to the voice recognition device 100 M. That is, the voice recognition device 100 A sends and receives information as an intermediary of the voice recognition devices 100 B, 100 M.
  • information about voice recognition may be exchanged in accordance with the distance between devices.
  • the information may be exchanged only when the distance between the voice recognition devices 100 A, 100 M is equal to a predetermined distance or less and is determined to be “close”. Accordingly, information is exchanged only when information about voice recognition becomes necessary.
  • a voice recognition device 100 C is connected to the fixed network shown in FIG. 9 .
  • the voice recognition devices 100 A, 100 B and the voice recognition device 100 C are physically separated.
  • the voice recognition devices 100 A, 100 B are located in the first floor of a building and the voice recognition device 100 C is located in the second floor of the building.
  • the voice recognition devices 100 A, 100 B may be set as a first group and the voice recognition device 100 C as a second group so that only information about voice recognition of the voice recognition devices of the same group is sent to other devices connected by communication.
  • the voice recognition device 100 A and the voice recognition device 100 M are connected by ad hoc communication.
  • the voice recognition device 100 A sends information by including information about the voice recognition device 100 B belonging to the same group to the voice recognition device 100 M, but does not send out information about the voice recognition device 100 C belonging to a different group.
  • Information about voice recognition of the voice recognition device 100 C is exchanged when, for example, the voice recognition devices 100 C, 100 M are connected by ad hoc communication.
  • a beacon may be installed in the space for measure the distance between voice recognition devices.
  • a beacon X and the voice recognition devices 100 A, 100 B are associated as a group in advance and when the distance between the voice recognition device 100 M and the beacon X is equal to a predetermined distance or less, the voice recognition device 100 M acquires and utilizes voice recognition information of the voice recognition devices 100 A, 100 B.
  • information may be exchanged between the voice recognition device 100 M and the voice recognition devices 100 A, 100 B by ad hoc communication between the voice recognition device 100 M and the voice recognition device 100 A or the voice recognition device 100 B.
  • information may be exchanged by sending notification of the location on the Internet where information about voice recognition is present.
  • voice recognition devices Next, an information exchange process between voice recognition devices according to the fourth embodiment of the present disclosure will be described based on FIG. 12 .
  • information about voice recognition to be exchanged may be other than the activation word and may be, for example, word information set for each user and identifiable by voice recognition (hereinafter, referred to also as a “user dictionary”).
  • a case when, as shown in FIG. 12 , a user purchases a beverage from a vending machine 300 will be considered.
  • the vending machine 300 is equipped with the voice recognition function and a beverage can be selected and purchased by, for example, the name of the desired beverage being uttered by the user.
  • the user wears a glass type terminal 200 equipped with the voice recognition function.
  • the glass type terminal 200 and the vending machine 300 can communicate via ad hoc communication or a network 5 .
  • the vending machine 300 can acquire the user dictionary of the user from the glass type terminal 200 worn by the user. With the user dictionary being acquired by the vending machine 300 , the user can purchase goods from the vending machine 300 using words identified by voice recognition set individually by the user. If, for example, “Ocha (tea)” is associated with the word “Ryokucha (green tea)” in the user dictionary, when the user utters “Ocha”, the vending machine 300 selects the green tea by referring to the user dictionary.
  • the vending machine 300 When the user purchases a beverage and moves away from the vending machine 300 out of the predetermined range of the vending machine 300 , the vending machine 300 deletes the user dictionary of the user. Alternatively, the vending machine 300 may delete the user dictionary of the user when a predetermined time passes after the user purchases a beverage. Accordingly, the vending machine 300 can temporarily acquire the user dictionary and delete the dictionary when the dictionary becomes unnecessary.
  • the present technology is not limited to such an example.
  • the glass type terminal 200 may acquire goods information from the vending machine 300 .
  • user's input voice is matched to the corresponding goods by the glass type terminal 200 and the glass type terminal 200 notifies the vending machine 300 of the goods intended by the user based on a matching result.
  • the vending machine 300 selects the notified goods.
  • the vending machine 300 does not need to be equipped with the voice recognition function and only has to be able to send and receive information to and from the glass type terminal 200 .
  • the vending machine 300 may acquire the user dictionary from the server 400 to match user's input voice to the user dictionary.
  • the vending machine 300 acquires the user ID of the user positioned within the predetermined range via the glass type terminal 200 worn by the user or the like and notifies the server 400 of the user ID via the network 5 .
  • the server 400 sends the user dictionary corresponding to the user ID to the vending machine 300 .
  • the vending machine 300 having acquired the user dictionary can identify the corresponding goods based on the user dictionary after receiving user's input voice. Incidentally, matching of the user's input voice to the corresponding goods may be done on the side of the server 400 .
  • such an information exchange process can be used when, for example, telephone directory information is temporarily provided in the public telephone.
  • the information exchange process between voice recognition devices has been described. According to an embodiment, by exchanging voice recognizable word information other than the activation word that activates voice recognition based on the physical relationship between voice recognition devices, settings for each user can temporarily be made available to other devices. Accordingly, the user can use the voice recognition function of any device in the same manner, enhancing the convenience of the user. In addition, the path of information exchange formed by devices being brought closer to each other disappears and information is also deleted when the devices move away from each other. Therefore, information that is no longer used will not be continued to be accumulated.
  • voice recognition device When the voice recognition device is a wearable terminal, user-specific parameters of voice recognition may be set. In such a case, by communicating voice recognition parameters held by the wearable terminal like an activation word or a user dictionary over the network, recognition performance of fixed words of peripheral devices connected to a fixed network can further be improved. For example, attribute information of the user such as the sex and age of the owner of a voice recognition device may be sent.
  • FIG. 13 is a hardware configuration diagram showing a hardware configuration of the voice recognition device 100 according to embodiments.
  • the voice recognition device 100 can be implemented by a processing apparatus such as a computer, as described above. As illustrated in FIG. 13 , the voice recognition device 100 includes a central processing unit (CPU) 901 , a read only memory (ROM) 902 , a random access memory (RAM) 903 , and a host bus 904 a . The voice recognition device 100 also includes a bridge 904 , an external bus 904 b , an interface 905 , an input device 906 , an output device 907 , a storage device (hard disk drive) 908 , a drive 909 , a connection port 911 , and a communication device 913 .
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • the voice recognition device 100 also includes a bridge 904 , an external bus 904 b , an interface 905 , an input device 906 , an output device 907 , a storage device (hard disk drive) 908 , a drive 909 , a connection port 911
  • the CPU 901 functions as an arithmetic processing unit and a control unit, and controls overall operation of the voice recognition device 100 according to a variety of programs.
  • the CPU 901 may also be a microprocessor.
  • the ROM 902 stores therein the programs, operational parameters, and the like that are used by the CPU 901 .
  • the RAM 903 temporarily stores therein the programs used and executed by the CPU 901 , parameters appropriately varying in executing the programs, and the like. These are connected to each other through the host bus 904 a configured of a CPU bus or the like.
  • the host bus 904 a is connected to the external bus 904 b such as a peripheral component interconnect/interface (PCI) bus through the bridge 904 .
  • PCI peripheral component interconnect/interface
  • the host bus 904 a , the bridge 904 , and the external bus 904 b do not have to be configured separately, and functions of these may be implemented by a single bus.
  • the input device 906 includes: an input unit for inputting information by a user, such as a mouse, a keyboard, a touch panel, buttons, a microphone, a switch, or a lever, an input control circuit generating input signals based on input by the user and outputting the signals to the CPU 901 ; and the like.
  • the output device 907 includes: a display device such as a liquid crystal display (LCD) device, an organic light emitting diode (OLED) device, or a lamp; and an audio output device such as a speaker.
  • LCD liquid crystal display
  • OLED organic light emitting diode
  • the storage device 908 is an example of a storage unit of the voice recognition device 100 and is a device for storing data.
  • the storage device 908 may include a storage medium, a recorder that records data in the storage medium, a reader that reads data from the storage medium, a deletion device that deletes data recorded in the storage medium, and the like.
  • the storage device 908 drives a hard disk and stores programs executed by the CPU 901 and a variety of data.
  • the drive 909 is a reader/writer and is built in or externally connected to the voice recognition device 100 .
  • the drive 909 reads information recorded in the removable recording medium loaded in the drive 909 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903 .
  • the connection port 911 is an interface connected to an external device, and is a port of connection with the external device capable of transferring data through, for example, a universal serial bus (USB).
  • the communication device 913 is a communication interface configured of a communication device or the like for connecting to, for example, the communication network 5 .
  • the communication device 913 may be a communication device supporting a wireless local area network (LAN), a communication device supporting a wireless USB, or a wired communication device that performs wired communication.
  • the voice recognition device is, for example, a smartphone, a glass type terminal, a head-mounted display, a pendant type terminal, a bracelet type terminal, or a finger ring type terminal, but the present technology is not limited to such examples.
  • the voice recognition device may be, for example, a TV set, a game machine, a microwave oven, an audio device, a lighting apparatus, a speaker, a tablet terminal, a personal computer, an automobile, an on-vehicle device, or medical equipment such as an endoscope.
  • a first apparatus including:
  • a communication unit configured to transmit information permitting a second apparatus to modify stored voice recognition information based on a relationship between the first apparatus and the second apparatus.
  • the first apparatus wherein the communication unit is configured to provide or authorize, for receipt at the second apparatus, first voice recognition information as the transmitted information based on the relationship between the first apparatus and the second apparatus.
  • the first apparatus according to any one of (1) to (3), wherein the relationship between the first apparatus and the second apparatus is a lapse in time after communication between the first apparatus and the second apparatus.
  • the first apparatus according to any one of (1) to (4), wherein the relationship between the first apparatus and the second apparatus is a change in communication radio field intensity between the first apparatus and the second apparatus.
  • the first apparatus according to any one of (1) to (5), wherein the voice recognition information includes at least one voice activation word.
  • the first apparatus according to any one of (1) to (6), wherein the voice recognition information is a user specific dictionary associated with the first device including the at least one voice activation word or at least one voice recognition word which is not a voice activation word.
  • the first apparatus according to any one of (1) to (7), wherein the stored voice recognition information of the second apparatus includes second voice recognition information associated with the second device.
  • the first apparatus according to any one of (1) to (8), wherein the second apparatus modifies the stored voice recognition information based on the relationship between the first apparatus and the second apparatus by updating the stored voice recognition information to include the first voice recognition information.
  • the first apparatus according to any one of (1) to (8), wherein the second apparatus modifies the stored voice recognition information based on the relationship between the first apparatus and the second apparatus by updating the second voice recognition information to include the first voice recognition information.
  • the first apparatus according to any one of (1) to (10), wherein the second apparatus modifies the first voice recognition information based on the relationship between the first apparatus and the second apparatus by updating the stored voice recognition information to remove the first voice recognition information from the stored voice recognition information.
  • the first apparatus according to any one of (1) to (11), wherein the second apparatus compares the first voice recognition information with the second voice recognition information.
  • the first apparatus according to any one of (1) to (12), wherein at least one of the first apparatus or the second apparatus inactivates voice recognition functions when the first voice recognition information is the same or similar to the second voice recognition information.
  • the first apparatus according to any one of (1) to (13), wherein the first voice recognition information and the second voice recognition information is the same or similar based on phonetic symbol string analysis.
  • the first apparatus according to any one of (1) to (14), wherein at least one of the first apparatus or the second apparatus issues a warning of potential voice recognition conflict if the first voice recognition information and the second voice recognition information is the same or similar.
  • the first apparatus according to any one of (1) to (15), wherein the first voice recognition information and the second voice recognition information is the same or similar based on phonetic symbol string analysis.
  • the first apparatus according to any one of (1) to (16), wherein the second apparatus receives the first voice recognition information from a server.
  • the first apparatus according to any one of (1) to (17), wherein the second apparatus receives the first voice recognition information from the server based on the second apparatus receiving identification information of the first apparatus from the first apparatus.
  • a method including:
  • a system including:
  • the first apparatus transmits information permitting the second apparatus to modify stored voice recognition information based on a relationship between the first apparatus and the second apparatus.
  • An information processing apparatus including:
  • control unit configured to change a process related to voice recognition of a first device based on a relationship between devices having a voice recognition function.
  • control unit controls whether to accept an activation word causing the first device to perform the process related to the voice recognition based on a distance between the devices.
  • control unit accepts the activation word of the device positioned within a predetermined range of the first device.
  • control unit records the activation word accepted from the device in an activation word storage unit.
  • control unit accepts dictionary information from a device other than the first device based on the relationship between the devices, the dictionary information containing at least an activation word used by the device for the voice recognition.
  • dictionary information contains the activation word of another device received by the device.
  • the control unit when the dictionary information is present on a server connected to the first device via a network, the control unit receives, instead of the dictionary information, information indicating a location of the dictionary information in the network from the device.
  • control unit receives the dictionary information from the device positioned within a predetermined range of the first device.
  • control unit causes a sending unit to send the dictionary information of the first device to the device positioned within a predetermined range of the first device.
  • control unit deletes the dictionary information of the device.
  • the information processing apparatus according to any one of (26) to (30).
  • control unit deletes the dictionary information that has not been updated for a predetermined period of time.
  • control unit deletes the dictionary information.
  • the information processing apparatus according to any one of (22) to (33), further including:
  • a similarity determination unit configured to determine a similarity of a word
  • the control unit issues a warning to a user of the first device.
  • the information processing apparatus according to any one of (22) to (34), further including:
  • a similarity determination unit configured to determine a similarity of a word
  • the control unit instructs a user of the first device to temporarily change the activation word of the first device.
  • the information processing apparatus according to any one of (22) to (34), further including:
  • a similarity determination unit configured to determine a similarity of a word
  • the control unit prevents the voice recognition function of the first device from functioning while the device other than the first device is positioned within a predetermined range of the first device.
  • the relationship between the devices is determined based on communication radio field intensity between the devices.
  • An information processing method including:

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Telephonic Communication Services (AREA)
US15/307,621 2014-07-16 2015-07-15 Apparatus, method, non-transitory computer-readable medium and system for modifying voice recognition information Active US10490192B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2014-145795 2014-07-16
JP2014145795A JP2016024212A (ja) 2014-07-16 2014-07-16 情報処理装置、情報処理方法およびプログラム
PCT/JP2015/003573 WO2016009646A1 (en) 2014-07-16 2015-07-15 Apparatus, method, non-transitory computer-readable medium and system

Publications (2)

Publication Number Publication Date
US20170053650A1 US20170053650A1 (en) 2017-02-23
US10490192B2 true US10490192B2 (en) 2019-11-26

Family

ID=53783800

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/307,621 Active US10490192B2 (en) 2014-07-16 2015-07-15 Apparatus, method, non-transitory computer-readable medium and system for modifying voice recognition information

Country Status (4)

Country Link
US (1) US10490192B2 (zh)
JP (1) JP2016024212A (zh)
CN (1) CN106663428B (zh)
WO (1) WO2016009646A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180330716A1 (en) * 2017-05-11 2018-11-15 Olympus Corporation Sound collection apparatus, sound collection method, sound collection program, dictation method, information processing apparatus, and recording medium recording information processing program
US20200152186A1 (en) * 2018-11-13 2020-05-14 Motorola Solutions, Inc. Methods and systems for providing a corrected voice command
US11508378B2 (en) * 2018-10-23 2022-11-22 Samsung Electronics Co., Ltd. Electronic device and method for controlling the same
US20230086579A1 (en) * 2018-10-23 2023-03-23 Samsung Electronics Co.,Ltd. Electronic device and method for controlling the same

Families Citing this family (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9691378B1 (en) * 2015-11-05 2017-06-27 Amazon Technologies, Inc. Methods and devices for selectively ignoring captured audio data
US9965247B2 (en) 2016-02-22 2018-05-08 Sonos, Inc. Voice controlled media playback system based on user profile
US10264030B2 (en) 2016-02-22 2019-04-16 Sonos, Inc. Networked microphone device control
US9947316B2 (en) 2016-02-22 2018-04-17 Sonos, Inc. Voice control of a media playback system
US10509626B2 (en) 2016-02-22 2019-12-17 Sonos, Inc Handling of loss of pairing between networked devices
US9772817B2 (en) 2016-02-22 2017-09-26 Sonos, Inc. Room-corrected voice detection
US10095470B2 (en) 2016-02-22 2018-10-09 Sonos, Inc. Audio response playback
US10510350B2 (en) * 2016-03-30 2019-12-17 Lenovo (Singapore) Pte. Ltd. Increasing activation cue uniqueness
US9978390B2 (en) 2016-06-09 2018-05-22 Sonos, Inc. Dynamic player selection for audio signal processing
US10134399B2 (en) 2016-07-15 2018-11-20 Sonos, Inc. Contextualization of voice inputs
US10115400B2 (en) 2016-08-05 2018-10-30 Sonos, Inc. Multiple voice services
US9942678B1 (en) 2016-09-27 2018-04-10 Sonos, Inc. Audio playback settings for voice interaction
US10181323B2 (en) 2016-10-19 2019-01-15 Sonos, Inc. Arbitration-based voice recognition
EP3555825A4 (en) * 2016-12-13 2019-11-27 Viatouch Media Inc. METHOD AND APPLICATIONS FOR CONSUMER INTERACTION WITH A SELF-OPERATING SYSTEM
US11003417B2 (en) * 2016-12-15 2021-05-11 Samsung Electronics Co., Ltd. Speech recognition method and apparatus with activation word based on operating environment of the apparatus
US10593328B1 (en) * 2016-12-27 2020-03-17 Amazon Technologies, Inc. Voice control of remote device
WO2018144882A1 (en) 2017-02-03 2018-08-09 Viatouch Media Inc. Cantilevered weight sensitive shelf, rail, and mounting system
US10504511B2 (en) * 2017-07-24 2019-12-10 Midea Group Co., Ltd. Customizable wake-up voice commands
US10475449B2 (en) 2017-08-07 2019-11-12 Sonos, Inc. Wake-word detection suppression
US10048930B1 (en) 2017-09-08 2018-08-14 Sonos, Inc. Dynamic computation of system response volume
US10531157B1 (en) * 2017-09-21 2020-01-07 Amazon Technologies, Inc. Presentation and management of audio and visual content across devices
US10446165B2 (en) 2017-09-27 2019-10-15 Sonos, Inc. Robust short-time fourier transform acoustic echo cancellation during audio playback
US10621981B2 (en) 2017-09-28 2020-04-14 Sonos, Inc. Tone interference cancellation
US10482868B2 (en) 2017-09-28 2019-11-19 Sonos, Inc. Multi-channel acoustic echo cancellation
US10466962B2 (en) 2017-09-29 2019-11-05 Sonos, Inc. Media playback system with voice assistance
KR102471493B1 (ko) * 2017-10-17 2022-11-29 삼성전자주식회사 전자 장치 및 음성 인식 방법
US10586537B2 (en) * 2017-11-30 2020-03-10 International Business Machines Corporation Filtering directive invoking vocal utterances
JP7062958B2 (ja) * 2018-01-10 2022-05-09 トヨタ自動車株式会社 通信システム、及び通信方法
US11343614B2 (en) 2018-01-31 2022-05-24 Sonos, Inc. Device designation of playback and network microphone device arrangements
US10600408B1 (en) * 2018-03-23 2020-03-24 Amazon Technologies, Inc. Content output management based on speech quality
JP7133969B2 (ja) 2018-04-27 2022-09-09 シャープ株式会社 音声入力装置、及び遠隔対話システム
US11175880B2 (en) 2018-05-10 2021-11-16 Sonos, Inc. Systems and methods for voice-assisted media content selection
US10959029B2 (en) 2018-05-25 2021-03-23 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US10681460B2 (en) 2018-06-28 2020-06-09 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US10461710B1 (en) 2018-08-28 2019-10-29 Sonos, Inc. Media playback system with maximum volume setting
US11076035B2 (en) 2018-08-28 2021-07-27 Sonos, Inc. Do not disturb feature for audio notifications
CN109343817A (zh) * 2018-09-10 2019-02-15 阿里巴巴集团控股有限公司 自助服务的使用方法及装置和电子设备
US10587430B1 (en) 2018-09-14 2020-03-10 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
WO2020060311A1 (en) * 2018-09-20 2020-03-26 Samsung Electronics Co., Ltd. Electronic device and method for providing or obtaining data for training thereof
US11024331B2 (en) 2018-09-21 2021-06-01 Sonos, Inc. Voice detection optimization using sound metadata
US11100923B2 (en) 2018-09-28 2021-08-24 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
KR20200043075A (ko) * 2018-10-17 2020-04-27 삼성전자주식회사 전자 장치 및 그 제어방법, 전자 장치의 음향 출력 제어 시스템
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
EP3654249A1 (en) 2018-11-15 2020-05-20 Snips Dilated convolutions and gating for efficient keyword spotting
US11183183B2 (en) 2018-12-07 2021-11-23 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11132989B2 (en) 2018-12-13 2021-09-28 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US10602268B1 (en) 2018-12-20 2020-03-24 Sonos, Inc. Optimization of network microphone devices using noise classification
US10867604B2 (en) 2019-02-08 2020-12-15 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11315556B2 (en) 2019-02-08 2022-04-26 Sonos, Inc. Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification
EP3709194A1 (en) 2019-03-15 2020-09-16 Spotify AB Ensemble-based data comparison
US11076219B2 (en) * 2019-04-12 2021-07-27 Bose Corporation Automated control of noise reduction or noise masking
US11120794B2 (en) 2019-05-03 2021-09-14 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
US11361756B2 (en) 2019-06-12 2022-06-14 Sonos, Inc. Conditional wake word eventing based on environment
US10586540B1 (en) 2019-06-12 2020-03-10 Sonos, Inc. Network microphone device with command keyword conditioning
US10871943B1 (en) 2019-07-31 2020-12-22 Sonos, Inc. Noise classification for event detection
US11138969B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US11138975B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US11094319B2 (en) 2019-08-30 2021-08-17 Spotify Ab Systems and methods for generating a cleaned version of ambient sound
KR20210044606A (ko) * 2019-10-15 2021-04-23 삼성전자주식회사 웨이크업 모델 생성 방법 및 이를 위한 전자 장치
US11189286B2 (en) 2019-10-22 2021-11-30 Sonos, Inc. VAS toggle based on device orientation
US11200900B2 (en) 2019-12-20 2021-12-14 Sonos, Inc. Offline voice control
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11308958B2 (en) 2020-02-07 2022-04-19 Sonos, Inc. Localized wakeword verification
US11308959B2 (en) 2020-02-11 2022-04-19 Spotify Ab Dynamic adjustment of wake word acceptance tolerance thresholds in voice-controlled devices
US11328722B2 (en) * 2020-02-11 2022-05-10 Spotify Ab Systems and methods for generating a singular voice audio stream
US11482222B2 (en) * 2020-03-12 2022-10-25 Motorola Solutions, Inc. Dynamically assigning wake words
JP7434016B2 (ja) 2020-03-26 2024-02-20 本田技研工業株式会社 起動語登録の支援方法、支援装置、音声認識装置、およびプログラム
US11308962B2 (en) * 2020-05-20 2022-04-19 Sonos, Inc. Input detection windowing
US11727919B2 (en) 2020-05-20 2023-08-15 Sonos, Inc. Memory allocation for keyword spotting engines
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11698771B2 (en) 2020-08-25 2023-07-11 Sonos, Inc. Vocal guidance engines for playback devices
US11984123B2 (en) 2020-11-12 2024-05-14 Sonos, Inc. Network device interaction by range

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5737723A (en) * 1994-08-29 1998-04-07 Lucent Technologies Inc. Confusable word detection in speech recognition
US5884266A (en) * 1997-04-02 1999-03-16 Motorola, Inc. Audio interface for document based information resource navigation and method therefor
EP1045374A1 (en) * 1999-04-13 2000-10-18 Sony International (Europe) GmbH Merging of speech interfaces for concurrent use of devices and applications
US6330539B1 (en) * 1998-02-05 2001-12-11 Fujitsu Limited Dialog interface system
US6413079B1 (en) * 2000-04-10 2002-07-02 Heat-N-Glo Fireplace Products, Inc. Voice activated fireplace control system
US6778098B2 (en) * 2000-07-21 2004-08-17 Koninklijke Philips Electronics N.V. Method and electronic device for speech control
US20080221896A1 (en) * 2007-03-09 2008-09-11 Microsoft Corporation Grammar confusability metric for speech recognition
US20130325451A1 (en) * 2012-05-31 2013-12-05 Elwha LLC, a limited liability company of the State of Delaware Methods and systems for speech adaptation data
US20130325446A1 (en) * 2012-05-31 2013-12-05 Elwha LLC, a limited liability company of the State of Delaware Speech recognition adaptation systems based on adaptation data
US20130339028A1 (en) * 2012-06-15 2013-12-19 Spansion Llc Power-Efficient Voice Activation
US20150170664A1 (en) * 2013-03-14 2015-06-18 Google Inc. Compartmentalized self registration of external devices
US20160182938A1 (en) * 2013-08-06 2016-06-23 Saronikos Trading And Services, Unipessoal Lda System for Controlling Electronic Devices by Means of Voice Commands, More Specifically a Remote Control to Control a Plurality of Electronic Devices by Means of Voice Commands
US9445209B2 (en) * 2013-07-11 2016-09-13 Intel Corporation Mechanism and apparatus for seamless voice wake and speaker verification

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4888730A (en) * 1988-01-05 1989-12-19 Smith Corona Corporation Memory typewriter with count of overused words
IL140805A0 (en) * 1998-10-02 2002-02-10 Ibm Structure skeletons for efficient voice navigation through generic hierarchical objects
US20020116196A1 (en) * 1998-11-12 2002-08-22 Tran Bao Q. Speech recognizer
US6622251B1 (en) * 1999-04-07 2003-09-16 Telefonaktiebolaget Lm Ericsson (Publ) Method to put a mobile terminal into sleep when a frame control channel containing a location of slow broadcast channel does not include wakeup information
US20050261907A1 (en) * 1999-04-12 2005-11-24 Ben Franklin Patent Holding Llc Voice integration platform
JP4314680B2 (ja) * 1999-07-27 2009-08-19 ソニー株式会社 音声認識制御システム及び音声認識制御方法
JP4200608B2 (ja) * 1999-09-03 2008-12-24 ソニー株式会社 情報処理装置および方法、並びにプログラム格納媒体
DE60032982T2 (de) * 1999-09-13 2007-11-15 Matsushita Electric Industrial Co., Ltd., Kadoma Spracherkennung zur Steuerung eines Geräts
JP2004508595A (ja) * 2000-09-07 2004-03-18 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ 音声制御及びアップロード可能なユーザ制御情報
CN100568222C (zh) * 2001-01-31 2009-12-09 微软公司 歧义消除语言模型
JP2004029354A (ja) 2002-06-25 2004-01-29 Toshiba Corp 音声認識装置、音声認識方法及び音声認識プログラム
CN2658846Y (zh) * 2003-08-21 2004-11-24 泉茂科技股份有限公司 无线辨识锁
US7590533B2 (en) * 2004-03-10 2009-09-15 Microsoft Corporation New-word pronunciation learning using a pronunciation graph
JP4237713B2 (ja) 2005-02-07 2009-03-11 東芝テック株式会社 音声処理装置
US7826945B2 (en) * 2005-07-01 2010-11-02 You Zhang Automobile speech-recognition interface
US7555291B2 (en) * 2005-08-26 2009-06-30 Sony Ericsson Mobile Communications Ab Mobile wireless communication terminals, systems, methods, and computer program products for providing a song play list
US8185400B1 (en) * 2005-10-07 2012-05-22 At&T Intellectual Property Ii, L.P. System and method for isolating and processing common dialog cues
JP4845118B2 (ja) * 2006-11-20 2011-12-28 富士通株式会社 音声認識装置、音声認識方法、および、音声認識プログラム
US10056077B2 (en) * 2007-03-07 2018-08-21 Nuance Communications, Inc. Using speech recognition results based on an unstructured language model with a music system
US20090018842A1 (en) * 2007-07-11 2009-01-15 Garmin Ltd. Automated speech recognition (asr) context
US20090190735A1 (en) * 2008-01-24 2009-07-30 General Motors Corporation Method and system for enhancing telematics services
US8386261B2 (en) * 2008-11-14 2013-02-26 Vocollect Healthcare Systems, Inc. Training/coaching system for a voice-enabled work environment
US20120309363A1 (en) * 2011-06-03 2012-12-06 Apple Inc. Triggering notifications associated with tasks items that represent tasks to perform
US8279052B2 (en) * 2009-11-04 2012-10-02 Immersion Corporation Systems and methods for haptic confirmation of commands
CN101833950A (zh) * 2010-05-19 2010-09-15 吉林大学 一种支持most总线连接的车载语音控制器
US8340975B1 (en) * 2011-10-04 2012-12-25 Theodore Alfred Rosenberger Interactive speech recognition device and system for hands-free building control
JP5928048B2 (ja) * 2012-03-22 2016-06-01 ソニー株式会社 情報処理装置、情報処理方法、情報処理プログラムおよび端末装置
US20130317817A1 (en) * 2012-05-22 2013-11-28 Nuance Communications, Inc. Method and Apparatus for Applying Steganography in a Signed Model
CN103532823B (zh) * 2012-07-04 2018-11-23 中兴通讯股份有限公司 物联网消息处理方法、装置及系统
US8947220B2 (en) * 2012-10-31 2015-02-03 GM Global Technology Operations LLC Speech recognition functionality in a vehicle through an extrinsic device
CN103888383B (zh) * 2012-12-24 2017-09-29 华为技术有限公司 资源预留方法、系统及汇聚设备
KR20140088449A (ko) * 2013-01-02 2014-07-10 엘지전자 주식회사 중앙 제어 장치 및 그것의 제어 방법
CN103823545B (zh) * 2014-03-05 2016-05-18 南京邮电大学 一种云计算系统的服务器唤醒方法

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5737723A (en) * 1994-08-29 1998-04-07 Lucent Technologies Inc. Confusable word detection in speech recognition
US5884266A (en) * 1997-04-02 1999-03-16 Motorola, Inc. Audio interface for document based information resource navigation and method therefor
US6330539B1 (en) * 1998-02-05 2001-12-11 Fujitsu Limited Dialog interface system
EP1045374A1 (en) * 1999-04-13 2000-10-18 Sony International (Europe) GmbH Merging of speech interfaces for concurrent use of devices and applications
US6615177B1 (en) * 1999-04-13 2003-09-02 Sony International (Europe) Gmbh Merging of speech interfaces from concurrent use of devices and applications
US6413079B1 (en) * 2000-04-10 2002-07-02 Heat-N-Glo Fireplace Products, Inc. Voice activated fireplace control system
US6778098B2 (en) * 2000-07-21 2004-08-17 Koninklijke Philips Electronics N.V. Method and electronic device for speech control
US20080221896A1 (en) * 2007-03-09 2008-09-11 Microsoft Corporation Grammar confusability metric for speech recognition
US20130325451A1 (en) * 2012-05-31 2013-12-05 Elwha LLC, a limited liability company of the State of Delaware Methods and systems for speech adaptation data
US20130325446A1 (en) * 2012-05-31 2013-12-05 Elwha LLC, a limited liability company of the State of Delaware Speech recognition adaptation systems based on adaptation data
US20130339028A1 (en) * 2012-06-15 2013-12-19 Spansion Llc Power-Efficient Voice Activation
US20150170664A1 (en) * 2013-03-14 2015-06-18 Google Inc. Compartmentalized self registration of external devices
US9445209B2 (en) * 2013-07-11 2016-09-13 Intel Corporation Mechanism and apparatus for seamless voice wake and speaker verification
US20160182938A1 (en) * 2013-08-06 2016-06-23 Saronikos Trading And Services, Unipessoal Lda System for Controlling Electronic Devices by Means of Voice Commands, More Specifically a Remote Control to Control a Plurality of Electronic Devices by Means of Voice Commands

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180330716A1 (en) * 2017-05-11 2018-11-15 Olympus Corporation Sound collection apparatus, sound collection method, sound collection program, dictation method, information processing apparatus, and recording medium recording information processing program
US10777187B2 (en) * 2017-05-11 2020-09-15 Olympus Corporation Sound collection apparatus, sound collection method, sound collection program, dictation method, information processing apparatus, and recording medium recording information processing program
US11508378B2 (en) * 2018-10-23 2022-11-22 Samsung Electronics Co., Ltd. Electronic device and method for controlling the same
US20230086579A1 (en) * 2018-10-23 2023-03-23 Samsung Electronics Co.,Ltd. Electronic device and method for controlling the same
US11830502B2 (en) * 2018-10-23 2023-11-28 Samsung Electronics Co., Ltd. Electronic device and method for controlling the same
US20200152186A1 (en) * 2018-11-13 2020-05-14 Motorola Solutions, Inc. Methods and systems for providing a corrected voice command
US10885912B2 (en) * 2018-11-13 2021-01-05 Motorola Solutions, Inc. Methods and systems for providing a corrected voice command

Also Published As

Publication number Publication date
JP2016024212A (ja) 2016-02-08
WO2016009646A1 (en) 2016-01-21
CN106663428A (zh) 2017-05-10
CN106663428B (zh) 2021-02-09
US20170053650A1 (en) 2017-02-23

Similar Documents

Publication Publication Date Title
US10490192B2 (en) Apparatus, method, non-transitory computer-readable medium and system for modifying voice recognition information
CN105976813B (zh) 语音识别系统及其语音识别方法
KR102301880B1 (ko) 전자 장치 및 이의 음성 대화 방법
EP3040985B1 (en) Electronic device and method for voice recognition
US20190051297A1 (en) False positive wake word
JP6497372B2 (ja) 音声対話装置および音声対話方法
KR102483834B1 (ko) 음성 명령을 이용한 사용자 인증 방법 및 전자 장치
US11282528B2 (en) Digital assistant activation based on wake word association
EP3444811B1 (en) Speech recognition method and device
US10489515B2 (en) Method and apparatus for providing automatic speech translation service in face-to-face situation
KR102548453B1 (ko) 전자 장치 및 그 제어 방법
ES2950974T3 (es) Dispositivo electrónico para realizar una tarea que incluye una llamada en respuesta al pronunciamiento de un usuario y procedimiento de operación del mismo
US11170764B2 (en) Electronic device for processing user utterance
US11915700B2 (en) Device for processing user voice input
CN107643909B (zh) 用于协调多个本地设备上的输入的方法和电子设备
KR20180138017A (ko) 음성 인식을 위한 전자 장치 및 시스템
US11004075B2 (en) Device and method for performing payment using utterance
US10403277B2 (en) Method and apparatus for information search using voice recognition
KR20210036527A (ko) 사용자 발화를 처리하는 전자 장치 및 그 작동 방법
US11393466B2 (en) Electronic device and method of providing dialog service based on electronic medical record
US10600405B2 (en) Speech signal processing method and speech signal processing apparatus
CN111819831B (zh) 消息接收通知方法及支持该方法的电子设备
US10963466B2 (en) Contextual associations for entity queries
KR102180955B1 (ko) 음성 데이터 송신 및 수신 방법
KR20210062279A (ko) 전자 장치 및 이를 이용한 근거리 통신 장치의 사용자 식별 정보 획득 방법

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OGAWA, HIROAKI;REEL/FRAME:040161/0038

Effective date: 20160914

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4