WO2021031290A1 - Translation method and device for earphone pair, earphone pair and translation system - Google Patents

Translation method and device for earphone pair, earphone pair and translation system Download PDF

Info

Publication number
WO2021031290A1
WO2021031290A1 PCT/CN2019/107897 CN2019107897W WO2021031290A1 WO 2021031290 A1 WO2021031290 A1 WO 2021031290A1 CN 2019107897 W CN2019107897 W CN 2019107897W WO 2021031290 A1 WO2021031290 A1 WO 2021031290A1
Authority
WO
WIPO (PCT)
Prior art keywords
earphone
translation
signal
electronic device
voice signal
Prior art date
Application number
PCT/CN2019/107897
Other languages
French (fr)
Chinese (zh)
Inventor
张海宏
Original Assignee
歌尔股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔股份有限公司 filed Critical 歌尔股份有限公司
Publication of WO2021031290A1 publication Critical patent/WO2021031290A1/en

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/005Language recognition
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/14Direct-mode setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/30Connection release

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)
  • Headphones And Earphones (AREA)

Abstract

The present invention discloses a translation method and device for earphone pair, an earphone pair and a translation system, the earphone pair comprises a first earphone and a second earphone which correspond to each other and is used for establishing a Bluetooth link with electronic apparatus; the translation method comprises: controlling the first earphone to establish a Bluetooth link with the electronic apparatus; controlling the first earphone to obtain a first voice signal input by a user, and uploading the first voice signal to the electronic apparatus through the Bluetooth link, so that the electronic apparatus translates the first voice signal to obtain a first translation signal; controlling the first earphone and the second earphone to obtain the first translation signal sent by the electronic apparatus through the Bluetooth link; controlling the first earphone and the second earphone to play the first translation signal.

Description

一种用于耳机对的翻译方法、装置、耳机对及翻译系统Translation method and device for earphone pair, earphone pair and translation system
本申请要求于2019年8月22日提交中国专利局、申请号201910780680.6、申请名称为“一种用于耳机对的翻译方法、装置、耳机对及翻译系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, application number 201910780680.6, and the application name "A translation method, device, earphone pair and translation system for earphone pair" on August 22, 2019. The entire content is incorporated into this application by reference.
技术领域Technical field
本发明涉及耳机翻译技术领域,更具体地,本发明涉及一种用于耳机对的翻译方法、装置、耳机对及翻译系统。The present invention relates to the field of earphone translation technology, and more specifically, the present invention relates to a translation method, device, earphone pair and translation system for earphone pair.
背景技术Background technique
随着社会的发展和进步,各行各业全球化国际化的步伐越来越快,不管在工作还是在生活中和外国人沟通的概率越来越高。虽然手机应用和桌面应用都开启了语音在线翻译服务,为两个说着不同语言的人架起了沟通的桥梁,但这两种方式实在是不够便捷,实用性不高。而且只能完成单向完成从第一语言到第二语言的同声翻译,无法实现不同用户分别使用第一语言到第二语言进行无障碍交谈的效果。With the development and progress of society, the pace of globalization and internationalization in all walks of life is getting faster and faster, and the probability of communicating with foreigners in work or life is getting higher and higher. Although both mobile phone applications and desktop applications have enabled online voice translation services to bridge the communication between two people who speak different languages, these two methods are not convenient enough and not very practical. Moreover, it can only complete one-way simultaneous translation from the first language to the second language, and cannot achieve the effect of barrier-free conversations between the first language and the second language for different users.
如果单独使用手机进行交流翻译服务,用户需要手动在第一语言到第二语言上进行切换,导致不同用户分别使用第一语言到第二语言进行交谈时非常的不便利。If the mobile phone is used alone for the communication translation service, the user needs to manually switch from the first language to the second language, which makes it very inconvenient for different users to talk in the first language to the second language respectively.
因此,提出一种语音翻译方法,以使用户获得更好的使用体验的方案。Therefore, a voice translation method is proposed to enable users to obtain a better user experience.
发明内容Summary of the invention
本发明的一个目的是提供一种能够解决上述问题之一的新的技术方案。An object of the present invention is to provide a new technical solution that can solve one of the above-mentioned problems.
根据本发明的第一方面,提供了一种用于耳机对的翻译方法,所述耳机对包括对应的第一耳机和第二耳机,所述耳机对用于与电子设备建立蓝牙链路;所述翻译方法包括:According to a first aspect of the present invention, a translation method for a pair of earphones is provided, the pair of earphones includes a corresponding first earphone and a second earphone, and the earphone pair is used to establish a Bluetooth link with an electronic device; The translation methods include:
控制所述第一耳机与所述电子设备建立蓝牙链路;Controlling the first earphone to establish a Bluetooth link with the electronic device;
控制所述第一耳机获取第一用户输入的第一语音信号,并通过所述蓝牙链路将所述第一语音信号上传至所述电子设备,以供所述电子设备对所述第一语音信号进行翻译处理得到第一翻译信号;Control the first earphone to obtain the first voice signal input by the first user, and upload the first voice signal to the electronic device through the Bluetooth link, so that the electronic device can respond to the first voice signal Translating the signal to obtain the first translated signal;
控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述第一翻译信号;Controlling the first earphone and the second earphone to obtain the first translation signal sent by the electronic device through the Bluetooth link;
控制所述第一耳机和所述第二耳机播放所述第一翻译信号。Controlling the first earphone and the second earphone to play the first translation signal.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
控制所述第二耳机获取所述蓝牙链路的信道参数;Controlling the second earphone to obtain the channel parameters of the Bluetooth link;
控制所述第二耳机获取第二用户输入的第二语音信号,并根据所述信道参数,将所述第二语音信号上传至所述电子设备,以供所述电子设备对所述第二语音信号进行翻译处理得到第二翻译信号;Control the second earphone to obtain the second voice signal input by the second user, and upload the second voice signal to the electronic device according to the channel parameters, so that the electronic device can respond to the second voice The signal is translated and processed to obtain a second translated signal;
控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述第二翻译信号;Controlling the first earphone and the second earphone to obtain the second translation signal sent by the electronic device through the Bluetooth link;
控制所述第一耳机和所述第二耳机播放所述第二翻译信号。Controlling the first earphone and the second earphone to play the second translation signal.
可选的,控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述翻译信号包括:Optionally, controlling the first earphone and the second earphone to obtain the translation signal sent by the electronic device through the Bluetooth link includes:
控制所述第一耳机通过所述蓝牙链路接收所述翻译信号;其中,所述翻译信号为所述第一翻译信号或所述第二翻译信号;Controlling the first earphone to receive the translation signal through the Bluetooth link; wherein the translation signal is the first translation signal or the second translation signal;
控制所述第二耳机根据所述信道参数监听所述蓝牙链路,获取所述翻译信号。Control the second earphone to monitor the Bluetooth link according to the channel parameter, and obtain the translation signal.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
在控制所述第一耳机播放所述第一翻译信号之后,控制所述第一耳机检测所述第一用户未输入所述第一语音信号的第一连续时长;After controlling the first earphone to play the first translation signal, controlling the first earphone to detect the first continuous duration during which the first user has not input the first voice signal;
在所述第一连续时长超过预设的第一时长阈值时,控制所述第一耳机向所述第二耳机发送自身翻译过程结束的第一结束通知,以供所述第二耳机在接收到所述第一结束通知的情况下,获取所述第二用户输入的所述第二语音信号。When the first continuous duration exceeds the preset first duration threshold, the first headset is controlled to send a first end notification that the translation process is completed to the second headset, so that the second headset can receive In the case of the first end notification, the second voice signal input by the second user is acquired.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
在所述第一耳机向所述第二耳机发送所述第一结束通知的情况下,控制所述第一耳机的第一麦克风和第一射频发送单元停止工作。In the case that the first earphone sends the first end notification to the second earphone, the first microphone and the first radio frequency sending unit of the first earphone are controlled to stop working.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
控制所述第一耳机检测用户输入第一语音信号的第一事件是否发生;Controlling the first earphone to detect whether a first event occurs when a user inputs a first voice signal;
在所述第一事件发生的情况下,控制所述第一耳机的第一麦克风和第一射频发送单元启动工作,以获取所述第一用户输入的所述第一语音信号。When the first event occurs, control the first microphone of the first earphone and the first radio frequency sending unit to start work to obtain the first voice signal input by the first user.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
在控制所述第一耳机的第一麦克风和第一射频发送单元启动工作的情况下,控制所述第一耳机发出提醒警报。When the first microphone and the first radio frequency transmitting unit of the first earphone are controlled to start working, the first earphone is controlled to issue a reminder alarm.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
在控制所述第一耳机获取第一用户输入的第一语音信号的情况下,控制所述第一耳机向所述第二耳机发送自身翻译过程启动的第一启动通知,以在所述第二耳机在接收到所述 第一启动通知、且未接收到所述第一结束通知的情况下,控制所述第二耳机停止获取所述第二用户输入的所述第二语音信号。In the case that the first earphone is controlled to obtain the first voice signal input by the first user, the first earphone is controlled to send to the second earphone the first start notification of the start of its own translation process, so that the When the earphone receives the first start notification but does not receive the first end notification, the earphone is controlled to stop acquiring the second voice signal input by the second user.
可选的,所述翻译方法还包括:Optionally, the translation method further includes:
通过所述第一耳机检测用户未输入所述第一语音信号的连续时长;Detecting, by the first earphone, the continuous duration during which the user has not input the first voice signal;
在所述连续时长超过预设的第三时长阈值时,断开所述第一耳机与所述电子设备之间的所述蓝牙链路。When the continuous duration exceeds a preset third duration threshold, disconnect the Bluetooth link between the first earphone and the electronic device.
可选的,所述蓝牙链路为SCO同步链路或者ACL异步链路或者BLE链路。Optionally, the Bluetooth link is an SCO synchronous link, an ACL asynchronous link, or a BLE link.
根据本发明的第二方面,提供了一种用于耳机对的翻译装置,所述耳机对包括对应的第一耳机和第二耳机,所述耳机对用于与电子设备建立蓝牙链路;所述翻译装置包括:According to a second aspect of the present invention, there is provided a translation device for a pair of earphones, the pair of earphones includes a corresponding first earphone and a second earphone, and the earphone pair is used to establish a Bluetooth link with an electronic device; The translation device includes:
第一链路建立模块,用于控制所述第一耳机与所述电子设备建立蓝牙链路;A first link establishment module, configured to control the first headset to establish a Bluetooth link with the electronic device;
第一语音上传模块,用于控制所述第一耳机获取用户输入的第一语音信号,并通过所述蓝牙链路将所述第一语音信号上传至所述电子设备,以供所述电子设备对所述第一语音信号进行翻译处理得到第一翻译信号;The first voice uploading module is used to control the first earphone to obtain the first voice signal input by the user, and upload the first voice signal to the electronic device through the Bluetooth link for the electronic device Performing translation processing on the first speech signal to obtain a first translated signal;
第一翻译获取模块,用于控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述第一翻译信号;A first translation acquisition module, configured to control the first earphone and the second earphone to acquire the first translation signal sent by the electronic device through the Bluetooth link;
第一信号播放模块,用于控制所述第一耳机和所述第二耳机播放所述第一翻译信号。The first signal playing module is used to control the first earphone and the second earphone to play the first translation signal.
根据本发明的第三方面,提供了一种耳机对,所述耳机对包括:According to a third aspect of the present invention, there is provided an earphone pair, the earphone pair including:
根据本发明第二方面所述的翻译装置;或者,The translation device according to the second aspect of the present invention; or,
处理器和存储器,所述存储器用于存储指令,所述指令用于控制所述处理器执行根据本发明第一方面所述的翻译方法。A processor and a memory, where the memory is used to store instructions, and the instructions are used to control the processor to execute the translation method according to the first aspect of the present invention.
根据本发明的第四方面,提供了一种翻译系统,包括电子设备、及根据本发明第三方面所述的耳机对;其中,所述电子设备用于与所述耳机对的第一耳机建立蓝牙链路,通过所述蓝牙链路接收所述第一耳机上传的第一语音信号,并对所述第一语音信号进行翻译处理,得到第一翻译信号,并将所述第一翻译信号通过所述蓝牙链路发送至所述第一耳机。According to a fourth aspect of the present invention, there is provided a translation system, including an electronic device and the earphone pair according to the third aspect of the invention; wherein the electronic device is used to establish a connection with the first earphone of the earphone pair. Bluetooth link, receiving the first voice signal uploaded by the first earphone through the Bluetooth link, and performing translation processing on the first voice signal to obtain a first translation signal, and passing the first translation signal The Bluetooth link is sent to the first headset.
本发明的一个有益效果在于,通过本实施例的翻译方法,两个不同语言的用户分别佩戴第一耳机和第二耳机,使用不同的语言进行交谈时,可以分别听到对方语音翻译成本国语言的语音,无语言障碍地进行沟通交谈。而且第一耳机和第二耳机均可以获取到电子设备发送的第一翻译信号,无需第一耳机将获取的第一翻译信号转发至第二耳机中,可以使得第一耳机和第二耳机获取到第一翻译信号的延迟较小;无需第一耳机断开蓝牙链路和第二耳机重新连接蓝牙链路的过程,可以使得第一用户和第二用户在交谈时无需等待蓝牙链路建立的过程时间。One beneficial effect of the present invention is that through the translation method of this embodiment, two users of different languages wear the first earphone and the second earphone respectively, and when they talk in different languages, they can hear the other party’s voice translation in the national language. Voice, communicate and talk without language barriers. Moreover, both the first earphone and the second earphone can obtain the first translation signal sent by the electronic device, without the first earphone to forward the obtained first translation signal to the second earphone, so that the first earphone and the second earphone can obtain The delay of the first translation signal is small; there is no need for the first headset to disconnect the Bluetooth link and the second headset to reconnect to the Bluetooth link, so that the first user and the second user do not need to wait for the Bluetooth link establishment process when talking time.
通过以下参照附图对本发明的示例性实施例的详细描述,本发明的其它特征及其优点将会变得清楚。Through the following detailed description of exemplary embodiments of the present invention with reference to the accompanying drawings, other features and advantages of the present invention will become clear.
附图说明Description of the drawings
被结合在说明书中并构成说明书的一部分的附图示出了本发明的实施例,并且连同其说明一起用于解释本发明的原理。The drawings incorporated in the specification and constituting a part of the specification illustrate the embodiments of the present invention, and together with the description thereof are used to explain the principle of the present invention.
图1为根据本发明实施例的用于耳机对的翻译方法的流程图;Fig. 1 is a flowchart of a translation method for a pair of earphones according to an embodiment of the present invention;
图2为根据本发明实施例的用于耳机对的翻译方法的一个例子的流程图;2 is a flowchart of an example of a translation method for a pair of earphones according to an embodiment of the present invention;
图3为根据本发明实施例的用于耳机对的翻译方法的另一个例子的流程图;3 is a flowchart of another example of a translation method for a pair of earphones according to an embodiment of the present invention;
图4为根据本发明实施例的翻译系统的示意图;Figure 4 is a schematic diagram of a translation system according to an embodiment of the present invention;
图5为根据本发明实施例的用于耳机对的翻译装置的一个例子的原理框图;Fig. 5 is a functional block diagram of an example of a translation device for a pair of earphones according to an embodiment of the present invention;
图6为根据本发明实施例的用于耳机对的翻译装置的一个例子的原理框图;Figure 6 is a functional block diagram of an example of a translation device for a pair of earphones according to an embodiment of the present invention;
图7为根据本发明实施例的耳机对一个例子的原理框图。Fig. 7 is a functional block diagram of an example of a pair of earphones according to an embodiment of the present invention.
具体实施方式detailed description
现在将参照附图来详细描述本发明的各种示例性实施例。应注意到:除非另外具体说明,否则在这些实施例中阐述的部件和步骤的相对布置、数字表达式和数值不限制本发明的范围。Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that unless specifically stated otherwise, the relative arrangement, numerical expressions and numerical values of the components and steps set forth in these embodiments do not limit the scope of the present invention.
以下对至少一个示例性实施例的描述实际上仅仅是说明性的,决不作为对本发明及其应用或使用的任何限制。The following description of at least one exemplary embodiment is actually only illustrative, and in no way serves as any limitation to the present invention and its application or use.
对于相关领域普通技术人员已知的技术、方法和设备可能不作详细讨论,但在适当情况下,所述技术、方法和设备应当被视为说明书的一部分。The technologies, methods, and equipment known to those of ordinary skill in the relevant fields may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be regarded as part of the specification.
在这里示出和讨论的所有例子中,任何具体值应被解释为仅仅是示例性的,而不是作为限制。因此,示例性实施例的其它例子可以具有不同的值。In all the examples shown and discussed herein, any specific value should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiment may have different values.
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步讨论。It should be noted that similar reference numerals and letters indicate similar items in the following drawings, so once a certain item is defined in one drawing, it does not need to be further discussed in subsequent drawings.
<方法实施例><Method Example>
为了解决现有技术中存在的不同语言用户之间沟通通过电子设备上的翻译应用来实现的方法实用性较差问题,提供了一种用于耳机对的翻译方法。该翻译方法可以是由耳机对来实现,该耳机对可以包括对应的第一耳机和第二耳机,该耳机对用于与电子设备建立蓝牙链路。In order to solve the problem of poor practicability of communication between users of different languages in the prior art through the translation application on the electronic device, a translation method for a pair of earphones is provided. The translation method may be implemented by a pair of earphones, the pair of earphones may include a corresponding first earphone and a second earphone, and the earphone pair is used to establish a Bluetooth link with an electronic device.
相对应的第一耳机和第二耳机是一副真无线耳机(TWS耳机),第一耳机和第二耳机之间可以通过TWS协议传输数据。在本发明的实施例中,第一耳机和第二耳机之间可以通过TWS协议传输信道参数和通知,无需在第一耳机和第二耳机之间传输语音信号或者是翻译信号。The corresponding first earphone and second earphone are a pair of true wireless earphones (TWS earphones), and data can be transmitted between the first earphone and the second earphone through the TWS protocol. In the embodiment of the present invention, the channel parameters and notifications can be transmitted between the first earphone and the second earphone through the TWS protocol, and there is no need to transmit voice signals or translation signals between the first earphone and the second earphone.
图1为根据本发明实施例的用于耳机对的翻译方法的流程图。Fig. 1 is a flowchart of a translation method for a pair of earphones according to an embodiment of the present invention.
如图1所示,该翻译方法可以包括如下所示的步骤S1100~S1400:As shown in FIG. 1, the translation method may include steps S1100 to S1400 as shown below:
步骤S1100,控制第一耳机与电子设备建立蓝牙链路。Step S1100, controlling the first earphone to establish a Bluetooth link with the electronic device.
在本发明的一个实施例中,第一耳机与电子设备之间可以是通过蓝牙连接,建立蓝牙链路。In an embodiment of the present invention, the first earphone and the electronic device may be connected via Bluetooth to establish a Bluetooth link.
该蓝牙链路可以是SCO同步链路或者ACL异步链路或者BLE链路。The Bluetooth link can be a SCO synchronous link or an ACL asynchronous link or a BLE link.
在蓝牙链路为SCO同步链路的情况下,第一耳机与电子设备之间可以建立HFP连接,第一耳机与电子设备之间可以通过HFP协议在SCO同步链路上直接进行语音信号的上下行同步传输(如打电话)。When the Bluetooth link is the SCO synchronization link, an HFP connection can be established between the first headset and the electronic device, and the first headset and the electronic device can directly perform voice signal up and down on the SCO synchronization link through the HFP protocol. Line synchronous transmission (such as calling).
在蓝牙链路为ACL异步链路的情况下,第一耳机与电子设备之间可以建立A2DP连接和SPP连接,第一耳机与电子设备之间可以在ACL异步链路中,通过A2DP协议进行语音信号的下行异步传输(如听音乐),通过SPP协议进行语音信号的上下行异步传输。In the case that the Bluetooth link is an ACL asynchronous link, an A2DP connection and an SPP connection can be established between the first earphone and the electronic device, and the first earphone and the electronic device can be in the ACL asynchronous link through the A2DP protocol for voice The downlink asynchronous transmission of the signal (such as listening to music), the uplink and downlink asynchronous transmission of the voice signal is carried out through the SPP protocol.
在蓝牙链路时BLE链路的情况下,第一耳机与电子设备建立BLE链接,第一耳机和电子设备通过数据协议或语音协议进行上下行传输。可选的是,第二耳机和电子设备也可以建立BLE链接,通过数据协议或语音协议进行上下行传输。步骤S1200,控制第一耳机获取第一用户输入的第一语音信号,并通过蓝牙链路将第一语音信号上传至电子设备,以供电子设备对第一语音信号进行翻译处理得到第一翻译信号。In the case of a BLE link in a Bluetooth link, the first earphone establishes a BLE link with the electronic device, and the first earphone and the electronic device perform uplink and downlink transmission through a data protocol or a voice protocol. Optionally, the second earphone and the electronic device may also establish a BLE link, and perform uplink and downlink transmission through a data protocol or a voice protocol. Step S1200: Control the first earphone to obtain the first voice signal input by the first user, and upload the first voice signal to the electronic device through the Bluetooth link, so that the electronic device can translate the first voice signal to obtain the first translation signal .
在本实施例中,第一耳机上可以是设置有第一麦克风和第一射频发送单元,第一麦克风以用于采集第一用户输入的第一语音信号,第一射频发送单元可以用于将第一语音信号上传至电子设备中。该第一射频发送单元可以是由第一耳机中的蓝牙芯片提供。In this embodiment, the first earphone may be provided with a first microphone and a first radio frequency transmitting unit. The first microphone is used to collect the first voice signal input by the first user, and the first radio frequency transmitting unit may be used to The first voice signal is uploaded to the electronic device. The first radio frequency sending unit may be provided by a Bluetooth chip in the first earphone.
本实施例中的电子设备可以是手机、智能手表、平板电脑等能够实现语音翻译功能的电子产品。The electronic device in this embodiment may be an electronic product capable of implementing a voice translation function, such as a mobile phone, a smart watch, or a tablet computer.
当电子设备接收到第一语音信号之后,可以将第一语音信号转换为文字进行翻译,再将翻译后的文字转换为语音信号,得到第一翻译信号。After the electronic device receives the first voice signal, it can convert the first voice signal into text for translation, and then convert the translated text into a voice signal to obtain the first translation signal.
进一步地,电子设备需提前设置好翻译的源语言类型为第一用户使用的第一语言,目标语言类型为使用第二耳机的第二用户能够听懂的第二语言,当检测到的第一语音信号的语音为源语言类型时,电子设备就能够将第一语言的第一语音信号翻译为第二语言的第一翻译信号。Further, the electronic device needs to set the source language type of the translation as the first language used by the first user in advance, and the target language type as the second language that the second user using the second headset can understand. When the first language is detected When the voice of the voice signal is in the source language type, the electronic device can translate the first voice signal in the first language into the first translated signal in the second language.
上述文字翻译过程可以是通过翻译引擎实现的,文字和语音之间的转换例如可以是通过语音识别引擎来实现的。The above-mentioned text translation process can be realized by a translation engine, and the conversion between text and speech can be realized by a speech recognition engine, for example.
在本实施例中,电子设备在得到第一翻译信号之后,可以是将第一翻译信号通过该蓝牙链路进行发送。In this embodiment, after the electronic device obtains the first translation signal, it may send the first translation signal through the Bluetooth link.
步骤S1300,控制第一耳机和第二耳机获取电子设备通过蓝牙链路发送的第一翻译信号。Step S1300, controlling the first earphone and the second earphone to obtain the first translation signal sent by the electronic device through the Bluetooth link.
在一个实施例中,第一耳机在与电子设备建立蓝牙链路的情况下,会将该蓝牙链路的信道参数发送至第二耳机,供第二耳机获取。In one embodiment, when the first headset establishes a Bluetooth link with the electronic device, the channel parameters of the Bluetooth link will be sent to the second headset for the second headset to obtain.
在此基础上,控制第一耳机和第二耳机获取电子设备通过蓝牙链路发送的第一翻译信号的步骤包括:On this basis, the step of controlling the first earphone and the second earphone to obtain the first translation signal sent by the electronic device through the Bluetooth link includes:
控制第一耳机通过该蓝牙链路接收第一翻译信号;控制第二耳机根据信道参数监听该蓝牙链路,获取第一翻译信号。Control the first earphone to receive the first translation signal through the Bluetooth link; control the second earphone to monitor the Bluetooth link according to channel parameters to obtain the first translation signal.
具体的,电子设备可以是通过蓝牙链路来发送第一翻译信号,由于第一耳机通过蓝牙链路与电子设备连接,因此,第一耳机可以直接接收到电子设备通过蓝牙链路发送的第一翻译信号。Specifically, the electronic device may send the first translation signal through the Bluetooth link. Since the first headset is connected to the electronic device through the Bluetooth link, the first headset may directly receive the first translation signal sent by the electronic device through the Bluetooth link. Translate the signal.
另外,第二耳机可以是采用监听的方式,接收跳频点和频带等信道参数和第一耳机完全相同。因此,第二耳机可以采用监听的方式获取到电子设备通过蓝牙链路发送的第一翻译信号,无需第一耳机转发。In addition, the second earphone may adopt a monitoring mode, and the channel parameters such as the frequency hopping point and frequency band are completely the same as the first earphone. Therefore, the second earphone can obtain the first translation signal sent by the electronic device through the Bluetooth link in a monitoring manner, without the first earphone for forwarding.
这个过程就像从电子设备到第二耳机之间有一条虚拟的蓝牙链路来同时传输第一翻译信号。This process is like a virtual Bluetooth link from the electronic device to the second headset to simultaneously transmit the first translation signal.
在本实施例中,可以是第一耳机和第二耳机之间建立TWS连接,可以通过TWS协议传输信道参数。In this embodiment, a TWS connection may be established between the first earphone and the second earphone, and the channel parameters may be transmitted through the TWS protocol.
具体的,可以是第一耳机将自身的蓝牙地址、发送频点、接收跳频点和频带等信道参数通过TWS协议传输至第二耳机,供第二耳机模拟第一耳机的接收跳频点和频带,实现蓝牙链路的监听,获取电子设备通过蓝牙链路发送至第一耳机的第一翻译信号。Specifically, the first earphone may transmit its own Bluetooth address, sending frequency point, receiving frequency hopping point, and frequency band to the second earphone through the TWS protocol, so that the second earphone can simulate the receiving frequency hopping point and frequency of the first earphone. The frequency band realizes the monitoring of the Bluetooth link, and obtains the first translation signal sent by the electronic device to the first earphone via the Bluetooth link.
在蓝牙链路为SCO链路的情况下,电子设备可以将第一翻译信号通过基带编码成蓝牙数据包,并通过射频发送。第二耳机采用监听的方式,接收跳频点和频带等信息和第一耳机完全相同。第一耳机和第二耳机均收到相同的蓝牙基带数据包,并进行解析得到第一翻译信号。这个过程就相当于是从电子设备到第二耳机之间有一条虚拟的SCO链路来同时传输第一翻译信号。In the case that the Bluetooth link is an SCO link, the electronic device may encode the first translation signal into a Bluetooth data packet through the baseband, and send it through a radio frequency. The second earphone adopts a monitoring method, and receives information such as frequency hopping point and frequency band, which is exactly the same as the first earphone. Both the first earphone and the second earphone receive the same Bluetooth baseband data packet, and perform analysis to obtain the first translation signal. This process is equivalent to a virtual SCO link from the electronic device to the second headset to simultaneously transmit the first translation signal.
在蓝牙链路为ACL链路的情况下,电子设备可以是对第一翻译信号进行编码并封装成A2DP协议的数据包,然后再封装成蓝牙基带协议包,通过ACL链路向第一耳机的蓝牙地址发送。第一耳机直接接收并解析该蓝牙基带协议包,得到第一翻译信号。第二耳机采用 监听的方式,和第一耳机采用同样的频点策略进行蓝牙基带协议包的接收,并用与第一耳机相同的耳机蓝牙地址等信息进行解析,得到第一翻译信号。这样第一耳机和第二耳机就同时收到了下行的协议的数据包,并解码成第一翻译信号。这个过程看起来相当于是第二耳机和电子设备之间建立了一条虚拟的A2DP异步链路。In the case that the Bluetooth link is an ACL link, the electronic device can encode the first translated signal and encapsulate it into an A2DP protocol data packet, and then encapsulate it into a Bluetooth baseband protocol packet, and send it to the first headset through the ACL link. Bluetooth address sending. The first earphone directly receives and parses the Bluetooth baseband protocol packet to obtain the first translated signal. The second earphone adopts a monitoring method, uses the same frequency point strategy as the first earphone to receive the Bluetooth baseband protocol packet, and uses the same earphone Bluetooth address and other information to analyze to obtain the first translation signal. In this way, the first earphone and the second earphone simultaneously receive the data packets of the downlink protocol and decode them into the first translation signal. This process seems to be equivalent to establishing a virtual A2DP asynchronous link between the second headset and the electronic device.
在蓝牙链路为BLE链路的情况下,电子设备可以将第一翻译信号通过按照相关数据协议或语音协议,直接发送给第一耳机和第二耳机。In the case that the Bluetooth link is a BLE link, the electronic device may directly send the first translation signal to the first earphone and the second earphone in accordance with the relevant data protocol or voice protocol.
步骤S1400,控制第一耳机和第二耳机播放第一翻译信号。Step S1400, controlling the first earphone and the second earphone to play the first translation signal.
在本实施例中,第一耳机和第二耳机均可以获取到电子设备发送的第一翻译信号,无需第一耳机将获取的第一翻译信号转发至第二耳机中,可以使得第一耳机和第二耳机获取到第一翻译信号的延迟较小。In this embodiment, both the first earphone and the second earphone can obtain the first translation signal sent by the electronic device, and the first earphone is not required to forward the obtained first translation signal to the second earphone, so that the first earphone and the The delay for the second earphone to acquire the first translation signal is relatively small.
在本发明的一个实施例中,该翻译方法还可以包括如下所示的步骤S2100~S2400:In an embodiment of the present invention, the translation method may further include steps S2100 to S2400 as shown below:
步骤S2100,控制第二耳机获取蓝牙链路的信道参数。Step S2100, controlling the second earphone to obtain channel parameters of the Bluetooth link.
步骤S2200,控制第二耳机获取第二用户输入的第二语音信号,并根据该信道参数将第二语音信号上传至电子设备,以供电子设备对第二语音信号进行翻译处理得到第二翻译信号。Step S2200: Control the second earphone to obtain the second voice signal input by the second user, and upload the second voice signal to the electronic device according to the channel parameter, so that the electronic device can translate the second voice signal to obtain the second translation signal .
在本发明的一个或多个实施例中,第二语音信号为通过第二耳机采集的语音信号。对应的,第二耳机上可以设置有第二麦克风,可以用于采集第二用户输入的二语音信号。In one or more embodiments of the present invention, the second voice signal is a voice signal collected through a second earphone. Correspondingly, a second microphone may be provided on the second earphone, which may be used to collect the second voice signal input by the second user.
在本实施例中,第二耳机可以是根据蓝牙链路的信道参数,模拟第一耳机向电子设备上传第二语音信号,无需第一耳机断开蓝牙链路和第二耳机重新连接蓝牙链路的过程,可以使得第一用户和第二用户在交谈时无需等待蓝牙链路建立的过程时间。In this embodiment, the second headset can simulate the first headset to upload the second voice signal to the electronic device according to the channel parameters of the Bluetooth link, without the first headset disconnecting the Bluetooth link and the second headset reconnecting to the Bluetooth link The process can make the first user and the second user do not need to wait for the process time of Bluetooth link establishment when talking.
在一个实施例中,第二耳机上可以是设置有第二麦克风和第二射频发送单元。第二麦克风用于采集第二语音信号,第二射频发送单元用于将第二语音信号上传至电子设备中。该第二射频发送单元可以是由第二耳机中的蓝牙芯片提供。In one embodiment, the second earphone may be provided with a second microphone and a second radio frequency transmitting unit. The second microphone is used to collect the second voice signal, and the second radio frequency sending unit is used to upload the second voice signal to the electronic device. The second radio frequency sending unit may be provided by a Bluetooth chip in the second earphone.
在本实施例中,当电子设备接收到第二语音信号之后,可以将第二语音信号转换为文字进行翻译,再将翻译后的文字转换为语音信号,得到第二翻译信号。In this embodiment, after the electronic device receives the second voice signal, it can convert the second voice signal into text for translation, and then convert the translated text into a voice signal to obtain the second translation signal.
进一步地,电子设备需提前设置好翻译的源语言类型为第二用户使用的第二语言,目标语言类型为使用第一耳机的第一用户能够听懂的第一语言,当检测到的第二语音信号的语音为源语言类型时,电子设备就能够将第二语言的第二语音信号翻译为第一语言的第二翻译信号。Further, the electronic device needs to set the source language type of the translation as the second language used by the second user in advance, and the target language type as the first language that the first user using the first headset can understand. When the second language is detected When the voice of the voice signal is in the source language type, the electronic device can translate the second voice signal in the second language into the second translated signal in the first language.
步骤S2300,控制第一耳机和第二耳机获取电子设备通过蓝牙链路发送的第二翻译信号。Step S2300: Control the first earphone and the second earphone to obtain the second translation signal sent by the electronic device through the Bluetooth link.
在一个例子中,控制第一耳机和第二耳机获取电子设备通过第二翻译链路发送的第二翻译信号可以包括:In an example, controlling the first earphone and the second earphone to obtain the second translation signal sent by the electronic device through the second translation link may include:
控制第一耳机通过蓝牙链路接收第二翻译信号;控制第一耳机根据信道参数监听蓝牙链路,获取第二翻译信号。具体可以参照前述的控制第一耳机和第二耳机获取电子设备通过蓝牙链路发送的第一翻译信号的描述,在此不再赘述。Control the first earphone to receive the second translation signal through the Bluetooth link; control the first earphone to monitor the Bluetooth link according to the channel parameters to obtain the second translation signal. For details, reference may be made to the aforementioned description of controlling the first earphone and the second earphone to obtain the first translation signal sent by the electronic device through the Bluetooth link, which is not repeated here.
步骤S2400,控制第一耳机和第二耳机播放第二翻译信号。Step S2400, controlling the first earphone and the second earphone to play the second translation signal.
在本发明的一个或多个实施例中,该翻译方法还可以包括:In one or more embodiments of the present invention, the translation method may further include:
在控制第一耳机播放第一翻译信号之后,控制第一耳机检测第一用户未输入第一语音信号的第一连续时长;在第一连续时长超过预设的第一时长阈值的情况下,控制第一耳机向第二耳机发送自身翻译过程结束的第一结束通知,以供第二耳机在接收到第一结束通知的情况下,获取第二用户输入的第二语音信号。After controlling the first earphone to play the first translation signal, the first earphone is controlled to detect the first continuous duration when the first user has not input the first voice signal; when the first continuous duration exceeds the preset first duration threshold, control The first earphone sends to the second earphone a first end notification indicating that the translation process has ended, so that the second earphone can obtain the second voice signal input by the second user when the first end notification is received.
具体的,第一连续时长具体可以是第一耳机在播放完第一翻译信号之后,检测到的第一用户未输入第一语音信号的连续时长。Specifically, the first continuous duration may specifically be the continuous duration of the detected first user not inputting the first voice signal after the first earphone finishes playing the first translation signal.
在本实施例中,第一耳机和第二耳机之间通过蓝牙连接,并可以通过TWS协议传输该第一结束通知。In this embodiment, the first earphone and the second earphone are connected through Bluetooth, and the first end notification can be transmitted through the TWS protocol.
该第一时长阈值可以是预先根据应用场景或具体需求预先设定,还可以根据用户实际需求进行更改。The first duration threshold may be preset according to application scenarios or specific needs, and may also be changed according to actual needs of users.
对应的,该翻译方法还可以包括:Correspondingly, the translation method may also include:
在控制第二耳机播放第二翻译信号之后,控制第二耳机检测第二用户未输入第二语音信号的第二连续时长;在第二连续时长超过预设的第二时长阈值时,控制第二耳机向第一耳机发送自身翻译过程结束的第二结束通知,以供第一耳机在接收到第二结束通知的情况下,获取第一用户输入的第一语音信号。After controlling the second earphone to play the second translation signal, control the second earphone to detect the second continuous duration when the second user does not input the second voice signal; when the second continuous duration exceeds the preset second duration threshold, control the second The earphone sends to the first earphone a second end notification indicating that the translation process is completed, so that the first earphone can obtain the first voice signal input by the first user when the second end notification is received.
具体的,第二连续时长具体可以是第二耳机在播放完第二翻译信号之后,检测到的第二用户未输入第二语音信号的连续时长。Specifically, the second continuous duration may specifically be the continuous duration of the detected second user not inputting the second voice signal after the second earphone finishes playing the second translated signal.
在本实施例中,第一耳机和第二耳机之间可以通过TWS协议传输该第二结束通知。In this embodiment, the second end notification can be transmitted between the first earphone and the second earphone through the TWS protocol.
该第二时长阈值可以是预先根据应用场景或具体需求预先设定,还可以根据用户实际需求进行更改。The second duration threshold may be preset according to application scenarios or specific needs, and may also be changed according to actual needs of users.
进一步地,第一时长阈值和第二时长阈值可以相等,也可以不相等。Further, the first duration threshold and the second duration threshold may be equal or unequal.
在本发明的一个或多个实施例中,该翻译方法还可以包括:In one or more embodiments of the present invention, the translation method may further include:
在第一耳机向第二耳机发送第一结束通知的情况下,控制第一耳机的第一麦克风和第一射频发送单元停止工作。When the first earphone sends the first end notification to the second earphone, the first microphone and the first radio frequency sending unit of the first earphone are controlled to stop working.
这样,可以降低第一耳机在未进行翻译过程中的功耗,延长第一耳机的使用时长。In this way, the power consumption of the first earphone in the process of not performing translation can be reduced, and the use time of the first earphone can be prolonged.
对应的,该翻译方法还可以包括:Correspondingly, the translation method may also include:
在第二耳机向第一耳机发送第二结束通知的情况下,控制第二耳机的第二麦克风和第二射频发送单元停止工作。When the second earphone sends the second end notification to the first earphone, the second microphone and the second radio frequency sending unit of the second earphone are controlled to stop working.
这样,可以降低第二耳机在未进行翻译过程中的功耗,延长第二耳机的使用时长。In this way, the power consumption of the second earphone in the process of not performing translation can be reduced, and the use time of the second earphone can be prolonged.
在本发明的一个或多个实施例中,该翻译方法还可以包括:In one or more embodiments of the present invention, the translation method may further include:
控制第一耳机检测用户输入第一语音信号的第一事件是否发生;Controlling the first earphone to detect whether the first event occurs when the user inputs the first voice signal;
在第一事件发生的情况下,控制第一耳机的第一麦克风和第一射频发送单元启动工作,以获取第一用户输入的第一语音信号。When the first event occurs, the first microphone of the first earphone and the first radio frequency transmitting unit are controlled to start work to obtain the first voice signal input by the first user.
该第一事件可以包括:The first event may include:
接收到第一用户输入的第一语音信号;和/或,Receiving the first voice signal input by the first user; and/or,
第一用户针对第一耳机执行的指定操作。A designated operation performed by the first user on the first headset.
在第一事件为接收到用户输入的第一语音信号的情况下,第一耳机可以是通过语音活性检测算法,来检测第一用户输入第一语音信号的第一事件是否发生。语音活性检测(Voice activity detection,VAD)也称为speech activity detection or speech detection,是一项用于语音处理的技术,目的是检测语音信号是否存在。对应的,第一耳机中可以设置有第一语音活性检测单元,用于检测第一用户输入第一语音信号的第一事件是否发生。In the case where the first event is receiving the first voice signal input by the user, the first earphone may use a voice activity detection algorithm to detect whether the first event in which the first user inputs the first voice signal occurs. Voice activity detection (Voice activity detection, VAD), also known as speech activity detection or speech detection, is a technology used for voice processing to detect whether a voice signal exists. Correspondingly, a first voice activity detection unit may be provided in the first earphone for detecting whether the first event in which the first user inputs the first voice signal occurs.
在第一事件为第一用户针对第一耳机执行的指定操作的情况下,该指定操作可以是第一用户控制第一耳机执行指定的动作、或者第一用户点击第一耳机上的指定按键。In the case where the first event is a designated operation performed by the first user on the first headset, the designated operation may be that the first user controls the first headset to perform a designated action, or the first user clicks a designated button on the first headset.
在检测到第一事件发生的情况下,表明第一用户要讲话,因此,需要控制第一耳机的第一麦克风和第一射频发送单元启动工作,保证第一耳机正常工作。When the occurrence of the first event is detected, it indicates that the first user wants to talk. Therefore, it is necessary to control the first microphone of the first earphone and the first radio frequency transmitting unit to start working to ensure that the first earphone works normally.
对应的,该翻译方法还可以包括:Correspondingly, the translation method may also include:
控制第二耳机检测用户输入第二语音信号的第二事件是否发生;Controlling the second earphone to detect whether a second event occurs when the user inputs a second voice signal;
在第二事件发生的情况下,控制第二耳机的第二麦克风和第二射频发送单元启动工作,以获取第二用户输入的第二语音信号。When the second event occurs, the second microphone of the second earphone and the second radio frequency transmitting unit are controlled to start work to obtain the second voice signal input by the second user.
其中,第二事件可以包括:Among them, the second event may include:
接收到第二用户输入的第二语音信号;和/或,Receiving a second voice signal input by a second user; and/or,
第二用户针对第二耳机执行的指定操作。A designated operation performed by the second user on the second headset.
在第二事件为接收到用户输入的第二语音信号的情况下,第二耳机可以是通过语音活性检测算法,来检测第二用户输入第二语音信号的第二事件是否发生。对应的,第二耳机 中可以设置有第二语音活性检测单元,用于检测第二用户输入第二语音信号的第二事件是否发生。In the case that the second event is receiving the second voice signal input by the user, the second earphone may use a voice activity detection algorithm to detect whether the second event in which the second user inputs the second voice signal occurs. Correspondingly, a second voice activity detection unit may be provided in the second earphone for detecting whether the second event of the second user inputting the second voice signal occurs.
在第二事件为第二用户针对第二耳机执行的指定操作的情况下,该指定操作可以是第二用户控制第二耳机执行指定的动作、或者第二用户点击第二耳机上的指定按键。In the case where the second event is a designated operation performed by the second user on the second headset, the designated operation may be that the second user controls the second headset to perform a designated action, or the second user clicks a designated button on the second headset.
在检测到第二事件发生的情况下,表明第二用户要讲话,因此,需要控制第二耳机的第二麦克风和第二射频发送单元启动工作,保证第二耳机正常工作。When the second event is detected, it indicates that the second user wants to talk. Therefore, it is necessary to control the second microphone of the second earphone and the second radio frequency transmitting unit to start working to ensure the normal operation of the second earphone.
在本发明的一个或多个实施例中,该翻译方法还可以包括:In one or more embodiments of the present invention, the translation method may further include:
在控制第一耳机的第一麦克风和第一射频发送单元启动工作的情况下,控制第一耳机发出提醒警报。When the first microphone and the first radio frequency transmitting unit of the first earphone are controlled to start working, the first earphone is controlled to send out a reminder alarm.
在本实施例中,在第一耳机的第一麦克风和第一射频发送单元启动工作的情况下,控制第一耳机发出提醒警报,可以提醒第一用户可以开始讲话,且可以通过该耳机对和电子设备翻译给第二用户。In this embodiment, when the first microphone of the first earphone and the first radio frequency transmitting unit start to work, the first earphone is controlled to send out a reminder alarm, which can remind the first user that he can start talking, and can pair and connect through the earphone. The electronic device is translated to the second user.
对应的,该翻译方法还可以包括:Correspondingly, the translation method may also include:
在控制第二耳机的第二麦克风和第一射频发送单元启动工作的情况下,控制第二耳机发出提醒警报,可以提醒第二用户可以开始讲话,且可以通过该耳机对和电子设备翻译给第一用户。When the second microphone of the second earphone and the first radio frequency transmitting unit are controlled to start working, the second earphone is controlled to send out a reminder alarm, which can remind the second user that he can start speaking, and the earphone pair and the electronic device can be translated to the first One user.
在一个例子中,提醒警报的方式例如可以是播放指定的提示音、发光或者是振动等。In an example, the way of reminding the alarm may be, for example, playing a designated prompt sound, lighting, or vibrating.
以蓝牙链路上行采用的是SCO链路为例,当需要第一耳机向电子设备通过SCO蓝牙链路发送第一语音信号时,第一耳机的第一麦克风开启,第一射频发送单元开启射频发送功能;第二耳机的第二麦克风关闭,第二射频发送单元关闭射频发送功能。第一耳机按照HFP协议,对第一麦克风采集的第一语音信号进行封装以及基带封包,向电子设备的蓝牙地址发送第一语音信号。Taking the SCO link as an example of the Bluetooth link uplink, when the first earphone is required to send the first voice signal to the electronic device through the SCO Bluetooth link, the first microphone of the first earphone is turned on, and the first radio frequency transmitting unit turns on the radio frequency Transmission function; the second microphone of the second earphone is turned off, and the second radio frequency transmitting unit turns off the radio frequency transmitting function. According to the HFP protocol, the first earphone encapsulates and baseband the first voice signal collected by the first microphone, and sends the first voice signal to the Bluetooth address of the electronic device.
当需要第二耳机向电子设备通过SCO蓝牙链路发送第二语音信号时,第二耳机的第二麦克风开启,第二射频发送单元开启射频发送功能;第一耳机的第一麦克风关闭,第一射频发送单元关闭射频发送功能。第二耳机按照相同的HFP协议,对第二麦克风采集的第二语音信号进行封装以及基带封包,向电子设备的蓝牙地址发送第二语音信号。When the second earphone is required to send a second voice signal to the electronic device through the SCO Bluetooth link, the second microphone of the second earphone is turned on, and the second radio frequency transmitting unit starts the radio frequency transmission function; the first microphone of the first earphone is turned off, and the first microphone is turned off. The radio frequency transmitting unit turns off the radio frequency transmitting function. According to the same HFP protocol, the second earphone encapsulates and baseband the second voice signal collected by the second microphone, and sends the second voice signal to the Bluetooth address of the electronic device.
上行语音信号的发送可以是由第一耳机或者是第二耳机执行的,这个过程中电子设备的HFP是始终和第一耳机的蓝牙地址保持连接(具体的,是第一耳机和第二耳机用同一个蓝牙地址和电子设备保持连接)。The transmission of the uplink voice signal can be performed by the first headset or the second headset. In this process, the HFP of the electronic device is always connected to the Bluetooth address of the first headset (specifically, the first headset and the second headset are used The same Bluetooth address and the electronic device remain connected).
这样,在翻译过程中,第一耳机和电子设备之间的蓝牙链路不需要断开再连接,而是类似于在第二耳机和电子设备之间建立一种虚拟连接的方式进行语音信号的下行和上行的 传输。从而整个过程中的链路延时非常小,从而使得真正的同声翻译在耳机对中的应用有了可能性。In this way, during the translation process, the Bluetooth link between the first headset and the electronic device does not need to be disconnected and reconnected, but is similar to establishing a virtual connection between the second headset and the electronic device for voice signal processing. Downlink and uplink transmission. As a result, the link delay in the whole process is very small, which makes the application of true simultaneous translation in headset pairs possible.
通过本实施例的翻译方法,两个不同语言的用户分别佩戴第一耳机和第二耳机,使用不同的语言进行交谈时,可以分别听到对方语音翻译成本国语言的语音,无语言障碍地进行沟通交谈。Through the translation method of this embodiment, two users of different languages wear the first earphone and the second earphone respectively, and when they talk in different languages, they can hear each other’s voice translation in the national language, without language barriers. Communicate and talk.
在本发明的一个或多个实施例中,为了保证在第二用户讲话的过程中,第一用户说话对翻译过程产生干扰,该翻译方法还可以包括:In one or more embodiments of the present invention, in order to ensure that during the speech of the second user, the speech of the first user interferes with the translation process, the translation method may further include:
在控制第一耳机获取第一用户输入的第一语音信号的情况下,控制第一耳机向第二耳机发送自身翻译过程启动的第一启动通知,以在第二耳机在接收到第一启动通知、且未接收到第一结束通知的情况下,控制第二耳机停止获取第二用户输入的第二语音信号。In the case of controlling the first earphone to obtain the first voice signal input by the first user, controlling the first earphone to send to the second earphone the first start notification that the translation process is started, so that the second earphone receives the first start notification And if the first end notification is not received, controlling the second earphone to stop acquiring the second voice signal input by the second user.
在第二耳机接收到第一启动通知、且未接收到第一结束通知的情况下,表明该耳机对和电子设备正在执行对第一语音信号的翻译过程,因此,通过控制第二耳机停止获取第二用户输入的第二语音信号,来防止语音信号间的干扰。In the case that the second earphone receives the first start notification and does not receive the first end notification, it indicates that the pair of earphones and the electronic device are performing the translation process of the first voice signal. Therefore, the second earphone is controlled to stop acquiring The second voice signal input by the second user prevents interference between voice signals.
在第二耳机接收到第一启动通知、且未接收到第一结束通知的情况下,如果第二耳机检测到第二事件发生,则可以通过发出指定提示音、发光或者是振动提醒第二用户进行等待。In the case that the second earphone receives the first start notification and does not receive the first end notification, if the second earphone detects the occurrence of the second event, it can remind the second user by emitting a designated prompt sound, light or vibration Wait.
对应的,为了保证在第一用户讲话的过程中,第二用户说话对翻译过程产生干扰,该翻译方法还可以包括:Correspondingly, in order to ensure that during the speech of the first user, the speech of the second user interferes with the translation process, the translation method may further include:
在控制第二耳机获取第二用户输入的第一语音信号的情况下,控制第二耳机向第一耳机发送自身翻译过程启动的第二启动通知,以供第一耳机在接收到第二启动通知、且未接收到第二结束通知的情况下,控制第一耳机停止获取第一用户输入的第一语音信号。In the case of controlling the second earphone to obtain the first voice signal input by the second user, controlling the second earphone to send to the first earphone a second start notification for the start of its own translation process, so that the first earphone receives the second start notification And if the second end notification is not received, controlling the first earphone to stop acquiring the first voice signal input by the first user.
在第一耳机接收到第二启动通知、且未接收到第二结束通知的情况下,表明该耳机对和电子设备正在执行对第二语音信号的翻译过程,因此,通过控制第一耳机停止获取第一用户输入的第一语音信号,来防止语音信号间的干扰。In the case that the first earphone receives the second start notification and does not receive the second end notification, it indicates that the earphone pair and the electronic device are performing the translation process of the second voice signal. Therefore, the first earphone is controlled to stop acquiring The first voice signal input by the first user prevents interference between voice signals.
在第一耳机接收到第二启动通知、且未接收到第二结束通知的情况下,如果第一耳机检测到第一事件发生,则可以通过发出指定提示音、发光或者是振动提醒第一用户进行等待。In the case that the first earphone receives the second start notification and does not receive the second end notification, if the first earphone detects the occurrence of the first event, it can remind the first user by emitting a designated prompt sound, lighting or vibrating Wait.
在本发明的一个实施例中,该翻译方法还可以包括:In an embodiment of the present invention, the translation method may further include:
在第一耳机检测到的第一用户未输入第一语音信号的第一连续时长超过预设的第三时长阈值的情况下,断开第一耳机与电子设备之间的蓝牙链路。When the first continuous duration of the first voice signal detected by the first user without inputting the first voice signal exceeds the preset third duration threshold, the Bluetooth link between the first headset and the electronic device is disconnected.
在第一耳机检测到的第一用户未输入第一语音信号的第一连续时长超过预设的第三时长阈值的情况下,可以表明翻译过程结束,因此,可以断开第一耳机与电子设备之间的蓝牙链路。In the case that the first continuous duration of the first voice signal detected by the first user not inputting the first voice signal exceeds the preset third duration threshold, it can indicate that the translation process is over, and therefore, the first headset can be disconnected from the electronic device Bluetooth link between.
<翻译系统><Translation System>
图4为用于实现本发明的翻译方法的翻译系统的示意图。Figure 4 is a schematic diagram of a translation system for implementing the translation method of the present invention.
在如图4所示的翻译系统中,第一用户A使用第一耳机M,第二用户B使用第二耳机S,第一耳机M和第二耳机S可以用于与电子设备P建立蓝牙链路。In the translation system shown in Figure 4, the first user A uses the first headset M, the second user B uses the second headset S, the first headset M and the second headset S can be used to establish a Bluetooth link with the electronic device P road.
参照图4所示,第一耳机M可以包括第一语音活性检测单元M1、第一麦克风M2、第一扬声器M3、第一射频发送单元M4、第一射频接收模块M5和第一处理单元M6。4, the first earphone M may include a first voice activity detection unit M1, a first microphone M2, a first speaker M3, a first radio frequency transmitting unit M4, a first radio frequency receiving module M5, and a first processing unit M6.
第一语音模型检测单元M1可以用于检测第一用户A输入第一语音信号的第一事件是否发生。第一麦克风M2用于获取第一用户A输入的第一语音信号。第一处理单元M6用于按照对应的协议对第一语音信号进行封装,得到对应的数据包。第一射频发送单元M4用于将第一处理单元M6得到的数据包发送至电子设备P。第一射频接收单元M5用于接收电子设备P发送的数据包。第一处理单元M6还用于对接收到的数据包进行解析,得到第一翻译信号。第一扬声器M3用于播放第一翻译信号。第一处理单元M6还可以用于在第一语音模型检测单元M1检测到第一事件发生的情况下,控制第一麦克风M2和第一射频发送单元M4启动工作;在检测到第一用户A未输入第一语音信号的连续时长超过预设的时长阈值的情况下,控制第一麦克风M2和第一射频发送单元M4停止工作。The first voice model detection unit M1 may be used to detect whether the first event in which the first user A inputs the first voice signal occurs. The first microphone M2 is used to obtain the first voice signal input by the first user A. The first processing unit M6 is configured to encapsulate the first voice signal according to the corresponding protocol to obtain the corresponding data packet. The first radio frequency sending unit M4 is configured to send the data packet obtained by the first processing unit M6 to the electronic device P. The first radio frequency receiving unit M5 is used for receiving data packets sent by the electronic device P. The first processing unit M6 is also used to analyze the received data packet to obtain the first translated signal. The first speaker M3 is used to play the first translation signal. The first processing unit M6 may also be used to control the first microphone M2 and the first radio frequency transmitting unit M4 to start work when the first voice model detection unit M1 detects that the first event occurs; when the first user A is not detected When the continuous duration of the input first voice signal exceeds the preset duration threshold, the first microphone M2 and the first radio frequency sending unit M4 are controlled to stop working.
第二语音模型检测单元S1可以用于检测第二用户B输入第二语音信号的第二事件是否发生。第二麦克风S2用于获取第二用户B输入的第二语音信号。第二处理单元S6用于按照对应的协议对第二语音信号进行封装,得到对应的数据包。第二射频发送单元S4用于将第二处理单元S6得到的数据包发送至电子设备P。第二射频接收单元S5用于接收电子设备P发送的数据包。第二处理单元S6还用于对接收到的数据包进行解析,得到第二翻译信号。第二扬声器S3用于播放第二翻译信号。第二处理单元S6还可以用于在第二语音模型检测单元S1检测到第二事件发生的情况下,控制第二麦克风S2和第二射频发送单元S4启动工作;在检测到第二用户B未输入第二语音信号的连续时长超过预设的时长阈值的情况下,控制第二麦克风S2和第二射频发送单元S4停止工作。The second voice model detection unit S1 may be used to detect whether the second event in which the second user B inputs the second voice signal occurs. The second microphone S2 is used to acquire the second voice signal input by the second user B. The second processing unit S6 is configured to encapsulate the second voice signal according to the corresponding protocol to obtain the corresponding data packet. The second radio frequency sending unit S4 is configured to send the data packet obtained by the second processing unit S6 to the electronic device P. The second radio frequency receiving unit S5 is used for receiving data packets sent by the electronic device P. The second processing unit S6 is also used to analyze the received data packet to obtain a second translated signal. The second speaker S3 is used for playing the second translation signal. The second processing unit S6 may also be used to control the second microphone S2 and the second radio frequency transmitting unit S4 to start working when the second voice model detection unit S1 detects that the second event occurs; when the second user B is not detected When the continuous duration of the input of the second voice signal exceeds the preset duration threshold, the second microphone S2 and the second radio frequency sending unit S4 are controlled to stop working.
本实施例中,参照图4所示,电子设备P可以包括处理器1100、存储器1200、接口装置1300、通信装置1400、显示装置1500、输入装置1600、扬声器1700、麦克风1800等等。In this embodiment, as shown in FIG. 4, the electronic device P may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and so on.
处理器1100可以是移动版处理器。存储器1200例如包括ROM(只读存储器)、RAM(随机存取存储器)、诸如硬盘的非易失性存储器等。接口装置1300例如包括USB接口、耳机接口等。通信装置1400例如能够进行有线或无线通信,通信装置1400可以包括蓝牙 装置,用于通过蓝牙协议与第一耳机M或第二耳机S进行蓝牙通信。显示装置1500例如是液晶显示屏、触摸显示屏等。输入装置1600例如可以包括触摸屏、键盘等。用户可以通过扬声器1700和麦克风1800输入/输出语音信息。The processor 1100 may be a mobile version processor. The memory 1200 includes, for example, ROM (Read Only Memory), RAM (Random Access Memory), non-volatile memory such as a hard disk, and the like. The interface device 1300 includes, for example, a USB interface, a headphone interface, and the like. The communication device 1400 can perform wired or wireless communication, for example. The communication device 1400 may include a Bluetooth device for performing Bluetooth communication with the first earphone M or the second earphone S through the Bluetooth protocol. The display device 1500 is, for example, a liquid crystal display, a touch display, or the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. The user can input/output voice information through the speaker 1700 and the microphone 1800.
尽管在图4中示出了电子设备P的多个装置,但是,本发明可以仅涉及其中的部分装置,例如,电子设备P只涉及存储器1200和处理器1100和通信装置1400。Although multiple devices of the electronic device P are shown in FIG. 4, the present invention may only involve some of the devices. For example, the electronic device P only involves the memory 1200, the processor 1100, and the communication device 1400.
<例子1><Example 1>
下面以一个具体的例子来说明本发明实施例的翻译方法实施的过程。该例子1以图4所示的翻译系统为例,对本实施例的翻译方法进行描述。The following takes a specific example to illustrate the implementation process of the translation method in the embodiment of the present invention. This example 1 uses the translation system shown in FIG. 4 as an example to describe the translation method of this embodiment.
该翻译方法可以包括如图2所示的步骤S2001~S2015:The translation method may include steps S2001 to S2015 as shown in Fig. 2:
步骤S2001,第一耳机M与电子设备P建立蓝牙链路。Step S2001, the first earphone M and the electronic device P establish a Bluetooth link.
步骤S2002,第一耳机M检测第一用户A输入第一语音信号的第一事件是否发生。In step S2002, the first earphone M detects whether the first event in which the first user A inputs the first voice signal occurs.
步骤S2003,第一用户A使用第一耳机M输入第一语音信号。In step S2003, the first user A uses the first earphone M to input a first voice signal.
步骤S2004,第一耳机M在检测到第一用户A输入第一语音信号的第一事件发生的情况下,检测第二耳机S的翻译过程是否结束。In step S2004, the first earphone M detects whether the translation process of the second earphone S is finished when the first event occurs when the first user A inputs the first voice signal.
在第一耳机M接收到第二耳机S发送的第二结束通知的情况下,确定第二耳机S的翻译过程结束。In the case that the first earphone M receives the second end notification sent by the second earphone S, it is determined that the translation process of the second earphone S is ended.
步骤S2005,第一耳机M在检测到第二耳机S的翻译过程结束的情况下,控制第一麦克风和第一射频发送单元启动,并发出提醒警报,以提醒使用第一用户A可以输入第一语音信号,与使用第二耳机S的第二用户B进行交谈。In step S2005, when the first earphone M detects that the translation process of the second earphone S is finished, it controls the first microphone and the first radio frequency transmitting unit to start, and sends out a reminder alarm to remind the first user A to input the first Voice signal to talk with the second user B using the second earphone S.
步骤S2006,第一耳机M向第二耳机S发送第一启动通知和蓝牙链路的信道参数。In step S2006, the first earphone M sends the first start notification and the channel parameters of the Bluetooth link to the second earphone S.
步骤S2007,第一耳机M获取第一用户A输入的第一语音信号,并通过蓝牙链路将第一语音信号上传至电子设备P。In step S2007, the first earphone M obtains the first voice signal input by the first user A, and uploads the first voice signal to the electronic device P through the Bluetooth link.
步骤S2008,电子设备P对第一语音信号进行翻译处理得到第一翻译信号。In step S2008, the electronic device P performs translation processing on the first voice signal to obtain the first translated signal.
步骤S2009,电子设备P通过蓝牙链路发送第一翻译信号。In step S2009, the electronic device P sends the first translation signal through the Bluetooth link.
步骤S2010,第一耳机M通过蓝牙链路接收第一翻译信号。In step S2010, the first earphone M receives the first translation signal through the Bluetooth link.
步骤S2011,第二耳机S根据信道参数监听蓝牙链路,获取第一翻译信号。In step S2011, the second earphone S monitors the Bluetooth link according to the channel parameters to obtain the first translated signal.
步骤S2012,第一耳机M播放第一翻译信号。Step S2012, the first earphone M plays the first translation signal.
步骤S2013,第二耳机S播放第一翻译信号。In step S2013, the second earphone S plays the first translation signal.
步骤S2014,第一耳机M检测第一用户A未输入第一语音信号的第一连续时长。In step S2014, the first earphone M detects the first continuous duration during which the first user A has not input the first voice signal.
步骤S2015,第一耳机M在第一连续时长超过预设的第一时长阈值的情况下,向第二耳机发送第一结束通知,以通知第二耳机自身的翻译过程结束。In step S2015, when the first continuous duration exceeds the preset first duration threshold, the first earphone M sends a first end notification to the second earphone to notify that the translation process of the second earphone itself is over.
步骤S2016,第一耳机M在第一连续时长超过预设的第三时长阈值的情况下,,断开与电子设备P之间的蓝牙链路。In step S2016, when the first continuous duration exceeds the preset third duration threshold, the first headset M disconnects the Bluetooth link with the electronic device P.
<例子2><Example 2>
在以上例子1基础上,该翻译方法还可以包括如图3所示的步骤S3001~S3015:On the basis of the above example 1, the translation method may also include steps S3001 to S3015 as shown in Fig. 3:
步骤S3001,第二耳机S检测第二用户B输入第二语音信号的第二事件是否发生。In step S3001, the second earphone S detects whether a second event occurs when the second user B inputs a second voice signal.
步骤S3002,第二用户B使用第二耳机S输入第二语音信号。In step S3002, the second user B uses the second earphone S to input a second voice signal.
步骤S3003,第二耳机S在检测到第二用户B输入第二语音信号的第二事件发生的情况下,检测第一耳机M的翻译过程是否结束。In step S3003, the second earphone S detects whether the translation process of the first earphone M is finished when the second event occurs when the second user B inputs the second voice signal.
在第二耳机S接收到第一耳机M发送的第一结束通知的情况下,确定第一耳机M的翻译过程结束。When the second earphone S receives the first end notification sent by the first earphone M, it is determined that the translation process of the first earphone M is finished.
步骤S3004,第二耳机S在检测到第一耳机M的翻译过程结束的情况下,控制第二麦克风和第二射频发送单元启动,并发出提醒警报,以提醒使用第二用户B可以输入第二语音信号,与使用第一耳机M的第一用户A进行交谈。In step S3004, when the second earphone S detects that the translation process of the first earphone M is finished, it controls the second microphone and the second radio frequency transmitting unit to start, and sends out a reminder alarm to remind the second user B to input the second Voice signal to talk with the first user A using the first earphone M.
步骤S3005,第二耳机S向第一耳机M发送第二启动通知。In step S3005, the second earphone S sends a second start notification to the first earphone M.
步骤S3006,第二耳机S获取第二用户B输入的第二语音信号,并根据信道参数,将第二语音信号上传至电子设备P。Step S3006: The second earphone S obtains the second voice signal input by the second user B, and uploads the second voice signal to the electronic device P according to the channel parameters.
步骤S3007,电子设备P对第二语音信号进行翻译处理得到第二翻译信号。In step S3007, the electronic device P performs translation processing on the second speech signal to obtain a second translated signal.
步骤S3008,电子设备P通过蓝牙链路发送第二翻译信号。Step S3008: The electronic device P sends the second translation signal through the Bluetooth link.
步骤S3009,第一耳机M通过蓝牙链路接收第二翻译信号。In step S3009, the first earphone M receives the second translation signal through the Bluetooth link.
步骤S3010,第二耳机S根据信道参数监听蓝牙链路,获取第二翻译信号。Step S3010: The second earphone S monitors the Bluetooth link according to the channel parameters, and obtains the second translated signal.
步骤S3011,第二耳机S播放第二翻译信号。Step S3011, the second earphone S plays the second translation signal.
步骤S3012,第一耳机M播放第二翻译信号。Step S3012, the first earphone M plays the second translation signal.
步骤S3013,第二耳机S检测第二用户B未输入第二语音信号的第二连续时长。In step S3013, the second earphone S detects the second continuous duration during which the second user B has not input the second voice signal.
步骤S3014,第二耳机S在第二连续时长超过预设的第二时长阈值的情况下,向第一耳机发送第一结束通知,以通知第一耳机自身的翻译过程结束。In step S3014, when the second continuous duration exceeds the preset second duration threshold, the second headset S sends a first end notification to the first headset to notify the end of the translation process of the first headset itself.
<装置实施例><Device Example>
在本实施例中,提供一种用于耳机对的翻译装置5000,其中,该耳机对包括对应的第一耳机和第二耳机,该耳机对用于与电子设备建立蓝牙链路。In this embodiment, a translation apparatus 5000 for a pair of earphones is provided, wherein the pair of earphones includes a corresponding first earphone and a second earphone, and the earphone pair is used to establish a Bluetooth link with an electronic device.
如图5所示,翻译装置5000包括第一链路建立模块5100、第一语音上传模块5200、第一翻译获取模块5300和第一信号播放模块5400,该第一链路建立模块5100用于控制第一耳机与电子设备建立蓝牙链路;该第一语音上传模块5200用于控制第一耳机获取用户输入的第一语音信号,并通过蓝牙链路将第一语音信号上传至电子设备,以供电子设备对第一语音信号进行翻译处理得到第一翻译信号;该第一翻译获取模块5300用于控制第一耳机和第二耳机获取电子设备通过蓝牙链路发送的第一翻译信号;该第一信号播放模块5400用于控制第一耳机和第二耳机播放第一翻译信号。As shown in FIG. 5, the translation device 5000 includes a first link establishment module 5100, a first voice upload module 5200, a first translation acquisition module 5300, and a first signal playback module 5400. The first link establishment module 5100 is used to control The first earphone establishes a Bluetooth link with the electronic device; the first voice upload module 5200 is used to control the first earphone to obtain the first voice signal input by the user, and upload the first voice signal to the electronic device through the Bluetooth link for The electronic device performs translation processing on the first voice signal to obtain the first translation signal; the first translation acquisition module 5300 is used to control the first earphone and the second earphone to acquire the first translation signal sent by the electronic device through the Bluetooth link; The signal playing module 5400 is used to control the first earphone and the second earphone to play the first translation signal.
在本发明的一个或多个实施例中,如图6所示,该翻译装置5000还可以包括:信道参数获取模块6100、第二语音上传模块6200、第二翻译获取模块6300和第二信号播放模块6400。该信道参数获取模块6100用于控制第二耳机获取蓝牙链路的信道参数;该第二语音上传模块6200用于控制第二耳机获取第二用户输入的第二语音信号,并根据信道参数,将第二语音信号上传至电子设备,以供电子设备对第二语音信号进行翻译处理得到第二翻译信号;该第二翻译获取模块6300用于控制第一耳机和第二耳机获取电子设备通过蓝牙链路发送的第二翻译信号;该第二信号播放模块6400用于控制第一耳机和第二耳机播放第二翻译信号。In one or more embodiments of the present invention, as shown in FIG. 6, the translation device 5000 may further include: a channel parameter acquisition module 6100, a second voice upload module 6200, a second translation acquisition module 6300, and a second signal player Module 6400. The channel parameter acquisition module 6100 is used to control the second headset to acquire the channel parameters of the Bluetooth link; the second voice upload module 6200 is used to control the second headset to acquire the second voice signal input by the second user, and according to the channel parameters, The second voice signal is uploaded to the electronic device for the electronic device to perform translation processing on the second voice signal to obtain the second translation signal; the second translation acquisition module 6300 is used to control the first earphone and the second earphone to acquire the electronic device through the Bluetooth link The second signal playing module 6400 is used to control the first earphone and the second earphone to play the second translation signal.
在本发明的一个或多个实施例中,第一翻译获取模块5300还可以用于:控制第一耳机通过蓝牙链路接收第一翻译信号;控制第二耳机根据信道参数监听蓝牙链路,获取第一翻译信号。第二翻译获取模块6300还可以用于:控制第一耳机通过蓝牙链路接收第二翻译信号;控制第二耳机根据信道参数监听蓝牙链路,获取第二翻译信号。In one or more embodiments of the present invention, the first translation acquisition module 5300 may also be used to: control the first earphone to receive the first translation signal through the Bluetooth link; control the second earphone to monitor the Bluetooth link according to the channel parameters to obtain The first translation signal. The second translation acquisition module 6300 may also be used to: control the first earphone to receive the second translation signal through the Bluetooth link; control the second earphone to monitor the Bluetooth link according to the channel parameters to obtain the second translation signal.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在控制第一耳机播放第一翻译信号之后,控制第一耳机检测第一用户未输入第一语音信号的第一连续时长的模块;A module for controlling the first earphone to detect the first continuous duration of the first voice signal not input by the first user after controlling the first earphone to play the first translation signal;
用于在第一连续时长超过预设的第一时长阈值时,控制第一耳机向第二耳机发送自身翻译过程结束的第一结束通知,以供第二耳机在接收到第一结束通知的情况下,获取第二用户输入的第二语音信号的模块。Used to control the first earphone to send the first end notification of the end of its own translation process to the second earphone when the first continuous time length exceeds the preset first time length threshold, for the second earphone to receive the first end notification Next, a module for acquiring the second voice signal input by the second user.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在控制第二耳机播放第二翻译信号之后,控制第二耳机检测第二用户未输入第二语音信号的第二连续时长的模块;A module for controlling the second earphone to detect the second continuous duration of the second user not inputting the second voice signal after controlling the second earphone to play the second translation signal;
用于在第二连续时长超过预设的第二时长阈值时,控制第二耳机向第一耳机发送自身翻译过程结束的第二结束通知,以供第一耳机在接收到第二结束通知的情况下,获取第一用户输入的第一语音信号的模块。Used to control the second earphone to send a second end notification of the end of its own translation process to the first earphone when the second continuous time length exceeds the preset second time length threshold, so that the first earphone receives the second end notification Next, a module for acquiring the first voice signal input by the first user.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在第一耳机向第二耳机发送第一结束通知的情况下,控制第一耳机的第一麦克风和第一射频发送单元停止工作的模块。A module for controlling the first microphone of the first earphone and the first radio frequency sending unit to stop working when the first earphone sends the first end notification to the second earphone.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在第二耳机向第一耳机发送第二结束通知的情况下,控制第二耳机的第二麦克风和第二射频发送单元停止工作的模块。A module for controlling the second microphone of the second earphone and the second radio frequency sending unit to stop working when the second earphone sends the second end notification to the first earphone.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于控制第一耳机检测用户输入第一语音信号的第一事件是否发生的模块;A module for controlling the first earphone to detect whether the first event occurs when the user inputs the first voice signal;
用于在第一事件发生的情况下,控制第一耳机的第一麦克风和第一射频发送单元启动工作,以获取第一用户输入的第一语音信号的模块。A module used to control the first microphone of the first earphone and the first radio frequency transmitting unit to start work when the first event occurs, so as to obtain the first voice signal input by the first user.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于控制第二耳机检测用户输入第二语音信号的第二事件是否发生的模块;A module for controlling the second earphone to detect whether a second event occurs when the user inputs a second voice signal;
用于在第二事件发生的情况下,控制第二耳机的第二麦克风和第二射频发送单元启动工作,以获取第二用户输入的第二语音信号的模块。A module for controlling the second microphone of the second earphone and the second radio frequency transmitting unit to start work in the case of a second event, so as to obtain the second voice signal input by the second user.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在控制第一耳机的第一麦克风和第一射频发送单元启动工作的情况下,控制第一耳机发出提醒警报的模块。A module for controlling the first earphone to send out a reminder alarm when the first microphone and the first radio frequency transmitting unit of the first earphone are controlled to start working.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在控制第二耳机的第二麦克风和第二射频发送单元启动工作的情况下,控制第二耳机发出提醒警报的模块。A module for controlling the second earphone to send out a reminder alarm when the second microphone and the second radio frequency transmitting unit of the second earphone are controlled to start working.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在控制第一耳机获取第一用户输入的第一语音信号的情况下,控制第一耳机向第二耳机发送自身翻译过程启动的第一启动通知,以在第二耳机在接收到第一启动通知、且未接收到第一结束通知的情况下,控制第二耳机停止获取第二用户输入的第二语音信号的模块。Used for controlling the first earphone to obtain the first voice signal input by the first user, and controlling the first earphone to send to the second earphone the first start notification that the translation process is started, so that when the second earphone receives the first voice signal When the notification is started and the first end notification is not received, the module that controls the second earphone to stop acquiring the second voice signal input by the second user.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在控制第二耳机获取第二用户输入的第二语音信号的情况下,控制第二耳机向第一耳机发送自身翻译过程启动的第二启动通知,以在第一耳机在接收到第二启动通知、且未接收到第二结束通知的情况下,控制第一耳机停止获取第一用户输入的第一语音信号的模块。It is used to control the second earphone to send the second start notification of the start of the translation process to the first earphone in the case of controlling the second earphone to obtain the second voice signal input by the second user, so that the When the notification is started and the second end notification is not received, the module that controls the first earphone to stop acquiring the first voice signal input by the first user.
在本发明的一个或多个实施例中,该翻译装置5000还可以包括:In one or more embodiments of the present invention, the translation device 5000 may further include:
用于在第一用户未输入第一语音信号的第一连续时长超过预设的第三时长阈值时,断开第一耳机与电子设备之间的蓝牙链路的模块。A module for disconnecting the Bluetooth link between the first earphone and the electronic device when the first continuous duration when the first user does not input the first voice signal exceeds the preset third duration threshold.
在本发明的一个或多个实施例中,该蓝牙链路为SCO同步链路或者ACL异步链路或者BLE链路。In one or more embodiments of the present invention, the Bluetooth link is a SCO synchronous link or an ACL asynchronous link or a BLE link.
本领域技术人员应当明白,可以通过各种方式来实现用于耳机对的翻译装置5000。例如,可以通过指令配置处理器来实现用于耳机对的翻译装置5000。例如,可以将指令存储在ROM中,并且当启动设备时,将指令从ROM读取到可编程器件中来实现用于耳机对的翻译装置5000。例如,可以将用于耳机对的翻译装置5000固化到专用器件(例如ASIC)中。可以将用于耳机对的翻译装置5000分成相互独立的单元,或者可以将它们合并在一起实现。用于耳机对的翻译装置5000可以通过上述各种实现方式中的一种来实现,或者可以通过上述各种实现方式中的两种或更多种方式的组合来实现。Those skilled in the art should understand that the translation device 5000 for a pair of earphones can be implemented in various ways. For example, the translation device 5000 for a pair of earphones can be implemented by configuring the processor through instructions. For example, the instructions can be stored in the ROM, and when the device is started, the instructions are read from the ROM into the programmable device to implement the translation apparatus 5000 for the earphone pair. For example, the translation device 5000 for a pair of earphones can be solidified into a dedicated device (for example, ASIC). The translation device 5000 for the earphone pair can be divided into mutually independent units, or they can be combined together for implementation. The translation apparatus 5000 for a pair of earphones may be implemented by one of the foregoing various implementation manners, or may be implemented by a combination of two or more of the foregoing various implementation manners.
在本实施例中,用于耳机对的翻译装置5000可以具有多种实现形式,例如,用于耳机对的翻译装置5000可以是任何的提供网络访问服务的软件产品或者应用程序中运行的功能模块,或者是这些软件产品或者应用程序的外设嵌入件、插件、补丁件等,还可以是这些软件产品或者应用程序本身。In this embodiment, the translation device 5000 for the earphone pair may have multiple implementation forms. For example, the translation device 5000 for the earphone pair may be any software product or functional module running in an application that provides network access services. , Or peripheral embedded parts, plug-ins, patches, etc. of these software products or applications, or these software products or applications themselves.
<耳机对><headphone pair>
在本实施例中,还提供一种耳机对7000,该耳机对7000包括对应的第一耳机和第二耳机,且第一耳机和/或第二耳机可以通过蓝牙与电子设备建立对应的蓝牙链路。In this embodiment, a pair of earphones 7000 is also provided. The pair of earphones 7000 includes a corresponding first earphone and a second earphone, and the first earphone and/or the second earphone can establish a corresponding Bluetooth link with the electronic device via Bluetooth. road.
在一个实施例中,该耳机对7000可以包括根据本发明任意实施例的用于耳机对的翻译装置5000,用于实施本发明任意实施例的用于耳机对的翻译方法。In one embodiment, the earphone pair 7000 may include the translation device 5000 for the earphone pair according to any embodiment of the present invention, for implementing the translation method for the earphone pair according to any embodiment of the present invention.
在另一个实施例中,如图7所示,耳机对7000还可以包括处理器7100和存储器7200,该存储器7200用于存储可执行的指令;该处理器7100用于根据指令的控制运行耳机对7000执行根据本发明任意实施例的用于耳机对的翻译方法。In another embodiment, as shown in FIG. 7, the earphone pair 7000 may further include a processor 7100 and a memory 7200. The memory 7200 is used to store executable instructions; the processor 7100 is used to run the earphone pair under the control of the instructions. 7000 executes the translation method for earphone pair according to any embodiment of the present invention.
<翻译系统><Translation System>
在本实施例中,还提供一种翻译系统,该翻译系统包括电子设备和前述任意实施例的耳机对。该耳机对用于执行本发明任意实施例的用于耳机对的翻译方法。In this embodiment, a translation system is also provided. The translation system includes an electronic device and the headset pair of any of the foregoing embodiments. The earphone pair is used to execute the translation method for the earphone pair according to any embodiment of the present invention.
该电子设备用于:与耳机对的第一耳机建立蓝牙链路,通过蓝牙链路接收第一耳机上传的第一语音信号,并对第一语音信号进行翻译处理,得到第一翻译信号,并将第一翻译信号通过蓝牙链路发送至第一耳机。The electronic device is used to establish a Bluetooth link with the first earphone of the earphone pair, receive the first voice signal uploaded by the first earphone through the Bluetooth link, and perform translation processing on the first voice signal to obtain the first translation signal, and The first translation signal is sent to the first headset through the Bluetooth link.
上述各实施例主要重点描述与其他实施例的不同之处,但本领域技术人员应当清楚的是,上述各实施例可以根据需要单独使用或者相互结合使用。The foregoing embodiments mainly focus on the differences from other embodiments, but it should be clear to those skilled in the art that the foregoing embodiments can be used individually or in combination with each other as required.
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分相互参见即可,每个实施例重点说明的都是与其他实施例的不同之处,但本领域技术人员应当清楚的是,上述各实施例可以根据需要单独使用或者相互结合使用。另外,对于装置实施例而言,由于其是与方法实施例相对应,所以描述得比较简单,相关之处参见方法实施例的对应部分的说明即可。以上所描述的系统实施例仅仅是示意性的,其中作为分离部件说明的模块可以是或者也可以不是物理上分开的。The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. It should be clear to the skilled person that the above embodiments can be used alone or in combination with each other as required. In addition, as for the device embodiment, since it corresponds to the method embodiment, the description is relatively simple, and for related parts, please refer to the description of the corresponding part of the method embodiment. The system embodiments described above are merely illustrative, and the modules described as separate components may or may not be physically separated.
本发明可以是装置、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质,其上载有用于使处理器实现本发明的各个方面的计算机可读程序指令。The present invention may be a device, a method and/or a computer program product. The computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present invention.
计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是――但不限于――电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身,诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如,通过光纤电缆的光脉冲)、或者通过电线传输的电信号。The computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (non-exhaustive list) include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, such as a printer with instructions stored thereon The protruding structure in the hole card or the groove, and any suitable combination of the above. The computer-readable storage medium used here is not interpreted as a transient signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.
这里所描述的计算机可读程序指令可以从计算机可读存储介质下载到各个计算/处理设备,或者通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令,并转发该计算机可读程序指令,以供存储在各个计算/处理设备中的计算机可读存储介质中。The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .
用于执行本发明操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码,所述编程语言包括面向对象的编程语言—诸如Smalltalk、C++等,以及常规的过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个 独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中,通过利用计算机可读程序指令的状态信息来个性化定制电子电路,例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA),该电子电路可以执行计算机可读程序指令,从而实现本发明的各个方面。The computer program instructions used to perform the operations of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or in one or more programming languages. Source code or object code written in any combination, the programming language includes object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages. Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server carried out. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to access the Internet connection). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions. The computer-readable program instructions are executed to implement various aspects of the present invention.
这里参照根据本发明实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本发明的各个方面。应当理解,流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合,都可以由计算机可读程序指令实现。Here, various aspects of the present invention are described with reference to flowcharts and/or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present invention. It should be understood that each block of the flowcharts and/or block diagrams and combinations of blocks in the flowcharts and/or block diagrams can be implemented by computer-readable program instructions.
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其它可编程数据处理装置的处理器,从而生产出一种机器,使得这些指令在通过计算机或其它可编程数据处理装置的处理器执行时,产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中,这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作,从而,存储有指令的计算机可读介质则包括一个制造品,其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine such that when these instructions are executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowchart and/or block diagram is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner, so that the computer-readable medium storing instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowchart and/or block diagram.
也可以把计算机可读程序指令加载到计算机、其它可编程数据处理装置、或其它设备上,使得在计算机、其它可编程数据处理装置或其它设备上执行一系列操作步骤,以产生计算机实现的过程,从而使得在计算机、其它可编程数据处理装置、或其它设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。It is also possible to load computer-readable program instructions onto a computer, other programmable data processing device, or other equipment, so that a series of operation steps are executed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , So that the instructions executed on the computer, other programmable data processing apparatus, or other equipment realize the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.
附图中的流程图和框图显示了根据本发明的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分,所述模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。对于本领域技术人员来说公知的是,通过硬件方式实现、通过软件方式实现以及通过软件和硬件结合的方式实现都是等价的。The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to multiple embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more functions for implementing the specified logical function. Executable instructions. In some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent.
以上已经描述了本发明的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术的技术改进,或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。本发明的范围由所附权利要求来限定。The various embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Without departing from the scope and spirit of the described embodiments, many modifications and changes are obvious to those of ordinary skill in the art. The choice of terms used herein is intended to best explain the principles, practical applications, or technical improvements of the technologies in the market, or to enable other ordinary skilled in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims (13)

  1. 一种用于耳机对的翻译方法,其特征在于,所述耳机对包括对应的第一耳机和第二耳机,所述耳机对用于与电子设备建立蓝牙链路;所述翻译方法包括:A translation method for a pair of earphones, characterized in that the pair of earphones includes a corresponding first earphone and a second earphone, and the earphone pair is used to establish a Bluetooth link with an electronic device; the translation method includes:
    控制所述第一耳机与所述电子设备建立蓝牙链路;Controlling the first earphone to establish a Bluetooth link with the electronic device;
    控制所述第一耳机获取第一用户输入的第一语音信号,并通过所述蓝牙链路将所述第一语音信号上传至所述电子设备,以供所述电子设备对所述第一语音信号进行翻译处理得到第一翻译信号;Control the first earphone to obtain the first voice signal input by the first user, and upload the first voice signal to the electronic device through the Bluetooth link, so that the electronic device can respond to the first voice signal Translating the signal to obtain the first translated signal;
    控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述第一翻译信号;Controlling the first earphone and the second earphone to obtain the first translation signal sent by the electronic device through the Bluetooth link;
    控制所述第一耳机和所述第二耳机播放所述第一翻译信号。Controlling the first earphone and the second earphone to play the first translation signal.
  2. 根据权利要求1所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 1, wherein the translation method further comprises:
    控制所述第二耳机获取所述蓝牙链路的信道参数;Controlling the second earphone to obtain the channel parameters of the Bluetooth link;
    控制所述第二耳机获取第二用户输入的第二语音信号,并根据所述信道参数,将所述第二语音信号上传至所述电子设备,以供所述电子设备对所述第二语音信号进行翻译处理得到第二翻译信号;Control the second earphone to obtain the second voice signal input by the second user, and upload the second voice signal to the electronic device according to the channel parameters, so that the electronic device can respond to the second voice The signal is translated and processed to obtain a second translated signal;
    控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述第二翻译信号;Controlling the first earphone and the second earphone to obtain the second translation signal sent by the electronic device through the Bluetooth link;
    控制所述第一耳机和所述第二耳机播放所述第二翻译信号。Controlling the first earphone and the second earphone to play the second translation signal.
  3. 根据权利要求2所述的翻译方法,其特征在于,所述控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述翻译信号包括:The translation method according to claim 2, wherein the controlling the first earphone and the second earphone to obtain the translation signal sent by the electronic device through the Bluetooth link comprises:
    控制所述第一耳机通过所述蓝牙链路接收所述翻译信号;其中,所述翻译信号为所述第一翻译信号或所述第二翻译信号;Controlling the first earphone to receive the translation signal through the Bluetooth link; wherein the translation signal is the first translation signal or the second translation signal;
    控制所述第二耳机根据所述信道参数监听所述蓝牙链路,获取所述翻译信号。Control the second earphone to monitor the Bluetooth link according to the channel parameter, and obtain the translation signal.
  4. 根据权利要求2所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 2, wherein the translation method further comprises:
    在控制所述第一耳机播放所述第一翻译信号之后,控制所述第一耳机检测所述第一用户未输入所述第一语音信号的第一连续时长;After controlling the first earphone to play the first translation signal, controlling the first earphone to detect the first continuous duration during which the first user has not input the first voice signal;
    在所述第一连续时长超过预设的第一时长阈值时,控制所述第一耳机向所述第二耳机发送自身翻译过程结束的第一结束通知,以供所述第二耳机在接收到所述第一结束通知的情况下,获取所述第二用户输入的所述第二语音信号。When the first continuous duration exceeds the preset first duration threshold, the first headset is controlled to send a first end notification that the translation process is completed to the second headset, so that the second headset can receive In the case of the first end notification, the second voice signal input by the second user is acquired.
  5. 根据权利要求4所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 4, wherein the translation method further comprises:
    在所述第一耳机向所述第二耳机发送所述第一结束通知的情况下,控制所述第一耳机的第一麦克风和第一射频发送单元停止工作。In the case that the first earphone sends the first end notification to the second earphone, the first microphone and the first radio frequency sending unit of the first earphone are controlled to stop working.
  6. 根据权利要求5所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 5, wherein the translation method further comprises:
    控制所述第一耳机检测用户输入第一语音信号的第一事件是否发生;Controlling the first earphone to detect whether a first event occurs when a user inputs a first voice signal;
    在所述第一事件发生的情况下,控制所述第一耳机的第一麦克风和第一射频发送单元启动工作,以获取所述第一用户输入的所述第一语音信号。When the first event occurs, control the first microphone of the first earphone and the first radio frequency sending unit to start work to obtain the first voice signal input by the first user.
  7. 根据权利要求6所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 6, wherein the translation method further comprises:
    在控制所述第一耳机的第一麦克风和第一射频发送单元启动工作的情况下,控制所述第一耳机发出提醒警报。When the first microphone and the first radio frequency transmitting unit of the first earphone are controlled to start working, the first earphone is controlled to issue a reminder alarm.
  8. 根据权利要求4所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 4, wherein the translation method further comprises:
    在控制所述第一耳机获取第一用户输入的第一语音信号的情况下,控制所述第一耳机向所述第二耳机发送自身翻译过程启动的第一启动通知,以在所述第二耳机在接收到所述第一启动通知、且未接收到所述第一结束通知的情况下,控制所述第二耳机停止获取所述第二用户输入的所述第二语音信号。In the case that the first earphone is controlled to obtain the first voice signal input by the first user, the first earphone is controlled to send to the second earphone the first start notification of the start of its own translation process, so that the When the earphone receives the first start notification but does not receive the first end notification, the earphone is controlled to stop acquiring the second voice signal input by the second user.
  9. 根据权利要求1所述的翻译方法,其特征在于,所述翻译方法还包括:The translation method according to claim 1, wherein the translation method further comprises:
    通过所述第一耳机检测用户未输入所述第一语音信号的连续时长;Detecting, by the first earphone, the continuous duration during which the user has not input the first voice signal;
    在所述连续时长超过预设的第三时长阈值时,断开所述第一耳机与所述电子设备之间的所述蓝牙链路。When the continuous duration exceeds a preset third duration threshold, disconnect the Bluetooth link between the first earphone and the electronic device.
  10. 根据权利要求1所述的翻译方法,其特征在于,所述蓝牙链路为SCO同步链路或者ACL异步链路或者BLE链路。The translation method according to claim 1, wherein the Bluetooth link is a SCO synchronous link, an ACL asynchronous link, or a BLE link.
  11. 一种用于耳机对的翻译装置,其特征在于,所述耳机对包括对应的第一耳机和第二耳机,所述耳机对用于与电子设备建立蓝牙链路;所述翻译装置包括:A translation device for a pair of earphones, characterized in that the pair of earphones includes a corresponding first earphone and a second earphone, the pair of earphones is used to establish a Bluetooth link with an electronic device; the translation device includes:
    第一链路建立模块,用于控制所述第一耳机与所述电子设备建立蓝牙链路;A first link establishment module, configured to control the first headset to establish a Bluetooth link with the electronic device;
    第一语音上传模块,用于控制所述第一耳机获取用户输入的第一语音信号,并通过所述蓝牙链路将所述第一语音信号上传至所述电子设备,以供所述电子设备对所述第一语音信号进行翻译处理得到第一翻译信号;The first voice uploading module is used to control the first earphone to obtain the first voice signal input by the user, and upload the first voice signal to the electronic device through the Bluetooth link for the electronic device Performing translation processing on the first speech signal to obtain a first translated signal;
    第一翻译获取模块,用于控制所述第一耳机和所述第二耳机获取所述电子设备通过所述蓝牙链路发送的所述第一翻译信号;A first translation acquisition module, configured to control the first earphone and the second earphone to acquire the first translation signal sent by the electronic device through the Bluetooth link;
    第一信号播放模块,用于控制所述第一耳机和所述第二耳机播放所述第一翻译信号。The first signal playing module is used to control the first earphone and the second earphone to play the first translation signal.
  12. 一种耳机对,其特征在于,所述耳机对包括:An earphone pair, characterized in that the earphone pair includes:
    根据权利要求11所述的翻译装置;或者,The translation device according to claim 11; or,
    处理器和存储器,所述存储器用于存储指令,所述指令用于控制所述处理器执行根据权利要求1至10中任一项所述的翻译方法。A processor and a memory, where the memory is used to store instructions, and the instructions are used to control the processor to execute the translation method according to any one of claims 1 to 10.
  13. 一种翻译系统,其特征在于,包括电子设备、及根据权利要求12所述的耳机对;其中,所述电子设备用于与所述耳机对的第一耳机建立蓝牙链路,通过所述蓝牙链路接收所述第一耳机上传的第一语音信号,并对所述第一语音信号进行翻译处理,得到第一翻译信号,并将所述第一翻译信号通过所述蓝牙链路发送至所述第一耳机。A translation system, characterized by comprising an electronic device and the earphone pair according to claim 12; wherein, the electronic device is used to establish a Bluetooth link with the first earphone of the earphone pair through the Bluetooth The link receives the first voice signal uploaded by the first earphone, and performs translation processing on the first voice signal to obtain a first translation signal, and sends the first translation signal to the station through the Bluetooth link Mentioned first headset.
PCT/CN2019/107897 2019-08-22 2019-09-25 Translation method and device for earphone pair, earphone pair and translation system WO2021031290A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910780680.6A CN110602675A (en) 2019-08-22 2019-08-22 Earphone pair translation method and device, earphone pair and translation system
CN201910780680.6 2019-08-22

Publications (1)

Publication Number Publication Date
WO2021031290A1 true WO2021031290A1 (en) 2021-02-25

Family

ID=68855210

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/107897 WO2021031290A1 (en) 2019-08-22 2019-09-25 Translation method and device for earphone pair, earphone pair and translation system

Country Status (2)

Country Link
CN (1) CN110602675A (en)
WO (1) WO2021031290A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314814A (en) * 2020-01-19 2020-06-19 湖南国声声学科技股份有限公司 TWS Bluetooth headset-based translation method, mobile terminal, TWS Bluetooth headset and storage medium
CN111556476B (en) * 2020-04-17 2021-01-19 炬力(珠海)微电子有限公司 Data transmission method between Bluetooth TWS (two way communication) devices and Bluetooth TWS devices
CN111526440B (en) * 2020-04-27 2022-03-01 歌尔科技有限公司 Method, device and medium for switching master ear and slave ear of TWS earphone in call scene
CN111696552B (en) * 2020-06-05 2023-09-22 北京搜狗科技发展有限公司 Translation method, translation device and earphone
CN111696554B (en) * 2020-06-05 2022-04-26 北京搜狗科技发展有限公司 Translation method and device, earphone and earphone storage device
CN112446223A (en) * 2020-11-23 2021-03-05 维沃移动通信有限公司 Translation method and device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106851450A (en) * 2016-12-26 2017-06-13 歌尔科技有限公司 A kind of wireless headset pair and electronic equipment
CN107885731A (en) * 2017-11-06 2018-04-06 深圳市沃特沃德股份有限公司 Voice translation method and device
CN107894881A (en) * 2017-10-18 2018-04-10 恒玄科技(上海)有限公司 The method that principal and subordinate link switching, conversation monitoring and the Mike of bluetooth earphone switch
CN109543198A (en) * 2018-11-29 2019-03-29 与德科技有限公司 Interpretation method, device, system and storage medium
EP3474156A1 (en) * 2017-10-20 2019-04-24 Tap Sound System Real-time voice processing

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10602397B2 (en) * 2016-09-21 2020-03-24 Apple Inc. Real-time relay of wireless communications
US10517111B2 (en) * 2016-09-21 2019-12-24 Apple Inc. Mitigating scheduling conflicts in wireless communication devices
CN109151789B (en) * 2018-09-30 2021-08-17 Oppo广东移动通信有限公司 Translation method, device and system and Bluetooth headset
CN110046358A (en) * 2019-03-11 2019-07-23 厦门盈趣科技股份有限公司 A kind of wireless blue tooth translation earphone based on TWS technology

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106851450A (en) * 2016-12-26 2017-06-13 歌尔科技有限公司 A kind of wireless headset pair and electronic equipment
CN107894881A (en) * 2017-10-18 2018-04-10 恒玄科技(上海)有限公司 The method that principal and subordinate link switching, conversation monitoring and the Mike of bluetooth earphone switch
EP3474156A1 (en) * 2017-10-20 2019-04-24 Tap Sound System Real-time voice processing
CN107885731A (en) * 2017-11-06 2018-04-06 深圳市沃特沃德股份有限公司 Voice translation method and device
CN109543198A (en) * 2018-11-29 2019-03-29 与德科技有限公司 Interpretation method, device, system and storage medium

Also Published As

Publication number Publication date
CN110602675A (en) 2019-12-20

Similar Documents

Publication Publication Date Title
WO2021031290A1 (en) Translation method and device for earphone pair, earphone pair and translation system
US10803880B2 (en) Method, device, and system for audio data processing
US10602321B2 (en) Audio systems and methods
US9973561B2 (en) Conferencing based on portable multifunction devices
US10225510B2 (en) Providing a log of events to an isolated user
CN105556955B (en) Video conversation apparatus and video calling processing method
TWI593270B (en) System and method for efficiently mixing voip data
US11032675B2 (en) Electronic accessory incorporating dynamic user-controlled audio muting capabilities, related methods and communications terminal
JP2015515643A (en) Instant communication speech recognition method and terminal
CN105493177A (en) Preserving privacy of a conversation from surrounding environment
US20170195817A1 (en) Simultaneous Binaural Presentation of Multiple Audio Streams
WO2017161724A1 (en) Voice processing method and device, and terminal
Lopez et al. Development and technical validation of the mobile based assistive listening system: a smartphone-based remote microphone
US9906927B2 (en) Multi-modality communication initiation
US9363358B2 (en) Wireless Bluetooth apparatus with intercom and broadcasting functions and operating method thereof
US20230035128A1 (en) Concurrent streaming of content to multiple devices
US20110216915A1 (en) Providing audible information to a speaker system via a mobile communication device
US10678499B1 (en) Audio interface device and audio interface system
US20120146790A1 (en) Method and apparatus for generating a subliminal alert
US11573761B2 (en) Audio-based near field communication
Lesner et al. Apps with amps: Mobile devices, hearing assistive technology, and older adults
CN105306656B (en) Call message leaving method, apparatus and system
WO2018010432A1 (en) Sound code tag-based configuration method, device and storage medium
Ito et al. A Study on Effect of IP Performance Degradation on Horizontal Sound Localization in a VoIP Phone Service with 3D Sound Effects
Albrecht et al. Continuous mobile communication with acoustic co-location detection

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19942487

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19942487

Country of ref document: EP

Kind code of ref document: A1