WO2020078332A1 - 一种基于语音通话翻译能力的协商方法及电子设备 - Google Patents
一种基于语音通话翻译能力的协商方法及电子设备 Download PDFInfo
- Publication number
- WO2020078332A1 WO2020078332A1 PCT/CN2019/111124 CN2019111124W WO2020078332A1 WO 2020078332 A1 WO2020078332 A1 WO 2020078332A1 CN 2019111124 W CN2019111124 W CN 2019111124W WO 2020078332 A1 WO2020078332 A1 WO 2020078332A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- voice
- voice call
- translation
- user
- Prior art date
Links
- 238000013519 translation Methods 0.000 title claims abstract description 592
- 238000000034 method Methods 0.000 title claims abstract description 82
- 238000004891 communication Methods 0.000 claims abstract description 83
- 230000006870 function Effects 0.000 claims description 315
- 230000004044 response Effects 0.000 claims description 40
- 238000004590 computer program Methods 0.000 claims description 15
- 230000014616 translation Effects 0.000 description 537
- 238000010295 mobile communication Methods 0.000 description 28
- 238000012545 processing Methods 0.000 description 18
- 238000013461 design Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 17
- 238000007726 management method Methods 0.000 description 15
- 230000005236 sound signal Effects 0.000 description 9
- 230000003993 interaction Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 229920001621 AMOLED Polymers 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000003862 health status Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000415 inactivating effect Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000008093 supporting effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/30—Devices which can set up and transmit only one digit at a time
- H04M1/50—Devices which can set up and transmit only one digit at a time by generating or selecting currents of predetermined frequencies or combinations of frequencies
- H04M1/505—Devices which can set up and transmit only one digit at a time by generating or selecting currents of predetermined frequencies or combinations of frequencies signals generated in digital form
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/64—Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations
- H04M1/65—Recording arrangements for recording a message from the calling party
- H04M1/6505—Recording arrangements for recording a message from the calling party storing speech in digital form
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/64—Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations
- H04M1/65—Recording arrangements for recording a message from the calling party
- H04M1/658—Means for redirecting recorded messages to other extensions or equipment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. short messaging services [SMS] or e-mails
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
- H04M2201/40—Electronic components, circuits, software, systems or apparatus used in telephone systems using speech recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2242/00—Special services or facilities
- H04M2242/12—Language recognition, selection or translation arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/58—Details of telephonic subscriber devices including a multilanguage function
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/74—Details of telephonic subscriber devices with voice recognition means
Definitions
- This application relates to the technical field of terminals, and in particular, to a negotiation method and electronic equipment based on voice call translation capabilities.
- the present application provides a negotiation method and electronic device based on the voice call translation capability, which helps to reduce the possibility of errors in the electronic device during the voice call, thereby improving the efficiency of the user using the electronic device to call.
- a negotiation method based on voice call translation capabilities includes:
- the first electronic device After the first electronic device establishes a communication link with the second electronic device, if the voice call translation function is turned on, it receives first indication information sent by the second electronic device, and the first indication information is used to indicate The voice call translation function of the second electronic device is turned on; when the voice call translation function is turned on, the first electronic device is used to obtain the translation result of the voice collected by the first electronic device through the microphone and obtain the reception The translation result of the voice sent by the second electronic device, and sending the translation result of the voice collected through the microphone to the second electronic device; the voice communication translation function of the second electronic device is turned on Is used to obtain the translation result of the voice collected by the second electronic device through the microphone, and to obtain the received translation result of the voice sent by the first electronic device, and to translate the translation result of the voice collected by the microphone Sent to the first electronic device; and in response to the first indication information, the first electronic Equipment automatically shut down a voice call translation.
- the embodiment of the present application may be able to enable only one party's voice call translation function when both the first electronic device and the second electronic device support dual-end voice translation after the communication link is established, thereby helping to reduce the first electronic
- the possibility of repeating the translation of the voice call may cause errors, which helps to improve the efficiency of the user using the electronic device to call.
- the first indication information is the first character sent in a dual-tone multi-frequency DTMF tone. Helps simplify implementation.
- the first electronic device after automatically turning off the voice call translation function, the first electronic device sends second indication information to the second electronic device, where the second indication information is used to instruct the first electronic device Voice call translation is turned off. Therefore, it helps the first electronic device to know whether the voice call translation function of the second electronic device is turned on or off.
- the first electronic device displays first prompt information on a display screen, and the first prompt information is used to prompt a user that the voice call translation function of the second electronic device is turned on; and / or The first electronic device prompts the user by broadcasting a voice that the voice call translation function of the second electronic device has been turned on. Help to improve the interaction between electronic devices and users.
- the first electronic device after the first electronic device automatically turns off the voice call translation function, the first electronic device prohibits the user from turning on the voice call translation function. This helps reduce the possibility of user misuse.
- a second prompt message is displayed on the display screen, and the second prompt message is used to prompt the user to prohibit the voice call translation function from
- the restriction on the user to enable the voice call translation function is cancelled; and / or, the first electronic device prohibits the user from turning on the voice by broadcasting a voice prompt A call translation function, and after the voice call function of the second electronic device is turned off or the communication link is disconnected, the restriction on the user's opening of the voice call translation function is cancelled.
- another negotiation method based on voice call translation capabilities includes:
- the first electronic device After the first electronic device establishes a communication link with the second electronic device, if the voice call translation function is turned on, it receives first indication information sent by the second electronic device, and the first indication information is used to indicate The voice call translation function of the second electronic device is turned on; when the voice call translation function is turned on, the first electronic device is used to obtain the translation result of the voice collected by the first electronic device through the microphone and obtain the received The translation result of the voice sent by the second electronic device, and sending the translation result of the voice collected through the microphone to the second electronic device; when the voice call translation function is turned on For acquiring the translation result of the voice collected by the second electronic device through the microphone, and obtaining the received translation result of the voice sent by the first electronic device, and sending the translation result of the voice collected by the microphone To the first electronic device; sent by the first electronic device to the second electronic device Two indication information, the second indication information indicating that the voice call off the second electronic device translation.
- the embodiment of the present application may be able to enable only one party's voice call translation function when both the first electronic device and the second electronic device support dual-end voice translation after the communication link is established, thereby helping to reduce the first electronic The equipment is well equipped.
- both the second electronic device and the voice call translation function are enabled, the possibility of repeating the translation of the voice call and causing an error will help to improve the efficiency of the user's use of the electronic device to communicate.
- the first indication information is the first character sent in a dual-tone multi-frequency DTMF tone. Helps simplify implementation.
- the third indication information sent by the second electronic device is received, and the third indication information is used to Indicating that the voice call translation function of the second electronic device has been turned off. Therefore, it is helpful for the first electronic device to know whether the voice call translation function of the second electronic device is turned on or off.
- the first electronic device after the voice communication translation function is turned off, the first electronic device sends fourth instruction information to the second electronic device, where the fourth instruction information is used to instruct the voice communication translation of the first electronic device
- the function is turned off. It is helpful to enable the second electronic device to turn on the local voice call translation function when the first electronic device voice call translation function is turned off during the voice call, thereby improving the efficiency of the voice call.
- a negotiation method based on voice call translation capabilities includes:
- the voice call translation function of the electronic device After the first electronic device establishes a communication link with the second electronic device, if the voice call translation function is turned on, it receives first indication information sent by the second electronic device, and the first indication information is used to indicate the first Second, the voice call translation function of the electronic device is turned on; when the voice call translation function is turned on, the first electronic device is used to obtain the translation result of the voice collected by the first electronic device through the microphone, and the The translation result of the collected voice is sent to the second electronic device; when the voice call translation function is turned on, the second electronic device is used to obtain the translation result of the voice collected by the second electronic device through the microphone, and Sending the translation result of the voice collected through the microphone to the first electronic device; after receiving the first indication information, the first electronic device turns off the voice broadcast mode and turns on the text display mode; the first When the voice broadcast mode is turned off and the text display mode is turned on, the electronic device does not broadcast the second The translation result of the voice collected by the sub-device through the microphone, and the text showing
- the translation result of the voice may be prohibited from being broadcast, and the text of the voice translation result may be displayed to always prompt the other party to express the meaning. Therefore, it helps to reduce the possibility of causing the translation result of the voice collected by the microphone of the electronic device to be translated during the voice broadcast, thereby helping to improve the performance of the electronic device.
- the first electronic device when the voice call translation function is turned on, the first electronic device is also used to send the voice collected through the microphone to the second electronic device; the second electronic device When the voice call translation function is turned on, it is also used to send the voice collected through the microphone to the first electronic device.
- the method when the first electronic device has been turned off in the voice broadcast mode, the method further includes not broadcasting the voice collected by the microphone sent by the second electronic device. Help to further improve the performance of electronic devices.
- an electronic device provided by an embodiment of the present application includes: one or more processors, memory, multiple application programs, and one or more computer programs; wherein, one or more computer programs are stored in In the memory, when the computer program is executed by the electronic device, the foregoing aspects of the embodiments of the present application and any possible design methods involved in the various aspects are implemented.
- a chip provided in an embodiment of the present application is coupled to a memory in an electronic device, so that the chip calls a computer program stored in the memory when the chip is running to implement the above aspects of the embodiment of the present application And any possible design method involved in various aspects.
- a computer storage medium stores a computer program, and when the computer program runs on an electronic device, the electronic device causes the electronic device to perform the foregoing aspects and aspects of the embodiment of the present application Any possible design method involved.
- a computer program product when the computer program product runs on an electronic device, causes the electronic device to perform the above-mentioned various aspects of the embodiment of the present application and any possibility involved in the various aspects Design method.
- FIG. 1 is a schematic diagram of a hardware architecture of an electronic device according to an embodiment of this application.
- FIG. 2 is a schematic diagram of a communication system architecture according to an embodiment of the present application.
- FIG. 3 is a schematic flowchart of a negotiation method based on voice call translation capabilities according to an embodiment of the present application
- 4a is a schematic diagram of an application scenario of an embodiment of this application.
- 4b is a schematic diagram of an application scenario of a voice call translation function according to an embodiment of the present application.
- FIG. 5a is a schematic diagram of prompting a voice call translation function according to an embodiment of the present application.
- 5b is a schematic diagram of another prompt to restrict the voice call translation function according to an embodiment of the present application.
- FIG. 6 is a schematic diagram of a system language setting according to an embodiment of this application.
- FIG. 7 is a schematic diagram of a peer language setting according to an embodiment of this application.
- FIG. 8 is a schematic diagram of a peer language list according to an embodiment of this application.
- FIG. 9 is a schematic flowchart of another negotiation method based on voice call translation capabilities according to an embodiment of the present application.
- FIG. 10 is a schematic diagram of a user interface according to an embodiment of this application.
- 11 is a schematic flowchart of another negotiation method based on voice call translation capabilities according to an embodiment of the present application.
- FIG. 12 is a schematic diagram of another user interface according to an embodiment of the present application.
- 13A is a schematic flowchart of another negotiation method based on voice call translation capabilities according to an embodiment of the present application.
- 13B is a schematic flowchart of another negotiation method based on voice call translation capabilities according to an embodiment of the present application.
- FIG. 14 is a schematic diagram of another user interface according to an embodiment of the present application.
- 15 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
- 16 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
- At least one refers to one or more, and “multiple” refers to two or more than two.
- “And / or” describes the relationship of the related objects, indicating that there can be three relationships.
- a and / or B can represent the following three relationships: A exists alone, A and B exist simultaneously, and B exists alone.
- a and B can be singular or plural.
- the character “/” generally indicates that the related object is a "or” relationship.
- At least one (item) of the following” or similar expressions refer to any combination of these items, including any combination of a single item (s) or a plurality of items (s).
- At least one (a) of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c It can be single or multiple.
- the electronic device may be a portable electronic device, such as a mobile phone, a tablet computer, a wearable device with a wireless communication function (such as a smart watch), an in-vehicle device, and the like.
- portable electronic devices include, but are not limited to Or portable electronic devices of other operating systems.
- the above-mentioned portable electronic device may also be, for example, a laptop computer having a touch-sensitive surface (for example, a touch panel).
- the electronic device 100 may also be a desktop computer with a touch-sensitive surface (such as a touch panel).
- FIG. 1 shows a schematic diagram of a hardware structure of an electronic device to which an embodiment of the present application is applicable.
- the electronic device includes a processor 110, an internal memory 121, an external memory interface 122, an antenna 1, a mobile communication module 131, an antenna 2, a wireless communication module 132, an audio module 140, a speaker 140A, and a receiver 140B, Microphone 140C, headset interface 140D, display screen 151, subscriber identification module (SIM) card interface 152, camera 153, button 154, sensor module 160, universal serial bus (USB) interface 170, charging Management module 180, power management module 181, and battery 182.
- the electronic device may further include a motor, an indicator, and the like.
- the processor 110 may include one or more processing units.
- the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (ISP), a controller, and a video Codec, digital signal processor (DSP), baseband processor, and / or neural-network processor (NPU), etc.
- application processor application processor
- AP application processor
- modem processor graphics processor
- ISP image signal processor
- controller a controller
- video Codec video Codec
- DSP digital signal processor
- NPU neural-network processor
- a memory may also be provided in the processor 110 for storing instructions and data.
- the memory in the processor 110 may be a cache memory.
- the memory may be used to store instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Therefore, it helps to avoid repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
- the internal memory 121 may be used to store computer executable program code.
- the executable program code includes instructions.
- the processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the electronic device.
- the internal memory 121 may include a storage program area and a storage data area.
- the storage program area may store an operating system, at least one function required application programs (such as sound playback function, image playback function, etc.).
- the storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device.
- the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and so on.
- a non-volatile memory such as at least one disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and so on.
- the external memory interface 122 may be used to connect an external memory card (for example, a Micro SD card) to achieve expansion of the storage capacity of the electronic device.
- the external memory card communicates with the processor 110 through the external memory interface 122 to realize the data storage function. For example, save music, video and other files in an external memory card.
- Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.
- Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
- the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
- the mobile communication module 131 can provide a wireless communication solution including 2G / 3G / 4G / 5G and the like applied to electronic devices.
- the mobile communication module 131 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and so on.
- the mobile communication module 131 can receive the electromagnetic wave signal from the antenna 1 and filter, amplify, etc. the received electromagnetic wave signal, and transmit it to the modem processor for demodulation.
- the mobile communication module 131 can also amplify the signal modulated by the modulation and demodulation processor and convert it into an electromagnetic wave signal through the antenna 1 to radiate it out.
- at least part of the functional modules of the mobile communication module 131 may be provided in the processor 110.
- At least part of the functional modules of the mobile communication module 131 and at least part of the modules of the processor 110 may be provided in the same device.
- the mobile communication module 131 may send voice to other electronic devices, and may also receive voice sent by other electronic devices.
- the modem processor may include a modulator and a demodulator.
- the modulator is used to modulate the low-frequency baseband signal to be transmitted into a high-frequency signal.
- the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
- the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
- the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
- the application processor outputs a sound signal through an audio device (not limited to a speaker 140A, a receiver 140B, etc.), or displays an image or video through a display screen 151.
- the modem processor may be an independent device.
- the modem processor may be independent of the processor 110, and may be set in the same device as the mobile communication module 131 or other functional modules.
- the wireless communication module 132 can provide wireless local area networks (wireless local area networks, WLAN) (such as Wi-Fi networks), Bluetooth (bluetooth, BT), and global navigation satellite systems (GNSS) that are applied to electronic devices. , Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR) and other wireless communication solutions.
- the wireless communication module 132 may be one or more devices integrating at least one communication processing module.
- the wireless communication module 132 receives the electromagnetic wave signal via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and sends the processed signal to the processor 110.
- the wireless communication module 132 can also receive the signal to be transmitted from the processor 110, perform frequency modulation and amplification on it, and convert it to an electromagnetic wave signal via the antenna 2 to radiate it out.
- the antenna 1 of the electronic device and the mobile communication module 131 are coupled, and the antenna 2 and the wireless communication module 132 are coupled so that the electronic device can communicate with the network and other devices through wireless communication technology.
- the wireless communication technology may include a global mobile communication system (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Wideband code division multiple access (WCDMA), time division code division multiple access (time-division code division multiple access (TD-SCDMA), long-term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and / or IR technology, etc.
- GSM global system for mobile communications
- general packet radio service general packet radio service
- GPRS general packet radio service
- code division multiple access code division multiple access
- WCDMA broadband Wideband code division multiple access
- time division code division multiple access time-division code division multiple access
- LTE long-term evolution
- BT GNSS
- WLAN N
- the GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation system (BDS), and a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and / or satellite-based augmentation system (SBAS).
- GPS global positioning system
- GLONASS global navigation satellite system
- BDS beidou navigation system
- QZSS quasi-zenith satellite system
- SBAS satellite-based augmentation system
- the electronic device can realize the audio function through the audio module 140, the speaker 140A, the receiver 140B, the microphone 140C, the headphone interface 140D, and the application processor. For example, music playback, recording, etc.
- the audio module 140 can be used to convert digital audio information into an analog audio signal output and also to convert analog audio input into a digital audio signal.
- the audio module 140 may also be used to encode and decode audio signals.
- the audio module 140 may be disposed in the processor 110, or some functional modules of the audio module 140 may be disposed in the processor 110.
- the speaker 140A also called “speaker” is used to convert audio electrical signals into sound signals.
- the electronic device can listen to music through the speaker 140A or answer a hands-free call.
- the receiver 140B also known as "handset" is used to convert audio electrical signals into sound signals.
- the voice can be received by holding the receiver 140B close to the ear.
- the microphone 140C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
- the microphone 140C can be used to collect the user's voice, and then convert the user's voice into an electrical signal.
- the electronic device may be provided with at least one microphone 140C. In other embodiments, the electronic device may be provided with two microphones 140C. In addition to collecting sound signals, it may also implement a noise reduction function. In other embodiments, the electronic device may also be provided with three, four, or more microphones 140C, to achieve sound signal collection, noise reduction, and also to identify the sound source, to achieve the directional recording function, and so on.
- the headset interface 140D is used to connect wired headsets.
- the earphone interface 140D may be a USB interface 130, or a 3.5mm open mobile electronic device platform (OMTP) standard interface, the American Telecommunications Industry Association (cellular telecommunications industry association of the USA, CTIA) standard interface, etc. .
- OMTP open mobile electronic device platform
- CTIA cellular telecommunications industry association of the USA, CTIA
- the electronic device can realize the display function through the GPU, the display screen 151, and the application processor.
- the GPU is a microprocessor for image processing, and connects the display screen 151 and the application processor.
- the GPU is used to perform mathematical and geometric calculations, and is used for graphics rendering.
- the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
- the display screen 151 can be used to display images, videos, and the like.
- the display screen 151 may include a display panel.
- the display panel may use a liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active matrix organic light-emitting diode (active-matrix organic light) emitting diodes (AMOLED), flexible light-emitting diodes (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (QLED), etc.
- the electronic device may include 1 or N display screens 151, where N is a positive integer greater than 1.
- the electronic device can realize the shooting function through an ISP, a camera 153, a video codec, a GPU, a display screen 151, an application processor, and the like.
- the ISP can be used to process the data fed back by the camera 153. For example, when taking a picture, the shutter is opened, and the optical signal is collected by the camera 153, and then the camera 153 converts the collected optical signal into an electrical signal, and transmits the electrical signal to an ISP for processing, which is converted into an image visible to the naked eye.
- ISP can also optimize the algorithm of image noise, brightness and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be set in the camera 193.
- the camera 153 may be used to capture still images or video.
- the camera 153 includes a lens and an image sensor.
- the object generates an optical image through the lens and projects it onto the graphic sensor.
- the image sensor may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
- CCD charge coupled device
- CMOS complementary metal-oxide-semiconductor
- the image sensor converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
- the ISP outputs the digital image signal to the DSP for processing.
- DSP converts digital image signals into standard RGB, YUV and other image signals.
- the electronic device may include 1 or N cameras 153, where N is a positive integer greater than 1.
- the key 154 may include a power-on key, a volume key, and the like.
- the key 154 may be a mechanical key. It can also be a touch button.
- the electronic device can receive key input and generate key signal input related to user settings and function control of the electronic device.
- the sensor module 160 may include one or more sensors.
- the sensor module 160 may further include an environment sensor, a distance sensor, a proximity light sensor, a bone conduction sensor, and the like.
- the touch sensor 160A may also be referred to as a “touch panel”.
- the touch sensor 160A may be provided on the display screen 151, and the touch sensor 160A and the display screen 151 constitute a touch screen, also called a "touch screen”.
- the touch sensor 160A is used to detect a touch operation acting on or near it.
- the touch sensor 160A may pass the detected touch operation to the application processor to determine the type of touch event.
- the visual output related to the touch operation can be provided through the display screen 151.
- the touch sensor 160A may also be disposed on the surface of the electronic device, which is different from the location where the display screen 151 is located.
- the fingerprint sensor 160 may be used to collect fingerprints. Electronic devices can use the collected fingerprint features to unlock fingerprints, access application locks, take photos with fingerprints, and answer incoming calls with fingerprints.
- the gyro sensor 160C may be used to determine the movement posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (ie, x, y, and z axes) may be determined by the gyro sensor 160C.
- the gyro sensor 160C can be used for shooting anti-shake. Exemplarily, when the shutter is pressed, the gyro sensor 160C detects the jitter angle of the electronic device, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the jitter of the electronic device through reverse movement to achieve anti-shake.
- the gyro sensor 160C can also be used for navigation and somatosensory game scenes.
- the pressure sensor 160D is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
- the pressure sensor 160D may be provided on the display screen 151.
- the capacitive pressure sensor may be a parallel plate including at least two conductive materials. When force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device determines the strength of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device may also calculate the touched position based on the detection signal of the pressure sensor 180A.
- touch operations that act on the same touch position but have different touch operation intensities may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
- the acceleration sensor 160E can detect the acceleration of the electronic device in various directions (generally three axes). When the electronic device is stationary, the magnitude and direction of gravity can be detected. It can also be used for recognizing the posture of electronic devices, and used in applications such as horizontal and vertical screen switching and pedometers.
- the processor 110 may also include one or more interfaces.
- the interface may be a SIM card interface 152.
- the interface may also be a USB interface 170.
- the interface may also be an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit integrated audio (inter-integrated circuit, sound, I2S) interface, a pulse code modulation (pulse code modulation (PCM) interface, a universal asynchronous transceiver transmission (Universal asynchronous receiver / transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input / output (GPIO) interface, etc.
- I2C integrated circuit
- I2S integrated circuit integrated audio
- PCM pulse code modulation
- UART universal asynchronous transceiver transmission
- mobile industry processor interface mobile industry processor interface
- MIPI mobile industry processor interface
- GPIO general-purpose input / output
- the processor 110 may be connected to different modules of the electronic device through the interface, thereby enabling the electronic device to implement different functions. For example, taking pictures and processing. It should be noted that the embodiment of the present application does not limit the connection mode of the interface in the electronic device.
- the SIM card interface 152 may be used to connect the SIM card.
- the SIM card can be inserted into or removed from the SIM card interface 152 to achieve contact and separation with the electronic device.
- the electronic device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
- the SIM card interface 152 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple SIM cards can be inserted into the same SIM card interface 152 at the same time. The types of the multiple cards may be the same or different.
- the SIM card interface 152 can also be compatible with different types of SIM cards.
- the SIM card interface 152 can also be compatible with external memory cards.
- the electronic device interacts with the network through the SIM card to realize functions such as call and data communication.
- the electronic device uses eSIM, that is, an embedded SIM card.
- the eSIM card can be embedded in the electronic device and cannot be separated from the electronic device.
- the USB interface 170 is an interface conforming to the USB standard specification.
- the USB interface 170 may include a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.
- the USB interface 170 can be used to connect a charger to charge an electronic device, and can also be used to transfer data between the electronic device and a peripheral device. It can also be used to connect headphones and play audio through the headphones.
- the USB interface 170 can also be used to connect with other electronic devices, such as augmented reality (AR) devices.
- AR augmented reality
- the charging management module 180 is used to receive charging input from the charger.
- the charger can be a wireless charger or a wired charger.
- the charging management module 180 may receive the charging input of the wired charger through the USB interface 170.
- the charging management module 180 may receive wireless charging input through the wireless charging coil of the electronic device. While the charging management module 140 charges the battery 182, it can also supply power to the electronic device through the power management module 181.
- the power management module 181 is used to connect the battery 182, the charging management module 180 and the processor 110.
- the power management module 181 receives input from the battery 182 and / or the charging management module 180, and supplies power to the processor 110, internal memory 121, external memory, display screen 151, camera 153, mobile communication module 131, wireless communication module 132, and the like.
- the power management module 181 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
- the power management module 181 may also be disposed in the processor 110.
- the power management module 181 and the charging management module 180 may also be set in the same device.
- FIG. 1 is only an example.
- the electronic device of the embodiment of the present application may have more or less components than shown in the figure, may combine two or more components, or may have different component configurations.
- the various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
- the communication system architecture shown in FIG. 2 includes an electronic device 100, an electronic device 200, and a mobile communication network.
- the electronic device 100 and the electronic device 200 can communicate through a mobile communication network.
- the mobile communication network may be a second generation mobile communication (2nd-generation, 2G) network, or a third generation mobile communication (3rd-generation, 3G) network, or a fourth generation mobile communication (4th-generation, 4G) ) Network, you can also the fifth-generation mobile communication (5th-generation, 5G) network, etc.
- the hardware structure of the electronic device 100 and / or the electronic device 200 refer to the hardware structure of the electronic device shown in FIG. It should also be noted that the architecture of the communication system shown in FIG. 2 is only a schematic diagram, and does not limit the number of electronic devices in the communication system shown in FIG. 2.
- user A uses electronic device 100 and user B uses electronic device 200.
- user A uses language 1 and user B uses language 2
- user A and user B are talking, in order to make user B understand user A
- the voice of user A can be translated into language 2.
- the voice of user B can be translated into language 1.
- At least one of the electronic device 100 and the electronic device 200 can implement dual-end voice translation, that is, one electronic device performs a translation function to translate the local voice and the opposite voice.
- the electronic device 100 can acquire the translation result of the voice of the user A after collecting the voice of the user A during the conversation between the user A and the user B.
- the translation result of the voice of the user A uses the language 2.
- the electronic device 100 transmits the obtained translation result of the voice of the user A to the electronic device 200 through the mobile communication network, so that the electronic device 200 can directly play the voice of the language 2 to the user B.
- the electronic device 100 may also send the voice of the user A to the electronic device 200.
- the electronic device 200 can send the collected user B's voice to the electronic device 100 through the mobile communication network. After receiving the user device's voice sent by the electronic device 200, the electronic device 100 can obtain the translation result of the user B's voice.
- User B The translation result of the speech is language 1, which is then broadcast to user A, which helps user A and user B to communicate without language.
- the electronic device 100 may also send the translation result of the voice of the user B to the electronic device 200. Take language 1 as Chinese and language 2 as English as an example.
- the voice of user A collected by the electronic device 100 is “I am Lucy, do you need any help?”
- the translation result of the voice of user A obtained is "This is Lucy speaking, may I help you?"
- To the electronic device 200 so that the electronic device 200 plays the voice of "This is Lucy speaking, may help you?"
- To the user B so that the user B can understand the meaning expressed by user A without understanding Chinese.
- the electronic device 200 After collecting the voice "I want to buy ticket” of user B, the electronic device 200 sends the voice "I want to buy ticket” of user B to the electronic device 100 through the mobile communication network.
- the electronic device 100 After receiving the voice of "I want to buy ticket” sent by the electronic device 200, the electronic device 100 obtains the translation result of the voice of the user B "I want to buy a ticket” and replaces "I want to buy a ticket” Is played to user A, so that user A can understand the meaning of user B without understanding English.
- the electronic device 100 may also send the voice of the user A to the electronic device 200 through the mobile communication network, so that the electronic device 200 can play the voice of the user A.
- the electronic device 100 can also send the translation result of the voice of the user B to the electronic device 200 through the mobile communication network, so that the electronic device 200 can also play the translation result of the voice of the user B .
- the electronic device 100 may also play the voice of the user B to the user A.
- the electronic device performs the translation function, which may be the language translation of the electronic device itself, or the electronic device communicates with the translation server and the translation server performs the translation.
- a translation engine may be pre-configured in the electronic device 100 to translate the voice of user A and the voice of user B through the translation engine.
- the communication system architecture shown in FIG. 2 may further include a translation server, and the electronic device 100 may also convert the voice of user A and / or user B.
- the translation server After being sent to the translation server, the translation server translates the voice of the user A and / or the voice of the user B, and returns the translation result to the electronic device 100.
- the number of translation servers included in the structure of the communication system is not limited.
- the translation server for translating the voice of user A and the translation server for translating the voice of user B may be the same or different. Understandably, the electronic device and the translation server may communicate through a mobile communication network, or may communicate through a WiFi network or other network. Understandably, the translation result may be in audio format. There are no restrictions on how to obtain translation results in this application.
- the electronic device when the electronic device can realize dual-end voice translation, one of the electronic devices used by the two parties during the call can support the voice call translation function. However, during the actual call, the electronic devices used by both parties may simultaneously support the voice call translation function. If the electronic devices used by both parties simultaneously support the voice call translation function, take the electronic device 100 and the electronic device 200 as examples. With the possibility of repeating the translation of user A's voice and user B's voice during a call, the electronic device 100 and the electronic device 200 can negotiate the voice call translation capabilities after establishing a communication link.
- the electronic device 100 and the electronic device 200 may negotiate the voice call translation capabilities, so that when both the electronic device 100 and the electronic device 200 support the voice call translation function, If the voice call translation functions of the electronic device 100 and the electronic device 200 are both turned on, the voice call translation function of one of the electronic device 100 and the electronic device 200 is turned off, while the voice call translation function of the other electronic device remains on, thereby Helps avoid repeated translation.
- the voice call translation function of the electronic device 100 has been turned on, which means that the voice call translation function of the electronic device 100 is turned on.
- the electronic device 100 may enable the voice call translation function in response to the user's operation or automatically open the voice call translation function in response to the language configuration of the electronic device 100, so that the voice call translation function of the electronic device 100 is in an on state.
- the electronic device 100 may be used to obtain a translation result of the voice of the user A collected by the microphone or other sound sensor of the electronic device 100, And obtain the received translation result of the voice of the user B sent by the electronic device 200, and send the translation result of the voice of the user A to the electronic device 200.
- the voice call translation function of the electronic device 100 when the voice call translation function of the electronic device 100 is turned on, it can also be used to send the obtained translation result of the voice of the user B to the electronic device 200. In other embodiments, when the voice call translation function of the electronic device 100 is turned on, it can also be used to convert voice into text. For example, the electronic device 100 may convert the collected user A's voice, the obtained translation result of the user A's voice, the user B's voice, and the user B's voice translation results into text, and display them. In addition, the electronic device 100 may also send the text converted from voice to the electronic device 200, or may not send it to the electronic device 200.
- the electronic device 200 can perform voice recognition and convert the voice into text.
- the voice call translation function of the electronic device 200 is turned on, the functions that can be implemented by the electronic device 200 can refer to the implementation manner of the electronic device 100.
- FIG. 3 it is a schematic flowchart of a method for negotiating a voice call translation capability according to an embodiment of the present application. It includes the following steps.
- step 301 the electronic device 100 sends a call request to the electronic device 200.
- the electronic device 100 displays a user interface 400.
- the user interface 400 includes a phone icon 401.
- the user interface 400 may also include icons of other applications, such as WeChat icons, settings icons, camera icons, and so on.
- the electronic device 100 may display the user interface 410 on the display screen in response to the operation of the phone icon 401.
- the user interface 410 includes a dial keypad 412. The user can input the phone number of user B by touching the corresponding symbol included on the dial keypad 412. For example, the user interface 410 includes the entered user B's phone number "12345659876".
- the electronic device 100 sends a call request to the electronic device 200 in response to the operation of the dial button 411, and displays the user interface 420.
- the electronic device 100 may also send a call request to the electronic device 200 in response to the operation of the user B in the contact, and display the user interface on the display screen 420.
- the electronic device 100 may also send a call request to the electronic device 200 and display the user interface 420 on the display screen in response to the voice instruction “make a call to user B”.
- the user may also perform other operations on the electronic device, so that the electronic device 100 sends a call request to the electronic device 200.
- the user interface 420 may further include a voice translation button 421.
- the electronic device 100 may activate the voice translation button 421 on the user interface 420 in response to the operation of user A dialing the phone of user B, so that the user can operate the voice translation button 421.
- the electronic device 100 may also activate the voice translation button 421 on the user interface 420 after the communication link with the electronic device 200 is established, and the electronic device 100 When the communication link with the electronic device 200 is not established, the voice translation button 421 on the user interface 420 is not activated.
- inactivating the voice translation button 421 may appear as the voice translation button 421 is grayed out so that the user cannot operate the voice translation button 421, or the voice translation button 421 is not displayed on the user interface 420.
- the user interface 420 may not include the voice translation button 421, or the voice translation button 421 may be grayed out, so that the user cannot operate the voice translation button 421.
- the electronic device 100 may turn on or off the voice call translation function of the electronic device 100 in response to the user's operation of the voice translation button 421.
- the language translation button 421 is ON, the language conversation translation function of the electronic device 100 is turned on; when the language translation button 421 is off, the language conversation translation function of the electronic device 100 is turned off.
- the electronic device 100 may also display the user interface 430 on the display screen in response to the operation of the voice translation button 421.
- the user interface 430 includes a voice translation button 431.
- the electronic device 100 may turn on or off the voice call translation function of the electronic device 100 in response to the operation of the voice translation button 431.
- the user interface 430 further includes a local language setting button 432 and a peer language setting button 433. It should be understood that the local language setting button 432 is used to set the language used by user A, and the remote language setting button 432 is used to set the language used by user B.
- Step 302 After receiving the call request sent by the electronic device 100, the electronic device 200 sends a response to the electronic device 100 to accept the call request.
- the electronic device 200 displays the user interface 430 on the display screen in response to the call request of the electronic device 100.
- the user interface 430 includes an accept button 431 and a reject button 432.
- the electronic device 200 responds to the operation of the accept button 431, sends a response to the electronic device 100 to receive the call request, and displays the user interface 440 on the display screen.
- the user interface 430 may further include a voice translation button 433, so that the user B can accept the electronic Before the call request of the device 100, the voice call translation function is turned on or off.
- the electronic device 200 responding to the operation of the voice translation button 433, refer to the implementation manner of the electronic device 100 responding to the operation of the voice translation button 421 in the embodiment of the present application.
- the electronic device 200 does not activate the voice call translation function before the user accepts the call request of the electronic device 100, so that the user cannot turn on or off the voice call translation function.
- the user interface 430 The voice translation button 433 may not be included, or the user interface 430 includes the voice translation button 433, but the voice translation button 433 is grayed out so that the user cannot perform operations.
- the voice call translation function is activated so that the user can turn on or off the voice call translation function.
- the electronic device 100 as the calling end and the electronic device 200 as the called end as an example.
- both the electronic device 100 and the electronic device 200 support the voice call translation function
- the voice translation button of the calling terminal before the establishment of the call link, only the voice translation button of the calling terminal can be activated, and the voice translation button of the called terminal is not activated, that is, only the user of the calling terminal can
- the voice translation button is operated before the call link is established, and the calling party's voice call translation function is turned on, while the called party's user cannot operate the called party's voice translation button to turn on the called party's voice translation.
- both the electronic device 100 and the electronic device 200 enable the voice translation function.
- the user interface 430 may not include the voice translation button 433, or the voice translation button 433 may be grayed out.
- the electronic device 200 may also send a response to the electronic device 100 to accept the call request in response to a voice instruction to answer the user A's phone call.
- the embodiments of the present application are not limited to the manner in which the response to the call acceptance request is sent to the electronic device 100.
- the electronic device 100 and the electronic device 200 can complete the establishment of the communication link through the call request and the response to accept the call request.
- the electronic device 200 may also display the user interface 440 on the display screen in response to the operation of accepting the call request of the electronic device 100.
- the user interface 440 may further include a voice translation button 441.
- the user interface 440 may not include the voice translation button 441, or the voice translation button 441 may be grayed out.
- the function of the voice translation button 441 in the embodiment of the present application refer to the function of the voice translation button 421 shown in FIG. 4a.
- the user interface 450 shown in FIG. 4b may further include a local language setting button 452 and a peer language setting button 453.
- the local language setting button 452 can be used to set the language used by user B
- the remote language setting button 453 can be used to set the language used by user A.
- the electronic device 100 and the electronic device 200 may negotiate the voice call translation capability after the communication link is established.
- the following uses the electronic device 100 to initiate negotiation of voice call translation capabilities as an example for detailed description.
- the electronic device 100 executes step 303. Understandably, the electronic device 100 can turn on the voice translation function before the communication link is established, and it is necessary to negotiate with the electronic device 200 on the voice call translation capability after the communication link is established.
- the electronic device 100 may also start the voice translation function after the communication link is established, and may automatically start the voice translation function, or may start the voice translation function in response to the user's operation after the communication link is completed.
- the electronic device 100 sends the first character to the electronic device 200.
- the first character is used to indicate that the voice call translation function of the electronic device 100 is turned on.
- the electronic device 100 may send the first character to the electronic device 200 in the form of DTMF tones.
- the first character can be 1, it can also be 0, or other positive integers, it can be #, it can also be *, etc.
- step 304 is executed.
- step 304 the electronic device 200 automatically turns off the voice call translation function.
- the electronic device 200 after receiving the first character, the electronic device 200 automatically switches the voice translation button 451 from ON to OFF.
- the electronic device 100 and the electronic device 200 can realize the negotiation of the translation capability of the voice call, thereby helping to avoid repeated translation, thereby helping to reduce the possibility of errors.
- the electronic device 200 after receiving the first character, the electronic device 200 also prompts the user that the voice call translation function of the electronic device 100 has been turned on. For example, the electronic device 200 may prompt the user in the form of voice that the voice call translation function of the electronic device 100 has been turned on. For another example, the electronic device 200 may also display the first prompt information on the display screen. The first prompt information is used to prompt the user that the voice call translation function of the electronic device 100 has been turned on. For example, as shown in FIG. 5a, after receiving the first character, the electronic device 200 displays a prompt box 600 on the display screen. The prompt box 600 includes first prompt information. The first prompt message may be that the voice call translation function of the peer electronic device is turned on.
- the electronic device 200 may also prohibit the user from turning on the voice call translation function after automatically turning off the voice call translation function.
- the electronic device 200 may gray the voice translation button 441 or hide the voice translation button 441.
- the electronic device 200 may receive a notification that the voice call translation function of the electronic device 100 has been turned off by the electronic device 100 during a call or cancel the user's voice to the electronic device 200 after the communication link with the electronic device 100 is disconnected Restrictions on the call translation function. For example, taking the user interface 440 shown in FIG.
- the electronic device 200 canceling the restriction on the user's opening of the voice call translation function of the electronic device 200 may be represented by activating the voice translation button 441 so that the user can operate the voice translation button 411 To turn on or off the voice call translation function of the electronic device 200.
- the electronic device 200 after the user is prohibited from enabling the voice call translation function, the electronic device 200 also prompts the user to prohibit the voice call translation function. In other embodiments, after prohibiting the user from enabling the voice call translation function, the electronic device 200 not only prompts the user to disable the voice call translation function, but also prompts the user to cancel the time limit for enabling the voice call translation function.
- the electronic device 200 may prompt the user through voice to prohibit the opening of the voice call translation function, and prompt the user to cancel the time when the voice call translation function is turned on.
- the electronic device 200 may also prompt the user by displaying second prompt information on the display screen.
- the second prompt information is used to prompt the user to prohibit the opening of the voice call translation function and the time to cancel the restriction on the opening of the voice call translation function.
- the electronic device 200 may prompt the user by displaying a prompt box 510 on the display screen.
- the prompt box 510 includes second prompt information.
- the second prompt message may be that the voice call translation function is prohibited from being turned on. Cancel the restriction when the call translation function is turned off or when the communication link is disconnected.
- the electronic device 200 may prompt the user of the first prompt information and the second prompt information after automatically turning off the voice call translation function, or after the electronic device 200 receives the first character , The user is prompted with the first prompt information, and after the voice call translation function is turned off, the user is prompted with the second prompt information, which is not limited.
- the electronic device 200 may also send a second character to the electronic device 100, and the second character is used to indicate the voice call translation function of the electronic device 200. closed. After receiving the second character, the electronic device 100 determines that the negotiation of the voice call translation capability has been completed.
- the electronic device 200 may also send the second character to the electronic device 100 in the form of DTMF tones.
- the second character may be any character other than the first character, for example, the first character is 1, the second character may be 2, or a positive integer other than 1, or # or *, etc.
- first character and the second character in the embodiment of the present application may be pre-agreed in the form of a communication protocol.
- the electronic device 100 After the electronic device 100 receives the second character sent by the electronic device 200, it can also use language 1 to play the prompt tone of the voice call translation function is turned on, and send the electronic device 200 a prompt that the voice call translation function is turned on into language 2 sound.
- language 1 is Chinese
- the text of the prompt tone of the translation function may be "Welcome to use the voice call translation function, and start the call after the voice broadcast is completed.”
- the negotiation of the translation capability of the voice call initiated by the electronic device 100 is used as an example.
- the negotiation method of the translation capability of the voice call initiated by the electronic device 200 reference may be made to the above steps 303 and 304.
- the electronic device that enables the voice call translation function initiates negotiation of the voice call translation capability to another electronic device.
- the electronic device 200 does not support or does not turn on the voice call translation function as an example.
- the electronic device 100 sends the first character.
- the first character is used to indicate that the voice call translation function of the electronic device 100 is turned on.
- the electronic device 100 may send the first character to the electronic device 200 in the form of dual tone multifrequency (DTMF) tones.
- DTMF dual tone multifrequency
- the first character can be 1, it can also be 0, or other positive integers, it can be #, it can also be *, etc. Since the electronic device 200 does not support or does not enable the voice call translation function, the electronic device 200 cannot recognize the first character.
- the electronic device 200 does not respond to receiving the first character sent from the electronic device 100. If the electronic device 100 does not receive the response from the electronic device 200 within a preset time period, it is confirmed that the electronic device 200 is not turned on or does not support the voice call translation function. In other embodiments, when the first character cannot be recognized, the electronic device 200 may send a target character to the electronic device 100, for example, the target character may be a character different from the first character preset. Exemplarily, the electronic device 200 may send the target character to the electronic device 100 in the form of DTMF tones. After receiving the target character, the electronic device 100 confirms that the electronic device 200 is not turned on or does not support the voice call translation function.
- the coordination method of the voice call translation capability between the electronic device 100 and the electronic device 200 can be referred to when the electronic device 100 enables voice call translation Function, when the electronic device 200 does not support or turn off the voice call translation function, the coordination method of the voice call translation capability between the electronic device 100 and the electronic device 200.
- both the electronic device 100 and the electronic device 200 support the voice call translation function
- the electronic device 100 and the electronic device 200 have the voice translation function turned on before the communication link is established
- the electronic device 100 and In the electronic device 200 the electronic device that completes the establishment of the communication link first initiates the negotiation of the translation capability of the voice call, or the calling terminal may initiate the negotiation of the translation capability of the voice call, or the called end may initiate the negotiation of the translation capability of the voice call.
- the electronic device that initiates the negotiation of voice call translation capabilities in the embodiments of the present application is not limited. If the electronic device 100 and the electronic device 200 start the voice translation function at the same time after the communication link is established, this situation is relatively rare.
- the electronic device 100 and the electronic device 200 can initiate a voice call
- the calling terminal may initiate negotiation of voice call translation capabilities
- the called terminal may initiate negotiation of voice call translation capabilities.
- the electronic device that initiates the negotiation of voice call translation capabilities in the embodiments of the present application is not limited. .
- the calling terminal may also automatically turn on the voice call translation function and initiate the negotiation of voice call translation capabilities, or may be automatically turned on by the called terminal.
- the voice call translation function initiates negotiation of voice call translation capabilities, etc.
- the electronic device that initiates the negotiation of voice call translation capabilities in the embodiments of the present application is not limited.
- the voice call translation function when the electronic device 100 and / or the electronic device 200 supports the voice call translation function, the voice call translation function can be automatically turned on, or the voice call translation function can be turned on in response to the user's operation.
- the electronic device 100 can determine whether it is automatically based on the language used by the user A and the language used by the user B in the call log Turn on voice call translation.
- the electronic device 100 automatically starts the voice call translation function when the language used by user A and the language used by user B in the call log are different.
- the electronic device 100 may also automatically enable the voice call translation function when the preset local language and the peer language are different.
- the electronic device 100 may automatically turn on the voice call translation function when the native language of the home place of the user A's phone number and the native language of the home place of the user B's phone number are different.
- the user can set the local language by setting the system language.
- the display screen of the electronic device 100 displays the user interface 400.
- the user interface 400 includes a setting icon 600.
- the user interface 400 may also include other application icons, such as a camera icon, a WeChat icon, and the like.
- the electronic device 100 may display the system setting interface 610 on the display screen in response to the operation of the setting icon 600.
- the system setting interface 610 includes a language and region setting button 611. It should be understood that the system setting interface 610 may also include multiple other setting buttons, such as enabling cloud backup and screen lock.
- the electronic device 100 displays the user interface 620 on the display screen in response to the operation of the language and region setting button 611.
- the user interface 620 includes a system language setting button 621.
- the user can set the system language by operating the system language setting button. For example, if the system language is set to simplified Chinese on the user interface 600 shown in FIG. 6, the electronic device 100 determines that the local language is simplified Chinese. When the electronic device 100 receives the voice of the user B sent by the electronic device 200, the obtained The language used for the translation result of user B's voice is simplified Chinese.
- user A may set the peer language through the language set for user B.
- the display screen of the electronic device 100 displays the user interface 400.
- the electronic device 100 displays the user interface 710 on the display screen in response to the operation of the phone icon.
- the user interface 710 includes a contact list 711 and a function bar 712.
- the function bar 712 includes a new contact button and the like.
- the electronic device 100 may display the user interface 720 on the display screen in response to the operation of the user B in the contact list 711.
- the user interface 720 includes a language setting button 721.
- the language setting button 721 is used to set the language used by the user B.
- the user interface 720 may also include user B's name, contact information (such as phone number, email address, etc.), and function buttons such as send information.
- the user can set the peer language by operating the language setting button 721.
- the electronic device 100 displays the language list 800 on the display screen in response to the operation of the language setting button 721.
- the language list includes languages supported by the electronic device 100 and / or languages supported by the translation server.
- the user can set the peer language by selecting the language in the language list 800. For example, if the user selects English, the peer language is set to English.
- the user can also find the language to be set by sliding the language list 800 up and down.
- the user in order to facilitate user operation, can also set the local language through the local language setting button 432 included in the user interface 430 shown in FIG. 4a, and the remote language setting button 433 Language settings.
- the local language setting button 432 and the opposite language setting button 433 may also be located on the user interface 420.
- the method for automatically enabling the voice call translation function can be automatically turned on.
- the user can also manually turn on or off the call translation function through the user interface displayed on the display screen of the electronic device 200.
- the user interface may be the user interface 430 as shown in FIG. 4b, or the user interface 440, or the user interface 450.
- the electronic device ie, the local end
- the first character is used to instruct the peer end to enable the voice call translation function
- the local end receives If the first character has previously turned on the voice call translation function of the local end, then the voice call translation function of the local end is turned off.
- the local end sends the second character to the peer end to notify End-to-end voice call translation has been turned off.
- the local end does not enable the voice call translation function or does not support the voice translation function when receiving the first character, it does not respond; or sends the target character (such as the second character, or the first character or the second character Character) to the opposite end, notifying the opposite end that the voice call translation function is not enabled or does not support the voice translation function.
- the target character such as the second character, or the first character or the second character Character
- FIG. 9 it is a schematic flowchart of another method for negotiating a voice call translation capability according to an embodiment of the present application. It includes the following steps.
- step 901 the electronic device 100 sends a call request to the electronic device 200.
- step 902 after receiving the call request sent by the electronic device 100, the electronic device 200 sends a response to the electronic device 100 to accept the call request.
- step 901 and step 902 in the embodiment of the present application, reference may be made to the specific implementation manners of step 301 and step 302 in the method for negotiating voice call translation capabilities shown in FIG. 3, and details are not described herein again.
- the electronic device 100 sends the third character to the electronic device 200 if the voice call translation function is enabled.
- the third character is used to indicate that the voice call translation function of the electronic device 100 is turned on.
- the electronic device 100 may send the third character to the electronic device 200 in the form of DTMF tones.
- the third character may be 1, or 0, or other positive integer, #, or *, etc.
- the electronic device 100 initiates the negotiation of the voice call translation capability as an example for introduction.
- the electronic device that initiates the negotiation of the voice call translation capability is an electronic device that prioritizes the establishment of the communication link
- the electronic device 100 is the electronic device of the electronic device 100 and the electronic device 200 that completes the establishment of the communication link first.
- the electronic device that initiates the negotiation of voice call translation capabilities is the calling end
- the electronic device 100 is the calling end.
- the electronic device 200 sends a response to accept the call request to the electronic device 100 after accepting the call request sent by the electronic device 100 in response to the user's operation.
- a third character where the third character is used to indicate that the voice call translation function of the electronic device 200 has been turned on.
- the electronic device that initiates the voice call translation function initiates Negotiation of voice call translation capabilities.
- the method shown in FIG. 9 which electronic device initiates the negotiation of the voice call translation capability can refer to the related description of the embodiment shown in FIG. 3.
- step 904 the electronic device 200 transmits the fourth character to the electronic device 100 before the voice call translation function is turned on before receiving the third character.
- the fourth character is used to notify the electronic device 100 to turn off the voice call translation function.
- the electronic device 200 when the electronic device 200 does not support or turn off the voice call translation function, if the third character sent by the electronic device 100 cannot be recognized after receiving the third character, it may not respond. In this case, if the electronic device 100 cannot receive the response sent by the electronic device 200 within a preset time period, it is confirmed that the electronic device 200 does not support or turn off the voice call translation function, and the voice call translation function is kept on.
- the preset duration in the embodiment of the present application can be set correspondingly according to the actual situation, for example, 2s, 5s, 10s, etc.
- the electronic device 100 when the electronic device 200 does not support or disable the voice call translation function, if the third character sent by the electronic device 100 cannot be recognized after receiving the third character, the electronic device 100 may also send a Set the characters. After receiving the preset characters, the electronic device 100 confirms that the electronic device 200 does not support or disable the voice call translation function, and then continues to enable the voice call translation function. It should be understood that the preset character and the third character are different characters.
- step 905 after receiving the fourth character, the electronic device 100 turns off the voice call translation function.
- the electronic device 100 may also send a fifth character to the electronic device 200.
- the fifth character may be used to instruct the electronic device 100 to turn off the voice Call translation function.
- the electronic device 100 may also send the fifth character to the electronic device 200 in the form of DTMF tones.
- the fifth character may be other characters than the third character and the fourth character, for example, the third character is 1, the fourth character is 2, the fifth character may be 3, or other positive characters than 1 and 2. Integer, can also be # or * etc.
- the functions of the third character, the fourth character, and the fifth character in the embodiment of the present application may be pre-agreed in the form of a communication protocol.
- the electronic device 200 After receiving the fifth character sent by the electronic device 100, the electronic device 200 uses language 2 to play a prompt tone that the voice call translation function is turned on, and sends to the electronic device 100 a prompt tone that the voice call translation function that is translated into language 1 is turned on.
- the text of the prompt tone of the voice call translation function may be "Welcome to use the voice call translation function, and start the call after the voice broadcast is completed.”
- the electronic device receives the third character sent by the peer end, the third character is used to instruct the peer end to enable the voice call translation function, if the local end receives Before the third character has turned on the voice call translation function of the local end, a fourth character is sent to the peer end, and the fourth character is used to indicate that the voice call translation function of the local end is turned on, and requires the peer end to turn off the voice call translation function.
- the peer end After receiving the fourth character, the peer end turns off the voice call translation function.
- the peer end sends the fifth character to the local end after turning off the voice call translation function. The fifth character is used to indicate that the peer end has turned off the voice call translation.
- the local end does not enable the voice call translation function or does not support the voice translation function when receiving the third character, it does not respond; or sends the target character (such as characters other than the third, fourth, and fifth characters) to the right End, notify the peer end that the voice call translation function is not enabled or does not support the voice translation function.
- the target character such as characters other than the third, fourth, and fifth characters
- the text of the voice of the two parties when the voice call translation function of the electronic device 100 or the electronic device 200 is turned on, the text of the voice of the two parties and the text of the translation result of the corresponding voice can also be displayed to the user through the display screen.
- the text of the voice of the two parties may be referred to as the voice text of the call record of the two parties, and the text of the translation result of the voice may also be referred to as the text of the translation result of the voice of the call records of the two parties. For example, as shown in FIG.
- the user interface 430 may further include a text display area 434, and the electronic device 100 may display the text of the conversation voice of the user A and the user B and the text of the translation result of the voice in the text display area 434.
- the user interface 450 shown in FIG. 4b may further include a text display area 454, and the electronic device 100 may display the text of the conversation voice of the user A and the user B and the text of the translation result of the voice in the text display area 454.
- the electronic device 100 and the electronic device 200 since both the electronic device 100 and the electronic device 200 support the voice call translation function, one of the electronic devices enables the voice call translation function, and the other electronic device disables the voice translation function .
- the electronic device 100 can display the text of the call voice of the user A and the user B and the text of the voice translation result on the display screen.
- the voice translation function of the electronic device 100 is turned on, and the text display function of the electronic device 100 can also be turned off. That is, when the electronic device 100 executes the translation function by itself or is combined with a translation server to implement the translation function, the electronic device 100 The text of the voice and the text of the translation result of the voice may not be displayed.
- the electronic device 200 may also display the text of the conversation voice of the user A and the user B and the text of the translation result of the voice on the display screen.
- the electronic device 200 when the electronic device 200 can support the voice call translation function, if the voice call translation function is enabled, the electronic device 200 has a function of displaying text during the voice call, and can display the call voices of the user A and the user B on the display screen Text and speech translation results. However, after the voice call translation function is turned off, the electronic device 200 also turns off the function of displaying text during the voice call, so the electronic device 200 cannot display the text of the call voice of the user A and the user B and the text of the voice translation result.
- the function of displaying text during the voice call in the electronic device 200 and the voice call translation function are two independent functions.
- the voice call translation function of the electronic device 200 When the voice call translation function of the electronic device 200 is turned off, it only restricts the electronic device 200 from being unable to obtain the translation result of the voice through its own translation or from the translation server itself, but does not affect the electronic device 200 to display user A and user B The text of the call voice and the text of the voice translation result. Therefore, the electronic device 200 turns on the function of displaying text during the voice call, and when the voice call translation function is turned off, the electronic device 200 can still display the text of the call voice of the user A and the user B and the text of the voice translation result on the display screen .
- the text of the conversation voice of user A and user B and the text of the translation result of the voice may also be sent from the electronic device 100 to the electronic device 200, or the electronic device 200 may perform voice recognition to translate the voice and the voice After the result is converted into text, it is displayed on the display.
- the text of the voice of the user A, the text of the translation result of the voice of the user A and the text of the voice translation result of the user B may be sent from the electronic device 100 to the electronic device 200, and the voice of the user B The electronic device 200 is converted into text.
- the embodiment of the present application does not limit the manner in which the electronic device 200 acquires voice text.
- the electronic device 100 in the embodiment of the present application may also only display the text of the translation result of the voice of the user B, or the electronic device 100 only displays the text of the voice of the user B and the user B
- the text of the translation result of the voice the electronic device 200 may also display only the text of the translation result of the voice of the user A, or the electronic device 100 only displays the text of the translation result of the voice of the user A and the text of the translation result of the voice of the user A.
- the voice call translation function when the voice call translation function is turned off and the function of text display during the voice call is limited, taking the user interface 450 shown in FIG. 4b as an example, if the voice translation button of the electronic device 200 is turned off (OFF), Then, the text display area 454 may no longer display the text of the conversation voice of the user A and the user B and the text of the translation result of the voice.
- the voice translation button when the voice translation button is turned off, the function of obtaining the voice call translation of the electronic device 200 is only turned off, and does not affect the display of the text of the call voice of the user A and the user B and the text of the voice translation result. .
- a text display mode button may be added to the user interface. If the text display mode button is turned on, the electronic device 200 displays user A and user in the text display area The text of the call voice of B and the text of the translation result of the voice; if the text display mode button is turned off, the electronic device 200 does not display the text of the call voice of the user A and the user B and the text of the translation result of the voice in the text display area.
- the electronic device 100 after receiving the fourth character, the electronic device 100 turns off the voice call translation function.
- the electronic device 100 after receiving the fourth character, the electronic device 100 also prompts the user A that the voice call translation function of the electronic device 200 has been turned on. For the manner in which the electronic device 100 prompts the user A that the voice call translation of the electronic device 200 has been turned on, see the manner in which the electronic device 200 prompts the user that the voice call translation function of the electronic device 100 has been turned on.
- the electronic device 100 may also prohibit the user from turning on the voice call translation function after automatically turning off the voice call translation function.
- the electronic device 100 in order to improve the interaction between the user and the electronic device 100, in some embodiments, after the user is prohibited from enabling the voice call translation function, the electronic device 100 also prompts the user to prohibit the voice call translation function.
- the electronic device 100 after prohibiting the user from enabling the voice call translation function, not only prompts the user to disable the voice call translation function, but also prompts the user to cancel the restriction on the voice call translation function.
- the prompt method after the electronic device 200 prohibits the user from enabling the voice call translation function in the method shown in FIG. 3.
- the user A can also close the voice call translation by operating the voice translation button included on the user interface displayed on the electronic device 100 Features.
- the electronic device 100 may also send preset characters to the electronic device 200 to notify the electronic device 200 that the electronic device 100 has turned off the voice call translation function.
- the electronic device 200 can automatically turn on the voice call translation function when it receives a preset character when its own voice call translation function is turned off.
- the electronic device 100 may display the user interface 1000 shown in FIG. 10 on the display screen in response to the operation of the voice translation button 421.
- the electronic device 200 may display the user interface 1000 on the display screen in response to the operation of the voice translation button 511.
- the user interface 1000 includes a voice translation button 1001, a local language setting button 1002, a peer language setting button 1003, a voice broadcast mode button 1004, and a text display mode button 1005.
- the voice broadcast mode button 1004 is turned OFF, the electronic device turns off the voice broadcast.
- the voice broadcast mode button 1004 is turned ON, the electronic device starts voice broadcast. For example, taking the electronic device 100 as an example, as shown in FIG.
- the electronic device 100 broadcasts the translation result of user B's voice and user B's voice It does not broadcast the translation result of user A's voice; however, when the local transliteration is selected, the electronic device 100 broadcasts the translation result of user A's voice. Similar to the broadcast mode button 1004, when the text display mode button 1005 is turned off (OFF), the electronic device 100 does not display the text corresponding to the voice or translation result; when the text display mode button 1005 is turned on (ON), the electronic device 100 displays the speech or translation result The corresponding text. In some embodiments, when the text display mode button 1005 is OFF, the electronic device may also hide the text display area 1006.
- the electronic device can also display the text display area 1006.
- the electronic device may display the text display area 1006 in full screen in response to the operation on the text display area 1006.
- the operation on the text display area 1006 may be two-finger swipe up, double-click, or the like. It should be noted that the text display area 1006 is used to display the user's call history and the text of the corresponding translation result.
- the electronic device 100 may automatically turn off the voice broadcast mode button 1004, and / or automatically turn off the text display mode button 1005.
- the call method of the electronic device in the prior art may be adopted.
- turning off the voice translation button 1001 in the embodiment of the present application does not affect the turning off and turning on of the voice broadcast mode button 1004, and does not affect turning off and turning on of the text display mode button 1005. In this case, if the voice translation button 1001 is turned off, the electronic device 100 cannot obtain the translation result of the voice.
- Whether the electronic device 100 broadcasts the translation result or broadcasts the user's voice may be related according to the setting of the voice broadcast mode. For example, when the voice broadcast mode is turned on and only the option of the opposite end original sound is selected, the electronic device 100 only broadcasts the opposite end original sound. For another example, when the voice broadcast mode is turned off, the electronic device 100 does not broadcast any voice.
- whether the electronic device 100 displays the text of the voice is related to whether the text display mode button 1005 is turned on. When the text display mode button 1005 is turned on, the electronic device 100 displays the speech text and the text of the speech translation result; when the text display mode button 1005 is turned off, the electronic device 100 does not display the speech text and the text of the speech translation result.
- the user can set the voice broadcast mode by operating a virtual button on the user interface 1000.
- the electronic device may also automatically set the broadcast mode.
- both the electronic device 100 and the electronic device 200 can implement dual-end voice translation, when both the voice call translation functions of the electronic device 100 and the electronic device 200 are turned on, in order to avoid repeated translation, in other embodiments, the electronic The device 100 and the electronic device 200 may negotiate the voice call translation capability, so that the electronic device 100 and the electronic device 200 only translate the collected local voice, but not the peer voice.
- the local voice is the voice of the user A collected by the electronic device 100 through its own sound collection sensor (such as a microphone)
- the peer voice is sent by the electronic device 200 received through the mobile communication network to the user B voice.
- the local voice is the voice of the user B collected by the electronic device 200 through its own sound collection sensor (such as a microphone)
- the voice of the peer end is the voice of the user A sent by the electronic device 100 received through the mobile communication network.
- the following uses the electronic device 100 to initiate negotiation of voice call translation capabilities as an example. As shown in FIG. 11, this is another method for negotiating voice call translation capabilities provided by this application. It includes the following steps.
- Step 1101 after the electronic device 100 establishes a communication link with the electronic device 200, if the voice call translation function of the electronic device 100 is turned on, a sixth character is sent to the electronic device 200, where the sixth character is used to indicate the electronic device 100 ’s Voice call translation is turned on.
- the sending method and specific implementation of the sixth character can refer to the sending method and specific implementation of the first character in the method described in FIG. 3 in the embodiment of the present application.
- the voice call translation function of the electronic device 100 when the voice call translation function of the electronic device 100 is turned off or does not support the voice call translation function, after the establishment of the communication link with the electronic device 200 is completed, the negotiation of the voice call translation capability will not be initiated.
- step 1102 if the voice call translation function of the electronic device 200 is turned on, after receiving the sixth character, it is determined that the voice sent by the electronic device 100 is not translated, and only the voice collected by the electronic device 200 is translated and sent to the electronic device 100.
- the seventh character is sent, and the seventh character is used to indicate that the voice call translation function of the electronic device 200 has been turned on. It should be noted that the sixth character and the seventh character are different characters.
- the electronic device 200 determines not to translate the voice sent by the electronic device 100, but only translates the voice collected by the electronic device 200, and displays a prompt box 1200 shown in FIG. 12 on the display screen
- the prompt box 1200 includes prompt information that restricts translation of the peer voice.
- the prompt box 1200 includes "turn on the local voice translation function and turn off the peer voice translation function.”
- the electronic device 200 may also prompt the user to restrict the translation of the peer voice by voice.
- the electronic device 200 may not respond to the sixth character, and may not send a message to the electronic device 100, or send a preset character to indicate that the electronic device 200 does not enable the voice translation function, and the electronic device 100 performs dual-end translation.
- Step 1103 After the electronic device 100 receives the seventh character, if the voice call translation function is turned on, it is determined that the voice sent by the electronic device 200 is not translated, and only the voice collected by the electronic device 100 is translated.
- the electronic device 100 may also prompt the user to restrict the translation of the peer voice.
- a specific prompting method refer to the prompting method of the electronic device 200 restricting translation of the peer voice.
- the electronic device 100 and the electronic device 200 can realize the negotiation of the translation ability of the voice call, thereby helping to reduce the possibility of repeated translations, and thus help reduce the probability of errors.
- the electronic device 100 may, after the negotiation of the voice call translation capability is completed, in some embodiments, the electronic device 100 uses language 1 to play the prompt tone that the voice translation function is turned on, and the electronic device 200 plays the language 2 to play the voice translation function Prompt tone turned on.
- the text of the prompt tone that the voice translation function is turned on may be "Welcome to use the voice call translation function, and start the call after the voice broadcast is completed.”
- the electronic device 100 can collect the collected user A's voice and the obtained user A's voice.
- the translation result of the voice is sent to the electronic device 200.
- the electronic device 200 can play the translation result of the voice of the user A and the voice of the user A through a speaker or a receiver .
- the electronic device 200 may send the collected user B's voice and the obtained user B's translation result to the electronic device 100.
- the electronic device 100 may use the speaker Or the earpiece plays user B's voice and the translation result of user B's voice.
- the electronic device plays the translation result of the user's voice and the user's voice, it may be collected by its own sound sensor (such as a microphone), resulting in repeated translation.
- the electronic device 100 plays the translation result of the voice of the user B, it may be collected by the microphone of the electronic device 100, and then the voice translation result of the user B is translated, and then sent to the electronic device 200.
- the voice call translation function is turned on, the electronic device 200 may turn off the broadcast of the results of the voice translation or turn off the broadcast of the voice after receiving the sixth character, but the two parties ’calls are displayed on the display The text of the recorded voice text and the translation result of the voice of the call record.
- the electronic device 100 may also turn off the broadcasting of the voice translation result, or turn off the broadcasting of the voice, but the voice text of the call record of both parties and the text of the translation result of the voice of the call record are displayed on the display screen. It should be noted that, in the embodiment of the present application, for the text that specifically displays the voice text of the call records of both parties and the translation result of the voice of the call records, reference may be made to the foregoing related implementation manners.
- the electronic device 200 can realize the broadcast of the translation result of the voice by turning off: the electronic device 200 automatically selects the opposite end original sound, and does not select the options of the opposite end transliteration and the local end transliteration.
- the electronic device 200 may turn off the broadcast of the voice by implementing the following: the electronic device 200 automatically sets the voice broadcast mode button 1004 to OFF.
- the electronic device 200 can display the call records of both parties and the translation results of the call records on the display screen by: the electronic device 200 automatically sets the text display mode button 1005 to ON.
- electronic device 100 may send the translation result of user A's voice For the electronic device 200, the translation result of the voice of the user A may not be sent to the electronic device 200.
- the electronic device 200 displays the voice text of the call records of both parties and the text of the translation result of the voice of the call record
- the electronic device 100 may send the text of the voice of the user A and the text of the translation result of the voice of the user A to the electronic device 200
- the electronic device 200 may obtain the corresponding text according to the translation result of the voice of the user A and the voice of the user A sent by the electronic device 100.
- the implementation of the electronic device 100 is similar to the implementation of the electronic device 200, and will not be repeated here.
- the electronic device when the electronic device can only implement local voice translation, the electronic device can translate the local voice through a pre-configured translation engine, or can also translate the local voice through a translation server.
- the voice translation function of the electronic device when turned on, it can be used to obtain the translation result of the local end voice and send the translation result of the local end voice to the peer end.
- an embodiment of the present application provides another method for negotiating translation capabilities of voice calls. It includes the following steps.
- Step 1301 After the electronic device 100 establishes a communication link with the electronic device 200, if the voice translation function of the electronic device 100 is turned on, an eighth character is sent to the electronic device 200, where the eighth character is used to instruct the electronic device 100 to translate the voice The function is turned on.
- the electronic device 100 and the electronic device 200 are capable of simultaneous voice translation, the electronic device can establish the communication link to complete the negotiation of the voice call translation capability, or the calling end can initiate the voice call.
- the negotiation of translation capabilities the called party can initiate negotiation of translation capabilities for voice calls.
- the electronic device supporting the voice translation function can initiate negotiation of the voice call translation capability.
- FIG. 13A which electronic device initiates the negotiation of voice call translation capabilities can refer to the related description of the embodiment shown in FIG.
- Step 1302 when the voice translation function is turned on, the electronic device 200 receives the eighth character, then turns off the voice broadcast mode, turns on the text display mode, and sends a ninth character to the electronic device 100, where the ninth character is used to indicate 100 Turn off the broadcast mode and turn on the text display mode.
- turning off the voice broadcasting mode may refer to turning off the broadcasting of the speech translation result, or may refer to turning off the broadcasting of the speech and speech translation result.
- the electronic device 200 when the electronic device 200 closes the broadcast of the voice translation result, the electronic device 200 does not play the translation result of the voice of the user A to the user B, nor does it play the translation result of the voice of the user B, but plays the user A's voice.
- the electronic device 200 turns off the broadcasting of the voice and the result of the voice translation, the electronic device 200 does not play the translation result of the voice of the user A and the voice of the user A to the user B, and does not play the translation result of the voice of the user B.
- the electronic device 200 starts the text display mode, which means that the electronic device 200 can display the text of the voice of the call record between the user A and the user B through the display screen and the text of the translation result of the corresponding voice. For example, as shown in FIG. 10, the electronic device 200 may display the text of the voice of the call record between the user A and the user B and the text of the translation result of the corresponding voice in the text display area 1005 included in the user interface 1000.
- Step 1303 after receiving the ninth character, the electronic device 100 turns off the voice broadcast mode and turns on the text display mode.
- the electronic device 100 turns off the voice broadcast mode and turning on the text display mode.
- the electronic device 200 turning off the voice broadcast mode and turning on the text display mode.
- the electronic device 100 turning off the voice broadcast mode may automatically turn off the voice broadcast mode button 1412 in the user interface 1410 shown in FIG. 14 for the electronic device 100, or may maintain the voice broadcast mode button 1412 for the electronic device 100 On, but only the option of the opposite end original sound is selected.
- the electronic device 100 turns on the text display mode
- the electronic device 100 automatically turns on the text display mode button 1413 in the user interface 1410 shown in FIG. 14.
- the user can also set the voice broadcast mode and text display mode during the call.
- the electronic device 100 displays the user interface 1400 during user communication.
- the user interface 1400 includes a voice translation button 1401.
- the electronic device 100 may display the user interface 1410 on the display screen in response to the operation of the voice translation button 1401.
- the user interface 1410 may include a voice translation button 1411, a voice broadcast mode button 1412, a peer original audio option, a peer transliteration option, a local transliteration option, a text display mode button 1413, and a text display area 1414.
- the user can set the virtual buttons included on the user interface 1410 according to their own needs.
- the electronic device 100 notifies the peer, that is, the electronic device 200.
- the electronic device 200 turns off its own voice broadcast mode and turns on the text display mode. And notify the electronic device 100 to also turn off the voice broadcast mode and turn on the text display mode.
- both the electronic devices 100 and 200 support the local voice translation function.
- another negotiation method is provided, as shown in FIG. 13B, which specifically includes the following steps.
- Step 1310 After the electronic device 100 establishes a communication link with the electronic device 200, if the voice translation function of the electronic device 100 is turned on, an eighth character is sent to the electronic device 200, where the eighth character is used to instruct the electronic device 100 to translate the voice The function is turned on.
- Step 1320 When the voice translation function is turned on, the electronic device 200 receives the eighth character and sends a ninth character to the electronic device 100, where the ninth character is used to indicate that the voice function of the electronic device 200 is turned on.
- Step 1330 after receiving the ninth character, the electronic device 100 turns off the voice broadcast mode, turns on the text display mode, and sends a tenth character to the electronic device 200.
- the tenth character is used to notify the electronic device 200 to turn off the voice broadcast mode.
- Turn on text display mode For a specific implementation manner of the electronic device 100 turning off the voice broadcast mode and turning on the text display mode, see step 1302 for the electronic device 200 turning off the voice broadcast mode and turning on the text display mode.
- Step 1340 after receiving the tenth character, the electronic device 200 closes the broadcast mode and starts the text display mode.
- the electronic device 100 confirms the peer, that is, the electronic device 200 turns on the voice translation function, then turns off its own voice broadcast mode, turns on the text display mode, and notifies the electronic The device 200 turns off the voice broadcast mode and turns on the text display mode.
- the first character to the ninth character involved in the embodiments of the present application may be characters in characters 0 to 1, #, and * in the dial pad, or may be other predefined characters.
- other information may be used to indicate the information indicated by the first character and other characters in the embodiment of the present application.
- the embodiment of the present application does not limit the specific implementation form of the indication information.
- the electronic device may also implement automatic negotiation of other functions by sending characters.
- multiple reserved characters may be pre-configured. For example, take Table 1 as an example.
- characters 6 to * are reserved characters and can be used to implement automatic negotiation of other functions.
- the method provided by the embodiments of the present application is introduced from the perspective of an electronic device as an execution subject.
- the electronic device may include a hardware structure and / or a software module, and the above functions are implemented in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is executed in a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application of the technical solution and design constraints.
- FIG. 15 shows an electronic device 1500 provided by the present application.
- the electronic device 1500 includes a transceiver module 1501 and a processing module 1502.
- the transceiver module 1501 may be used to perform steps 301 to 303, and the processing module 1502 may be used to perform step 304.
- the transceiver module 1501 may be used to perform steps 901 to step 904, and the processing module 1502 may be used to perform step 905.
- the transceiver module 1501 may be used to perform the steps of sending the seventh character in steps 1101 and 1102, and the processing module 1502 It can be used to perform the determination step in step 1102.
- the transceiver module 1501 may be used to perform the steps of sending the ninth character in steps 1301 and 1302, and the processing module 1502 It can be used to perform the steps of turning off the broadcast mode and turning on the text display mode in step 1302.
- the transceiver module 1501 may be used to perform the steps of sending the ninth character in steps 13010 and 1320, and step 1340 In the step of receiving the tenth character, the processing module 1502 may be used to execute the steps of turning off the broadcast mode and turning on the text display mode in step 1340.
- FIG. 16 shows an electronic device 1600 provided by the present application.
- the electronic device 1600 includes at least one processor 1610, memory 1620, and transceiver 1630.
- the processor 1610 is coupled to the memory 1620 and the transceiver 1630.
- the coupling in the embodiments of the present application is an indirect coupling or communication connection between devices, units, or modules, which may be electrical, mechanical, or other forms used for devices , Information exchange between units or modules.
- the memory 1620 is used to store program instructions.
- the transceiver 1630 is used to receive or transmit data.
- the processor 1610 is used to call the program instructions stored in the memory 1620, so that the electronic device 1600 executes the steps performed by the electronic device 200 in FIG. 3, or executes the steps performed by the electronic device 100 in FIG. 9, 11, 11, 13A, or 13B. step.
- the electronic device 1500 and the electronic device 1600 can be used to implement the methods shown in FIG. 3, FIG. 9, FIG. 11, FIG. 13A, and / or FIG. 13A of the embodiments of the present application. No longer.
- Computer-readable media includes computer storage media and communication media, where communication media includes any medium that facilitates transfer of a computer program from one place to another.
- a storage medium may be any available medium that can be accessed by a computer.
- computer-readable media may include RAM, ROM, electrically erasable programmable read-only memory (electrically erasable programmable read only memory, EEPROM), compact disc read-only memory (CD- ROM) or other optical disk storage, magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store a desired program code in the form of instructions or data structures and that can be accessed by a computer. Also. Any connection can become a computer-readable medium as appropriate.
- disks and discs include compact discs (CDs), laser discs, optical discs, digital video discs (DVDs), floppy disks, and Blu-ray discs, where Disks usually copy data magnetically, while disks use lasers to copy data optically.
- CDs compact discs
- DVDs digital video discs
- floppy disks floppy disks
- Blu-ray discs where Disks usually copy data magnetically, while disks use lasers to copy data optically.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Telephone Function (AREA)
Abstract
一种基于语音通话翻译能力的协商方法及电子设备,涉及终端技术领域,该方法包括:第一电子设备在与第二电子设备建立通信链路后,若语音通话翻译功能已开启,接收到第二电子设备发送的第一指示信息,第一指示信息用于指示第二电子设备语音通话翻译功能已开启,自动关闭语音通话翻译功能。这种技术方案有助于降低电子设备在语音通话过程中出错的可能性,从而提高用户使用电子设备通话的效率。
Description
本申请要求于2018年10月15日提交中国国家知识产权局、申请号为201811198712.3、发明名称为“一种基于语音通话翻译能力的协商方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及终端技术领域,特别涉及一种基于语音通话翻译能力的协商方法及电子设备。
手机等电子设备的普及使得人与人之间的通信不再受时间和空间的制约,为人们的生活和工作带来了极大的便利。但是,受地域的影响,通信双方可能因语言不同,而导致沟通障碍。
因此,对于如何使得使用不同语言的通信双方通过手机实现无障碍沟通的研究,具有重要的实用价值。
发明内容
本申请提供了一种基于语音通话翻译能力的协商方法及电子设备,有助于降低电子设备在语音通话过程中出错的可能性,从而提高用户使用电子设备通话的效率。
第一方面,本申请实施例提供的一种基于语音通话翻译能力的协商方法,所述方法包括:
第一电子设备在与第二电子设备建立通信链路后,若语音通话翻译功能处于开启状态时,接收到所述第二电子设备发送的第一指示信息,所述第一指示信息用于指示所述第二电子设备语音通话翻译功能已开启;所述第一电子设备在语音通话翻译功能处于开启状态时,用于获取所述第一电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第二电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第二电子设备;所述第二电子设备在语音通话翻译功能处于开启状态时,用于获取所述第二电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第一电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第一电子设备;并响应于所述第一指示信息,所述第一电子设备自动关闭语音通话翻译功能。
本申请实施例可以能够在通信链路建立后,第一电子设备和第二电子设备在均支持双端语音翻译的情况下,只开启一方的语音通话翻译功能,从而有助于降低第一电子设备和第二电子设备均开启语音通话翻译功能的情况下,重复语音通话的翻译而导致出错的可能性,有助于提高用户使用电子设备通话的效率。
在一种可能的设计中,所述第一指示信息为以双音多频DTMF音发送的第一字符。有助于简化实现方式。
在一种可能的设计中,所述第一电子设备自动关闭语音通话翻译功能之后,向所述第二电子设备发送第二指示信息,所述第二指示信息用于指示所述第一电子设备语音通话翻译功能已关闭。从而有助于第一电子设备获知第二电子设备语音通话翻译功能开启或关闭 的情况。
在一种可能的设计中,所述第一电子设备在显示屏上显示第一提示信息,所述第一提示信息用于提示用户所述第二电子设备语音通话翻译功能已开启;和/或所述第一电子设备通过播报语音提示用户所述第二电子设备的语音通话翻译功能已开启。有助于提高电子设备与用户之间的交互。
在一种可能的设计中,所述第一电子设备自动关闭语音通话翻译功能后,所述第一电子设备禁止用户开启语音通话翻译功能。从而有助于降低用户误操作的可能性。
在一种可能的设计中,所述第一电子设备禁止用户开启语音通话翻译功能之后,在显示屏上显示第二提示信息,所述第二提示信息用于提示禁止用户开启语音通话翻译功能、并在所述第二电子设备的语音通话功能关闭或者通信链路断开后,取消对用户开启语音通话翻译功能的限制;和/或,所述第一电子设备通过播报语音提示禁止用户开启语音通话翻译功能,并在所述第二电子设备的语音通话功能关闭或者通信链路断开后,取消对用户开启语音通话翻译功能的限制。有助于提高电子设备与用户之间的交互。
第二方面,本申请实施例提供的另一种基于语音通话翻译能力的协商方法,所述方法包括:
第一电子设备在与第二电子设备建立通信链路后,若语音通话翻译功能处于开启状态时,接收到所述第二电子设备发送第一指示信息,所述第一指示信息用于指示所述第二电子设备语音通话翻译功能已开启;所述第一电子设备在语音通话翻译功能处于开启状态时,用于获取所述第一电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第二电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第二电子设备;所述第二电子设备在语音通话翻译功能处于开启状态时,用于获取所述第二电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第一电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第一电子设备;所述第一电子设备向所述第二电子设备发送的第二指示信息,所述第二指示信息指示所述第二电子设备关闭语音通话翻译功能。
本申请实施例可以能够在通信链路建立后,第一电子设备和第二电子设备在均支持双端语音翻译的情况下,只开启一方的语音通话翻译功能,从而有助于降低第一电子设备好第二电子设备均开启语音通话翻译功能的情况下,重复语音通话的翻译而导致出错的可能性,有助于提高用户使用电子设备通话的效率。
在一种可能的设计中,所述第一指示信息为以双音多频DTMF音发送的第一字符。有助于简化实现方式。
在一种可能的设计中,所述第一电子设备向所述第二电子设备发送的第二指示信息之后,接收所述第二电子设备发送第三指示信息,所述第三指示信息用于指示所述第二电子设备语音通话翻译功能已关闭。从而有助于第一电子设备获知第二电子设备语音通话翻译功能开启或关闭的情况。
在一种可能的设计中,所述第一电子设备关闭语音通话翻译功能之后,向第二电子设备发送第四指示信息,所述第四指示信息用于指示所述第一电子设备语音通话翻译功能已关闭。有助于使得第二电子设备在语音通话过程中在第一电子设备语音通话翻译功能关闭的情况下,开启本端的语音通话翻译功能,来提高语音通话的效率。
第三方面,本申请实施例中提供的一种基于语音通话翻译能力的协商方法,所述方法包括:
第一电子设备与第二电子设备建立通信链路后,若语音通话翻译功能处于开启状态时,接收所述第二电子设备发送第一指示信息,所述第一指示信息用于指示所述第二电子设备语音通话翻译功能已开启;所述第一电子设备当语音通话翻译功能处于开启状态时,用于获取所述第一电子设备通过麦克风采集的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第二电子设备;所述第二电子设备当语音通话翻译功能处于开启状态时,用于获取所述第二电子设备通过麦克风采集的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第一电子设备;所述第一电子设备接收所述第一指示信息后,关闭语音播报模式、且开启文本显示模式;所述第一电子设备在语音播报模式已关闭、文本显示模式已开启时,不播报所述第二电子设备通过麦克风采集的语音的翻译结果、显示所述第二电子设备通过麦克风采集的语音的翻译结果的文本;所述第一电子设备向所述第二电子设备发送的第二指示信息,所述第二指示信息用于指示所述第二电子设备关闭语音播报模式、且开启文本显示模式;所述第二电子设备在语音播报模式已关闭、文本显示模式已开启时,不播报所述第一电子设备通过麦克风采集的语音的翻译结果、显示所述第一电子设备通过麦克风采集的语音的翻译结果的文本。
本申请实施例中当第一电子设备和第二电子设备均支持本端的语音翻译的情况下,可以通过禁止播报语音的翻译结果,显示语音的翻译结果的文本来向来提示对方所表达的意思,从而有助于降低在语音播报时导致电子设备自身的麦克风采集到语音的翻译结果进行翻译的可能性,从而有助于提高电子设备的性能。
在一种可能的设计中,所述第一电子设备当语音通话翻译功能处于开启状态时,还用于将所述通过麦克风采集的语音发送给所述第二电子设备;所述第二电子设备当语音通话翻译功能处于开启状态时,还用于将通过麦克风采集的语音发送给所述第一电子设备。
在一种可能的设计中,所述第一电子设备在语音播报模式已关闭时,还包括不播报所述第二电子设备发送的通过麦克风采集的语音。有助于进一步提高电子设备的性能。
第四方面,本申请实施例提供的一种电子设备,包括:一个或多个处理器、存储器、多个应用程序、以及一个或多个计算机程序;其中,一个或多个计算机程序被存储在存储器中,当计算机程序被电子设备执行时,实现本申请实施例上述各个方面以及各个方面涉及的任一可能设计的方法。
第五方面,本申请实施例提供的一种芯片,所述芯片与电子设备中的存储器耦合,使得所述芯片在运行时调用所述存储器中存储的计算机程序,实现本申请实施例上述各个方面以及各个方面涉及的任一可能设计的方法。
第六方面,本申请实施例的一种计算机存储介质,该计算机存储介质存储有计算机程序,当所述计算机程序在电子设备上运行时,使得电子设备执行本申请实施例上述各个方面以及各个方面涉及的任一可能设计的方法。
第七方面,本申请实施例的一种计算机程序产品,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行实现本申请实施例上述各个方面以及各个方面涉及的任一可能设计的方法。
另外,第四方面至第七方面中任一种可能设计方式所带来的技术效果可参见方法部分 相关中不同设计方式所带来的技术效果,此处不再赘述。
图1为本申请实施例电子设备的硬件架构示意图;
图2为本申请实施例的通信系统架构示意图;
图3为本申请实施例一种基于语音通话翻译能力的协商方法的流程示意图;
图4a为本申请实施例的应用场景的示意图;
图4b为本申请实施例一种语音通话翻译功能的应用场景的示意图;
图5a为本申请实施例一种提示语音通话翻译功能开启的示意图;
图5b为本申请实施例另一种提示限制语音通话翻译功能的示意图;
图6为本申请实施例一种系统语言设置的示意图;
图7为本申请实施例一种对端语言设置的示意图;
图8为本申请实施例一种对端语言列表的示意图;
图9为本申请实施例另一种基于语音通话翻译能力的协商方法的流程示意图;
图10为本申请实施例一种用户界面的示意图;
图11为本申请实施例另一种基于语音通话翻译能力的协商方法的流程示意图;
图12为本申请实施例另一种用户界面的示意图;
图13A为本申请实施例另一种基于语音通话翻译能力的协商方法的流程示意图;
图13B本申请实施例另一种基于语音通话翻译能力的协商方法的流程示意图;
图14为本申请实施例另一种用户界面的示意图;
图15为本申请实施例另一种电子设备的结构示意图;
图16为本申请实施例另一种电子设备的结构示意图。
应理解,本申请实施例中“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系。例如,A和/或B,可以表示以下三种关系:单独存在A,同时存在A和B,单独存在B。其中A、B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一(项)个”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a、b或c中的至少一项(个),可以表示:a,b,c,a和b,a和c,b和c,或a、b和c,其中a、b、c可以是单个,也可以是多个。
应理解,本申请实施例可以应用于电子设备中。例如电子设备可以是便携式电子设备,诸如手机、平板电脑、具备无线通讯功能的可穿戴设备(如智能手表)、车载设备等。便携式电子设备的示例性实施例包括但不限于搭载
或者其它操作系统的便携式电子设备。上述便携式电子设备也可以是诸如具有触敏表面(例如触控面板)的膝上型计算机(Laptop)等。还应当理解的是,在本申请其他一些实施例中,电子设备100也可以是具有触敏表面(例如触控面板)的台式计算机。
示例的,图1示出了本申请实施例适用的一种电子设备的硬件结构示意图。其中,如图1所示,电子设备包括处理器110、内部存储器121、外部存储器接口122、天线1、移 动通信模块131、天线2、无线通信模块132、音频模块140、扬声器140A、受话器140B、麦克风140C、耳机接口140D、显示屏151、用户标识模块(subscriber identification module,SIM)卡接口152、摄像头153、按键154、传感器模块160、通用串行总线(universal serial bus,USB)接口170、充电管理模块180、电源管理模块181和电池182。在另一些实施例中,电子设备还可以包括马达、指示器等。
其中,处理器110可以包括一个或多个处理单元。例如:处理器110可以包括应用处理器(application processor,AP)、调制解调处理器、图形处理器(graphics processing unit,GPU)、图像信号处理器(image signal processor,ISP)、控制器、视频编解码器、数字信号处理器(digital signal processor,DSP)、基带处理器、和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
在一些实施例中,处理器110中还可以设置存储器,用于存储指令和数据。示例的,处理器110中的存储器可以为高速缓冲存储器。该存储器可以用于保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从该存储器中直接调用。从而有助于避免重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
内部存储器121可以用于存储计算机可执行程序代码。所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等。存储数据区可存储电子设备使用过程中所创建的数据(比如音频数据、电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、通用闪存存储器(universal flash storage,UFS)等。
外部存储器接口122可以用于连接外部存储卡(例如,Micro SD卡),实现扩展电子设备的存储能力。外部存储卡通过外部存储器接口122与处理器110通信,实现数据存储功能。例如将音乐、视频等文件保存在外部存储卡中。
天线1和天线2用于发射和接收电磁波信号。电子设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块131可以提供应用在电子设备上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块131可以包括至少一个滤波器、开关、功率放大器、低噪声放大器(low noise amplifier,LNA)等。移动通信模块131可以由天线1接收电磁波信号,并对接收的电磁波信号进行滤波、放大等处理,传送至调制解调处理器进行解调。移动通信模块131还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波信号辐射出去。在一些实施例中,移动通信模块131的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块131的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。例如,移动通信模块131可以向其它电子设备发送语音,也可以接收其它电子设备发送的语音。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信 号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器140A、受话器140B等)输出声音信号,或通过显示屏151显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块131或其他功能模块设置在同一个器件中。
无线通信模块132可以提供应用在电子设备上的包括无线局域网(wireless local area networks,WLAN)(如Wi-Fi网络)、蓝牙(bluetooth,BT)、全球导航卫星系统(global navigation satellite system,GNSS)、调频(frequency modulation,FM)、近距离无线通信技术(near field communication,NFC)、红外技术(infrared,IR)等无线通信的解决方案。无线通信模块132可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块132经由天线2接收电磁波信号,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块132还可以从处理器110接收待发送的信号,对其进行调频、放大,经天线2转为电磁波信号辐射出去。
在一些实施例中,电子设备的天线1和移动通信模块131耦合,天线2和无线通信模块132耦合,使得电子设备可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM)、通用分组无线服务(general packet radio service,GPRS)、码分多址接入(code division multiple access,CDMA)、宽带码分多址(wideband code division multiple access,WCDMA)、时分码分多址(time-division code division multiple access,TD-SCDMA)、长期演进(long term evolution,LTE)、BT、GNSS、WLAN、NFC、FM、和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS)、全球导航卫星系统(global navigation satellite system,GLONASS)、北斗卫星导航系统(beidou navigation satellite system,BDS)、准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
电子设备可以通过音频模块140、扬声器140A、受话器140B、麦克风140C、耳机接口140D以及应用处理器等实现音频功能。例如音乐播放、录音等。
音频模块140可以用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块140还可以用于对音频信号编码和解码。在一些实施例中,音频模块140可以设置于处理器110中,或将音频模块140的部分功能模块设置于处理器110中。
扬声器140A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备可以通过扬声器140A收听音乐、或接听免提通话。
受话器140B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备接听电话或语音信息时,可以通过将受话器140B靠近人耳接听语音。
麦克风140C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风140C发声,麦克风140C可以用于采集用户的声音,然后,将用户的声音转换为电信号。电子设备可以设置至少一个麦克风140C。在另一些实施例中,电子设备可以设置两个麦克风140C,除了采集声音信号,还可以实 现降噪功能。在另一些实施例中,电子设备还可以设置三个、四个或更多麦克风140C,实现声音信号采集、降噪、还可以识别声音来源,实现定向录音功能等。
耳机接口140D用于连接有线耳机。耳机接口140D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口、美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口等。
电子设备可以通过GPU、显示屏151、以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏151和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏151可以用于显示图像、视频等。显示屏151可以包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD)、有机发光二极管(organic light-emitting diode,OLED)、有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED)、柔性发光二极管(flex light-emitting diode,FLED)、Miniled、MicroLed、Micro-oLed、量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备可以包括1个或N个显示屏151,N为大于1的正整数。
电子设备可以通过ISP、摄像头153、视频编解码器、GPU、显示屏151以及应用处理器等实现拍摄功能。
ISP可以用于处理摄像头153反馈的数据。例如,拍照时,打开快门,通过摄像头153采集光信号,然后摄像头153将采集的光信号转换为电信号,并将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点、亮度、肤色进行算法优化。ISP还可以对拍摄场景的曝光、色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头153可以用于捕获静态图像或视频。通常情况下,摄像头153包括镜头和图像传感器。其中,物体通过镜头生成光学图像投射到图形传感器。图像传感器可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。图像传感器把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB、YUV等格式的图像信号。在一些实施例中,电子设备可以包括1个或N个摄像头153,N为大于1的正整数。
按键154可以包括开机键、音量键等。按键154可以是机械按键。也可以是触摸式按键。电子设备可以接收按键输入,产生与电子设备的用户设置以及功能控制有关的键信号输入。
传感器模块160可以包括一个或多个传感器。例如,触摸传感器160A、指纹传感器160B、陀螺仪传感器160C、压力传感器160D、加速度传感器160E等。在一些实施例中,传感器模块160还可以包括环境传感器、距离传感器、接近光传感器、骨传导传感器等。
触摸传感器160A,也可称为“触控面板”。触摸传感器160A可以设置于显示屏151,由触摸传感器160A与显示屏151组成触摸屏,也称“触控屏”。触摸传感器160A用于检测作用于其上或附近的触摸操作。触摸传感器160A可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏151提供与触摸操作相关的视觉输出。在 另一些实施例中,触摸传感器160A也可以设置于电子设备的表面,与显示屏151所处的位置不同。
指纹传感器160可以用于采集指纹。电子设备可以利用采集的指纹特性实现指纹解锁、访问应用锁、指纹拍照、指纹接听来电等。
陀螺仪传感器160C可以用于确定电子设备的运动姿态。在一些实施例中,可以通过陀螺仪传感器160C确定电子设备围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器160C可以用于拍摄防抖。示例性的,当按下快门,陀螺仪传感器160C检测电子设备抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消电子设备的抖动,实现防抖。陀螺仪传感器160C还可以用于导航、体感游戏场景。
压力传感器160D用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器160D可以设置于显示屏151。压力传感器160D的种类很多,如电阻式压力传感器、电感式压力传感器、电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。电子设备根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,电子设备根据压力传感器180A检测所述触摸操作强度。电子设备也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
加速度传感器160E可检测电子设备在各个方向上(一般为三轴)加速度的大小。当电子设备静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换、计步器等应用。
在另一些实施例中,处理器110还可以包括一个或多个接口。例如,接口可以为SIM卡接口152。又例如,接口还可以为USB接口170。再例如,接口还可以为集成电路(inter-integrated circuit,I2C)接口、集成电路内置音频(inter-integrated circuit sound,I2S)接口、脉冲编码调制(pulse code modulation,PCM)接口、通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口、移动产业处理器接口(mobile industry processor interface,MIPI)、通用输入输出(general-purpose input/output,GPIO)接口等。可以理解的是,本申请实施例处理器110可以通过接口连接电子设备的不同模块,从而使得电子设备能够实现不同的功能。例如拍照、处理等。需要说明的是,本申请实施例对电子设备中接口的连接方式不作限定。
其中,SIM卡接口152可以用于连接SIM卡。SIM卡可以通过插入SIM卡接口152,或从SIM卡接口152拔出,实现和电子设备的接触和分离。电子设备可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口152可以支持Nano SIM卡、Micro SIM卡、SIM卡等。同一个SIM卡接口152可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口152也可以兼容不同类型的SIM卡。SIM卡接口152也可以兼容外部存储卡。电子设备通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,电子设备采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在电子设备中,不能和电子设备分离。
USB接口170是符合USB标准规范的接口。例如,USB接口170可以包括Mini USB接口、Micro USB接口、USB Type C接口等。USB接口170可以用于连接充电器为电子设备充电,也可以用于电子设备与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。USB接口170还可以用于连接其他电子设备,例如增强现实技术(augmented reality,AR)设备等。
充电管理模块180用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块180可以通过USB接口170接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块180可以通过电子设备的无线充电线圈接收无线充电输入。充电管理模块140为电池182充电的同时,还可以通过电源管理模块181为电子设备供电。
电源管理模块181用于连接电池182,充电管理模块180与处理器110。电源管理模块181接收电池182和/或充电管理模块180的输入,为处理器110、内部存储器121、外部存储器、显示屏151、摄像头153、移动通信模块131和无线通信模块132等供电。电源管理模块181还可以用于监测电池容量、电池循环次数、电池健康状态(漏电、阻抗)等参数。在其他一些实施例中,电源管理模块181也可以设置于处理器110中。在另一些实施例中,电源管理模块181和充电管理模块180也可以设置于同一个器件中。
应理解,图1所示的硬件结构仅是一个示例。本申请实施例的电子设备可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
如图2所示,为本申请实施例适用的一种通信系统的架构示意图。具体的,图2所示的通信系统架构包括电子设备100、电子设备200和移动通信网络。电子设备100和电子设备200可以通过移动通信网络进行通信。其中,移动通信网络可以为第二代移动通信(2nd-generation,2G)网络、或者第三代移动通信(3rd-generation,3G)网络,又可以为第四代移动通信(4th-generation,4G)网络,还可以第五代移动通信(5th-generation,5G)网络等。需要说明的是,电子设备100和/或电子设备200的硬件结构可以参见图1所示的电子设备的硬件结构。还需要说明的是,图2所示的通信系统架构仅为示意图,并不对图2所示的通信系统中电子设备的数量不作限制。
例如,用户A使用电子设备100,用户B使用电子设备200,在用户A使用语言1和用户B使用语言2的情况下,当用户A和用户B通话时,为了使得用户B可以理解用户A所说的话,本申请实施例中可以将用户A的语音翻译为语言2,为了使得用户A可以理解用户B所说的话,本申请实施例中可以将用户B的语音翻译为语言1。
在一些实施例中,电子设备100和电子设备200中的至少一个电子设备可以实现双端语音翻译,即由一个电子设备来执行翻译功能,翻译本端的语音和翻译对端的语音。以电子设备100为例。本申请实施例中电子设备100可以在用户A和用户B通话的过程中,采集到用户A的语音后,获取用户A的语音的翻译结果,用户A的语音的翻译结果使用语言2。然后,电子设备100通过移动通信网络将获取的用户A的语音的翻译结果发送给电子设备200,从而使得电子设备200能够直接向用户B播放语言2的语音。另外,在一些实施例中,电子设备100还可以将用户A的语音发送给电子设备200。而电子设备200可以将采集的用户B的 语音通过移动通信网络发送给电子设备100,电子设备100在接收到电子设备200发送用户B的语音后,可以获取用户B的语音的翻译结果,用户B的语音的翻译结果为语言1,然后播放给用户A,从而有助于用户A与用户B在语言不通的情况下进行沟通。在一些实施例中,电子设备100还可以将用户B的语音的翻译结果发送给电子设备200。以语言1为中文、语言2为英文为例。例如,电子设备100采集的用户A的语音为“我是露西,有什么需要帮助您的吗?”,获取的用户A的语音的翻译结果为“This is Lucy speaking,may I help you?”,并将“This is Lucy speaking,may I help you?”的语音发送给电子设备200,以使得电子设备200向用户B播放“This is Lucy speaking,may I help you?”的语音,从而使得用户B在不懂中文的情况下,可以明白用户A所表达的意思。电子设备200在采集到用户B的语音“I want to buy a ticket”后,将用户B的语音“I want to buy a ticket”通过移动通信网络发送给电子设备100。电子设备100在接收到电子设备200发送的“I want to buy a ticket”的语音后,获取用户B的语音的翻译结果“我想买一张票”,并将“我想买一张票”的语音播放给用户A,从而使得用户A在不懂英文的情况下,可以明白用户B所表达的意思。
应理解,在本申请实施例中电子设备100还可以将用户A的语音通过移动通信网络发送给电子设备200,以使得电子设备200可以播放用户A的语音。电子设备100在获取到用户B的语音的翻译结果后,还可以通过移动通信网络将用户B的语音的翻译结果发送给电子设备200,以使得电子设备200还可以播放用户B的语音的翻译结果。另外,在一些实施例中,电子设备100在接收到电子设备200发送的用户B的语音后,还可以向用户A播放用户B的语音。
电子设备执行翻译功能,可以是电子设备本身进行语言的翻译,也可以是电子设备与翻译服务器通信,由翻译服务器进行翻译。
示例的,本申请实施例中,可以在电子设备100中预先配置翻译引擎,通过翻译引擎对用户A的语音和用户B的语音进行翻译。在另一些实施例中,为了降低对电子设备100处理性能的要求,图2所示的通信系统架构中还可以包括翻译服务器,电子设备100还可以将用户A的语音和/或用户B的语音发送到翻译服务器,由翻译服务器对用户A的语音和/或用户B的语音进行翻译后,将翻译结果返回到电子设备100。需要说明的是,本申请实施例中对通信系统结构中包括的翻译服务器的个数不作限定。其中,用于对用户A的语音进行翻译的翻译服务器和用于对用户B的语音进行翻译的翻译服务器可以相同,也可以不同。可以理解地,电子设备与翻译服务器可以是通过移动通信网络进行通信的,也可以是通过WiFi网络等其它网络进行通信的。可以理解地,翻译结果可以是音频格式的。本申请中对如何获取翻译结果的方式不做限定。
因而,当电子设备可以实现双端语音翻译的情况下,双方在通话时所使用的电子设备中的其中一个电子设备支持语音通话翻译功能即可。但是在实际通话过程中,双方所使用的电子设备有可能同时支持语音通话翻译功能,若双方所使用的电子设备同时支持语音通话翻译功能,以电子设备100和电子设备200为例,为了降低对通话过程中对用户A的语音和用户B的语音重复翻译的可能性,电子设备100和电子设备200可以在建立通信链路后,进行语音通话翻译能力的协商。
在一些实施例中,电子设备100和电子设备200可以在建立通信链路后,进行语音通话翻译能力的协商,以使得在电子设备100和电子设备200在都支持语音通话翻译功能的情况 下,若电子设备100和电子设备200的语音通话翻译功能均已开启,则关闭电子设备100和电子设备200其中一个电子设备的语音通话翻译功能,而另一个电子设备的语音通话翻译功能保持开启,从而有助于避免重复翻译。示例性地,电子设备100的语音通话翻译功能已开启,指的是电子设备100的语音通话翻译功能处于开启的状态。其中,电子设备100可以响应于用户的操作开启语音通话翻译功能或者响应于电子设备100的语言配置自动开启语音通话翻译功能,使得电子设备100的语音通话翻译功能处于开启状态。电子设备100的语音通话翻译功能处于开启状态且电子设备100和200建立了通信链接时,电子设备100可以用于获取通过电子设备100的麦克风或者其它声音传感器采集的用户A的语音的翻译结果,以及获取接收到的电子设备200发送用户B的语音的翻译结果,并将用户A的语音的翻译结果发送给电子设备200。在一些实施例中,电子设备100的语音通话翻译功能处于开启状态时,还可以用于将获取的用户B的语音的翻译结果发送给电子设备200。在另一些实施例中,电子设备100的语音通话翻译功能处于开启状态时,还可以用于将语音转化为文字。例如,电子设备100可以将采集的用户A的语音、获取的用户A的语音的翻译结果、用户B的语音、用户B的语音的翻译结果均转化为文字,并显示。此外,电子设备100还可以将语音转化为的文字发送给电子设备200,也可以不发送给电子设备200。电子设备100在不将语音转化为的文字发送给电子设备200的情况下,电子设备200可以进行语音识别,将语音转化为文字。电子设备200的语音通话翻译功能已开启时,电子设备200可以实现的功能可以参见电子设备100的实现方式。
下面结合图2所示的通信系统架构,对电子设备100和电子设备200进行语音通话翻译能力的协商方法进行详细介绍。
如图3所示,为本申请实施例语音通话翻译能力的协商方法的流程示意图。具体包括以下步骤。
步骤301,电子设备100向电子设备200发送呼叫请求。
用户A使用电子设备100,用户B使用电子设备200。示例的,如图4a所示,电子设备100显示用户界面400。其中,用户界面400包括电话图标401。在另一些实施例中,用户界面400还可以包括其它应用的图标,例如微信图标、设置图标、相机图标等。电子设备100可以响应于对电话图标401的操作,在显示屏上显示用户界面410。用户界面410包括拨号键盘412。用户可以通过触摸拨号键盘412上包括的相应的符号,来输入用户B的电话号码。例如,用户界面410包括输入的用户B的电话号码“12345659876”。电子设备100响应于对拨号按钮411的操作,向电子设备200发送呼叫请求,并显示用户界面420。又示例的,当电子设备100中存储有用户B的电话号码时,电子设备100还可以响应于对联系人中的用户B的操作,向电子设备200发送呼叫请求,以及在显示屏显示用户界面420。又示例的,电子设备100还可以响应于语音指令“拨打用户B的电话”,向电子设备200发送呼叫请求,以及在显示屏显示用户界面420。本申请实施例用户还可以通过对电子设备进行其它操作,使得电子设备100向电子设备200发送呼叫请求。
需要说明的是,当电子设备100支持语音通话翻译功能时,为了便于用户与电子设备100之间的交互,在一些实施例中,用户界面420还可以包括语音翻译按钮421。示例的,电子设备100可以在响应于用户A拨打用户B电话的操作时,激活用户界面420上的语音翻译按钮421,使得用户可以对语音翻译按钮421进行操作。在另一些实施例中,当电子设备 100支持语音通话翻译功能时,电子设备100还可以在与电子设备200的通信链路建立完成后,激活用户界面420上的语音翻译按钮421,电子设备100当与电子设备200的通信链路未建立完成时,不激活用户界面420上的语音翻译按钮421。例如,不激活语音翻译按钮421可以表现为语音翻译按钮421置灰从而使得用户无法操作语音翻译按钮421,或者在用户界面420上不显示语音翻译按钮421。当电子设备100不支持语音通过翻译功能时,用户界面420上可以不包括语音翻译按钮421,也可以将语音翻译按钮421置灰,使得用户无法对语音翻译按钮421进行操作。在一些实施例中,语音翻译按钮421激活后,电子设备100可以响应于用户对语音翻译按钮421的操作,开启或关闭电子设备100的语音通话翻译功能。其中,语言翻译按钮421为开启(ON)时,电子设备100语言通话翻译功能处于开启状态;语言翻译按钮421为关闭(OFF)时,电子设备100语言通话翻译功能处于关闭状态。
在另外一些实施例中,电子设备100还可以响应于对语音翻译按钮421的操作,在显示屏显示用户界面430。用户界面430包括语音翻译按钮431。电子设备100可以响应于对语音翻译按钮431的操作,开启或关闭电子设备100的语音通话翻译功能。此外,为了便于用户对语言进行设置,在一些实施例中,用户界面430还包括本端语言设置按钮432和对端语言设置按钮433。应理解,本端语言设置按钮432用于设置用户A使用的语言,对端语言设置按钮432用于设置用户B使用的语言。
步骤302,电子设备200接收到电子设备100发送的呼叫请求后,向电子设备100发送接受呼叫请求的响应。
示例的,如图4b所示,电子设备200接收到电子设备100的呼叫请求后,响应于电子设备100的呼叫请求,在显示屏显示用户界面430。用户界面430包括接受按钮431和拒绝按钮432。电子设备200响应于对接受按钮431的操作,向电子设备100发送接收呼叫请求的响应,以及在显示屏显示用户界面440。在一些实施例中,当电子设备200支持语音通话翻译功能时,为了便于用户开启或关闭电子设备200的语音通话翻译功能,用户界面430还可以包括语音翻译按钮433,使得用户B可以在接受电子设备100的呼叫请求之前,开启或关闭语音通话翻译功能。其中,电子设备200响应于对语音翻译按钮433的操作的实现方式,可以参见本申请实施例中电子设备100响应于对语音翻译按钮421的操作的实现方式。在另一些实施例中,电子设备200在响应于用户接受电子设备100的呼叫请求之前,不激活语音通话翻译功能,使得用户无法开启或关闭语音通话翻译功能,在这种情况下,用户界面430可以不包括语音翻译按钮433,或者,用户界面430包括语音翻译按钮433,但语音翻译按钮433置灰使得用户无法进行操作。当电子设备200响应于用户接受电子设备100的呼叫请求后,激活语音通话翻译功能,使得用户可以开启或关闭语音通话翻译功能。
示例的,以电子设备100为主叫端,电子设备200为被叫端为例。当电子设备100和电子设备200均支持语音通话翻译功能时,在通话链路建立完成前,可以只激活主叫端的语音翻译按钮,不激活被叫端的语音翻译按钮,即只有主叫端的用户可以在发起呼叫后,通话链路还未建立前操作语音翻译按钮,打开主叫端的语音通话翻译功能,而被叫端的用户不可以对被叫端的语音翻译按钮操作,打开被叫端的语音通话的翻译功能。以此避免在通话链路建立完成前,电子设备100和电子设备200都开启语音翻译功能。
另外,当电子设备200不支持语音通话翻译功能时,用户界面430上可以不包括语音翻译按钮433,也可以将语音翻译按钮433置灰。
又示例的,电子设备200还可以在接收到电子设备100发送的呼叫请求后,响应于接听用户A的电话的语音指令,向电子设备100发送接受呼叫请求的响应。本申请实施例不限于触发向电子设备100发送接受呼叫请求的响应的方式。
需要说明的是,电子设备100和电子设备200可以通过呼叫请求和接受呼叫请求的响应完成通信链路的建立。
另外,还需要说明的是,电子设备200还可以响应于接受电子设备100的呼叫请求的操作,在显示屏显示用户界面440。本申请实施例中电子设备200支持语音通话翻译功能时,为了便于用户与电子设备200之间的交互,在一些实施例中,用户界面440上还可以包括语音翻译按钮441。当电子设备200在不支持语音通话翻译功能时,用户界面440上可以不包括语音翻译按钮441,也可以将语音翻译按钮441置灰。另外,本申请实施例中语音翻译按钮441的功能,可以参见图4a中所示的语音翻译按钮421的功能。
在一些实施例中,为了便于用户B进行语言设置,图4b所示的用户界面450还可以包括本端语言设置按钮452和对端语言设置按钮453。其中,本端语言设置按钮452可以用于设置用户B使用的语言,对端语言设置按钮453可以用于设置用户A所使用的语言。
本申请实施例中,电子设备100和电子设备200可以在通信链路建立完成后进行语音通话翻译能力的协商。下面以电子设备100发起语音通话翻译能力的协商为例进行详细说明。电子设备100在接收到接受呼叫请求的响应,并建立与电子设备200之间的通信链路完成后,执行步骤303。可以理解地,电子设备100在通信链路建立完成前可以打开语音翻译功能,需在通信链路建立完成后与电子设备200进行语音通话翻译能力的协商。电子设备100也可以通信链路建立完成后才开启语音翻译功能,可以自动开启语音翻译功能,也可以通信链路完成之后响应于用户的操作开启语音翻译功能。
步骤303,电子设备100向电子设备200发送第一字符。第一字符用于指示电子设备100语音通话翻译功能已开启。示例的,电子设备100可以DTMF音的形式向电子设备200发送第一字符。例如,第一字符可以为1,还可以为0、或者其它正整数,又可以为#,还可以为*等。
电子设备200接收到第一字符前语音通话翻译功能已开启时,执行步骤304。
步骤304,电子设备200自动关闭语音通话翻译功能。
例如,如图4b所示的用户界面450,电子设备200在接收到第一字符后,自动将语音翻译按钮451从开启(ON)切换为关闭(OFF)。
因而,通过上述技术方案,使得电子设备100和电子设备200可以实现语音通话翻译能力的协商,从而有助于避免重复翻译,进而有助于降低出错的可能性。
为了便于用户了解电子设备200自动关闭语音通话翻译功能的情况,在一些实施例中,电子设备200在接收到第一字符后,还向用户提示电子设备100的语音通话翻译功能已开启。示例的,电子设备200可以以语音的形式提示用户电子设备100的语音通话翻译功能已开启。又示例的,电子设备200还可以在显示屏上显示第一提示信息。第一提示信息用于提示用户电子设备100的语音通话翻译功能已开启。例如,如图5a所示,电子设备200可以接收到第一字符后,在显示屏上显示提示框600。其中,提示框600包括第一提示信息。第一提示信息可以为对端电子设备的语音通话翻译功能已开启。
为了提高用户A和用户B语音通话过程中语音通话翻译的可靠性,电子设备200还可以 在自动关闭语音通话翻译功能之后,禁止用户开启语音通话翻译功能。以图4b所示的用户界面440为例,为了便于禁止用户开启语音通话翻译功能,示例的,电子设备200可以将语音翻译按钮441置灰,或者隐藏语音翻译按钮441。电子设备200可以在通话过程中接收到由电子设备100发送的电子设备100的语音通话翻译功能已关闭的通知或者在与电子设备100的通信链路断开后,取消用户对电子设备200的语音通话翻译功能开启的限制。例如,以图4b所示的用户界面440为例,电子设备200取消用户对电子设备200的语音通话翻译功能开启的限制可以表现为激活语音翻译按钮441,以使得用户可以对语音翻译按钮411操作来开启或关闭电子设备200的语音通话翻译功能。为了提高用户与电子设备200的交互,在一些实施例中,电子设备200在禁止用户开启语音通话翻译功能后,还提示用户禁止开启语音通话翻译功能。在另一些实施例中,电子设备200在禁止用户开启语音通话翻译功能后,除了提示用户禁止开启语音通话翻译功能以外,还提示用户取消对语音通话翻译功能开启限制的时机。示例的,电子设备200可以通过语音提示用户禁止开启语音通话翻译功能,以及提示用户取消对语音通话翻译功能开启限制的时机。又示例,电子设备200还可以通过在显示屏显示第二提示信息来提示用户。其中第二提示信息用于提示用户禁止开启语音通话翻译功能,以及提示取消对语音通话翻译功能开启限制的时机。例如,如图5b所示,电子设备200可以通过在显示屏显示提示框510来提示用户。其中提示框510包括第二提示信息。示例的,取消对语音通话翻译功能开启限制的时机为电子设备100的语音通话翻译功能已关闭时或者通信链路断开时,第二提示信息可以为禁止开启语音通话翻译功能,当对端的语音通话翻译功能已关闭时或者通信链路断开时取消限制。
需要说明的是,在本申请实施例中,电子设备200可以在自动关闭语音通话翻译功能后,向用户提示第一提示信息和第二提示信息,也可以在电子设备200接收到第一字符后,向用户提示第一提示信息,在关闭语音通话翻译功能后,向用户提示第二提示信息,对此不作限定。
另外,为了使得电子设备100确定语音通话翻译能力的协商完成,在一些实施例中,电子设备200还可以向电子设备100发送第二字符,第二字符用于指示电子设备200的语音通话翻译功能已关闭。电子设备100在接收到第二字符后,确定语音通话翻译能力的协商已完成。示例的,电子设备200还可以以DTMF音的形式向电子设备100发送第二字符。其中第二字符可以为除第一字符以外的其它字符,例如第一字符为1,第二字符可以为2,还可以为除1以外的其它正整数,还可以为#或者*等。
需要说明的是,本申请实施例中第一字符和第二字符的功能可以以通信协议的形式预先约定。
电子设备100接收到电子设备200发送的第二字符后,还可以使用语言1播放语音通话翻译功能已开启的提示音,以及向电子设备200发送翻译为语言2的语音通话翻译功能已开启的提示音。例如语言1为中文时,开启翻译功能提示音的文本可以为“欢迎使用语音通话翻译功能,在语音播报完毕后开始通话”。
上述以电子设备100发起语音通话翻译能力的协商进行举例,电子设备200发起语音通话翻译能力的协商方法可以参考上述步骤303和304。
若电子设备100和电子设备200中只有一个电子设备开启语音通话翻译功能,则在通信链路建立完成后,由开启语音通话翻译功能的电子设备向另外一个电子设备发起语音通话 翻译能力的协商。
以电子设备100开启语音通话翻译功能,电子设备200不支持或者未开启语音通话翻译功能为例,电子设备100和电子设备200的通信链路建立完成后,电子设备100向电子设备200发送第一字符。第一字符用于指示电子设备100语音通话翻译功能已开启。示例的,电子设备100可以双音多频(dual tone multi frequency,DTMF)音的形式向电子设备200发送第一字符。例如,第一字符可以为1,还可以为0、或者其它正整数,又可以为#,还可以为*等。由于电子设备200不支持或未开启语音通话翻译功能,电子设备200无法识别第一字符,因此在一些实施例中,电子设备200不对接收到来自电子设备100发送的第一字符做出响应。电子设备100在预设时长内未接收到电子设备200作出的响应,则确认电子设备200未开启或者不支持语音通话翻译功能。在另一些实施例中,电子设备200在无法识别第一字符时,可以向电子设备100发送目标字符,例如目标字符可以为预先设定的不同于第一字符的字符。示例的,电子设备200可以DTMF音的形式向电子设备100发送目标字符。电子设备100在接收到目标字符后,确认电子设备200未开启或不支持语音通话翻译功能。
当电子设备100不支持或者关闭语音通话翻译功能,电子设备200的语音通话翻译功能已开启时,电子设备100与电子设备200语音通话翻译能力的协调方法,可以参见当电子设备100开启语音通话翻译功能,电子设备200不支持或者关闭语音通话翻译功能时电子设备100与电子设备200语音通话翻译能力的协调方式。
当电子设备100和电子设备200均支持语音通话翻译功能时,若电子设备100和电子设备200在通信链路建立完成前语音翻译功能均已开启,在一些实施例中,可以由电子设备100和电子设备200中先完成通信链路建立的电子设备发起语音通话翻译能力的协商,也可以由主叫端发起语音通话翻译能力的协商,还可以由被叫端发起语音通话翻译能力的协商等,本申请实施例发起语音通话翻译能力的协商的电子设备不作限定。若电子设备100和电子设备200在通信链路建立完成后同时开启语音翻译功能,这种情况比较少见,在一些实施例中,可以由电子设备100和电子设备200中任一电子设备发起语音通话翻译能力的协商,也可以由主叫端发起语音通话翻译能力的协商,还可以由被叫端发起语音通话翻译能力的协商等,本申请实施例发起语音通话翻译能力的协商的电子设备不作限定。
当电子设备100和电子设备200均支持语音翻译功能时,在一些实施例中,也可以由主叫端自动开启语音通话翻译功能并发起语音通话翻译能力的协商,还可以由被叫端自动开启语音通话翻译功能发起语音通话翻译能力的协商等,本申请实施例发起语音通话翻译能力的协商的电子设备不作限定。
需要说明的是,本申请实施例中,电子设备100和/或电子设备200在支持语音通话翻译功能时,可以自动开启语音通话翻译功能,也可以响应于用户的操作,开启语音通话翻译功能。
以电子设备100为例,电子设备100可以在发起向电子设备200的呼叫后,在一些实施例中,电子设备100可以根据通话记录中用户A使用的语言和用户B使用的语言,判断是否自动开启语音通话翻译功能。电子设备100当通话记录中用户A使用的语言和用户B使用的语言不同时,自动开启语音通话翻译功能。再示例的,电子设备100也可以根据预先设置的本端语言和对端语言不同时,自动开启语音通话翻译功能。又示例的,电子设备100也可以在用户A的电话号码的归属地的母语和用户B的电话号码的归属地的母语不同时,自 动开启语音通话翻译功能。
在一些实施例中,本申请实施例中用户可以通过对系统语言进行设置来设置本端语言。例如,如图6所示,电子设备100的显示屏显示用户界面400。用户界面400包括设置图标600。此外,用户界面400还可以包括其它应用图标,例如相机图标、微信图标等。电子设备100可以响应于对设置图标600的操作,在显示屏显示系统设置界面610。系统设置界面610包括语言与地区设置按钮611。应理解,系统设置界面610还可以包括其它多个设置按钮,例如开启云备份、屏幕锁定等。电子设备100响应于对语言与地区设置按钮611的操作,在显示屏显示用户界面620。用户界面620包括系统语言设置按钮621。用户可以通过对系统语言设置按钮进行操作来设置系统语言。例如,图6所示的用户界面600上将系统语言设置为简体中文,则电子设备100确定本端语言为简体中文,当电子设备100接收到电子设备200发送的用户B的语音后,获取的用户B的语音的翻译结果所使用的语言为简体中文。
另外,在一些实施例中,用户A可以通过针对用户B设置的语言来设置对端语言。例如,如图7所示,电子设备100的显示屏显示用户界面400。电子设备100响应于对电话图标的操作,在显示屏显示用户界面710。用户界面710包括联系人列表711和功能栏712。功能栏712包括新建联系人按钮等。电子设备100可以响应于对联系人列表711中用户B的操作,在显示屏显示用户界面720。用户界面720包括语言设置按钮721。语言设置按钮721用于对用户B所使用的语言进行设置。另外,用户界面720还可以包括用户B的名称、联系方式(如电话号码、邮箱等),以及发送信息等功能按钮。用户可以通过对语言设置按钮721操作来设置对端语言。例如,如图8所示,电子设备100响应于对语言设置按钮721的操作,在显示屏显示语言列表800。语言列表中包括电子设备100所支持的语言和/或翻译服务器所支持的语言。用户可以通过选中语言列表800中的语言来设置对端语言,例如用户选中英文,则将对端语言设置为英文。用户还可以通过上下滑动语言列表800,来查找需要设置的语言。
在另一些实施例中,为了便于用户操作,用户还可以通过图4a所示的用户界面430上包括的本端语言设置按钮432对本端语言进行设置,以及通过对端语言设置按钮433对对端语言进行设置。另外,本申请实施例中本端语言设置按钮432和对端语言设置按钮433还可以位于用户界面420上。
电子设备200当支持语音通话翻译功能时,在接收到电子设备100的呼叫请求后,可以自动开启语音通话翻译功能的方式,具体的可以参见电子设备100自动开启语音通话翻译功能的方式,在此不再赘述。此外,用户还可以通过电子设备200的显示屏显示的用户界面手动开启或关闭通话翻译功能。例如,用户界面可以为如图4b所示的用户界面430、或者用户界面440,亦或是用户界面450等。
本申请的上述实施例也可以理解为:电子设备(即本端)接收到对端发送的第一字符,所述第一字符用于指示对端开启语音通话翻译功能,若本端在收到所述第一字符之前已开启了本端的语音通话翻译功能,则关闭本端的语音通话翻译功能,可选地,在关闭本端的语音通话翻译功能后本端向对端发送第二字符,通知对端本端的语音通话翻译功能已关闭。若本端在收到所述第一字符之时未开启语音通话翻译功能或不支持语音翻译功能时,不做响应;或者发送目标字符(如第二字符,或者第一字符或第二字符以外的字符)给对端,通知对端本端未开启语音通话翻译功能或不支持语音翻译功能。
如图9所示,为本申请实施例提供的另一种语音通话翻译能力协商的方法的流程示意图。具体包括以下步骤。
步骤901,电子设备100向电子设备200发送呼叫请求。
步骤902,电子设备200接收到电子设备100发送的呼叫请求后,向电子设备100发送接受呼叫请求的响应。
本申请实施例中步骤901和步骤902的具体实现方式,可以参见图3所示的语音通话翻译能力协商的方法中步骤301和步骤302的具体实现方式,在此不再赘述。
步骤903,电子设备100接收到接受呼叫请求的响应后,若语音通话翻译功能已开启,则向电子设备200发送第三字符。第三字符用于指示电子设备100语音通话翻译功能已开启。示例的,电子设备100可以DTMF音的形式向电子设备200发送第三字符。例如,第三字符可以为1,还可以为0、或者其它正整数,又可以为#,还可以为*等。
需要说明的是,本申请实施例中是以电子设备100发起语音通话翻译能力的协商为例进行介绍的。例如,当发起语音通话翻译能力的协商的电子设备为优先完成通信链路建立的电子设备时,则电子设备100为电子设备100和电子设备200中先完成通信链路建立的电子设备。再例如,当发起语音通话翻译能力协商的电子设备为主叫端时,电子设备100为主叫端。又例如,当发起语音翻译能力协商的电子设备为被叫端时,是由电子设备200在响应于用户的操作接受电子设备100发送的呼叫请求后,向电子设备100发送接受呼叫请求的响应,以及第三字符,其中,第三字符用于指示电子设备200语音通话翻译功能已开启。
还需要说明的是,当电子设备100和电子设备200中只有一个电子设备开启语音通话翻译功能,而另外一个电子设备不支持或关闭语音通话翻译功能时,由开启语音通话翻译功能的电子设备发起语音通话翻译能力的协商。图9所示方法中,由哪个电子设备发起语音通话翻译能力的协商可以参考图3所示实施例的相关描述。
步骤904,电子设备200接收到第三字符前语音通话翻译功能已开启,则向电子设备100发送第四字符。第四字符用于通知电子设备100关闭语音通话翻译功能。
在一些实施例中,当电子设备200不支持或者关闭语音通话翻译功能时,若接收到电子设备100发送的第三字符后,无法识别出第三字符,可以不作出响应。在这种情况下,电子设备100在预设时长内接收不到电子设备200发送的响应,则确认电子设备200不支持或关闭语音通话翻译功能,则保持语音通话翻译功能继续开启。其中,本申请实施例中预设时长可以根据实际情况进行相应的设定,例如2s、5s、10s等。在另一些实施例中,当电子设备200不支持或者关闭语音通话翻译功能时,若接收到电子设备100发送的第三字符后,无法识别出第三字符,也可以向电子设备100发送一个预设字符,电子设备100接收到预设字符后确认电子设备200不支持或关闭语音通话翻译功能,则继续保持开启语音通话翻译功能。应理解,预设字符和第三字符为不同的字符。
步骤905,电子设备100接收到第四字符后,关闭语音通话翻译功能。
需要说明的是,为了使得电子设备200确定语音通话翻译能力协商完成,在一些实施例中,电子设备100还可以向电子设备200发送第五字符,第五字符可以用于指示电子设备100关闭语音通话翻译功能。示例的,电子设备100还可以以DTMF音的形式向电子设备200发送第五字符。其中第五字符可以为除第三字符和第四字符以外的其它字符,例如第三字 符为1,第四字符为2,第五字符可以为3,还可以为除1和2以外的其它正整数,还可以为#或者*等。
需要说明的是,本申请实施例中第三字符、第四字符和第五字符的功能可以以通信协议的形式预先约定。
电子设备200接收到电子设备100发送的第五字符后,使用语言2播放语音通话翻译功能已开启的提示音,以及向电子设备100发送翻译为语言1的语音通话翻译功能已开启的提示音。例如语言2为中文时,语音通话翻译功能已开启的提示音的文本可以为“欢迎使用语音通话翻译功能,在语音播报完毕后开始通话”。
本申请的上述实施例也可以理解为:电子设备(即本端)接收到对端发送的第三字符,所述第三字符用于指示对端开启语音通话翻译功能,若本端在收到所述第三字符之前已开启了本端的语音通话翻译功能,则向对端发送第四字符,第四字符用于指示本端的语音通话翻译功能已开启,要求对端关闭语音通话翻译功能。对端在收到第四字符后,关闭语音通话翻译功能,可选地,对端在关闭语音通话翻译功能后向本端发送第五字符,第五字符用于指示对端已关闭语音通话翻译功能。若本端在收到所述第三字符之时未开启语音通话翻译功能或不支持语音翻译功能时,不做响应;或者发送目标字符(如第三、四、五字符以外的字符)给对端,通知对端本端未开启语音通话翻译功能或不支持语音翻译功能。
需要说明的是,本申请实施例中,当电子设备100或电子设备200语音通话翻译功能已开启时,还可以通过显示屏向用户显示双方通话语音的文本以及对应的语音的翻译结果的文本。应理解,双方通话语音的文本又可称之为双方的通话记录的语音文本,语音的翻译结果的文本又可称之为双方的通话记录的语音的翻译结果的文本。示例的,如图4a所示用户界面430还可以包括文本显示区域434,电子设备100可以在文本显示区域434显示用户A和用户B通话语音的文本以及语音的翻译结果的文本。示例的,如图4b所示的用户界面450还可以包括文本显示区域454,电子设备100可以在文本显示区域454显示用户A和用户B通话语音的文本以及语音的翻译结果的文本。以电子设备100和电子设备200在通话过程中,由于电子设备100和电子设备200在均支持语音通话翻译功能的情况下,其中一个电子设备开启语音通话翻译功能,另外一个电子设备关闭语音翻译功能。以电子设备100的语音翻译功能已开启、电子设备200的语音翻译功能已关闭为例,电子设备100可以在显示屏显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。在一些实施例中,电子设备100的语音翻译功能已开启,电子设备100的文本显示功能也可以关闭,即电子设备100自身执行翻译功能或与翻译服务器结合实现翻译功能的情况下,电子设备100也可以不显示语音的文本以及语音的翻译结果的文本。电子设备200也可以在显示屏显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。示例的,电子设备200可以支持语音通话翻译功能的情况下,若语音通话翻译功能开启,则电子设备200具有语音通话过程中显示文本的功能,可以在显示屏显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。但是电子设备200当语音通话翻译功能关闭后,也会同时关闭语音通话过程中显示文本的功能,则电子设备200无法显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。又示例的,电子设备200中语音通话过程中显示文本的功能和语音通话翻译功能为两个独立的功能。电子设备200当语音通话翻译功能关闭后,则只是限制了电子设备200无法通过自身翻译获取语音的翻译结果或自身从翻译服务器获取语音的翻译结果,但 是不影响电子设备200显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。因此,电子设备200将语音通话过程中显示文本的功能开启,语音通话翻译功能关闭时,电子设备200依然可以在显示屏上显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。需要说明的是,用户A和用户B的通话语音的文本以及语音的翻译结果的文本也可以由电子设备100发送给电子设备200,也可以由电子设备200进行语音识别,将语音以及语音的翻译结果转化为文字后,通过显示屏显示出来。此外,对于电子设备200来说,用户A的语音的文本、用户A语音的翻译结果的文本和用户B的语音翻译结果的文本可以由电子设备100发送给电子设备200,而用户B的语音由电子设备200转化为文字。本申请实施例对电子设备200获取语音文本的方式不作限定。
在一些实施例中,文本显示的功能打开时,本申请实施例电子设备100还可以只显示用户B的语音的翻译结果的文本,或者,电子设备100只显示用户B的语音的文本和用户B的语音的翻译结果的文本;电子设备200还可以只显示用户A的语音的翻译结果的文本,或者,电子设备100只显示用户A的语音的文本和用户A的语音的翻译结果的文本,。
需要说明的是,当语音通话翻译功能的关闭,限制语音通话过程中文本显示的功能时,以图4b中所示的用户界面450为例,电子设备200若语音翻译按钮已关闭(OFF),则文本显示区域454可以不再显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。在另外一些实施例中,当语音翻译按钮关闭,仅仅是关闭了电子设备200获取语音通话翻译的功能,并不影响显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本的显示。在这种情况下,为了便于用户对文本显示区域是否显示文本进行控制,可以在用户界面中增加文本显示模式按钮,若文本显示模式按钮开启,则电子设备200在文本显示区域显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本;若文本显示模式按钮关闭,则电子设备200在文本显示区域不显示用户A和用户B的通话语音的文本以及语音的翻译结果的文本。
另外,本申请实施例中,电子设备100当接收到第四字符后,关闭语音通话翻译功能。
为了便于用户了解电子设备100自动关闭语音通话翻译功能的情况,在一些实施例中,电子设备100在接收到第四字符后,还向用户A提示电子设备200的语音通话翻译功能已开启。其中电子设备100向用户A提示电子设备200语音通话翻译已开启的方式可以参见电子设备200向用户提示电子设备100的语音通话翻译功能已开启的方式。
另外,为了提高用户A和用户B语音通话过程中语音通话翻译的可靠性,电子设备100还可以在自动关闭语音通话翻译功能之后,禁止用户开启语音通话翻译功能。其中,相关实现方式可以参见图3所示的方法中电子设备200禁止用户开启语音通话翻译功能的实现方式。在一些实施例中,为了提高用户与电子设备100的交互,在一些实施例中,电子设备100在禁止用户开启语音通话翻译功能后,还提示用户禁止开启语音通话翻译功能。在另一些实施例中,电子设备100在禁止用户开启语音通话翻译功能后,除了提示用户禁止开启语音通话翻译功能以外,还提示用户取消对语音通话翻译功能开启限制的时机。其中,相关实现方式可以参见图3所示的方法中电子设备200禁止用户开启语音通话翻译功能后的提示方式。
例如,当电子设备100在用户A和用户B通话的过程中开启了语音通话翻译功能,则用户A还可以通过对电子设备100显示的用户界面上包括的语音翻译按钮的操作,关闭语音通 话翻译功能。电子设备100当响应于用户的操作关闭了语音通话翻译功能,则电子设备100还可以向电子设备200发送预设字符,通知电子设备200电子设备100关闭了语音通话翻译功能。电子设备200可以在自身语音通话翻译功能关闭时,接收到预设字符,则可以自动开启语音通话翻译功能。
为了便于用户操作设置,在一些实施例中,电子设备100可以响应于对语音翻译按钮421的操作,在显示屏显示如图10所示的用户界面1000。此外,在另一些实施例中电子设备200可以响应于对语音翻译按钮511的操作,在显示屏显示用户界面1000。如图10所示,用户界面1000包括语音翻译按钮1001、本端语言设置按钮1002、对端语言设置按钮1003、语音播报模式按钮1004、文本显示模式按钮1005。其中,语音播报模式按钮1004关闭(OFF)时,电子设备关闭语音播报。语音播报模式按钮1004开启(ON)时,电子设备开启语音播报。例如,以电子设备100为例,如图10所示,对端原音和对端译音被选中,本端译音未被选中,则电子设备100播报用户B的语音以及用户B的语音的翻译结果,而不播报用户A的语音的翻译结果;然而当本端译音被选中时,则电子设备100播报用户A的语音的翻译结果。与播报模式按钮1004类似,文本显示模式按钮1005关闭(OFF)时,电子设备100不显示语音或翻译结果对应的文本;文本显示模式按钮1005开启(ON)时,电子设备100显示语音或翻译结果对应的文本。在一些实施例中,文本显示模式按钮1005关闭(OFF)时,电子设备还可以隐藏文本显示区域1006。当文本显示模式按钮1005开启(ON)时,电子设备还可以显示文本显示区域1006。其中,为了便于用户查看通话记录的文本,电子设备可以响应于对文本显示区域1006的操作,全屏显示文本显示区域1006。例如,对文本显示区域1006的操作可以为双指上滑、双击等。需要说明的是,文本显示区域1006用于显示用户的通话记录以及相应的翻译结果的文本。例如,用户A使用中文,用户B使用英文,电子设备100采集到的用户A的语音文本为“你好”,翻译结果的文本为“Hello”,电子设备100获取到的用户B的语音为“Hello,This is Mike speaking”,翻译结果的文本为“你好,我是迈克”则文本显示区域1006显示的通话记录和响应的翻译结果的文本信息可以如图10所示。
需要说明的是,本申请实施例中当语音翻译按钮1001关闭时,电子设备100可以自动将语音播报模式按钮1004关闭,和/或自动将文本显示模式按钮1005关闭。在这种情况下,电子设备100当与其它电子设备建立通信链路实现通话时,可采用现有技术中电子设备的通话方法。还需要说明的是,本申请实施例中语音翻译按钮1001关闭不影响语音播报模式按钮1004关闭和开启,也不影响文本显示模式按钮1005关闭和开启。在这种情况下,语音翻译按钮1001关闭,则电子设备100无法获取语音的翻译结果。对于电子设备100是否播报翻译结果还是播报用户的语音,可以根据语音播报模式的设置有关。例如语音播报模式开启,只选中的了对端原音的选项,则电子设备100仅播报对端的原音。又例如,当语音播报模式关闭,则电子设备100不播报任何语音。类似的,电子设备100是否显示语音的文本,与文本显示模式按钮1005是否开启有关。电子设备100当文本显示模式按钮1005开启时,则显示语音文本以及语音翻译结果的文本;电子设备100当文本显示模式按钮1005关闭时,则不显示语音文本以及语音翻译结果的文本。
在本申请实施例中,用户可以通过对用户界面1000上的虚拟按钮进行操作,来进行语音播报模式的设置。另外,本申请实施例中电子设备还可以自动进行播报模式的设置。
此外,若电子设备100和电子设备200均可以实现双端语音翻译,则当电子设备100和电子设备200的语音通话翻译功能均已开启时,为了避免重复翻译,在另外一些实施例中,电子设备100和电子设备200可以进行语音通话翻译能力的协商,以使得电子设备100和电子设备200只对采集的本端语音进行翻译,而不对对端语音进行翻译。其中对于电子设备100来说,本端语音为电子设备100通过自身的声音采集传感器(如麦克风)采集的用户A的语音,对端语音为通过移动通信网络接收到的电子设备200发送用户B的语音。对于电子设备200来说,本端语音为电子设备200通过自身的声音采集传感器(如麦克风)采集用户B的语音,对端语音为通过移动通信网络接收到的电子设备100发送用户A的语音。
其中,电子设备100和电子设备200开启语音通话翻译功能的方式、以及电子设备100和电子设备200中触发语音通话翻译能力的协商的方式可以参见上述相关介绍,在此不再赘述。
下面以电子设备100发起语音通话翻译能力的协商为例,如图11所示,为本申请提供的另一语音通话翻译能力的协商方法。具体包括以下步骤。
步骤1101,电子设备100在与电子设备200建立通信链路完成后,若电子设备100的语音通话翻译功能已开启,向电子设备200发送第六字符,其中第六字符用于指示电子设备100的语音通话翻译功能已开启。
需要说明的是,第六字符的发送方式和具体实现方式可以参见本申请实施例中图3所述的方法中第一字符的发送方式和具体实现方式。
本申请实施例中,当电子设备100语音通话翻译功能已关闭或者不支持语音通话翻译功能时,在与电子设备200建立通信链路完成后,则不会发起语音通话翻译能力的协商。
步骤1102,电子设备200若语音通话翻译功能已开启,则在接收到第六字符后,确定不对电子设备100发送的语音进行翻译,只对电子设备200采集的语音进行翻译,并向电子设备100发送第七字符,第七字符用于指示电子设备200的语音通话翻译功能已开启。需要说明的是,第六字符与第七字符为不同的字符。
为了便于提示用户,在一些实施例中,电子设备200在确定不对电子设备100发送的语音进行翻译,只对电子设备200采集的语音进行翻译后,在显示屏显示图12所示的提示框1200,提示框1200中包括限制对对端语音进行翻译的提示信息。例如,如图12所示,提示框1200中包括“开启本端语音翻译功能,关闭对端语音翻译功能”。在另一些实施例中,电子设备200还可以通过语音提示用户限制对对端语音进行翻译。
电子设备200若语音通话翻译功能未开启则可以不响应第六字符,不发送消息给电子设备100,或者发送预设字符指示电子设备200未开启语音翻译功能,则电子设备100执行双端翻译。
步骤1103,电子设备100接收到第七字符后,若语音通话翻译功能已开启,则确定不对电子设备200发送的语音进行翻译,只对电子设备100采集的语音进行翻译。
电子设备100在确定不对电子设备200发送的语音进行翻译,只对电子设备100采集的语音进行翻译后,还可以提示用户限制对对端语音进行翻译。其中,具体的提示方式可以参见电子设备200限制对对端语音进行翻译的提示方式。
因而,通过上述技术方案,使得电子设备100和电子设备200可以实现语音通话翻译能 力的协商,从而有助于降低重复翻译的可能性,进而有助于降低出错的概率。
另外,电子设备100可以在语音通话翻译能力的协商完成后,在一些实施例中,电子设备100使用语言1播放语音翻译功能已开启的提示音,以及电子设备200播放使用语言2播放语音翻译功能已开启的提示音。例如语言1为中文时,语音翻译功能已开启的提示音的文本可以为“欢迎使用语音通话翻译功能,在语音播报完毕后开始通话”。
当电子设备100和电子设备200仅对本端语音翻译时,以用户A使用电子设备100、用户B使用电子设备200为例,电子设备100可以将采集到的用户A的语音以及获取的用户A的语音的翻译结果发送给电子设备200,电子设备200在接收到用户A的语音以及获取的用户A的语音的翻译结果后,可以通过喇叭或听筒播放用户A的语音以及用户A的语音的翻译结果。类似的,电子设备200可以将采集到的用户B的语音以及获取的用户B的翻译结果发送给电子设备100,电子设备100在接收到用户B的语音以及用户B的翻译结果后,可以通过喇叭或者听筒播放用户B的语音以及用户B的语音的翻译结果。
然而,电子设备在播放用户的语音和用户的语音的翻译结果时,有可能被自身的声音传感器(如麦克)所采集,而导致重复翻译。例如电子设备100在播放用户B的语音的翻译结果时,可能被电子设备100的麦克风采集到,又将用户B的语音翻译结果进行翻译,再发送给电子设备200。在一些实施例中,电子设备200若语音通话翻译功能已开启,则在接收到第六字符后,还可以关闭语音翻译结果的播报,或者关闭语音的播报,但是在显示屏上显示双方的通话记录的语音文本以及通话记录的语音的翻译结果的文本。电子设备100在接收到字符2后,还可以关闭语音翻译结果的播报,或者关闭语音的播报,但是在显示屏上显示双方的通话记录的语音文本以及通话记录的语音的翻译结果的文本。需要说明的是,本申请实施例中具体的显示双方的通话记录的语音文本以及通话记录的语音的翻译结果的文本可以参见上述相关实现方式。
以如图10所示的用户界面1000为例。电子设备200关闭语音的翻译结果的播报的实现方式可以为:电子设备200自动选中对端原音,不选中对端译音和本端译音的选项。电子设备200关闭语音的播报的实现方式可以为:电子设备200自动将语音播报模式按钮1004置为关闭(OFF)。电子设备200在显示屏上显示双方的通话记录以及通话记录的翻译结果的实现方式可以为:电子设备200自动将文本显示模式按钮1005置为开启(ON)。
需要说明的是,本申请实施例中,若用户A使用电子设备100,用户B使用电子设备200,当电子设备200不播报语音翻译结果时,电子设备100可以将用户A的语音的翻译结果发送给电子设备200,也可以不将用户A的语音的翻译结果发送给电子设备200。当电子设备200显示双方的通话记录的语音文本以及通话记录的语音的翻译结果的文本时,电子设备100可以将用户A的语音的文本和用户A的语音的翻译结果的文本发送给电子设备200,也可以由电子设备200根据电子设备100发送的用户A的语音和用户A的语音的翻译结果获取相应的文本。电子设备100的实现方式与电子设备200的实现方式类似,在此不再赘述。
在另一些实施例中,电子设备在只能实现对本端语音翻译的情况下,电子设备可以通过预先配置的翻译引擎实现对本端语音的翻译,也可以通过翻译服务器实现对本端语音的翻译。在这种情况下,电子设备(本端)的语音翻译功能已开启时,可以用于获取本端语音的翻译结果,并将本端语音的翻译结果发送给对端。
以图2所示的通信系统为例。例如,电子设备100和电子设备200均只能实现对本端语音翻译,其中用户A使用电子设备100,用户B使用电子设备200,为了降低用户A和用户B通信过程中语音翻译重复的可能性,如图13A所示,本申请实施例提供了另一种语音通话翻译能力协商的方法。具体包括以下步骤。
步骤1301,电子设备100在与电子设备200建立通信链路完成后,若电子设备100语音翻译功能已开启,则向电子设备200发送第八字符,其中第八字符用于指示电子设备100语音翻译功能已开启。
需要说明的是,电子设备100和电子设备200当同时能够实现语音翻译的情况下,可以由先建立通信链路完成的电子设备发起语音通话翻译能力的协商,也可以由主叫端发起语音通话翻译能力的协商,又可以由被叫端发起语音通话翻译能力的协商等。当电子设备100和电子设备200中其中一个电子设备支持语音翻译功能的情况下,可以在通信链路建立完成后,由支持语音翻译功能的电子设备发起语音通话翻译能力的协商。图13A所示方法中,由哪个电子设备发起语音通话翻译能力的协商可以参考图3所示实施例的相关描述。
本申请实施例中开启语音翻译功能的方式,可以参见图3所示的方法中开启语音翻译功能的方式。
步骤1302,电子设备200当语音翻译功能已开启时,接收到第八字符,则关闭语音播报模式,开启文本显示模式,以及向电子设备100发送第九字符,其中第九字符用于指示电子设备100关闭播报模式,开启文本显示模式。
本申请实施例中关闭语音播报模式,可以指的是关闭语音翻译结果的播报,也可以指的是关闭语音以及语音翻译结果的播报。以电子设备200为例,当电子设备200关闭语音翻译结果的播报时,电子设备200不向用户B播放用户A的语音的翻译结果,也不会播放用户B的语音的翻译结果,但是播放用户A的语音。当电子设备200关闭语音以及语音翻译结果的播报时,电子设备200不向用户B播放用户A的语音、用户A的语音的翻译结果,也不会播放用户B的语音的翻译结果。电子设备200开启文本显示模式,指的是电子设备200可以通过显示屏向用户显示用户A和用户B之间的通话记录的语音的文本以及相应的语音的翻译结果的文本。例如,如图10所示,电子设备200可以在用户界面1000所包括的文本显示区域1005显示用户A和用户B之间的通话记录的语音的文本以及相应的语音的翻译结果的文本。
其中,第八字符和第九字符的发送和实现方式可以参见本申请实施例中图3所示的方法中第一字符的发送和实现方式。
步骤1303,电子设备100在接收到第九字符后,关闭语音播报模式,开启文本显示模式。具体的电子设备100关闭语音播报模式、开启文本显示模式的实现方式可以参见步骤1302中电子设备200关闭语音播报模式,开启文本显示模式的实现方式。
以电子设备100为例,电子设备100关闭语音播报模式可以为电子设备100自动将图14所示的用户界面1410中的语音播报模式按钮1412关闭,也可以为电子设备100保持语音播报模式按钮1412开启,但是仅选中对端原音的选项。电子设备100开启文本显示模式可以为电子设备100自动将图14所示的用户界面1410中的文本显示模式按钮1413开启。还需要说明的是,用户还可以在通话过程中设置语音播报模式和文本显示模式。例如,电子设备100在用户通信过程中显示用户界面1400。用户界面1400包括语音翻译按钮1401。电子设 备100可以响应于对语音翻译按钮1401的操作,在显示屏显示用户界面1410。用户界面1410可以包括语音翻译按钮1411、语音播报模式按钮1412、对端原音选项、对端译音选项、本端译音选项、文本显示模式按钮1413、和文本显示区域1414。其中,用户可以根据自己的需求对用户界面1410上包括的虚拟按钮进行相应的设置。
在这种方式中,电子设备100在开启语音翻译功能的情况下,通知了对端,即电子设备200,电子设备200在语音翻译功能开启时,关闭自身的语音播报模式,开启文本显示模式,并通知电子设备100也关闭语音播报模式且开启文本显示模式。
在一些实施例中,电子设备100和200均支持本端的语音翻译功能,为了避免重复翻译,提供了另一种协商方式,如图13B所示,具体包括以下步骤。
步骤1310,电子设备100在与电子设备200建立通信链路完成后,若电子设备100语音翻译功能已开启,则向电子设备200发送第八字符,其中第八字符用于指示电子设备100语音翻译功能已开启。
步骤1320,电子设备200当语音翻译功能已开启时,接收到第八字符,向电子设备100发送第九字符,其中第九字符用于指示电子设备200的语音功能已开启。
步骤1330,电子设备100在接收到第九字符后,关闭语音播报模式,开启文本显示模式,并向电子设备200发送第十字符,所述第十字符用于通知电子设备200关闭语音播报模式,开启文本显示模式。具体的电子设备100关闭语音播报模式、开启文本显示模式的实现方式可以参见步骤1302中电子设备200关闭语音播报模式,开启文本显示模式的实现方式。
步骤1340,电子设备200收到第十字符后,关闭播报模式,开启文本显示模式。
在这种方式中,电子设备100在开启语音翻译功能的情况下,在确认了对端,即电子设备200开启了语音翻译功能后,关闭自身的语音播报模式,开启文本显示模式,并通知电子设备200关闭语音播报模式且开启文本显示模式。
还需要说明的是,本申请实施例中涉及的第一字符~第九字符可以为拨号键盘中的字符0~1、#、*中的字符,也可以为预定义的其它字符。此外,本申请实施例中还可以通过其它信息来指示本申请实施例中第一字符等字符所指示的信息,本申请实施例对指示信息的具体实现形式不作限定。本申请实施例中电子设备还可以通过发送字符的方式实现其它功能的自动协商,为了便于后续应用程序的扩展,可以预先配置多个预留字符。示例的,以表1为例。
表1
字符 | 功能描述 | 字符 | 功能描述 | 字符 | 功能描述 |
1 | 开启语音翻译功能 | 2 | 关闭语音翻译功能 | 3 | 开启播报模式 |
4 | 关闭播报模式 | 5 | 协商完成 | 6 | A |
7 | B | 8 | C | 9 | D |
0 | E | # | F | * | G |
例如,如表1所示,字符6~字符*为预留字符,可以用于实现其它功能的自动协商。
本申请实施例中的上述各个实施例可以单独实现,也可以相互任意组合。
上述本申请提供的实施例中,从电子设备作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能,电子设备可以包括硬件结构和/或软件模块,以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行,取决于技术方案的特定应用和设计约束条件。
基于相同的构思,图15所示为本申请提供的一种电子设备1500。示例的,电子设备1500包括收发模块1501和处理模块1502。当电子设备1500执行图3所示的语音通话翻译能力的协商方法中的电子设备200所执行的步骤时,收发模块1501可用于执行步骤301~步骤303,处理模块1502可用于执行步骤304。当电子设备1500执行图9所示的语音通话翻译能力的协商方法中的电子设备200所执行的步骤时,收发模块1501可用于执行步骤901~步骤904,处理模块1502可用于执行步骤905。当电子设备1500执行图11所示的语音通话翻译能力的协商方法中的电子设备200所执行的步骤时,收发模块1501可用于执行步骤1101和步骤1102中发送第七字符的步骤,处理模块1502可用于执行步骤1102中的确定步骤。当电子设备1500执行图13A所示的语音通话翻译能力的协商方法中的电子设备200所执行的步骤时,收发模块1501可用于执行步骤1301和步骤1302中发送第九字符的步骤,处理模块1502可用于执行步骤1302中的关闭播报模式、开启文本显示模式步骤。当电子设备1500执行图13B所示的语音通话翻译能力的协商方法中的电子设备200所执行的步骤时,收发模块1501可用于执行步骤13010和步骤1320中发送第九字符的步骤,以及步骤1340接收第十字符的步骤,处理模块1502可用于执行步骤1340中的关闭播报模式、开启文本显示模式的步骤。
基于相同的构思,图16所示为本申请提供的一种电子设备1600。电子设备1600包括至少一个处理器1610、存储器1620和收发器1630。其中,处理器1610与存储器1620和收发器1630耦合,本申请实施例中的耦合是装置、单元或模块之间的间接耦合或通信连接,可以是电性,机械或其它的形式,用于装置、单元或模块之间的信息交互。
具体的,存储器1620用于存储程序指令。
收发器1630用于接收或发送数据。
处理器1610用于调用存储器1620中存储的程序指令,使得电子设备1600执行图3中电子设备200所执行的步骤,或者执行图9、图11、图13A或图13B中电子设备100所执行的步骤。
应理解,该电子设备1500和电子设备1600可以用于实现本申请实施例的图3、图9、图11、图13A和/或图13A所示的方法,相关特征可以参照上文,此处不再赘述。
所属领域的技术人员可以清楚地了解到本申请实施例可以用硬件实现,或固件实现,或它们的组合方式来实现。当使用软件实现时,可以将上述功能存储在计算机可读介质中或作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质,其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是计算机能够存取的任何可用介质。以此为例但不限于:计算机可读介质可以包括RAM、ROM、电可擦可编程只读存储器(electrically erasable programmable read only memory,EEPROM)、只读光盘(compact disc read-Only memory, CD-ROM)或其他光盘存储、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质。此外。任何连接可以适当的成为计算机可读介质。例如,如果软件是使用同轴电缆、光纤光缆、双绞线、数字用户线(digital subscriber line,DSL)或者诸如红外线、无线电和微波之类的无线技术从网站、服务器或者其他远程源传输的,那么同轴电缆、光纤光缆、双绞线、DSL或者诸如红外线、无线和微波之类的无线技术包括在所属介质的定影中。如本申请实施例所使用的,盘(disk)和碟(disc)包括压缩光碟(compact disc,CD)、激光碟、光碟、数字通用光碟(digital video disc,DVD)、软盘和蓝光光碟,其中盘通常磁性的复制数据,而碟则用激光来光学的复制数据。上面的组合也应当包括在计算机可读介质的保护范围之内。
总之,以上所述仅为本申请的实施例而已,并非用于限定本申请的保护范围。凡根据本申请的揭露,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内
Claims (14)
- 一种基于语音通话翻译能力的协商方法,其特征在于,所述方法包括:第一电子设备在与第二电子设备建立通信链路后,若语音通话翻译功能处于开启状态时,接收到所述第二电子设备发送的第一指示信息,所述第一指示信息用于指示所述第二电子设备语音通话翻译功能已开启;所述第一电子设备在语音通话翻译功能处于开启状态时,用于获取所述第一电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第二电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第二电子设备;所述第二电子设备在语音通话翻译功能处于开启状态时,用于获取所述第二电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第一电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第一电子设备;响应于所述第一指示信息,所述第一电子设备自动关闭语音通话翻译功能。
- 如权利要求1所述的方法,其特征在于,所述第一指示信息为以双音多频DTMF音发送的第一字符。
- 如权利要求1或2所述的方法,其特征在于,所述第一电子设备自动关闭语音通话翻译功能之后,所述方法还包括:所述第一电子设备向所述第二电子设备发送第二指示信息,所述第二指示信息用于指示所述第一电子设备语音通话翻译功能已关闭。
- 如权利要求1至3任一所述的方法,其特征在于,所述方法还包括:所述第一电子设备在显示屏上显示第一提示信息,所述第一提示信息用于提示用户所述第二电子设备语音通话翻译功能已开启;和/或所述第一电子设备通过播报语音提示用户所述第二电子设备的语音通话翻译功能已开启。
- 如权利要求1至4任一所述的方法,其特征在于,所述第一电子设备自动关闭语音通话翻译功能后,所述方法还包括:所述第一电子设备禁止用户开启语音通话翻译功能。
- 如权利要求5所述的方法,其特征在于,所述第一电子设备禁止用户开启语音通话翻译功能之后,所述方法还包括:所述第一电子设备在显示屏上显示第二提示信息,所述第二提示信息用于提示禁止用户开启语音通话翻译功能、并在所述第二电子设备的语音通话功能关闭或者通信链路断开后,取消对用户开启语音通话翻译功能的限制;和/或所述第一电子设备通过播报语音提示禁止用户开启语音通话翻译功能,并在所述第二电子设备的语音通话功能关闭或者通信链路断开后,取消对用户开启语音通话翻译功能的限制。
- 一种基于语音通话翻译能力的协商方法,其特征在于,所述方法包括:第一电子设备在与第二电子设备建立通信链路后,若语音通话翻译功能处于开启状态时,接收到所述第二电子设备发送第一指示信息,所述第一指示信息用于指示所述第二电子设备语音通话翻译功能已开启;所述第一电子设备在语音通话翻译功能处于开启状态时,用于获取所述第一电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第 二电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第二电子设备;所述第二电子设备在语音通话翻译功能处于开启状态时,用于获取所述第二电子设备通过麦克风采集的语音的翻译结果,以及获取接收到的所述第一电子设备发送的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第一电子设备;所述第一电子设备向所述第二电子设备发送的第二指示信息,所述第二指示信息指示所述第二电子设备关闭语音通话翻译功能。
- 一种基于语音通话翻译能力的协商方法,其特征在于,所述方法包括:第一电子设备与第二电子设备建立通信链路后,若语音通话翻译功能处于开启状态时,接收所述第二电子设备发送第一指示信息,所述第一指示信息用于指示所述第二电子设备语音通话翻译功能已开启;所述第一电子设备当语音通话翻译功能处于开启状态时,用于获取所述第一电子设备通过麦克风采集的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第二电子设备;所述第二电子设备当语音通话翻译功能处于开启状态时,用于获取所述第二电子设备通过麦克风采集的语音的翻译结果,并将所述通过麦克风采集的语音的翻译结果发送给所述第一电子设备;所述第一电子设备接收所述第一指示信息后,关闭语音播报模式、且开启文本显示模式;所述第一电子设备在语音播报模式已关闭、文本显示模式已开启时,不播报所述第二电子设备通过麦克风采集的语音的翻译结果、显示所述第二电子设备通过麦克风采集的语音的翻译结果的文本;所述第一电子设备向所述第二电子设备发送的第二指示信息,所述第二指示信息用于指示所述第二电子设备关闭语音播报模式、且开启文本显示模式;所述第二电子设备在语音播报模式已关闭、文本显示模式已开启时,不播报所述第一电子设备通过麦克风采集的语音的翻译结果、显示所述第一电子设备通过麦克风采集的语音的翻译结果的文本。
- 如权利要求8所述的方法,其特征在于,所述第一电子设备的语音通话翻译功能处于开启状态时,还用于将所述通过麦克风采集的语音发送给所述第二电子设备;所述第二电子设备的语音通话翻译功能处于开启状态时,还用于将通过麦克风采集的语音发送给所述第一电子设备。
- 如权利要求9所述的方法,其特征在于,所述第一电子设备在语音播报模式已关闭时,还包括不播报所述第二电子设备发送的通过麦克风采集的语音。
- 如权利要求8至10任一所述的方法,其特征在于,所述第一指示信息为双音多频DTMF音。
- 一种电子设备,其特征在于,包括:一个或多个处理器和存储器;多个应用程序;以及一个或多个计算机程序,其中所述一个或多个计算机程序被存储在所述存储器中,当所述计算机程序被所述电子设备执行时,使得所述电子设备实现如权利要求1至11任一所述的方法。
- 一种芯片,其特征在于,所述芯片与电子设备中的存储器耦合,使得所述芯片在运行时调用所述存储器中存储的计算机程序,实现如权利要求1至11任一所述的方法。
- 一种计算机存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当计算机程序在电子设备上运行时,使得所述电子设备执行如权利要求1至11任一所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/230,808 US11886830B2 (en) | 2018-10-15 | 2021-04-14 | Voice call translation capability negotiation method and electronic device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811198712.3 | 2018-10-15 | ||
CN201811198712.3A CN109327613B (zh) | 2018-10-15 | 2018-10-15 | 一种基于语音通话翻译能力的协商方法及电子设备 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/230,808 Continuation US11886830B2 (en) | 2018-10-15 | 2021-04-14 | Voice call translation capability negotiation method and electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020078332A1 true WO2020078332A1 (zh) | 2020-04-23 |
Family
ID=65262241
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/111124 WO2020078332A1 (zh) | 2018-10-15 | 2019-10-15 | 一种基于语音通话翻译能力的协商方法及电子设备 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11886830B2 (zh) |
CN (1) | CN109327613B (zh) |
WO (1) | WO2020078332A1 (zh) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109327613B (zh) | 2018-10-15 | 2020-09-29 | 华为技术有限公司 | 一种基于语音通话翻译能力的协商方法及电子设备 |
CN110087015A (zh) * | 2019-05-14 | 2019-08-02 | 江苏工程职业技术学院 | 一种带有字幕翻译的音频通话方法 |
CN111274828B (zh) * | 2020-01-21 | 2021-02-02 | 陈刚 | 基于留言的语言翻译方法、系统、计算机程序和手持终端 |
KR102803589B1 (ko) * | 2020-12-18 | 2025-05-02 | 텐센트 테크놀로지(센젠) 컴퍼니 리미티드 | 음성을 텍스트로 변환하는 방법, 시스템, 장치 및 매체 |
KR20230023359A (ko) * | 2021-08-10 | 2023-02-17 | 한화테크윈 주식회사 | 감시카메라 시스템 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102360347A (zh) * | 2011-09-30 | 2012-02-22 | 宇龙计算机通信科技(深圳)有限公司 | 一种语音翻译方法、系统及语音翻译服务器 |
US20170149961A1 (en) * | 2015-11-25 | 2017-05-25 | Samsung Electronics Co., Ltd. | Electronic device and call service providing method thereof |
CN108650419A (zh) * | 2018-05-09 | 2018-10-12 | 深圳市知远科技有限公司 | 基于智能手机的电话翻译系统 |
CN109327613A (zh) * | 2018-10-15 | 2019-02-12 | 华为技术有限公司 | 一种基于语音通话翻译能力的协商方法及电子设备 |
CN109582976A (zh) * | 2018-10-15 | 2019-04-05 | 华为技术有限公司 | 一种基于语音通话的翻译方法及电子设备 |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SG125908A1 (en) * | 2002-12-30 | 2006-10-30 | Singapore Airlines Ltd | Multi-language communication method and system |
JP2008077601A (ja) * | 2006-09-25 | 2008-04-03 | Toshiba Corp | 機械翻訳装置、機械翻訳方法および機械翻訳プログラム |
EP2912579B1 (en) * | 2012-10-23 | 2020-08-19 | IP Reservoir, LLC | Method and apparatus for accelerated format translation of data in a delimited data format |
KR102108500B1 (ko) | 2013-02-22 | 2020-05-08 | 삼성전자 주식회사 | 번역 기반 통신 서비스 지원 방법 및 시스템과, 이를 지원하는 단말기 |
KR20140121516A (ko) * | 2013-04-05 | 2014-10-16 | 이현철 | 실시간 통역 자막 제공 시스템 및 방법 |
KR20150093482A (ko) * | 2014-02-07 | 2015-08-18 | 한국전자통신연구원 | 화자 분할 기반 다자간 자동 통번역 운용 시스템 및 방법과 이를 지원하는 장치 |
US9614969B2 (en) * | 2014-05-27 | 2017-04-04 | Microsoft Technology Licensing, Llc | In-call translation |
US10628531B2 (en) * | 2016-06-09 | 2020-04-21 | Billy D. Duc | System and method for enabling translation of speech |
US9681471B1 (en) * | 2016-08-31 | 2017-06-13 | Bank Of America Corporation | Pairing of devices for activation/deactivation of a paired device |
CN107993646A (zh) * | 2016-10-25 | 2018-05-04 | 北京分音塔科技有限公司 | 一种实现实时语音互译的方法 |
CN107015970A (zh) * | 2017-01-17 | 2017-08-04 | 881飞号通讯有限公司 | 一种网络语音通信中实现双语互译的方法 |
CN206470756U (zh) | 2017-01-20 | 2017-09-05 | 北京分音塔科技有限公司 | 一种实时语音互译装置 |
CN107343113A (zh) * | 2017-06-26 | 2017-11-10 | 深圳市沃特沃德股份有限公司 | 语音通话方法和装置 |
CN107885732A (zh) | 2017-11-08 | 2018-04-06 | 深圳市沃特沃德股份有限公司 | 语音翻译方法、系统和装置 |
CN107886940B (zh) * | 2017-11-10 | 2021-10-08 | 科大讯飞股份有限公司 | 语音翻译处理方法及装置 |
CN108228575A (zh) * | 2017-12-20 | 2018-06-29 | 科大讯飞股份有限公司 | 语音翻译交互方法及系统 |
-
2018
- 2018-10-15 CN CN201811198712.3A patent/CN109327613B/zh active Active
-
2019
- 2019-10-15 WO PCT/CN2019/111124 patent/WO2020078332A1/zh active Application Filing
-
2021
- 2021-04-14 US US17/230,808 patent/US11886830B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102360347A (zh) * | 2011-09-30 | 2012-02-22 | 宇龙计算机通信科技(深圳)有限公司 | 一种语音翻译方法、系统及语音翻译服务器 |
US20170149961A1 (en) * | 2015-11-25 | 2017-05-25 | Samsung Electronics Co., Ltd. | Electronic device and call service providing method thereof |
CN108650419A (zh) * | 2018-05-09 | 2018-10-12 | 深圳市知远科技有限公司 | 基于智能手机的电话翻译系统 |
CN109327613A (zh) * | 2018-10-15 | 2019-02-12 | 华为技术有限公司 | 一种基于语音通话翻译能力的协商方法及电子设备 |
CN109582976A (zh) * | 2018-10-15 | 2019-04-05 | 华为技术有限公司 | 一种基于语音通话的翻译方法及电子设备 |
Non-Patent Citations (1)
Title |
---|
SHENG YULIN: "Design and implementation of cloud-based portable translation tool on android platform", INFORMATION AND TECHNOLOGY , CHINA MASTERS THESES FULL-TEXT DATABASE, no. 03, 15 March 2015 (2015-03-15) * |
Also Published As
Publication number | Publication date |
---|---|
CN109327613A (zh) | 2019-02-12 |
CN109327613B (zh) | 2020-09-29 |
US20210232778A1 (en) | 2021-07-29 |
US11886830B2 (en) | 2024-01-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7378576B2 (ja) | リモコン装置を用いたワンタッチスクリーンプロジェクションを実施するための端末装置、方法及びシステム | |
CN110138937B (zh) | 一种通话方法、设备及系统 | |
US11653398B2 (en) | Bluetooth connection method and device | |
US12101424B2 (en) | Electronic device having foldable screen and display method | |
WO2020078332A1 (zh) | 一种基于语音通话翻译能力的协商方法及电子设备 | |
CN111491297B (zh) | 一种控制智能家居设备连网的方法及设备 | |
WO2020078330A1 (zh) | 一种基于语音通话的翻译方法及电子设备 | |
EP4109967A1 (en) | Method for switching between sim card and esim card, and electronic device | |
CN112789934B (zh) | 一种蓝牙服务的查询方法及电子设备 | |
WO2022100610A1 (zh) | 投屏方法、装置、电子设备及计算机可读存储介质 | |
US12135692B2 (en) | File sharing method of mobile terminal and device | |
EP3944595B1 (en) | Method and system for adding smart home device to contacts | |
CN113395685A (zh) | 蓝牙通信系统和无线通信系统 | |
EP3852348A1 (en) | Translation method and terminal | |
CN117014859A (zh) | 基于通讯录的设备发现方法、音视频通信方法及电子设备 | |
US9723639B2 (en) | Communication method and terminal | |
CN113709024B (zh) | 数据传输方法、介质及其电子设备 | |
EP4421627A1 (en) | Method for receiving and sending red envelope, and electronic device | |
US12212619B2 (en) | Terminal device interaction method and apparatus | |
US20240316466A1 (en) | Service access method, terminal, and system | |
RU2780224C1 (ru) | Оконечное устройство, способ и система реализации экранной проекции одним касанием, используя дистанционное управление | |
EP4351181A1 (en) | Bluetooth communication method and system | |
EP4277351A1 (en) | Wi-fi access method and related device | |
CN117014843A (zh) | 一种移动通话方法及电子设备 | |
WO2023051204A1 (zh) | 跨设备连接方法、电子设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19872335 Country of ref document: EP Kind code of ref document: A1 |