WO2022001170A1 - 通话提示方法、通话设备、可读存储介质及芯片系统 - Google Patents
通话提示方法、通话设备、可读存储介质及芯片系统 Download PDFInfo
- Publication number
- WO2022001170A1 WO2022001170A1 PCT/CN2021/080230 CN2021080230W WO2022001170A1 WO 2022001170 A1 WO2022001170 A1 WO 2022001170A1 CN 2021080230 W CN2021080230 W CN 2021080230W WO 2022001170 A1 WO2022001170 A1 WO 2022001170A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- call
- audio
- prompt
- user
- state
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 130
- 238000003860 storage Methods 0.000 title claims abstract description 33
- 230000004044 response Effects 0.000 claims description 104
- 238000004891 communication Methods 0.000 claims description 85
- 238000004590 computer program Methods 0.000 claims description 31
- 230000006870 function Effects 0.000 claims description 23
- 230000009471 action Effects 0.000 claims description 11
- 230000004913 activation Effects 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 32
- 238000012545 processing Methods 0.000 description 15
- 238000012546 transfer Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 11
- 238000001514 detection method Methods 0.000 description 8
- 238000010295 mobile communication Methods 0.000 description 7
- 230000005236 sound signal Effects 0.000 description 6
- 239000003795 chemical substances by application Substances 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010079 rubber tapping Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000010409 thin film Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000010813 municipal solid waste Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000005316 response function Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/16—Communication-related supplementary services, e.g. call-transfer or call-hold
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/428—Arrangements for placing incoming calls on hold
- H04M3/4286—Notifying a held subscriber when his held call is removed from hold
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/724094—Interfacing with a device worn on the user's body to provide access to telephonic functionalities, e.g. accepting a call, reading or composing a message
- H04M1/724095—Worn on the wrist, hand or arm
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2203/00—Aspects of automatic or semi-automatic exchanges
- H04M2203/25—Aspects of automatic or semi-automatic exchanges related to user interface aspects of the telephonic communication service
- H04M2203/251—Aspects of automatic or semi-automatic exchanges related to user interface aspects of the telephonic communication service where a voice mode or a visual mode can be used interchangeably
- H04M2203/252—Aspects of automatic or semi-automatic exchanges related to user interface aspects of the telephonic communication service where a voice mode or a visual mode can be used interchangeably where a voice mode is enhanced with visual information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/428—Arrangements for placing incoming calls on hold
- H04M3/4285—Notifying, informing or entertaining a held party while on hold, e.g. Music On Hold
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/428—Arrangements for placing incoming calls on hold
- H04M3/4288—Notifying a called subscriber of an incoming call during an ongoing call, e.g. Call Waiting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Definitions
- the present application belongs to the field of calls, and in particular relates to a call prompting method, a call device, a readable storage medium and a chip system.
- a user uses a calling device to make a call
- the call is waiting or waiting for the user to respond.
- the user dials the operator's service call and waits for the manual agent to answer when transferring to a manual agent.
- the user makes a banking service call, wait for the user to press a key to jump to a different function menu.
- the user can only listen to the prompt message by sticking the calling device to the ear to confirm the end of the call waiting or the action that should be responded.
- call audio can be played through an external call device, such as a headset, a Bluetooth headset, a Bluetooth speaker, and the like. So that when there is a call waiting or waiting for a user's response, the user can listen to the prompt information through the external communication device.
- an external call device such as a headset, a Bluetooth headset, a Bluetooth speaker, and the like. So that when there is a call waiting or waiting for a user's response, the user can listen to the prompt information through the external communication device.
- the embodiments of the present application provide a call prompting method, a call device, a readable storage medium and a chip system, which can improve the situation of waiting for a call or waiting for a user's response and when the user does not use an external call device, he can only hold the call device sticker. Listening to the prompt information by the ear causes inconvenience for the user to operate and affects the user's other work.
- an embodiment of the present application provides a method for prompting a call.
- the executive body of the call prompting method is an electronic device, and the electronic device may be a call device with a call capability.
- the communication device includes a smart phone, a smart phone booth, a tablet computer with a communication capability, a wearable device or a vehicle-mounted computer, and the like.
- a call prompting method includes: enabling a call prompting mode. A first audio characteristic of the received call audio is identified. The call state is determined according to the first audio feature. According to the call prompt mode corresponding to the call state, the call prompt is performed.
- the call alert mode is turned on. It means that a call prompt is required for an ongoing call.
- the call device may determine the call state according to the first audio feature of the received call audio.
- the types of call states include: call waiting state, waiting for response state, or unavailable state.
- the first audio feature may be a keyword in the received call audio, such as "please wait", "please press” and so on. If no voice is recognized in the call audio, the call audio may contain music, phone signal tones, etc. At this time, the first audio feature may be the identified type of pure music or telephone signal tone, such as a connection tone, a busy tone, a waiting tone, and the like.
- Each call state corresponds to a plurality of first audio features, and after the corresponding audio features are identified, the current call state can be determined according to the audio features.
- Each call status includes different call prompt methods. For example, in the call waiting state, after identifying the keyword indicating the end of waiting, the user may be reminded to answer by vibrating, displaying prompt information, or the like. In the waiting for response state, the user may be prompted to respond by displaying prompt information containing the content to be responded, or providing a key associated with the content to be responded.
- the call device prompts the user according to different call states. Users do not need to use an external calling device, or keep the calling device close to their ear to answer, and can also receive prompt information in time. Therefore, hands can be freed to perform other work, the operation is more convenient and free, and the call experience of the user is effectively improved.
- turning on the call prompt mode includes: if a preset operation input by the user is received, turning on the call prompt mode. Or, if the automatic activation condition is met, the call prompt mode is activated.
- the call prompt service can be provided more flexibly. It makes the user experience better when using the call prompt service.
- receiving a preset operation input by the user includes: receiving a touch operation acting on a virtual key having a function of enabling a call prompt mode. Or, a key operation acting on a preset physical key is received. Or, a preset operation gesture is received.
- the virtual key for enabling the function of the call prompt mode may be a virtual key in a graphical interface displayed on the touch screen of the electronic device.
- it could also be a sensing area on an electronic device.
- a touch sensor is added to a certain area of the electronic device, and the call prompt mode is turned on after the touch sensor senses a touch.
- the key operations acting on the preset physical keys may include, for example, double-clicking the "Volume-" key, pressing "Volume+” and “Volume-” at the same time, and so on.
- the preset operation gestures may be graphics, characters, special operation gestures, etc. drawn on the touch screen of the electronic device, for example, writing "Z" or "S” on the touch screen, or tapping the touch screen three times with knuckles Wait.
- satisfying the auto-on condition includes confirming that the user does not listen to the call audio.
- the call number of the identified call is the preset open number.
- the call reminder mode is automatically turned on, which can better provide the user with a call reminder service and improve the user experience.
- confirming that the user does not listen to the call audio includes: confirming that the external call device is not enabled to play the call audio, and recognizing that the user does not listen to the call audio through the listening device of the electronic device.
- the external communication device may be a wired headset, a wireless headset, a smart screen, a smart speaker, or other devices. Verify that the external talker is not enabled to play call audio, including confirming that the electronic device is not connected to any of the external talkers. Or, the electronic device is connected to the external communication device, but the audio of the call is not played through the connected external communication device.
- the listening device includes a receiver and a speaker.
- Identifying that the user does not listen to the call audio through the listening device of the electronic device includes: determining that the user does not listen to the call audio through the receiver, and determining that the user does not listen to the call audio through the speaker.
- determining that the user does not listen to the call audio through the receiver includes: obtaining a distance between the receiver and the user's face, and if the distance is greater than a preset threshold, determining that the user does not listen to the call audio through the receiver.
- the distance between the receiver and the user's face can be acquired through a sensor disposed near the receiver.
- the distance can be obtained by a distance sensor.
- the brightness is acquired through a light sensor, and if the acquired brightness is greater than a preset brightness value, it can be determined that the distance between the receiver and the user's face is greater than a preset threshold.
- the image can also be acquired through the front camera, and if the proportion of the face graphic in the image is smaller than the preset proportion value, it can be determined that the distance between the receiver and the user's face is greater than the preset threshold.
- determining that the user does not listen to the call audio through the speaker includes: reading audio playback setting information of the electronic device. If in the audio playback setting information, the call audio is not played through the speaker, it is determined that the user does not listen to the call audio through the speaker.
- the method further includes: reading preset setting information of the call prompt mode.
- the setting information includes preset operation information. After the call prompt mode is turned on, the method further includes: performing a preset operation according to preset operation information.
- the preset operation may be automatic dialing, automatic redialing, and the like.
- the call state is a call waiting state.
- the call prompt is performed according to the call prompt mode corresponding to the call state, including: if a second audio feature indicating the end of the call waiting state is identified in the call audio, an answer prompt is performed, and the answer prompt is used to instruct the user to answer the call.
- audio features indicating call waiting may include keywords such as "queue”, “wait a moment”, “later”, “don't hang up”, etc. that indicate call waiting.
- the user In the call waiting state, if it is recognized that the call audio includes the second audio feature, such as "Hello”, “Hello”, “Mr.”, “Ms.” and other keywords indicating the end of the call waiting state, the user is prompted to answer the call . Therefore, the user does not need to keep the calling device close to the ear to answer the call, and can also answer the call in time after the call waiting is over, which improves the user's call experience.
- the second audio feature such as "Hello”, “Hello”, “Mr.”, "Ms.” and other keywords indicating the end of the call waiting state
- the call state is determined to be the call waiting state, if a third audio feature indicating the waiting response state is identified in the call audio, it is determined that the call state is switched from the call waiting state to the waiting response state.
- performing a call prompt according to a call prompt mode corresponding to the call state includes: performing an operation prompt according to the third audio feature, and the operation prompt is used to prompt the user to respond to the call.
- the third audio feature may be keywords such as "please press”, “please dial”, “please speak”, etc., which instruct the user to respond.
- the call state is determined to be the waiting response state by identifying the third audio feature, so that the calling device can flexibly switch between the call waiting state and the waiting response state, the application is more flexible, the scope of application is wider, and the effect of the call prompt is also more humane.
- the call state is a waiting-for-response state.
- Performing a call prompt according to a call prompt mode corresponding to the call state includes: performing an operation prompt according to a first audio feature.
- the operation prompt is used to prompt the user to respond to the call.
- While waiting for the response state prompt the user to respond according to the acquired first audio feature or the third audio feature.
- the user does not need to keep the calling device close to the ear to answer, and can also determine the content that needs to be responded to and respond, which can free the user's hands and make the operation more convenient.
- the method further includes: receiving a response operation from the user. Perform the action indicated by the response action.
- the operation prompt instructs the user to press a button, and after receiving the user's response (ie, a button operation), the operation corresponding to the case is executed.
- the call state is an unavailable state.
- the call prompt is performed, including: prompting that the connection cannot be made, and performing a hang-up operation or a redial operation.
- the first audio feature when the first audio feature includes an audio feature that cannot be connected, it may be determined that the call state is the unavailable state.
- the audio features that cannot be connected include “unable to connect”, “empty number”, and “please try again later” to indicate keywords that cannot be connected.
- a corresponding redial mode can be selected according to the characteristics of the audio that cannot be connected. For example, when the unreachable audio feature is "unreachable” or "please try again later", redialing can continue until it stops. When the unreachable audio feature is "empty number”, after redialing 3 times, if the unreachable audio feature still appears “empty number”, the redialing can be stopped, and the user is prompted to dial the number as Empty number.
- the incoming call status When the incoming call status is unavailable, it indicates that the called device cannot be connected temporarily, and a notification of unavailable connection can be made at this time. For example, users are reminded that they cannot be connected by means of voice, vibration, display reminder text, etc. Perform a hang-up operation or a redial operation to reduce the number of operations for the user and further improve the convenience of the operation.
- the method further includes: if it is recognized that the calling device meets the termination condition of the call prompt mode, suspending the call prompt.
- identifying that the calling device satisfies the termination condition of the calling prompt mode includes: recognizing that the calling device prompts a termination instruction during the call. Alternatively, it is recognized during the call that the user starts listening to the call audio.
- terminating the call prompt mode includes: if it is recognized that the call device enables an external call device to play call audio, or it is recognized that the user listens to the call audio through a listening device of the call device, terminating the call prompt mode.
- an embodiment of the present application provides a call prompting device, which is applied to an electronic device, and the device includes:
- the identification module is used for identifying the first audio feature of the received call audio.
- a determining module configured to determine the call state according to the first audio feature.
- the prompt module is used to prompt the call according to the call prompt mode corresponding to the call state.
- the enabling module is specifically configured to enable the call prompt mode if a preset operation input by the user is received. Or, if the automatic activation condition is met, the call prompt mode is activated.
- the enabling module is specifically configured to receive a touch operation acting on a virtual key with a function of enabling the call prompt mode. Or, a key operation acting on a preset physical key is received. Or, a preset operation gesture is received.
- the enabling module is specifically used to confirm that the user does not listen to the call audio.
- the call number of the identified call is the preset open number.
- the enabling module is specifically configured to confirm that the external call device is not enabled to play the call audio, and recognize that the user does not listen to the call audio through the listening device of the electronic device.
- the listening device includes a receiver and a speaker.
- the enabling module is specifically used to determine that the user does not listen to the call audio through the receiver, and to determine that the user does not listen to the call audio through the speaker.
- the enabling module is specifically used to obtain the distance between the receiver and the face of the user, and if the distance is greater than a preset threshold, it is determined that the user does not listen to the call audio through the receiver.
- the enabling module is specifically configured to read audio playback setting information of the electronic device. If in the audio playback setting information, the call audio is not played through the speaker, it is determined that the user does not listen to the call audio through the speaker.
- the device further includes a reading module for reading preset setting information of the call prompt mode.
- the setting information includes keyword information.
- the identification module is specifically configured to identify the first audio feature of the received call audio according to the keyword information contained in the setting information.
- the setting information includes preset operation information.
- the device further includes an execution module, configured to execute the preset operation according to the preset operation information.
- the call state is a call waiting state.
- the prompt module is specifically configured to perform an answer prompt if a second audio feature indicating the end of the call waiting state is identified in the call audio, and the answer prompt is used to instruct the user to answer the call.
- the call state is the call waiting state.
- the identification module is further configured to, after determining that the call state is the call waiting state, if a third audio feature indicating the waiting response state is identified in the call audio, determine that the call state is switched from the call waiting state to the waiting response state. state.
- the prompt module is specifically configured to perform an operation prompt according to the third audio feature, and the operation prompt is used to prompt the user to respond to the call.
- the call state is a waiting-for-response state.
- the prompting module is specifically configured to perform operation prompting according to the first audio feature.
- the operation prompt is used to prompt the user to respond to the call.
- the apparatus further includes a response module for receiving a user's response operation. Perform the action indicated by the response action.
- the call state is an unavailable state.
- the prompt module is specifically used to prompt the inability to connect, and to perform a hang-up operation or a redial operation.
- the identification module is specifically configured to terminate the call prompt if it is identified that the call device meets the termination condition of the call prompt mode.
- the identification module is specifically configured to prompt a termination instruction during a call during a call. Alternatively, it is recognized that the user starts listening to the audio of the call while on a call.
- the identification module is specifically configured to terminate the call prompt mode if it is recognized that the call device enables an external call device to play call audio, or if it is recognized that the user listens to the call audio through a listening device of the call device.
- an embodiment of the present application provides a communication device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the method provided in the first aspect is implemented when the processor executes the computer program.
- an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method provided in the first aspect is implemented.
- an embodiment of the present application provides a computer program product, which enables the terminal device to execute the method provided in the first aspect when the computer program product runs on a terminal device.
- an embodiment of the present application provides a chip system, the chip system includes a memory and a processor, and the processor executes a computer program stored in the memory to implement the method provided in the first aspect.
- an embodiment of the present application provides a chip system, the chip system includes a processor, the processor is coupled to the computer-readable storage medium provided in the fourth aspect, and the processor executes a computer program stored in the computer-readable storage medium, to implement the method provided in the first aspect.
- FIG. 1 is a system block diagram of a communication device provided by an embodiment of the present application
- FIG. 2 is an application scenario diagram of a call prompt method provided by an embodiment of the present application
- FIG. 3 is a schematic flowchart of a call prompting method provided by an embodiment of the present application.
- FIG. 4 is a schematic flowchart of a call prompting method provided by another embodiment of the present application.
- FIG. 5 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied;
- FIG. 6 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied;
- FIG. 7 is a schematic flowchart of a call prompting method provided by another embodiment of the present application.
- FIG. 8 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied.
- FIG. 9 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- FIG. 10 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied;
- FIG. 11 is a schematic flowchart of a call prompt method provided by another embodiment of the present application.
- FIG. 12 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied;
- FIG. 13 is a schematic flowchart of a call prompting method provided by another embodiment of the present application.
- FIG. 14 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied;
- 15 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied.
- 16 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied;
- 17 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied.
- FIG. 18 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied;
- 19 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied.
- 20 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied;
- 21 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- 22 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- FIG. 23 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- 24 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- 25 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- 26 is a schematic diagram of an interface when a call prompting method provided by another embodiment of the present application is applied.
- FIG. 27 is a schematic diagram of an interface when a call prompt method provided by another embodiment of the present application is applied.
- 29 is a schematic flowchart of a call prompting method provided by another embodiment of the present application.
- FIG. 30 is a schematic flowchart of a call prompting method provided by another embodiment of the present application.
- FIG. 31 is a schematic flowchart of a call prompting method provided by another embodiment of the present application.
- 35 is a schematic structural diagram of a call prompting device provided by an embodiment of the application.
- FIG. 36 is a schematic structural diagram of a call prompting device provided by another embodiment of the present application.
- FIG. 37 is a schematic structural diagram of a call prompting device provided by another embodiment of the present application.
- FIG. 38 is a schematic structural diagram of a call prompting device provided by another embodiment of the present application.
- FIG. 39 is a schematic structural diagram of a communication device according to an embodiment of the present application.
- the term “if” may be interpreted, depending on the context, as “when” or “once” or “in response to determining” or “in response to detecting ". Similarly, the phrases “if determined” or “if identified” may be interpreted contextually to mean “once determined” or “in response to determining” or “once identified” or “in response to identifying.”
- references in this specification to "one embodiment” or “some embodiments” and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
- appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically emphasized otherwise.
- the call prompting method provided by the embodiment of the present application can be applied to a mobile phone, a tablet computer with a call function, a wearable device, a vehicle-mounted device, a personal digital assistant (PDA), a voice over Internet Protocol (Voice over Internet Protocol) VoIP) phone on a calling device such as a desktop computer or laptop.
- PDA personal digital assistant
- VoIP voice over Internet Protocol
- VoIP voice over Internet Protocol
- SIM Subscriber Identity Module
- This embodiment of the present application does not impose any restrictions on the specific type of the communication device.
- FIG. 1 shows a structural diagram of a call device to which the call prompting method provided by the present application can be applied.
- the communication device includes: a processor 110 , a vibration motor 111 , an input module 112 , an audio module 120 , a screen 130 , a camera module 140 , a storage module 150 , an interface 160 , a power module 170 , a sensor module 180 , and a communication module 190 and other parts.
- a processor 110 the communication device includes: a processor 110 , a vibration motor 111 , an input module 112 , an audio module 120 , a screen 130 , a camera module 140 , a storage module 150 , an interface 160 , a power module 170 , a sensor module 180 , and a communication module 190 and other parts.
- a processor 110 includes: a processor 110 , a vibration motor 111 , an input module 112 , an audio module 120 , a screen 130 , a camera module 140 , a storage module 150 , an interface 160 , a power module 170 , a sensor module 180 , and a communication module 190
- the processor 110 is the control center of the communication device, and can use various interfaces and lines to connect various parts of the communication device, run or execute the software programs and/or modules stored in the storage module 150, and call the software programs and/or modules stored in the storage module 150. data, perform various functions of the call device and process data, so as to remind the call.
- the processor 110 may include one or more processing units.
- it can be a central processing unit (Central Processing Unit, CPU), or can also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable processor Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
- CPU Central Processing Unit
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- FPGA Field-Programmable Gate Array
- the processor 110 may integrate an application processor and a modem processor.
- the application processor mainly handles the operating system, user interface and application programs, etc.
- the modem processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 110, which is not limited in this application.
- the vibration motor 111 can vibrate when a signal is received to remind in the form of vibration.
- the input module 112 may be configured to receive input information and key signals.
- the input information includes numeric or character information, touch information, and the like.
- the key signals include a physical key press signal, a virtual key press signal, and the like.
- the input module 112 may include a touch panel and other input devices.
- the touch panel and the screen 130 can form a touch screen, and the touch panel can collect the user's touch operations on or near it (for example, objects or accessories that can generate touch signals on the touch panel by the user using a finger, a stylus, etc. operation on the panel or near the touch screen), and execute the corresponding function according to the preset program driver.
- the touch panel may include two parts, a touch detection device and a touch controller.
- the touch detection device detects the touch orientation of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller.
- the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the processor 110.
- the processor 180 receives the contact coordinates, converts them into touch commands, and executes them.
- the touch panel can be implemented using resistive, capacitive, infrared, and surface acoustic wave types.
- Other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick.
- the audio module 120 is connected to the listening device and the radio device, and is used for processing audio signals.
- the listening device includes a speaker 121 and a receiver 122
- the sound-receiving device includes a microphone 123 .
- the audio module 120 may convert the analog audio signal received by the microphone 123 into digital audio data and send it to the processor 110 .
- the digital audio data sent by the processor 110 is converted into an analog signal that can be played by the speaker 121 and the receiver 122 and sent to the speaker 121 or the receiver 122 to play audio.
- the screen 130 is used to display the content output by the communication device through visual output. For example, information entered by the user can be displayed, information provided to the user can be displayed, the system interface of the calling device, the interface of the application running on the calling device, and the like can be displayed.
- the material of the display panel of the screen 130 can be a liquid crystal display (Liquid Crystal Display, LCD), a thin film transistor (Thin Film Transistor, TFT), a light-emitting semiconductor (Light-Emitting Diode, LED), an organic light-emitting semiconductor (Organic Light-Emitting Diode, OLED) ), etc., which are not limited here.
- the touch panel may be covered on the display panel of the screen.
- the touch panel detects a touch operation on or near it, it transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 determines the type of the touch event according to The type of touch event provides a corresponding visual output on the display panel.
- the screen and the touch panel (not shown) are two independent components in FIG. 1 to realize the input and input functions of the mobile phone, in some embodiments, the touch panel and the display panel can be integrated to realize the mobile phone input and output functions. Wherein, after the touch panel is integrated with the screen, it can be used as a touch screen, and the touch screen can receive touch signals on the touch panel and feed it back to the processor 110 . The processor 110 responds according to the touch signal, and displays the response result on the display panel of the screen.
- the camera module 140 includes at least one camera, and the camera may be a front camera 141 or a rear camera 142 .
- the calling device may be a single camera, dual camera, triple camera or quad camera.
- one camera is the front camera 141 and three are the rear cameras 142 .
- the three rear cameras 142 can be cameras with different focal lengths.
- a main camera with an equivalent focal length of 35mm a wide-angle camera with an equivalent focal length of 20mm, and a telephoto camera with an equivalent focal length of 105mm. This embodiment of the present application does not limit this.
- the multiple cameras may be all front-facing, or all rear-facing, or part of the front-facing camera and another part of the rear-facing camera, which is not limited in this embodiment of the present application.
- the storage module 150 includes an internal memory 151 and an external memory interface 152, and the internal memory 151 may be a flash memory, a hard disk, a computing memory, or the like.
- the internal memory may include at least one hard disk or flash memory, and one computing memory.
- the external memory interface 152 is used to connect an external memory, and the external memory may include a memory card, a mobile hard disk, a U disk, an optical disk, and the like.
- the storage module 150 may be used to store software programs and modules, and the processor 110 executes various functional applications and data processing of the calling device by running the software programs and modules stored in the storage module 150 .
- the storage module 150 may mainly include a storage program area and a storage data area.
- the program storage area is usually located on the internal memory 151, and can store an operating system and an application program required for at least one function (eg, a sound playback function, a touch response function).
- the storage data area may be located on the internal memory 151, or on the external memory connected to the external memory interface 152, or on both the internal memory and the external memory.
- the storage data area can store data (such as audio data, image data, video data) created according to the usage of the mobile phone.
- the interface 160 includes, but is not limited to, a Subscriber Identity Module (SIM) card interface 161 , a USB interface 162 , and an earphone interface 163 .
- SIM Subscriber Identity Module
- the SIM card interface is used to insert the SIM card provided by the operator, so that when the calling device communicates with the base station through the mobile communication module 191, it can identify and verify the user identity, and after passing the verification, send a call request, a data request to the base station and receive the base station. Forwarded calls, data, text messages, etc.
- the USB interface 162 can connect the communication device and the computer through a USB data line to exchange data. At the same time, the USB interface 162 is also connected to the power module 170. When the USB data cable is connected to a computer or a charging socket, the input power can be transferred to the power module 170 to charge the calling device.
- the USB interface 162 can be micro-USB, mini-USB, USB Type-c, etc., which is not limited here.
- the earphone jack 163 is used to connect an earphone.
- the earphone interface 163 can be an independent interface, for example, the earphone interface 163 can be a 3.5mm earphone jack.
- the headphone jack 163 can also be integrated into the USB interface 162, for example, the headphone jack can be integrated into the USB Type-c.
- the audio module 120 can no longer send the output analog audio signal to the speaker 121 or the receiver 122 , but to the earphone through the earphone interface 163 to play audio through the earphone.
- the audio module When the earphone is inserted, if it is detected that the earphone does not include a microphone, the audio module still receives the analog audio signal sent by the microphone 123 at this time. If it is detected that the earphone includes a microphone, the audio module receives the analog audio signal sent by the earphone microphone, processes it, and sends it to the processor 110 .
- the communication device also includes a power module 170 for powering the various components.
- the power module may include a battery, a power management module, and the like.
- the power management module may be logically connected to the processor 110, so that functions such as managing the charging, discharging, and power consumption of the battery are implemented through the power management module.
- the telephony device may also include a sensor module 180 .
- the sensor module includes at least one sensor, such as a pressure sensor 181 , a gyro sensor 182 , a distance sensor 183 , a proximity light sensor 184 , a touch sensor 185 or an acceleration sensor 186 , and the like.
- the proximity light sensor 184 can include an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor can turn off the display of the screen 130 when the mobile phone is moved to the ear panel and/or backlight.
- the acceleration sensor 186 can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the communication device (such as picking up or putting down a call) device, horizontal or vertical call device, etc.). It can also be used to identify related actions (such as step counting, tapping) through vibration, etc. Other sensors of the call device will not be described here.
- the communication module 190 includes a mobile communication module 191 and a wireless communication module 192 .
- the mobile communication module 191 can support any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division Multiple Access) Division Multiple Access, CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (Long Term Evolution, LTE), Time Division Multiplexing WCDMA (Time-Division WCDMA, TD-WCDMA), Time Division Multiplexing LTE (Time-Division LTE, TD-LTE), the 5th generation New Radio (the 5th generation New Radio, 5G NR), etc.
- the wireless communication module 192 can support Bluetooth (Bluetooth), Wireless Fidelity (Wireless Fidelity, Wi-Fi), Near Field Communication (Near Field Communication, NFC) and the like.
- the mobile communication module 191 can be used to connect with the communication base station through an antenna, so as to establish a communication link between the communication device and other communication devices, and to receive the audio of the communication.
- the wireless communication module 192 is used for wirelessly connecting with an external communication device, wherein the external communication device may be an external device with functions of playing and receiving sound, such as a Bluetooth headset and a Bluetooth speaker.
- the external communication device is connected to the communication device through the wireless communication module 192 , audio can be played through the external communication device, and the analog audio signal collected by the external communication device can be received, processed and sent to the processor 110 .
- the mobile communication module 191 sends the received call audio data to the processor 110 for processing, and the processor 110 can implement the call prompt method provided by the present application by running the software program stored in the storage module 150 .
- FIG. 2 shows a schematic diagram of an application scenario of a call prompting method.
- the calling device is explained by taking a smartphone as an example.
- a base station 21 a smart phone 22 , and a smart watch 23 are included.
- the structure of the smart phone 22 can refer to the structure of the communication device in FIG. 1 .
- the smart phone 22 is connected to the base station 21 for communication through the mobile communication module.
- the smart phone 22 makes a call (number 1)
- the smart phone 22 sends the number 1 to communicate with it.
- the connected base station 21, the base station 21 establishes a communication channel between the smartphone 22 and the communication device corresponding to the number 1 according to the number 1, so that the smartphone 22 can communicate with the communication device corresponding to the number 1.
- the smart phone 22 can be connected to the smart watch 23 through Bluetooth, and the smart watch 23 can receive the call prompt information sent by the smart phone 22 and display the call prompt.
- the smart watch 23 can also be used for touch selection to respond to the call prompt.
- the smart watch 23 connected to the smart phone 22 is only an example, and does not necessarily exist. It can be left unconnected, or another device can be used instead.
- the smartphone 22 can also be connected with devices such as a Bluetooth headset, a smart bracelet, a smart speaker, or a smart display.
- the smartphone 22 when the smartphone 22 is connected to a device that can be used as an external communication device, such as a headset, a Bluetooth headset, or a smart speaker, if there is a call waiting or waiting for a response, the call audio can be played through the external communication device. Allows the user to receive prompts and confirm when the wait is over or how to respond.
- a device that can be used as an external communication device such as a headset, a Bluetooth headset, or a smart speaker
- the present application provides a method for prompting a call, which can prompt the user for a call when the audio of the call is played by a listening device that does not use an external call device or a call device, so that the user can receive prompt information and answer the call in time. call, or respond.
- FIG. 3 shows a schematic flowchart of a call prompting method provided by an embodiment of the present application, and the method can be applied to the above-mentioned call device.
- the method includes:
- the setting information of the call prompt mode may be read first, and the call prompt mode is enabled according to the setting information.
- the setting information of the call prompt mode includes setting information of whether the call prompt mode is enabled, preference information when the call prompt is performed, and the like.
- the call prompt mode is enabled on the calling device, and the call prompt mode can be enabled when the call device meets the enabling conditions for the call prompt mode.
- the call prompt mode when the call device detects that the user has input a preset operation, the call prompt mode is enabled. In other words, the call device will turn on the call prompt mode in response to the user's operation.
- the operation may be a touch operation, or a user clicking a physical button, or a specific gesture or body movement.
- the user can also turn on the call prompt mode by voice.
- the operation may be that the user clicks the call prompt button 1701 .
- the operation may be that the user clicks on the call reminder button 2301 . It can be understood that, the embodiment of the present application does not limit the specific implementation manner of the operation.
- the call device can automatically turn on the call prompt mode. Satisfying the automatic activation condition includes at least two situations. One is to determine that the calling device satisfies the preset activation condition, for example, it is detected during the call that the user does not listen to the call audio. For example, it is recognized that the call device does not enable the external call device to play call audio, and it is recognized that the user does not listen to the call audio through the listening device of the call device.
- the external communication device may be a wired headset or a Bluetooth headset.
- the listening device of the calling device may be a speaker, a receiver, and the like. For example, refer to the application scenario of FIG.
- the smartphone in which the smartphone is connected to the smart watch, and the hands-free is not enabled on the smartphone.
- the call device meets the enabling conditions for call alerts.
- the calling number if it is detected that the calling number is a preset enabled number, the calling device complies with the opening condition of the calling prompt.
- the preset activation number may be an emergency number, such as 110, 119, or a preset operator service number, etc., which is not limited here.
- the calling device if it is recognized that the calling device does not enable the external calling device to play the call audio, it can be confirmed whether the calling device is connected to the external calling device by detecting the load of the headphone interface, obtaining a list of wireless devices, or the like. If there is an external call device, it is also necessary to read the setting options of the output audio of the call device to confirm whether to play the call audio through the external call device.
- Identifying that the user does not listen to the call audio through the listening device of the calling device includes identifying that the user does not listen to the call audio through the speaker and the user does not listen to the call audio through the receiver. Among them, to identify that the user does not listen to the call audio through the speaker, it can be confirmed whether the call device plays the call audio through the speaker by reading the setting option of the output audio of the call device. If the calling device does not play the call audio through the speaker, it needs to continue to identify that the user does not listen to the call audio through the receiver. In some embodiments, whether the user listens to the call audio through the receiver can be determined by detecting whether the receiver is close to the ear. For example, a sensor installed near the receiver detects whether it is close to the face, and if it is close, it is confirmed that the user listens to the call audio through the receiver.
- the call device is set to turn on the call prompt mode by default when it leaves the factory. In this case, as long as no command to turn off the call prompt mode is received, the call prompt mode will be kept on every time you make a call.
- the first audio feature is used to confirm the state of the call.
- the call status includes call waiting status, waiting for response status, or unavailable status.
- the call waiting state means that the other party has not answered the call temporarily or the call has been connected but the other party cannot answer temporarily, and needs to wait for the other party to answer or answer. For example, when calling a customer service call to transfer to a human, wait for the human agent to answer. Or, wait for the other person to answer while you make a call.
- the waiting-for-response state refers to a state of waiting for the user to input a response command (eg, a key command, a voice command, etc.), for example, waiting for the user to input key-press information.
- a response command eg, a key command, a voice command, etc.
- the other party's voice answering robot instructs "please tell me the problem you want to solve”.
- you need to wait for the user to input relevant voice commands such as "carry out warranty”, "inquire about phone bills” and other voices.
- the other party's voice answering robot instructs "please press 1 to check the phone bill, press 2 for business, and press 0 for manual transfer", etc., it needs to wait for the key command input by the user.
- Unable to connect means that the other party cannot connect. For example, the other party is busy, the dialed number is empty, and the operator is busy and cannot provide manual services.
- Each call state is set with a plurality of first audio features corresponding to it.
- the first audio feature corresponding to the call waiting state may be "please wait”, “please wait”, “connecting”, and so on.
- the first audio feature corresponding to the waiting response state may be "please press”, “please dial”, and the like.
- the first audio feature corresponding to the inability to connect state may be “unable to connect", "empty number", “stop”, and so on.
- the call state corresponding to the first audio feature may be determined to be the current call state.
- the first audio feature corresponding to the call state may be preset by the user or automatically acquired.
- the call waiting state corresponds to features such as song A, "waiting", and “later”
- the waiting response state corresponds to "please press”, “please dial”, “please speak” and other features
- the unavailable state corresponds to the busy tone, "unable to connect", "empty number” and other characteristics.
- a plurality of correspondences between the call state and the first audio feature may be preset, and these correspondences may be stored in the call state identification database. For example, “call waiting state-waiting” and “call waiting state-song B” can be set. “Waiting” and “Song B” are the audio features of call waiting. You can also set “waiting for response status - please press”, “waiting for response status - please dial”, “waiting for response status - please speak”. "Please press”, "Please dial”, and "Please speak” are the third audio features.
- the identified first audio feature is matched with the corresponding relationship in the call state identification database to obtain a determined call state. For example, when the keyword "waiting" is identified and the call state corresponding to "waiting" is matched in the call state identification database as "call waiting state", it is determined that the current call state is the call waiting state.
- the call state identification database can be set on the server side, on the call device, or on the server side and on the call device at the same time, which is not limited here.
- the maintenance personnel can update the call state identification database every preset time, so as to determine the call state more accurately.
- the call state identification database on the call device can be synchronized with that on the server side to realize the update. Synchronization can be done manually, or automatically updated between presets, without limitation.
- the user needs to be prompted to answer by means of text or vibration.
- the wait-for-response state the user needs to be reminded to respond, and the content to be responded can be displayed on the touch screen so that the user can respond.
- the inability to connect state the user needs to be reminded that the other party cannot be connected, and at the same time, hang up or redial operations can be performed, and the user can be reminded by a vibration method different from the call waiting state.
- the prompting manner of each call state in this application is only an example, and is not limited thereto.
- the corresponding call state is confirmed according to the identified first audio feature.
- the user is prompted for a call in different ways. Users can use the call prompt to determine whether they need to answer the call or respond, without having to keep the calling device close to their ear. The user can free his hands to do other work when the user is waiting for a call or waiting for the user's response and the user does not use an external communication device, which effectively improves the user's call experience.
- FIG. 4 shows a call prompting method, which is an example of step S33 in FIG. 3 .
- Figures 5 and 6 show an example of prompting a call when the call is in a waiting state.
- the mobile phone is connected to the smart watch, so that the smart watch can be used as a component for prompting calls.
- the connected device can also be used as a component for prompting calls.
- the call prompting through a device such as a smart watch, a smart bracelet, a smart screen, etc., is only a scenario for performing a call prompt, and not a limitation. This application does not limit the types of devices that are connected to the calling device for reminding.
- the prompt for making a call includes:
- the call state is determined to be the call waiting state according to the identified first audio feature. Then, referring to FIG. 5 , "waiting for the other party to answer" is displayed on the call interface to remind the user that the other party has not answered at present.
- the prompt information that can be displayed on the smart watch. For example, when there is a smart watch connected to the calling device, if the calling device displays a prompt message of "waiting for the other party to answer", a prompt instruction can be generated according to the prompt information and sent to the smart watch. After receiving the prompt instruction, the smart watch displays a prompt message "waiting for the other party to answer" on its screen according to the prompt instruction.
- a prompt message "The other party may have finished waiting, please answer” may be displayed on the screen.
- the second audio feature includes keywords such as "Hello”, “Hello”, “Mr.”, “Ms.”, etc., which can indicate that the call waiting is over and the other party has answered or answered.
- the calling device can also remind the user to answer by means of continuous or intermittent vibration, intermittent lighting of the flash, and intermittent lighting or extinguishing of the screen backlight. Similar to FIG. 22 , when there is a smart watch connected to the calling device, the above prompt instruction can be generated and sent to the smart watch.
- an instruction instructing the smart watch to vibrate can be added. After receiving the instruction, the smart watch will display the prompt message "The other party may have finished waiting, please answer” on its screen, and vibrate continuously to remind the user to answer.
- FIG. 7 shows a call prompting method, which is another embodiment of step S33 in FIG. 3 .
- FIG. 8 and FIG. 9 show an example of prompting a call in a waiting state for a response.
- performing a call prompt includes: S51 , determining that the call state is a waiting-for-response state.
- determining that the call state is the waiting-for-response state includes two cases. One is to identify the third audio feature indicating the waiting response state when the calling state is the waiting response state, then determine that the calling state is the waiting response state, and perform an operation prompt according to the third audio feature. In another case, the identified first audio feature indicates waiting for a response, and the call state is determined to be a waiting-for-response state. For example, referring to FIG. 8 , when the dialed number is an operator service number, after the manual transfer, a long wait may occur, and the calling device enters a call waiting state.
- the prompt "The operator is busy, please press 1 to continue waiting, and please press 0 to return to the superior" may appear.
- the call audio includes a third audio feature of "please press”, and the call waiting state is converted into a waiting response state.
- the voice prompts "Please press 1 to check the call charge” and "Please press 0 for manual transfer” may appear.
- the call audio includes the first audio feature of "please press”, and the call waiting state is converted into a response waiting state.
- the waiting-for-response state is determined by the first audio feature or the third audio feature.
- prompt information including the first audio feature or the third audio feature (that is, "please press") can be displayed on the screen to indicate the response. If it is recognized that "the operator is busy, please press 1 to continue waiting. Press 0" to display “continue waiting” and “return to previous level” on the screen.
- the calling device can also remind the user to respond by means of continuous or intermittent vibration, intermittent lighting of the flash, etc.
- buttons are generated and sent to the processor; When the area is clicked, the button information of "0" is generated and sent to the processor.
- the processor sends the numbers or characters corresponding to the received key information to the number being called. If a click operation acting on "continue waiting” is received, the calling device dials "1" to the called party and exits the waiting state for a response.
- the calling device After exiting the waiting-for-response state, if the audio feature of the call-waiting can be identified in the call audio, the calling device enters the call-waiting state. If the click operation acting on "return to upper level" is received, the calling device will dial "0" to the called party. After the calling device exits the waiting-for-response state, it may recognize other audio features used to indicate the call-response state, such as "please press 1 to check the call charge", "please press 0 for manual transfer", etc. If it is recognized, the calling device enters the waiting state again.
- a prompt instruction can also be sent to the smart watch, so that the smart watch can also display prompt information waiting for a response synchronously.
- the smart watch receives the click operation acting on the prompt information on the smart watch, the smart watch sends the corresponding key command to the calling device.
- the calling device After the calling device receives the key command, it performs the key operation according to the key information contained in the key command, and dials The number corresponding to the prompt message is displayed.
- the prompt information of the calling device is "continue to wait" and "return to the upper level”.
- the calling device generates a prompt instruction according to the prompt information and the key information corresponding to the prompt information, and sends it to the smart watch.
- the smart watch displays the prompt information "continue to wait” and “return to the superior” in the prompt instruction.
- the smart watch sends the button information corresponding to the click operation area to the calling device, and the calling device dials the called party according to the button information. For example, referring to FIG. 24, if a click operation acting on "continue to wait” is received, the calling device dials "1" to the called party.
- Fig. 9 if the received audio is "press 1 to inquire about phone bills, press 2 for business, press 3 for emergency shutdown, and press 0 for manual service", it can be recognized that The contents of the prompts are “inquiry about phone bills”, “handling business”, “emergency shutdown”, and “manual service”. Similar to the above prompt method, prompt information waiting for a response can be displayed on the calling device, which is not repeated here.
- a voice command input by the user can also be received, and a response is made according to the voice command.
- the voice information input by the user can be collected through the microphone, and whether there is a voice command matching the prompt information waiting for a response in the voice information. If it exists, it will respond according to the voice command matching the prompt information waiting for the response. For example, when the calling device displays the prompt information waiting for a response as "inquiry about phone bills", "handling business", “emergency shutdown", "manual service”, and the user has not responded yet, the microphone receives the voice information input by the user. Recognizing the voice command of "inquiry about the call charge", the calling device performs a key operation according to the key information corresponding to "inquire about the call charge", and dials "1" to the called party.
- FIG. 11 shows a call prompting method, which is another embodiment of step S33 in FIG. 3 .
- FIG. 12 shows an example of a redial operation in a state where the connection cannot be made.
- the prompt for making a call includes:
- two prompt messages of "refresh redial” and “stop redial” may also be displayed on the screen.
- the current number of redials is reset to the first one.
- receiving a click operation for "Stop Redialing” terminate the redialing, and hang up the call after confirming that the call status is unavailable.
- FIG. 13 shows a schematic flowchart of a call prompting method in another embodiment of the present application.
- the call prompting method includes:
- the calling device starts a call.
- the calling device may be the calling party or the called party during the call.
- the calling device when making a call to a carrier's service through a calling device, the calling device is the calling party.
- the calling device When answering an incoming service call from some agencies, the calling device is the called party.
- the call prompting method provided in this application can be used for both the calling party and the called party, which is not limited here.
- S702 Determine whether the calling device satisfies the enabling condition prompted during the call, and if so, perform S703, otherwise continue to identify whether the calling device satisfies the enabling condition for the calling prompt.
- the call prompt mode can be turned on by the user, or can be turned on automatically.
- there are at least three ways to enable the call prompt mode namely, satisfying the manual opening condition, confirming that the call device meets the automatic opening condition, or the call device is set to be enabled in the call prompt mode by default when it leaves the factory.
- the default setting of the calling device is that the call prompt mode is turned on when it leaves the factory.
- the calling device has been set at the factory and does not need to be set by the user, which will not be repeated here.
- the judgment of the automatic opening condition essentially includes two situations. One is to determine whether the user is answering the call, and if the user does not answer the call, the call prompt is automatically opened. To this end, it can be detected whether the external call device is enabled first, and if the external call device is not enabled, it is further detected whether the user answers the call through the listening device (eg receiver, speaker) of the call device. The other is to identify the number of the call. If the number of the call requires a high probability of a call prompt, the call prompt is automatically turned on. For example, for a call between a user and a user, a call prompt is generally not required. When a user dials a functional number such as an emergency call or a customer service call, the other party may use an automatic answering robot, etc., and there is a high probability that a call prompt needs to be made.
- a functional number such as an emergency call or a customer service call
- the following describes the detection of whether the external communication device is enabled and whether the user answers the call through the listening device of the communication device.
- the headphone interface is loaded by detecting whether the headphone interface of the call device is loaded. Headphones are connected. If the headphone jack does not detect the load, that is, the headphone is not connected, it is also possible to determine whether the calling device is currently connected to an external communication device such as a Bluetooth headset or a Bluetooth speaker by obtaining the wireless communication device list of the calling device.
- the list of wireless communication devices includes all wireless devices connected to the calling device.
- the headset or an external call device If there is a connected headset or an external call device, it is necessary to further read the setting options of the output audio of the call device to confirm whether the call device is set to output audio through the headset or the external call device. If it is determined that the calling device is not connected to a headset or an external calling device, or is connected to an external calling device but does not output audio through the headset or external calling device, confirm that the calling device has not enabled the external calling device to play call audio.
- the calling device is a True Wireless Stereo (TWS) headset. Then the TWS headset is connected to the calling device through Bluetooth, and the wireless communication device list of the calling device contains the device name of the TWS headset.
- TWS True Wireless Stereo
- the TWS headset When the TWS headset is not worn, it can be detected that the headset interface of the call device is not loaded, and the list of wireless communication devices includes the connected external call device, but in the output audio setting option of the call device, the device that outputs audio is set to the receiver. or speakers, no audio is output through the TWS headphones. At this time, the identification result is that the external call device is not enabled to play call audio.
- the TWS headset When wearing the TWS headset, after the TWS headset detects that the headset is placed in the ear, it sends the wearing indication signal to the calling device through Bluetooth. After the calling device receives the wearing indication signal, the device that outputs audio is set to the TWS headset. At this time, the identification result is that the external call device is enabled to play call audio. It should be noted that when the calling device is waiting to answer the call, the worn indication signal can also be used to control the calling device to answer the call.
- to identify whether the user listens to the call audio through the listening device of the call device it may be detected first whether the user turns on the speaker to play the audio. For example, when reading the setting options of the calling device, if the setting options show that the audio is played through the speaker, confirm that the user turns on the speaker. Set the option to show that the audio is playing through the receiver or external communication device, confirm that the user has not turned on the speaker.
- a proximity light sensor or a distance sensor disposed near the receiver of the communication device detects that the light near the receiver of the communication device is blocked or an obstacle is close to the receiver, it is confirmed that there is a gap between the receiver and the user's face. If the distance is less than the preset threshold, it can be confirmed that the user puts the calling device next to the ear to answer.
- the brightness of the image collected by a camera such as a front-facing camera located near the receiver of the calling device is lower than the brightness threshold or an image of skin is recognized in the image, it can also be confirmed that the distance between the receiver and the user's face is smaller than the predetermined distance. Set the threshold, that is, the user puts the calling device next to the ear to answer.
- both sensors and cameras can be used for detection.
- a proximity light sensor near the receiver detects that the intensity of light is less than an intensity threshold
- the front-facing camera is enabled to capture images. If the brightness of the collected image is lower than the brightness threshold or the skin can be identified in the image, it can be confirmed that the user puts the calling device next to the ear to answer.
- the call prompt mode can be automatically turned on.
- the opening area of the dial pad, call record, and shortcut settings menu is displayed (in this embodiment, three circles arranged vertically in the upper right corner are displayed. point, but not limited to) and so on.
- the calling device receives the click operation acting on the opening area of the quick setting menu, it will display the quick setting menu shown in Figure 15. If it receives the click operation acting on the "Settings" option, it will display the setting shown in Figure 16. interface. After receiving the click operation acting on the "call prompt” option in the setting interface, the setting interface of the call prompt shown in FIG. 17 can be displayed.
- the call prompt mode selection interface shown in FIG. 18 is displayed.
- the interface of FIG. 18 according to the received selection operation, after it is determined that the open mode of the call prompt is the automatic mode, you can return to the setting screen of the call prompt shown in FIG. 17 .
- the interface shown in Figure 19 will appear. In this interface, you can select the processing strategy when an external call device is detected or the speaker is turned on.
- the processing strategy includes: : Stop Call Alert, Hold Call Alert, Alert Me.
- the call prompt mode is terminated after an external call device is detected or the speaker is turned on. If the calling device is in the process of prompting a call (that is, the calling state of the calling device is determined), after detecting the external calling device or turning on the speaker, when the calling state is terminated (that is, the user is prompted to answer in the call waiting state, and the user is in the waiting response state). When a response is received, the user has been prompted that the user cannot be connected in the unavailable state) to terminate the call.
- "Hold call reminder" is selected, during this call, whenever an external calling device is detected or the speaker is turned on, the call reminder will be held until the call ends.
- a selection interface may be displayed after detecting an external calling device or turning on the speaker, and waiting for user input to choose to stop the call prompt or hold the call prompt. If a click operation acting on "No More Prompt” is received, and then a click operation acting on "Yes” or “No” is received, the processing policy can be changed to "Yes” or “No” corresponding to the click operation. "Hold call alert” or “Stop call alert”.
- the preset enabled number may be obtained by the calling device from a third-party server, or may be set locally.
- the calling device sends the call number characteristics of the current call to the third-party server, and the third-party server matches the call number according to the characteristics of the call number.
- the calling device can also periodically download the open number database on the third-party server to the local, and then match the call number with the number in the open number database when making a call. If it matches the corresponding number, confirm the call number of the current call. is the default open number.
- multiple numbers may be pre-stored in the local open number database, and if the call number during the call matches one of the pre-stored numbers, it is confirmed that the call number of the current call is the preset open number.
- the emergency rescue setting can be enabled. For example, continuing to refer to FIG. 9 , if a click operation acting on the “emergency rescue” option is received, the “emergency rescue” setting interface shown in FIG. 14 may be displayed.
- the emergency calls are alarm calls, fire calls, emergency calls, etc., such as 110, 119, and 120. Or emergency calls from other countries and regions, such as 911, 999, 000, etc.
- a corresponding prompt may be displayed on the screen according to the type of the dialed emergency number. For example, when dialing 120, the medical emergency card can be displayed, when dialing 119, the positioning information can be displayed. Similarly, different emergency information can also be sent to the emergency number according to different dialed numbers, which will not be repeated here.
- a prompt box may be displayed on the call interface, prompting the user to enable the call prompt of emergency rescue for the current number. If an operation that the user chooses to turn on is received, a call prompt can be made according to the preset emergency rescue settings.
- the judgment of the manual turn-on condition is essentially to receive the turn-on instruction from the user.
- the user's turn-on instruction can be the turn-on setting performed in the setting menu, or it can be a preset operation gesture, etc., which is not limited here.
- the opening area of the dial pad, call record, and shortcut settings menu is displayed (in this embodiment, three circles arranged vertically in the upper right corner are displayed. point, but not limited to) and so on.
- the calling device receives a click operation acting on the opening area of the quick setting menu, it will display the quick setting menu shown in Figure 23. If a click operation acting on "Enable call prompt" is received, the call prompt preference selection menu shown in FIG. 24 is displayed. In the menu, "automatic identification” and multiple custom options are displayed, each custom option corresponds to a preset call prompt rule. If a click operation acting on the "Automatic identification” option is received, the call prompt mode will be enabled. The prompt method and prompt trigger of the call prompt mode are the same as when the call prompt mode is automatically enabled.
- the call prompt mode When receiving a click operation acting on a custom option such as "Check Call Charge”, "Custom 2" or “Custom 3", the call prompt mode is turned on according to the call prompt rule corresponding to the custom option.
- an on button can be set.
- the ON button shown in FIG. 16 is displayed as "ON”, which means that the call prompt mode is turned on. If a click operation or drag operation acting on the open button is received, the call prompt mode will be turned off, and the open button will be displayed as "OFF”. It is convenient for users to quickly turn on or off the call prompt mode.
- the setting interface of the call prompt can be as shown in FIG. 17 .
- the call prompt mode is enabled or disabled. same settings. For example, if the call prompt mode is turned off in the interface shown in FIG. 16 , when entering the interface shown in FIG. 17 , the call prompt mode is also turned off.
- the call prompt can also be enabled through a voice command.
- the call prompt can be started or turned off according to the wake-up command. Referring to FIG. 25, for example, if the preset wake-up command starts with "smart assistant".
- the calling device analyzes the audio after the "smart assistant", obtains the commands represented by it, and performs corresponding operations. For example, if the voice after "smart assistant" is "turn on call prompt", the command represented by it may be a call prompt mode start command. If the voice after "smart assistant" is "stop call prompt", the command represented by it can be the call prompt mode termination instruction.
- the call prompt mode selection interface shown in FIG. 18 is displayed.
- the interface of FIG. 18 according to the received selection operation, after it is determined that the call prompt mode is the custom mode, you can return to the setting screen of the call prompt shown in FIG. 17 .
- the click operation acting on the "call prompt preference setting” is received, the interface for setting the custom call prompt mode shown in FIG. 26 is displayed.
- each user-defined option can be marked by acting on the corresponding edit mark (shown by a pencil shape in the figure) or delete mark (shown by the trash can in the figure) shape shown) to edit or delete.
- Edit actions are used to change the name and ordering of the corresponding custom option. For example, after receiving the click operation acting on the edit mark, a name editing window may be displayed to receive the name of the input definition option, such as "check call charge”, "transfer to labor", "redial” and so on. If a long-press operation acting on the edit mark is received, the custom option can be moved according to the received sliding operation, so as to change the order of the corresponding custom option among the plurality of custom options.
- the "Check Call Charge” option will move to the bottom of all custom options, and the swipe operation ends. After that, the "Check Call Charge” option stays at the end of several custom options.
- the custom options that have been displayed on the interface can be deleted. For example, when a click operation on the delete mark corresponding to "Custom 3" is received, the "Custom 3" option can be deleted, and there are only two options left on the interface: “Check Calls” and "Custom 2". Finally, you can also add a custom option after receiving the click operation acting on "Add Custom Scheme".
- the name of the new custom option input by the user can be received by displaying a pop-up window, or it can be named "Custom N" by default, where N is the number of existing custom options plus one.
- N is the number of existing custom options plus one.
- FIG. 26 shows 3 custom options, if the default names are named, the name of the newly added custom option is "Custom 4".
- the setting interface corresponding to the custom option after receiving the click operation acting on the custom option, the setting interface corresponding to the custom option will be displayed. interface shown. In the interface shown in Figure 27, you can select a processing strategy when an external calling device is detected or the speaker is turned on. Same as the automatic mode, the processing strategy of the custom mode also includes: stop call prompt, hold call prompt, prompt me. And the processing method corresponding to each strategy is the same as the automatic mode, which is not repeated here.
- keywords for determining the call waiting state can be set, such as “wait a moment”, “queue”, “do not hang up”. It is also possible to set a keyword (second audio feature) for exiting call waiting, such as “hello”, “hello”, “hello”, “sir”, “madam”, “long wait”, “sorry” and so on. and keywords (third audio feature) for determining the waiting state for response, such as "please press”, “please dial”, “please input”, "please speak” and so on. Finally, you can also set keywords to determine the state of being unable to connect, such as “empty number”, “temporarily unavailable”, “arrears", “no longer service area” and so on.
- the keyword of this category is based on the custom keyword, and no longer refers to the corresponding relationship in the call state identification database. For example, refer to the keyword for entering call waiting in FIG. 28 . If there is a corresponding relationship of "call waiting state-waiting" in the call state identification database, but there is no "waiting" in the customized keyword, the call state will not be determined when the audio feature of "waiting" appears. Waiting state for the call.
- the keyword of this category is subject to the corresponding relationship in the call state identification database. For example, if a user-defined keyword is not input in the waiting response, the corresponding relationship pre-stored in the database is identified according to the calling state during the call, and the waiting response state is determined.
- the interface shown in FIG. 29 may be displayed.
- the trigger words that are automatically input after triggering the automatic button such as "mobile phone number”, "ID card”, etc.
- the call number is an automatic key-pressing number
- a sentence containing an automatic key-pressing trigger word is identified during the call
- the key indicated in the sentence where the trigger word is located is automatically dialed.
- the automatic key trigger word "check call charge” when it recognizes "please press 1 to check call charge”, "1" will be dialed automatically.
- the automatic key trigger word "transfer to manual” is set, it will automatically dial "0" when it recognizes "transfer to manual, please press 0".
- the required content may also be input automatically.
- trigger word 1 is set as "mobile phone number”
- the corresponding input content 1 is "number 8”.
- trigger word 2 is set as "ID card”
- the corresponding input content 2 is "ID card number 1”.
- the touch screen when receiving a user's key operation, it is first determined that the touch screen receives the key corresponding to the area where the click operation is received, and then the key information corresponding to the number or character of the key is generated and sent to the processor, wherein the key information is used to indicate the corresponding key. Press the corresponding numbers or characters to perform key operations.
- the processor dials according to the numbers or characters corresponding to the received key information, or sends the numbers or characters corresponding to the received key information to the number being called.
- the user's keystrokes can be simulated by the calling device.
- the keys involved in automatic dialing are numbers 0-9 and symbols "*" and "#”
- the key information corresponding to each number and symbol can be pre-stored.
- the corresponding pre-stored key information is sent to the processor in turn according to the numbers or symbols to be dialed.
- the processor sends the numbers or characters corresponding to the received key information to the number being called.
- the preference of "Check Call Charge” is enabled and the dialed number is "Number 7".
- the automatic key press is enabled. On the screen, it prompts “Automatic keystrokes are being checked”, and at the same time, a prompt message of "stop automatic keystrokes” is displayed. If the user's operation is not received, the key response is performed according to the set automatic key parameters. If a click operation acting on "stop the automatic key press” is received, the automatic key press is terminated, and the user is waiting for a response operation (such as a click operation, input voice, etc.).
- the interface shown in FIG. 31 may appear after receiving a click operation acting on "Auto Redial", the interface shown in FIG. 31 may appear.
- the call prompt mode can also be manually turned off.
- the call prompt mode can also be manually turned off.
- the shortcut shown in FIG. 7 can be displayed. setting menu.
- the original "open call prompt” has become “disable call prompt” if you receive a click operation to close the call prompt, you can disable the call prompt (that is, set the mobile phone to not use the call prompt mode).
- the call prompt when the call prompt is enabled, if it is identified that the call device satisfies the termination condition of the call prompt mode, the call prompt is terminated.
- the termination condition of the call prompt mode includes: receiving a call prompt termination instruction during a call or recognizing that the user starts listening to the call audio during a call.
- the call prompt termination instruction may be an option button displayed on the call interface, or a preset operation, such as double-clicking the volume down key, sliding a finger on the touch screen to a preset track, etc., which is not limited here.
- S701-S703 are an implementation manner of S31 in FIG. 3 .
- the first audio feature can be identified by first performing voice activity detection (Voice Activity Detection, VAD) on the audio data of the received call audio, and cutting out the silent segment in the audio data, so as to determine whether the audio data exists in the audio data.
- VAD Voice Activity Detection
- the boundary of the speech part is divided into frames, and the audio data in the boundary is divided into multiple frames, and each frame corresponds to a segment of waveform.
- MFCC Mel-scale Frequency Cepstral Coefficients
- a 12-row, N-column matrix (called an observation sequence) can be obtained, which can represent the audio data in the above boundary.
- an observation sequence the state corresponding to each frame in the observation sequence is determined, wherein three states can constitute one phoneme, and the pronunciation of the word is constituted by multiple phonemes.
- the Hidden Markov Model is used to match the corresponding shape of each frame in the observation sequence to determine the recognized text. If there is a keyword that can determine the call state in the recognized text, the keyword is used as the first audio feature.
- the call audio may be music, telephone signal tones, or the like.
- the waiting music is played when the person is transferred, the color ringtone, the connection tone, and the busy tone are played when waiting for the other party to answer.
- audio data may be matched to audio in a preset sound database.
- the acoustic features of the audio data are extracted from the frequency domain through the Short-Time Fourier Transform (STFT).
- STFT Short-Time Fourier Transform
- feature matching is performed between the acoustic feature and the acoustic feature in the preset sound database, and the music type corresponding to the audio data is determined. For example, if the above-mentioned waiting music, CRBT, and connecting tone are matched, it is determined that the music type is waiting to be answered. If a busy tone is matched, it is determined that the music type cannot be connected, etc. Finally, the obtained music type is used as the first audio feature.
- STFT Short-Time Fourier Transform
- S705. Determine the call state according to the first audio feature. If the call state is the waiting state for response, go to S706; if the call state is the call waiting state, go to S708; if the call state is the unreachable state, go to S711; if the call state cannot be determined, go to S712.
- S704-S705 are an implementation manner of S32 in FIG. 3 .
- the call state is a waiting state for a response, and an operation prompt is performed according to the first audio feature or the third audio feature.
- S706 and S707 are an implementation manner of S51 and S52, and the manner of performing the operation prompt and the manner of performing the operation response are the same as those in S51 and S52, and will not be repeated here.
- the call state is a call waiting state, and audio features are identified in the call audio.
- the method of identifying the audio feature is the same as that in S704, and will not be repeated here.
- S710 is an implementation manner of S41 and S42, and the manner in which the answering prompt is performed is the same as that in S41 and S42, which is not repeated here.
- the call state is the unconnectable state
- a notification of unconnectable is performed
- a hang-up operation or a redial operation is performed
- after the prompt the unconnected state is exited and S702 is performed.
- S711 is an implementation manner of S61 and S62, and the manner in which it performs a notification of inability to connect and performs a hang-up operation or a redial operation is the same as that in S61 and S62, and will not be repeated here.
- the user when the first audio feature is not identified in the call audio, if the content of the call audio does not indicate any call state, the user is prompted to answer the call, so as to prevent the user from missing information due to not answering.
- the manner of prompting for answering is the same as that in S41 and S42, and will not be repeated here.
- the call prompting method is performed cyclically to ensure timely provision of call prompts. For example, when the calling device makes a call to a carrier's service. After the call is connected, confirm that the calling device has turned on the call prompt mode, and then recognize the first audio feature after receiving the call audio. For example, it is possible to receive a call voice of "please press 1 for inquiries about call charges, press 2 for business processing, and press 0 for manual transfer", and the first audio feature recognized is "please press", indicating that the call status is waiting for a response. Then, the prompt information of "Inquiry Call Charge", "Business Handling", and “Transfer to Labor” is displayed on the screen. If it receives the click operation acting on "transfer to manual”, it will exit the waiting for response state and dial "0" to the calling party.
- the calling party After receiving "0", the calling party enters the process of transferring to manual. Continue to confirm that the calling device turns on the call prompt mode and recognizes the first audio feature. For example, when transferring to an employee, if a call audio of "The agent is busy, please wait” is received, the first audio feature is "Please wait", and the call state is confirmed to be the call waiting state. When the waiting is over, the artificial agent may receive the call audio of "Hello sir, I have kept you waiting for a long time”. After recognizing the second audio features such as "Mr.” and "Waiting for a long time", it will vibrate and display. Answer the prompt such as the prompt message, and exit the call waiting state, continue to confirm that the calling device has turned on the call prompt mode and identify the first audio feature.
- FIG. 33 shows an embodiment of turning on a call prompt based on detecting whether the user answers the call audio.
- the call prompting method includes:
- the calling device starts a call.
- S802 Identify whether the external calling device of the calling device is enabled to play call audio, if not, perform S803, otherwise continue to identify whether to enable the external calling device to play call audio.
- the earphone interface is connected to an earphone by first detecting whether the earphone interface of the calling device is loaded. If the headphone interface does not detect the load, then obtain the wireless communication device list of the calling device, and determine whether the calling device is connected to an external communication device such as a Bluetooth headset and a Bluetooth speaker. If there is a connected headset or an external call device, you need to read the setting options of the output audio of the call device to confirm whether the call device is set to output audio through the headset or external call device.
- the calling device If it is determined that the calling device is not connected to a headset or an external calling device, or is connected to an external calling device but does not output audio through the headset or external calling device, confirm that the calling device has not enabled the external calling device to play call audio.
- S803 Identify whether the user listens to the call audio through the listening device of the call device, if not, perform S804, otherwise continue to identify whether to enable the external call device to play the call audio.
- the listening device includes a speaker and a receiver.
- the setting options of the calling device can be read first. If the setting options show that the audio is played through the speaker, it is confirmed that the user has turned on the speaker, that is, the user has listened to the calling audio through the listening device of the calling device.
- the setting option shows that the audio is played through the receiver or external call device, and it is necessary to detect whether the user puts the call device next to the ear to answer. If it is detected that the user answers the call by putting the calling device next to the ear, it is confirmed that the user answers the call through the listening device of the calling device. On the contrary, if it is not detected, it is confirmed that the user has not answered the call through the listening device of the calling device.
- a proximity light sensor or a distance sensor disposed near the receiver of the communication device detects that the light near the receiver of the communication device is blocked or an obstacle is close to the receiver, it can be confirmed that the user has attached the communication device to the receiver. Listen by your ear.
- a camera such as a front-facing camera
- the brightness of the image collected by a camera is lower than the brightness threshold or an image of skin is recognized in the image, it can also be confirmed that the user puts the calling device next to the ear to answer.
- both sensors and cameras can be used for detection.
- the front-facing camera is enabled to capture images. If the brightness of the collected image is lower than the brightness threshold or the skin can be identified in the image, it can be confirmed that the user puts the calling device next to the ear to answer.
- S802 and S803 are an implementation manner in which the calling device automatically recognizes the enabled call prompting mode, and the setting for prompting is a preset preference.
- the preset preference can be changed in the operating system of the calling device, and the setting method has been described in S702, and will not be repeated here.
- S806. Determine the call state according to the first audio feature. If the call status is waiting for a response, go to S806; if the call status is a call waiting state, go to S808; if the call state is a disconnected state, go to S811; if the call state cannot be determined, go to S812.
- the call state is a waiting state for a response, and an operation prompt is performed according to the first audio feature or the third audio feature.
- S808 Receive the response operation, and respond according to the response operation, exit the waiting for response state after the response, and execute S802.
- the call state is a call waiting state, and audio features are identified in the call audio.
- the method of identifying the audio feature is the same as that in S805, and details are not described here.
- the call state is the state of being unable to be connected, a notification of being unable to be connected is performed, a hang-up operation or a redial operation is performed, and the state of being unable to be connected is exited after the prompt and S802 is performed.
- the call prompt mode is enabled by identifying whether the user listens to the call audio, which can provide more targeted services to the user and improve the user's experience when using the call device.
- FIG. 34 shows an embodiment of turning on a call prompt based on the detected call number.
- the call prompting method includes:
- the call number of the call can be obtained from the call request when the calling device starts the call.
- the calling number can be obtained when receiving the dialing information of the user.
- the calling device is the called party, it can obtain the call number in the call request when receiving the call request.
- S903 Identify whether the call number is a preset open number, if so, execute S904, and if not, directly end the process.
- the preset activation number may be obtained by the calling device from a third-party server, or may be set locally.
- the calling device sends the call number characteristics of the current call to the third-party server, and the third-party server matches according to the characteristics of the call number. If the corresponding number is matched, it confirms that the call number of the current call is the preset open number.
- the calling device can also periodically download the open number database on the third-party server to the local, and then match the call number with the number in the open number database when making a call. If it matches the corresponding number, confirm the call number of the current call. is the default open number.
- multiple numbers may be pre-stored in the local open number database, and if the call number during the call matches one of the pre-stored numbers, it is confirmed that the call number of the current call is the preset open number.
- S902 and S903 are an implementation manner in which the calling device automatically recognizes the enabled call prompting mode, and the setting for prompting is a preset preference.
- the preset preference can be changed in the operating system of the calling device, and the setting method has been described in S702, and will not be repeated here.
- the call state is a waiting state for a response, and an operation prompt is performed according to the first audio feature or the third audio feature.
- the call state is a call waiting state, and audio features are identified in the call audio.
- the method of identifying the audio feature is the same as that in S905, and will not be repeated here.
- the call state is the unconnectable state, a notification of unconnectable is performed, and a hang-up operation or a redial operation is performed, and after the prompt, the unconnected state is exited and S905 is performed.
- the call reminder mode is enabled by identifying the call number, so that a call reminder can be performed for a number that has a high probability of requiring a call reminder, which can improve the user's experience when using the call device.
- FIG. 35 shows a structural block diagram of the call prompting apparatus provided by the embodiment of the present application. For convenience of description, only the part related to the embodiment of the present application is shown.
- the device includes:
- the enabling module 1001 is used to enable the call prompt mode.
- the identification module 1002 is configured to identify the first audio feature of the received call audio.
- the determining module 1003 is configured to determine the call state according to the first audio feature.
- the prompt module 1004 is configured to perform a call prompt according to the call prompt mode corresponding to the call state.
- the enabling module 1001 is specifically configured to enable the call prompt mode if a preset operation input by the user is received. Or, if the automatic activation condition is satisfied, the call prompt mode is activated.
- the enabling module 1001 is specifically configured to receive a touch operation acting on a virtual key having a function of enabling the call prompt mode. Or, a key operation acting on a preset physical key is received. Or, a preset operation gesture is received.
- turning on the module 1001 is specifically configured to confirm that the user does not listen to the call audio.
- the call number of the identified call is the preset open number.
- the enabling module 1001 is specifically configured to confirm that the external call device is not enabled to play the call audio, and recognize that the user does not listen to the call audio through the listening device of the electronic device.
- the listening device includes a receiver and a speaker.
- the enabling module is specifically configured to determine that the user does not listen to the call audio through the receiver, and determine that the user does not listen to the call audio through the speaker.
- the enabling module 1001 is specifically configured to obtain the distance between the receiver and the face of the user, and if the distance is greater than a preset threshold, it is determined that the user does not listen to the call audio through the receiver.
- the enabling module 1001 is specifically configured to read the audio playback setting information of the electronic device. If in the audio playback setting information, the call audio is not played through the speaker, it is determined that the user does not listen to the call audio through the speaker.
- the device further includes a reading module 1005 for reading preset information about the setting of the call prompt mode.
- the setting information includes keyword information.
- the identification module 1002 is specifically configured to identify the first audio feature of the received call audio according to the keyword information contained in the setting information.
- the setting information described with reference to FIG. 37 includes preset operation information.
- the apparatus further includes an execution module 1006, configured to execute a preset operation according to the preset operation information.
- the call state is a call waiting state.
- the prompting module 1004 is specifically configured to perform an answer prompt if the second audio feature indicating the end of the call waiting state is identified in the call audio, and the answer prompt is used to instruct the user to answer the call.
- the identifying module 1002 is further configured to, after determining that the call state is the call waiting state, if a third audio feature indicating the waiting response state is identified in the call audio, determine that the call state is switched from the call waiting state to the waiting state. response status.
- the prompting module 1004 is specifically configured to perform an operation prompt according to the third audio feature, and the operation prompt is used to prompt the user to respond to the call.
- the call state is a waiting-for-response state.
- the prompting module 1004 is specifically configured to perform operation prompting according to the first audio feature.
- the operation prompt is used to prompt the user to respond to the call.
- the device further includes a response module 1007 for receiving a response operation from the user. Perform the action indicated by the response action.
- the call state is an unavailable state.
- the prompting module 1004 is specifically used for prompting that the connection cannot be made, and performing a hang-up operation or a redial operation.
- the identification module 1004 is specifically configured to terminate the call prompt if it is identified that the call device meets the termination condition of the call prompt mode.
- the identifying module 1004 is specifically configured to identify a prompting termination instruction during a call during a call. Alternatively, it is recognized during the call that the user starts listening to the call audio.
- the identification module 1004 is specifically configured to terminate the call prompt mode if it is recognized that the call device enables an external call device to play call audio, or if it is recognized that the user listens to the call audio through a listening device of the call device.
- An embodiment of the present application also provides a network device, the network device includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, the processor executing The computer program implements the steps in any of the foregoing method embodiments.
- FIG. 39 is a schematic structural diagram of a communication device provided by an embodiment of the present application.
- the communication device 1100 of this embodiment includes: at least one processor 1101 (only one is shown in FIG. 39 ), a memory 1102 , a communication module 1104 , and a communication module 1104 that is stored in the memory 1102 and can be processed in at least one
- the communication device 1100 may be a computing device such as a desktop computer, a notebook computer, a palmtop computer, and a cloud server.
- the calling device may include, but is not limited to, a processor 1101 , a memory 1102 , and a calling module 1104 .
- FIG. 39 is only an example of the communication device 1100, and does not constitute a limitation to the communication device 1100, and may include more or less components than the one shown, or combine some components, or different components , for example, may also include input and output devices, network access devices, and the like.
- the processor 1101 can be a central processing unit (Central Processing Unit, CPU), and the processor 1101 can also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC) ), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
- a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
- the memory 1102 may in some embodiments be an internal storage unit of the telephony device 110 , such as a hard disk or memory of the telephony device 1100 .
- the memory 1102 may also be an external storage device of the calling device 1100 in other embodiments, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) equipped on the calling device 1100 card, Flash Card, etc.
- the memory 1102 may also include both an internal storage unit of the communication device 1100 and an external storage device.
- the memory 1102 is used to store an operating system, an application program, a boot loader (Boot Loader), data, and other programs, such as program codes of computer programs, and the like.
- the memory 1102 may also be used to temporarily store data that has been or will be output.
- the call module 1104 may include a communication module that supports communication standards or protocols such as GSM, CDMA, WCDMA, LTE, TD-WCDMA, TD-LTE, and 5G NR, a slot for accessing a SIM card, and components such as an antenna, which are used for Communicate with other calling devices.
- communication standards or protocols such as GSM, CDMA, WCDMA, LTE, TD-WCDMA, TD-LTE, and 5G NR
- a slot for accessing a SIM card such as an antenna, which are used for Communicate with other calling devices.
- Embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the foregoing method embodiments can be implemented.
- the embodiments of the present application provide a computer program product, when the computer program product runs on a call device, the steps in the above method embodiments can be implemented when the call device executes.
- An embodiment of the present application provides a chip system, where the chip system includes a memory and a processor, and the processor executes a computer program stored in the memory to implement the steps in the foregoing method embodiments.
- An embodiment of the present application provides a chip system, the chip system includes a processor, the processor is coupled to the computer-readable storage medium provided in the fourth aspect, and the processor executes a computer program stored in the computer-readable storage medium to implement the above Steps in Method Examples.
- the integrated unit if implemented as a software functional unit and sold or used as a stand-alone product, may be stored in a computer-readable storage medium.
- all or part of the processes in the methods of the above embodiments can be implemented by a computer program to instruct the relevant hardware.
- the computer program can be stored in a computer-readable storage medium, and the computer program can be processed When the device is executed, the steps of the foregoing method embodiments may be implemented.
- the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate forms, and the like.
- the computer-readable medium may include at least: any entity or device capable of carrying the computer program code to the communication device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access memory) Memory), electrical carrier signals, telecommunications signals, and software distribution media.
- ROM read-only memory
- RAM random access memory
- electrical carrier signals telecommunications signals
- software distribution media For example, U disk, mobile hard disk, disk or CD, etc.
- computer readable media may not be electrical carrier signals and telecommunications signals.
- the disclosed call prompting method, device and call device may be implemented in other ways.
- the above-described embodiments of the call prompting device and the call device are merely illustrative.
- the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or integrated into another system, or some features may be ignored, or Do not execute.
- the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
- Units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Environmental & Geological Engineering (AREA)
- Telephone Function (AREA)
Abstract
本申请适用于通话领域,提供了一种通话提示方法、通话设备、可读存储介质及芯片系统,该方法包括:开启通话提示模式,识别通话设备接收到的通话音频的第一音频特征。根据第一音频特征确定通话状态。根据通话状态对应的通话提示方式,进行通话提示。由于可以根据不同的通话状态对用户进行提示,用户无需使用外置通话装置,或将通话设备一直贴在耳边接听,也能够及时接收提示信息。从而可以解放双手进行其他工作,操作更加便利自由,有效地提高了用户的通话体验。
Description
本申请要求于2020年06月30日提交国家知识产权局、申请号为202010618105.9、申请名称为“通话提示方法、通话设备、可读存储介质及芯片系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请属于通话领域,尤其涉及一种通话提示方法、通话设备、可读存储介质及芯片系统。
用户在使用通话设备通话时,经常会出现通话等待或者等待用户响应的情况。如,用户拨打运营商的服务电话,转接人工坐席时等待人工坐席接听。或者,用户拨打银行服务电话时,等待用户按键以跳转至不同的功能菜单。当出现通话等待或者等待用户响应的情况时,用户只能将通话设备贴在耳边听取提示信息,以确认通话等待结束或确认应进行响应的动作。
现有技术中,可以通过外置通话装置播放通话音频,如耳机、蓝牙耳机、蓝牙音箱等。使得在出现通话等待或者等待用户响应的情况时,用户可通过外置通话装置收听提示信息。
但是,若用户没有使用外置通话装置,在出现通话等待或者等待用户响应的情况时,依然只能手持通话设备贴在耳边收听提示信息,导致用户操作不便,影响用户进行其他工作。
发明内容
本申请实施例提供了一种通话提示方法、通话设备、可读存储介质及芯片系统,可以改善出现通话等待或者等待用户响应的情况且用户没有使用外置通话装置时,只能手持通话设备贴在耳边收听提示信息,导致用户操作不便,影响用户进行其他工作的问题。
为达到上述目的,本申请采用如下技术方案:
第一方面,本申请实施例提供了一种通话提示方法。通话提示方法的执行主体为电子设备,电子设备可以是具有通话能力的通话设备。示例性的,通话设备包括智能手机、智能电话亭、具有通话能力的平板电脑、可穿戴设备或车载电脑等。
在第一方面中,通话提示方法包括:开启通话提示模式。识别接收到的通话音频的第一音频特征。根据第一音频特征确定通话状态。根据通话状态对应的通话提示方式,进行通话提示。
在一种实施方式中,开启通话提示模式。即表明需要对正在进行的通话进行通话提示。在这个情况下,通话设备可根据接收到通话音频的第一音频特征,确定通话状态。一些实施方式中,通话状态的类型包括:通话等待状态、等待响应状态或无法接 通状态。需要说明的是,如果通话音频中能识别出语音,第一音频特征可以是接收到的通话音频中的关键字,如,“请等待”、“请按”等。若通话音频中识别不到语音,则通话音频可能包含音乐、电话信号音等。此时,第一音频特征可以是识别到的纯音乐或电话信号音的类型,如,接通音、占线音、等待音等。每个通话状态对应了多个第一音频特征,在识别到相应的音频特征后,即可根据音频特征确定当前的通话状态。每种通话状态包括不同的通话提示方式。例如,通话等待状态中,识别到指示等待结束的关键词后,可以通过震动、显示提示信息等方式提醒用户接听。等待响应状态中,可以通过展示包含待响应内容的提示信息,或提供与待响应内容关联的按键,以提示用户进行响应。
通话设备根据不同的通话状态对用户进行提示。用户无需使用外置通话装置,或将通话设备一直贴在耳边接听,也能够及时接收提示信息。从而可以解放双手进行其他工作,操作更加便利自由,有效地提高了用户的通话体验。
一些实施方式中,开启通话提示模式,包括:若接收到用户输入的预设操作,则开启通话提示模式。或,若满足自动开启条件,则开启通话提示模式。
通过自动开启通话提示模式,或者根据接收到用户输入的预设操作开启通话提示模式,可以更加灵活的提供通话提示服务。使得用户在使用通话提示服务时的体验更好。
一些实施方式中,接收到用户输入的预设操作,包括:接收到作用于具有开启通话提示模式功能的虚拟按键的触摸操作。或,接收到作用于预设物理按键的按键操作。或,接收到预设的操作手势。
其中,开启通话提示模式功能的虚拟按键可以是电子设备触摸屏上显示的图形界面中的虚拟按键。或者,也可以是在电子设备上的感应区域。例如,在电子设备某一区域添加触摸传感器,在触摸传感器感应到触摸后,开启通话提示模式。而作用于预设物理按键的按键操作,则可以包括如双击“音量-”键、同时按下“音量+”和“音量-”等。预设的操作手势则可以是在电子设备触摸屏上画出的图形、字符、特殊的操作手势等,例如,在触摸屏上写出“Z”或者“S”,或者用指关节敲击3下触摸屏等。
一些实施方式中,满足自动开启条件,包括:确认用户未收听通话音频。或,识别到通话的通话号码为预设开启号码。
用户未收听通话音频或通话号码为预设开启号码的情况下,具有较大概率需要用到通话提示功能。因此,在检测到用户未收听通话音频或通话号码为预设开启号码时,自动开启通话提醒模式,可以更好的为用户提供通话提醒服务,提高用户的使用体验。
一些实施方式中,确认用户未收听通话音频,包括:确认未启用外部通话装置播放通话音频,且识别到用户未通过电子设备的听音设备收听通话音频。
其中,外部通话装置可以是有线耳机、无线耳机、智能屏幕、智能音箱等设备。确认未启用外部通话装置播放通话音频,包括确认电子设备未与任何一个外部通话装置连接。或者,电子设备与外部通话装置连接,但并未通过连接的外部通话装置播放通话音频。
一些实施方式中,听音设备包括受话器和扬声器。
识别到用户未通过电子设备的听音设备收听通话音频,包括:确定用户未通过受 话器收听通话音频,且确定用户未通过扬声器收听通话音频。
一些实施方式中,确定用户未通过受话器收听通话音频,包括:获取受话器与用户人脸之间的距离,若距离大于预设阈值,则确定用户未通过受话器收听通话音频。
其中,可以通过设置在受话器附近的传感器来获取受话器与用户人脸之间的距离。例如,可以通过距离传感器获取距离。或者,通过光线传感器获取亮度,若获取到的亮度大于预设亮度值,则可以确定受话器与用户人脸之间的距离大于预设阈值。再或者,还可以通过前置摄像头获取图像,若图像中人脸图形的比例小于预设比例值,则可以确定受话器与用户人脸之间的距离大于预设阈值。
一些实施方式中,确定用户未通过扬声器收听通话音频,包括:读取电子设备的音频播放设置信息。若音频播放设置信息中,通话音频未通过扬声器播放,则确定用户未通过扬声器收听通话音频。
一些实施方式中,在开启通话提示模式之后,还包括:读取预先设置的通话提示模式的设置信息。
一些实施方式中,设置信息包括关键词信息。识别接收到的通话音频的第一音频特征,包括:根据设置信息中包含的关键词信息,识别接收到的通话音频的第一音频特征。
一些实施方式中,设置信息包括预设的操作信息。在开启通话提示模式之后,还包括:根据预设的操作信息,执行预设操作。
其中,预设操作可以是自动拨号、自动重拨等。
一种可能的实施方式中,通话状态为通话等待状态。则根据通话状态对应的通话提示方式,进行通话提示,包括:若在通话音频中识别到指示通话等待状态结束的第二音频特征,则进行接听提示,接听提示用于指示用户接听通话。
一些实施方式中,若确定第一音频特征中包含了通话等待的音频特征时,则可以确认通话状态为通话等待状态。例如,指示通话等待的音频特征可以包括“排队”、“稍等”、“稍后”、“不要挂机”等指示通话等待的关键词。
在通话等待状态中,若识别到通话音频中包括第二音频特征,如“喂”、“你好”、“先生”、“女士”等指示通话等待状态结束的关键词,则提示用户接听通话。使得用户无需将通话设备一直贴在耳边接听,也可以在通话等待结束后及时接听通话,提高用户的通话体验。
一些实施方式中,在确定通话状态为通话等待状态之后,若在通话音频中识别到指示等待响应状态的第三音频特征,则确定通话状态从通话等待状态切换为等待响应状态。
相应的,根据通话状态对应的通话提示方式,进行通话提示,包括:根据第三音频特征,进行操作提示,操作提示用于提示用户进行通话响应。
其中,第三音频特征可以是“请按”、“请拨”、“请说”等指示用户进行响应的关键词。在通话等待状态中,通过识别第三音频特征确定通话状态为等待响应状态,使得通话设备可以在通话等待和等待响应状态之间灵活切换,应用更灵活,适用范围更广,通话提示的效果也更人性化。
一些实施方式中,通话状态为等待响应状态。
根据通话状态对应的通话提示方式,进行通话提示,包括:根据第一音频特征,进行操作提示。操作提示用于提示用户进行通话响应。
在等待响应状态时,根据获取的第一音频特征或第三音频特征提示用户进行响应。使得用户无需将通话设备一直贴在耳边接听,也可以确定需要进行响应的内容,并进行响应,可以解放用户的双手,使操作更加简便。
一些实施方式中,在进行操作提示之后,还包括:接收用户的响应操作。执行响应操作所指示的操作。
例如,操作提示指示用户进行按键,在接收到用户的响应(即按键操作)后,执行该案件对应的操作。
一些实施方式中,通话状态为无法接通状态。
根据通话状态对应的通话提示方式,进行通话提示,包括:进行无法接通提示,并执行挂断操作或重拨操作。
一些实施方式中,当第一音频特征中包含无法接通的音频特征时,可确定通话状态为无法接通状态。其中,无法接通的音频特征包括“无法接通”、“空号”、“请稍后再拨”指示无法接通的关键词。
一种可能的实现方式中,可以先确认是否存在预设的重拨操作,若存在,则执行重拨操作。若不存在,则执行挂断操作。
需要说明的是,在执行重播操作时,可根据无法接通的音频特征选择相应的重拨方式。例如,当无法接通的音频特征为“无法接通”或“请稍后再拨”时,可以持续重拨,直至停止。当无法接通的音频特征为“空号”时,在重拨3次后,若仍为出现“空号”的无法接通的音频特征,则可以停止重拨,并提示用户拨打的号码为空号。
在进通话状态为无法接通状态时,表明被叫通话设备暂时无法接通,此时可以进行无法接通提示。例如,通过语音、震动、展示提醒文字等方式提醒用户无法接通。执行挂断操作或重拨操作,以减少用户的操作次数,进一步提高操作的便利性。
一些实施方式中,在通话设备根据音频特征,进入对应的通话状态之后,还包括:若识别到通话设备满足通话提示模式的终止条件,则中止通话提示。
一些实施方式中,识别到通话设备满足通话提示模式的终止条件,包括:在通话时识别到通话中提示终止指令。或者,在通话时识别到用户开始收听通话音频。
一些实施方式中,终止通话提示模式,包括:若识别到通话设备启用外置通话装置播放通话音频,或者,识别到用户通过通话设备的听音设备收听通话音频,则终止通话提示模式。
第二方面,本申请实施例提供了一种通话提示装置,应用于电子设备,该装置包括:
开启模块,用于开启通话提示模式。识别模块,用于识别接收到的通话音频的第一音频特征。确定模块,用于根据第一音频特征确定通话状态。提示模块,用于根据通话状态对应的通话提示方式,进行通话提示。
一些实施方式中,开启模块,具体用于若接收到用户输入的预设操作,则开启通话提示模式。或,若满足自动开启条件,则开启通话提示模式。
一些实施方式中,开启模块,具体用于接收到作用于具有开启通话提示模式功能 的虚拟按键的触摸操作。或,接收到作用于预设物理按键的按键操作。或,接收到预设的操作手势。
一些实施方式中,开启模块,具体用于确认用户未收听通话音频。或,识别到通话的通话号码为预设开启号码。
一些实施方式中,开启模块,具体用于确认未启用外部通话装置播放通话音频,且识别到用户未通过电子设备的听音设备收听通话音频。
一些实施方式中,听音设备包括受话器和扬声器。开启模块,具体用于确定用户未通过受话器收听通话音频,且确定用户未通过扬声器收听通话音频。
一些实施方式中,开启模块,具体用于获取受话器与用户人脸之间的距离,若距离大于预设阈值,则确定用户未通过受话器收听通话音频。
一些实施方式中,开启模块,具体用于读取电子设备的音频播放设置信息。若音频播放设置信息中,通话音频未通过扬声器播放,则确定用户未通过扬声器收听通话音频。
一些实施方式中,该装置还包括读取模块,用于读取预先设置的通话提示模式的设置信息。
一些实施方式中,设置信息包括关键词信息。识别模块,具体用于根据设置信息中包含的关键词信息,识别接收到的通话音频的第一音频特征。
一些实施方式中,设置信息包括预设的操作信息。则该装置还包括执行模块,用于根据预设的操作信息,执行预设操作。
一种可能的实施方式中,通话状态为通话等待状态。提示模块,具体用于若在通话音频中识别到指示通话等待状态结束的第二音频特征,则进行接听提示,接听提示用于指示用户接听通话。
一些实施方式中,若确定第一音频特征中包含了通话等待的音频特征时,则可以确认通话状态为通话等待状态。
一些实施方式中,识别模块,还用于在确定通话状态为通话等待状态之后,若在通话音频中识别到指示等待响应状态的第三音频特征,则确定通话状态从通话等待状态切换为等待响应状态。
相应的,提示模块,具体用于根据第三音频特征,进行操作提示,操作提示用于提示用户进行通话响应。
一些实施方式中,通话状态为等待响应状态。
提示模块,具体用于根据第一音频特征,进行操作提示。操作提示用于提示用户进行通话响应。
一些实施方式中,该装置还包括响应模块,用于接收用户的响应操作。执行响应操作所指示的操作。
一些实施方式中,通话状态为无法接通状态。
提示模块,具体用于进行无法接通提示,并执行挂断操作或重拨操作。
一些实施方式中,识别模块,具体用于若识别到通话设备满足通话提示模式的终止条件,则中止通话提示。
一些实施方式中,识别模块,具体用于在通话时识别到通话中提示终止指令。或 者,在通话时识别到用户开始收听通话音频。
一些实施方式中,识别模块,具体用于若识别到通话设备启用外置通话装置播放通话音频,或者,识别到用户通过通话设备的听音设备收听通话音频,则终止通话提示模式。
第三方面,本申请实施例提供了一种通话设备,包括存储器、处理器以及存储在存储器中并可在处理器上运行的计算机程序,处理器执行计算机程序时实现第一方面提供的方法。
第四方面,本申请实施例提供了一种计算机可读存储介质,计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现第一方面提供的方法。
第五方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在终端设备上运行时,使得终端设备执行第一方面提供的方法。
第六方面,本申请实施例提供了一种芯片系统,芯片系统包括存储器和处理器,处理器执行存储器中存储的计算机程序,以实现第一方面提供的方法。
第七方面,本申请实施例提供了一种芯片系统,芯片系统包括处理器,处理器与第四方面提供的计算机可读存储介质耦合,处理器执行计算机可读存储介质中存储的计算机程序,以实现第一方面提供的方法。
可以理解的是,上述第二方面至第七方面的有益效果可以参见上述第一方面中的相关描述,在此不再赘述。
图1为本申请实施例提供的通话设备的系统模块图;
图2为本申请实施例提供的通话提示方法的应用场景图;
图3为本申请一实施例提供的通话提示方法的流程示意图;
图4为本申请另一实施例提供的通话提示方法的流程示意图;
图5为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图6为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图7为本申请另一实施例提供的通话提示方法的流程示意图;
图8为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图9为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图10为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图11为本申请另一实施例提供的通话提示方法的流程示意图;
图12为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图13为本申请另一实施例提供的通话提示方法的流程示意图;
图14为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图15为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图16为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图17为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图18为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图19为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图20为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图21为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图22为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图23为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图24为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图25为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图26为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图27为本申请另一实施例提供的通话提示方法应用时的界面示意图;
图28为本申请另一实施例提供的通话提示方法的流程示意图;
图29为本申请另一实施例提供的通话提示方法的流程示意图;
图30为本申请另一实施例提供的通话提示方法的流程示意图;
图31为本申请另一实施例提供的通话提示方法的流程示意图;
图32为本申请另一实施例提供的通话提示方法的流程示意图;
图33为本申请另一实施例提供的通话提示方法的流程示意图;
图34为本申请另一实施例提供的通话提示方法的流程示意图;
图35为本申请一实施例提供的通话提示装置的结构示意图;
图36为本申请另一实施例提供的通话提示装置的结构示意图
图37为本申请另一实施例提供的通话提示装置的结构示意图
图38为本申请另一实施例提供的通话提示装置的结构示意图
图39为本申请实施例提供的一种通话设备的结构示意图。
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本申请实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。
应当理解,当在本申请说明书和所附权利要求书中使用时,术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在,但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。
还应当理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。
如在本申请说明书和所附权利要求书中所使用的那样,术语“若”可以依据上下文被解释为“当...时”或“一旦”或“响应于确定”或“响应于检测到”。类似地,短语“若确定”或“若识别到”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦识别到”或“响应于识别到”。
另外,在本申请说明书和所附权利要求书的描述中,术语“第一”、“第二”、“第三”等仅用于区分描述,而不能理解为指示或暗示相对重要性。
在本申请说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而 是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。
本申请实施例提供的通话提示方法可以应用于手机、具有通话功能的平板电脑、可穿戴设备、车载设备、个人数字助理(personal digital assistant,PDA)、安装有网络语音传输(Voice over Internet Protocol,VoIP)电话的台式电脑或笔记本电脑等通话设备上。例如,智能手机、智能座机、智能电话亭、具有嵌入式用户识别卡(embedded Subscriber Identity Module,eSIM)的智能手表、具有通话功能的车载电脑等。本申请实施例对通话设备的具体类型不作任何限制。
图1示出了一种可应用本申请提供的通话提示方法的通话设备的结构图。
参考图1,该通话设备包括:处理器110、震动马达111、输入模块112、音频模块120、屏幕130、摄像模块140、存储模块150、接口160、电源模块170、传感器模块180、通信模块190等部件。本领域技术人员可以理解,图1中示出的通话设备结构并不构成对通话设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面结合图1对通话设备的各个构成部件及模块进行具体的介绍:
处理器110是通话设备的控制中心,可以利用各种接口和线路连接通话设备的各个部分,通过运行或执行存储在存储模块150内的软件程序和/或模块,以及调用存储在存储模块150内的数据,执行通话设备的各种功能和处理数据,从而对通话进行提醒。
一些实施方式中,处理器110可包括一个或多个处理单元。例如,可以是中央处理单元(Central Processing Unit,CPU),或者还可以是通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。
还有一些实施方式中,处理器110可集成应用处理器和调制解调处理器。其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器110中,本申请对此不作限制。
震动马达111可在接收到信号时发生震动,以震动的形式进行提醒。
输入模块112可用于接收输入的信息和按键信号,输入的信息包括数字或字符信息、触控信息等,按键信号包括物理按键的按压信号、虚拟按键的按压信号等。
一种实施方式中,输入模块112可包括触控面板以及其他输入设备。触控面板与屏幕130可组成触摸屏,触控面板可收集用户在其上或附近的触摸操作(如用户使用手指、触控笔等能够在触控面板上产生触摸信号的物体或附件在触控面板上或在触摸屏附近的操作),并根据预先设定的程式驱动执行相应的功能。可选的,触控面板可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器。触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器110,处理器180接收发来触点坐标,将其转换为触控指令并加以执行。可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板。其他输入设备可以包括但不限于物理键盘、功能 键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆中的一种或多种。
音频模块120,与听音设备和收音设备连接,用于处理音频信号。其中,听音设备包括扬声器121和受话器122,收音设备包括麦克风123。例如,音频模块120可以将麦克风123接收到的模拟音频信号转换为数字音频数据并发送给处理器110。或者,将处理器110发送的数字音频数据转换为扬声器121和受话器122能够播放的模拟信号并发送给扬声器121或受话器122,以播放音频。
屏幕130用于通过视觉输出,展示通话设备输出的内容。例如,可以显示用户输入的信息、展示提供给用户的信息、显示通话设备的系统界面、以及在通话设备上运行的应用程序的界面等。屏幕130显示面板的材质可以为液晶显示器(Liquid Crystal Display,LCD)、薄膜晶体管(Thin Film Transistor,TFT)、发光半导体(Light-Emitting Diode,LED)、有机发光半导体(Organic Light-Emitting Diode,OLED)等,在此不做限制。
一些实施方式中,触控面板可覆盖在屏幕的显示面板上,当触控面板检测到在其上或附近的触摸操作后,传送给处理器110以确定触摸事件的类型,随后处理器110根据触摸事件的类型在显示面板上提供相应的视觉输出。虽然在图1中屏幕和触控面板(未示出)为互相独立的两个部件来实现手机的输入和输入功能,但是在一些实施方式中,可以将触控面板与显示面板集成而实现手机的输入和输出功能。其中,当触控面板与屏幕集成后,可以作为触摸屏使用,触摸屏可以接收触控面板上的触控信号,并反馈给处理器110。处理器110根据触控信号进行响应,并将响应后的结果通过屏幕的显示面板进行展示。
摄像模块140包括至少1个摄像头,摄像头可以是前置摄像头141或者后置摄像头142。
仅为作为示例,通话设备可以为单摄像头、双摄像头、三摄像头或四摄像头。例如,为四摄像头时,一个摄像头为前置摄像头141,三个为后置摄像头142。三个后置摄像头142可以为不同焦距的摄像头。如一个等效焦距35mm的主摄像头、一个等效焦距20mm的广角摄像头和一个等效焦距105mm的长焦摄像头。本申请实施例对此不作限定。
需要说明的是,当通话设备包括多个摄像头时,这多个摄像头可以全部前置,或者全部后置,或者一部分前置、另一部分后置,本申请实施例对此不作限定。
其中,存储模块150中包括内部存储器151和外部存储器接口152,内部存储器151可以是闪存、硬盘、运算内存等。例如,内部存储器可以包括至少一个硬盘或闪存,一个运算内存。外部存储器接口152用于连接外部存储器,外部存储器可以包括内存卡、移动硬盘、U盘、光碟等。
存储模块150可用于存储软件程序以及模块,处理器110通过运行存储在存储模块150的软件程序以及模块,从而执行通话设备的各种功能应用以及数据处理。存储模块150可主要包括存储程序区和存储数据区。其中,存储程序区通常位于内部存储器151上,可存储操作系统、至少一个功能所需的应用程序(如声音播放功能、触摸响应功能)。存储数据区可以位于内部存储器151上,或者位于与外部存储器接口152连接的外部存储器上,或者同时位于内部存储器和外部存储器上。存储数据区可存储 根据手机的使用所创建的数据(如音频数据、图像数据、视频数据)。
接口160包括但不限于用户识别(Subscriber Identity Module,SIM)卡接口161、USB接口162、耳机接口163。SIM卡接口用于插入运营商提供的SIM卡,以使得通话设备通过移动通信模块191与基站通信连接时,识别验证用户身份,并在通过验证后,向基站发送通话请求、数据请求以及接收基站转发的通话、数据、短信等。
USB接口162可以通过USB数据线将通话设备与电脑连接,进行数据交换。同时,USB接口162还与电源模块170连接,USB数据线在接入电脑或充电插口时,可以将输入电能传输给电源模块170,对通话设备进行充电。其中,USB接口162可以为micro-USB、mini-USB、USB Type-c等,在此不做限制。
耳机接口163用于接入耳机。耳机接口163可以为独立的接口,例如,耳机接口163可以为3.5mm耳机插孔。或者,耳机接口163还可以集成于USB接口162中,例如,耳机接口可以集成在USB Type-c中。当耳机接口163中插入了耳机时,音频模块120可以不再将输出的模拟音频信号发送给扬声器121或受话器122,而是通过耳机接口163发送给耳机,通过耳机播放音频。在插入耳机时,若检测到耳机不包括麦克风,此时音频模块依然接收麦克风123发送的模拟音频信号。若检测到耳机包括麦克风,则音频模块接收耳机麦克风发送的模拟音频信号,对其进行处理并发送给处理器110。
通话设备还包括给各个部件供电的电源模块170。电源模块可以包括电池、电源管理模块等。电源管理模块可以与处理器110逻辑相连,从而通过电源管理模块实现管理电池的充电、放电、以及功耗管理等功能。
通话设备还可包括传感器模块180。传感器模块包括至少一种传感器,比如包括压力传感器181、陀螺仪传感器182、距离传感器183、接近光传感器184、触摸传感器185或加速度传感器186等。其中,接近光传感器184可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板141的亮度,接近传感器可在手机移动到耳边时,关闭屏幕130的显示面板和/或背光。作为运动传感器的一种,加速度传感器186可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别通话设备的姿态(如拿起或放下通话设备,横置或竖置通话设备等)。还可用于通过震动识别相关动作(比如计步、敲击)等。通话设备的其他传感器,在此不作赘述。
通信模块190包括移动通信模块191和无线通信模块192。移动通信模块191可以支持任一通信标准或协议,包括但不限于全球移动通讯系统(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE)、时分复用WCDMA(Time-Division WCDMA,TD-WCDMA)、时分复用LTE(Time-Division LTE,TD-LTE)、第五代新无线(the 5th generation New Radio,5G NR)等。而无线通信模块192则可以支持蓝牙(Bluetooth)、无线保真(Wireless Fidelity,Wi-Fi)、近场通信(Near Field Communication,NFC)等。
移动通信模块191可以用于通过天线与通信基站连接,以建立通话设备与其他通 话设备之间通话链路,接收通话音频。无线通信模块192用于与外置通话装置无线连接,其中,外置通话装置可以是蓝牙耳机、蓝牙音响等具有放音、收音功能的外置装置。当外置通话装置通过无线通信模块192与通话设备连接时,可通过外置通话装置播放音频,并接收外置通话装置采集到的模拟音频信号,对其进行处理并发送给处理器110。
在通话过程中,移动通信模块191将接收到的通话音频数据发送给处理器110处理,处理器110可以通过运行存储模块150中的存储的软件程序,实现本申请提供的通话提示方法。
图2示出了一种通话提示方法的应用场景示意图。在该场景中,通话设备以智能手机为例进行说明。
参考图2,在该场景中,包括基站21、智能手机22、智能手表23。智能手机22的结构可参考图1中通话设备的结构,智能手机22通过移动通信模块与基站21通信连接,当智能手机22拨打电话(号码1)时,智能手机22将号码1发送至与其通信连接的基站21,基站21根据号码1建立智能手机22和号码1对应的通话设备之间的通话通道,使得智能手机22能够与号码1对应的通话设备进行通话。智能手机22可以通过蓝牙与智能手表23连接,智能手表23可以接收智能手机22发送的通话提示信息,并展示通话提示。当通话提示需要用户进行响应时,智能手表23还可以用于进行触摸选择,以对通话提示进行响应。
需要说明的是,与智能手机22连接的智能手表23仅为示例,并非必须存在。可以不连接,也可以使用其他设备代替。例如,智能手机22还可以与蓝牙耳机、智能手环、智能音箱或智能显示器等设备连接。
在上述场景中,当智能手机22与耳机、蓝牙耳机、智能音箱等能够作为外置通话装置的设备连接后,若出现通话等待或等待响应的情况,可以通过外置通话装置播放通话音频。使得用户接收提示信息并确认何时等待结束或者如何进行响应。
但是,当没有连接能够作为外置通话装置的设备,而用户又不方便手持通话设备持续接听时,则只能通过将通话设备夹持在面部和肩部之间或者每隔一定时间听一下是否结束等待。将通话设备夹持在面部和肩部之间可能会导致通话设备跌落,造成通话设备损坏,而每隔一定时间接听一下,不仅操作繁琐,还有可能错过接听时机,导致在通话等待结束后无法及时接听。
为此,本申请提供了一种通话提示方法,可在未使用外置通话装置或通话设备的听音设备播放通话音频时,对用户进行通话提示,使其能够及接收到提示信息,及时接听通话,或者进行响应。
图3示出了本申请中一实施例提供的通话提示方法的流程示意图,该方法可以应用于上述通话设备中。
参照图3,该方法包括:
S31、开启通话提示模式。
一些实施方式中,开启通话提示模式时,可以先读取通话提示模式的设置信息,并根据设置信息开启通话提示模式。其中,通话提示模式的设置信息包括通话提示模式是否开启的设置信息、进行通话提示时的偏好信息等。在通话设备建立通话连接时, 可根据读取的通话提示模式的设置信息,确定通话提示模式是否开启,以及开启后通过何种方式进行通话提醒。
通话设备开启通话提示模式,可以在通话设备满足通话提示模式的开启条件时,开启通话提示模式。
满足通话提示模式的开启条件至少有两种情况,在一些实施例中,当通话设备检测到用户输入了预设的操作,开启通话提示模式。换而言之,通话设备会响应于用户的操作,开启通话提示模式。该操作可以是触摸操作,也可以是用户点击实体按钮,还可以是特定的手势或者肢体动作等。在另一些实施例中,用户还可以通过语音开启通话提示模式。示例性的,参考图17,该操作可以是用户点击通话提示按钮1701。又例如,参考图23,该操作可以是用户点击开启通话提醒按钮2301。可以理解的是,本申请实施例对操作的具体实现方式不做限定。
在另一些实施例中,若满足自动开启条件,则通话设备可以自动开启通话提示模式。而满足自动开启条件又包括至少两种情况,一种是确定通话设备满足预设的开启条件,如在通话中检测到用户未收听通话音频。例如,识别到通话设备未启用外置通话装置播放通话音频,且识别到用户未通过通话设备的听音设备收听通话音频。其中,外置通话装置可以是有线耳机、蓝牙耳机。通话设备的听音设备可以是扬声器、受话器等。例如,参考图2的应用场景,其中,智能手机与智能手表连接,同时智能手机未开启免提。这种情况下,若用户未将通话设备贴在耳边接听,通话设备即符合通话提示的开启条件。或者,若检测到通话号码为预设的开启号码时,通话设备即符合通话提示的开启条件。预设的开启号码可以是紧急号码,如110、119或者预设的运营商服务号码等,在此不做限制。
一些实施方式中,识别到通话设备未启用外置通话装置播放通话音频,可以先通过检测耳机接口的负载、获取无线设备列表等方式确认是通话设备是否与外置通话装置连接。若存在外置通话装置,则还需读取通话设备的输出音频的设置选项,以确认是否通过外置通话装置播放通话音频。
识别到用户未通过通话设备的听音设备收听通话音频,则包括识别用户未通过扬声器收听通话音频和用户未通过受话器收听通话音频。其中,识别用户未通过扬声器收听通话音频可以通过读取通话设备的输出音频的设置选项,确认通话设备是否通过扬声器播放通话音频。若通话设备未通过扬声器播放通话音频,则需要继续识别用户未通过受话器收听通话音频。一些实施方式中,可以通过检测受话器是否贴近耳朵来确定用户是否通过受话器收听通话音频。例如,通过设置在受话器附近的传感器检测是否贴近人脸,若贴近,则确认用户通过受话器收听通话音频。
另一种则是通话设备在出厂时默认设置为通话提示模式开启,这个情况下,只要未接收到通话提示模式的关闭指令,则在每次通话时,均保持通话提示模式开启。
S32、识别通话音频的第一音频特征,并根据第一音频特征确定对应的通话状态。
一些实施方式中,第一音频特征用于确认通话状态。通话状态包括通话等待状态、等待响应状态或无法接通状态。其中,通话等待状态表示对方暂时未接听通话或电话虽然已被接通但对方暂时无法应答,需要等待对方接听或应答。例如,在拨打客服电话转人工时,等待人工坐席应答。或者,在拨打电话时等待对方接听。
而等待响应状态指的是等待用户输入响应指令(例如,按键指令、语音指令等)的状态,例如等待用户输入按键信息。例如,当拨打服务电话时,对方的语音应答机器人指示“请您说出您待解决的问题”,此时则需要等待用户输入相关语音指令,如“进行保修”、“查询话费”等语音。或者,在拨打服务电话时,若对方的语音应答机器人指示“查话费请按1、办理业务请按2、转人工请按0”等,则需要等待用户输入的按键指令。
无法接通状态则指的是对方无法接通。例如,对方占线、拨打的电话为空号、话务员忙无法提供人工服务等情况。
每种通话状态均设置有与之对应的多个第一音频特征。例如,通话等待状态对应的第一音频特征可以是“请等待”、“请稍后”、“正在接通中”等。等待响应状态对应的第一音频特征可以是“请按”、“请拨”等。而无法接通状态对应的第一音频特征可以是“无法接通”、“空号”、“停机”等。可以确定第一音频特征对应的通话状态,为当前的通话状态。
通话状态对应的第一音频特征的既可以是用户预设的,也可以是自动获取的。例如,用户可以在设置页面中进行设置,通话等待状态对应歌曲A、“等待”、“稍后”等特征;等待响应状态对应“请按”、“请拨”、“请说”等特征;无法接通状态对应占线音、“无法接通”、“空号”等特征。
一种可能的实施方式中,自动识别第一音频特征对应的通话状态时,可以先预设多个通话状态与第一音频特征的对应关系,并将这些对应关系存入通话状态识别数据库。例如,可以设置“通话等待状态-等待”、“通话等待状态-歌曲B”。“等待”、“歌曲B”即为通话等待的音频特征。还可以设置“等待响应状态-请按”、“等待响应状态-请拨”、“等待响应状态-请说”。“请按”、“请拨”、“请说”即为第三音频特征。然后,还以设置“无法接通状态-无人接听”、“无法接通状态-空号”、“无法接通状态-请稍后再拨”等。“无人接听”、“空号”、“请稍后再拨”即为无法接通的音频特征。最后,将所有对应关系存入通话状态识别数据库。
在通话时,将识别到的第一音频特征与通话状态识别数据库中的对应关系进行匹配,得到确定的通话状态。例如,当识别到关键字为“等待”时,在通话状态识别数据库中匹配到“等待”对应的通话状态为“通话等待状态”,则确定当前通话状态为通话等待状态。
需要说明的是,通话状态识别数据库可以设置在服务器端,也可以设置在通话设备上,或者同时设置在服务器端和通话设备上,在此不做限制。通话状态识别数据库设置在服务器端时,维护人员可以每隔一个预设的时间对通话状态识别数据库进行一次更新,以便更加准确的确定通话状态。当通话状态识别数据库同时设置在服务器端和通话设备上时,可以将通话设备上的通话状态识别数据库与服务器端的进行同步,以实现更新。同步可以手动进行,或者每隔预设之间自动更新,在此亦不做限制。
S33、根据通话状态对应的通话提示方式,进行通话提示。
一些实施方式中,不同的通话状态下,有着不同的提示方式。例如,对于通话等待状态,需要在对方接听或应答后,通过文字或震动等方式提示用户进行接听。而等待响应状态则需要提醒用户进行响应,可以在触摸屏上展示待响应的内容,以便用户 进行响应。对于无法接通状态,则需要提示用户对方无法接通,同时还可以进行挂断或者重拨操作,可以通过与通话等待状态不同的震动方式提醒用户。本申请中每种通话状态的提示方式仅为示例,并不以此为限。
在本实施例中,在通话时,根据识别到的第一音频特征,确认对应的通话状态。根据确认的通话状态,通过不同的方式对用户进行通话提示。用户可以通过通话提示确定是否需要接听通话或进行响应,无需将通话设备一直贴在耳边接听。使得用户可以在通话等待或者等待用户响应的情况且用户没有使用外置通话装置时,解放双手进行其他工作,有效地提高了用户的通话体验。
一种可能实施方式中,图4示出了一种通话提示方法,该方法为图3中的步骤S33的一种实施例。图5、图6示出了通话等待状态时,进行通话提示的示例。
需要说明的是,在以下部分附图中,手机与智能手表连接,使得智能手表可以作为进行通话提示的组件。类似的,当手机与智能手环、智能屏幕等设备连接时,被连接的设备也可作为进行通话提示的组件。本领域技术人员应当明确,通过智能手表、智能手环、智能屏幕等设备进行通话提示,仅为进行通话提示的一种场景,而非限制。本申请中不限制与通话设备连接,以进行提醒的设备的类型。
参考图4,进行通话提示包括:
S41、确定通话状态为通话等待状态。
若根据识别到的第一音频特征确定通话状态为通话等待状态。则可以参考图5,在通话界面上显示“正在等待对方接听”以提示用户目前对方还未接听。同时,当存在与通话设备连接的智能手表时,可在智能手表上显示的提示信息。例如,当存在与通话设备连接的智能手表时,若通话设备上展示了“正在等待对方接听”的提示信息,则可以根据提示信息生成提示指令,并发送给智能手表。智能手表在接收到该提示指令后,根据提示指令在其屏幕上显示“正在等待对方接听”的提示信息。
S42、若在所述通话音频中识别到指示通话等待状态结束的第二音频特征,则进行接听提示。
参考图6,当在通话音频中识别到第二音频特征后,则可以在屏幕上显示“对方可能已经结束等待,请接听”的提示信息。其中,第二音频特征包括如“喂”、“你好”、“先生”、“女士”等可以指示通话等待结束,对方已经接听或应答的关键词。同时,通话设备还可以通过如持续或间歇震动、间歇点亮闪光灯、间歇点亮或熄灭屏幕背光等方式,提醒用户接听。与图22类似,当存在与通话设备连接的智能手表时,可生成上述提示指令并发送给智能手表。与其不同的是,在生成上述提示指令时,可加入指示智能手表震动的指令。智能手表在接收到该指令后,在其屏幕上显示“对方可能已经结束等待,请接听”的提示信息,并持续震动,以提醒用户接听。
图7示出了一种通话提示方法,该方法为图3中的步骤S33的另一种实施例。图8、图9示出了等待响应状态时,进行通话提示的示例。
参考图7,进行通话提示包括:S51、确定通话状态为等待响应状态。
一些实施方式中,确定通话状态为等待响应状态包括两种情况。一种为在通话状态为等待响应状态时,识别到指示等待响应状态的第三音频特征,则确定通话状态为等待响应状态,并根据第三音频特征,进行操作提示。还有一种情况为识别到的第一 音频特征指示等待响应,则确定通话状态为等待响应状态。例如,参考图8,当拨打的号码为运营商服务号码时,在转人工后,可能出现长时间的等待,通话设备进入通话等待状态。当等待持续的时间达到预设时间(如1分钟),可能会出现“话务员忙,继续等待请按1,返回上级请按0”的提示。此时,可以识别到通话音频中包括“请按”的第三音频特征,则将通话等待状态转换为等待响应状态。或者,在接通通话后,可能会出现“查话费请按1”、“转人工请按0”的语音提示。此时,可以识别到通话音频中包括“请按”的第一音频特征,则将通话等待状态转换为等待响应状态。
S52、根据第一音频特征或第三音频特征,进行操作提示。
S51中,通过第一音频特征或第三音频特征确定了等待响应状态。进行操作提示可以在屏幕上显示包括第一音频特征或第三音频特征(即“请按”)的用于指示响应的提示信息,如识别到“话务员忙,继续等待请按1,返回上级请按0”,则可以在屏幕上显示“继续等待”和“返回上级”。同时,通话设备还可以通过如持续或间歇震动、间歇点亮闪光灯等方式,提醒用户进行响应。
若接收到作用于提示信息的点击操作,则根据点击操作作用的提示信息进行响应。例如,可以参考自动拨号时进行按键模拟的示例,当接收到作用于“继续等待”区域的点击操作时,生成“1”的按键信息并发送给处理器;当接收到作用于“返回上级”区域的点击操作时,生成“0”的按键信息并发送给处理器。处理器将接收到的按键信息对应的数字或字符发送给正在通话的号码。如接收到作用于“继续等待”的点击操作,则通话设备向被叫方拨出“1”,并退出等待响应状态。在退出等待响应状态后,若通话音频中可识别到通话等待的音频特征,则通话设备进入通话等待状态。如接收到作用于“返回上级”的点击操作,则通话设备向被叫方拨出“0”。通话设备在退出等待响应状态后,可能识别到其他用于指示通话响应状态的音频特征,如“查话费请按1”、“转人工请按0”等。若识别到,则通话设备再次进入等待响应状态。
一些实施方式中,当存在与通话设备连接的智能手表时,还可通过给智能手表发送提示指令,使得智能手表也能同步展示等待响应的提示信息。当智能手表接收到作用于智能手表上提示信息的点击操作时,智能手表发送对应的按键指令给通话设备,通话设备收到该按键指令后,根据按键指令内包含的按键信息执行按键操作,拨出提示信息所对应的号码。仅作为示例,当存在与通话设备连接的智能手表时,若通话设备的提示信息为“继续等待”和“返回上级”。通话设备根据提示信息以及提示信息对应的按键信息生成提示指令,并发送给智能手表。智能手表在接收到提示指令后,展示提示指令中的提示信息“继续等待”和“返回上级”。当接收到作用于“继续等待”或“返回上级”显示区域的点击操作时,智能手表将点击操作作用区域对应的按键信息发送给通话设备,通话设备根据按键信息向被叫方拨号。例如,参考图24,若接收到作用于“继续等待”的点击操作,则通话设备向被叫方拨出“1”。
另一种可能的实现方式中,参考图9,若接收到的音频为“查询话费请按1,办理业务请按2,紧急停机请按3,人工服务请按0”,则可识别到进行提示的内容为“查询话费”、“办理业务”、“紧急停机”、“人工服务”。与上述的提示方式类似,可以在通话设备上展示等待响应的提示信息,在此不做赘述。
需要说明的是,当存在与通话设备连接的智能手表时,若需要展示的等待响应的 提示信息较多,无法在智能手表的触摸屏上完整、清晰的展示,则可能需要接收用户的滑动操作,以进行翻页。或者仅在智能手表上展示部分提示信息,例如,在智能手表上展示“请在手机上点击按钮”,并震动提示用户进行响应。
一种可能的实施方式中,还可以接收用户输入的语音指令,并根据语音指令进行响应。参考图10,在通话设备展示等待响应的提示信息后,等待用户响应时,可以通过麦克风收集用户输入的语音信息,并识别语音信息中是否存在与等待响应的提示信息匹配的语音指令。若存在,则根据与等待响应的提示信息匹配的语音指令进行响应。例如,当通话设备展示等待响应的提示信息为“查询话费”、“办理业务”、“紧急停机”、“人工服务”,且用户尚未响应时,麦克风接收用户输入的语音信息,若语音信息中识别到了“查询话费”的语音指令,则通话设备根据“查询话费”对应的按键信息进行按键操作,向被叫方拨出“1”。
图11示出了一种通话提示方法,该方法为图3中的步骤S33的又一种实施例。图12示出了无法接通状态下,进行重拨操作的示例。
参考图11,进行通话提示包括:
S61、确定通话状态为无法接通状态。
S62、进行无法接通提示,并执行挂断操作或重拨操作。
一些实施方式中,通话状态为无法接通状态时,若不存在预设的重拨操作,则可以在屏幕上展示“对方暂时无法接通”,并挂断通话。若存在预设的重拨操作,则可以如图12所示,在屏幕上显示“对方暂时无法接通,正在重拨1/10”,以提示用户正在重拨,重拨次数为10次,当前为第1次重拨,此时,通话设备将在挂断通话后,执行重拨操作。同时,还可以通过如持续或间歇震动、间歇点亮闪光灯等方式,提示用户正在进行重拨。
一种可能的实施方式中,还可以在屏幕上展示“刷新重拨”和“停止重拨”两个提示信息。当用户点击“刷新重拨”时,将当前的重拨次数重置为第1次。当接收到作用于“停止重拨”的点击操作时,终止重拨,并在确定通话状态为无法接通状态后,挂断通话。
需要说明的是,当存在与通话设备连接的智能手表时,可通过给智能手表发送提示指令,智能手表根据提示指令在触摸屏上展示“对方暂时无法接通,正在重拨1/10”的信息,以及展示“刷新重拨”和“停止重拨”两个提示信息。同时,智能手表还可以震动以提醒用户正在进行重拨。当在智能手表上接收到作用于“刷新重拨”或“停止重拨”的点击操作时,智能手表发送点击操作对应的按键信息给通话设备,通话设备接收到按键信息后,通过执行刷新重拨或停止重拨的操作。
图13示出了本申请另一实施例中通话提示方法的流程示意图。
参考图13,在该实施例中,通话提示方法包括:
S701、通话设备开始通话。
一些实施方式中,通话设备在通话时,可以是主叫方,也可以是被叫方。例如,通过通话设备拨打某运营商的服务电话时,通话设备为主叫方。接听某些机构呼入的服务电话时,通话设备为被叫方。本申请提供的通话提示方法既可用于主叫方,也可以用于被叫方,在此不做限制。
S702、确定通话设备是否满足通话中提示的开启条件,若满足,则执行S703,否则继续识别通话设备是否满足通话提示的开启条件。
本申请中通话提示模式可以由用户开启,也可以自动开启。其中,提供开启通话提示模式的方式至少有三种,即满足手动开启条件、确定通话设备满足自动开启条件或通话设备在出厂时默认设置为通话提示模式开启。
需要说明的是,通话设备在出厂时默认设置为通话提示模式开启是通话设备在出厂时已经设置好的,无需用户进行设置,在此不做赘述。
自动开启条件的判别,实质上包含两种情况,一种是为了确定用户是否正在接听通话,若用户未接听通话,则自动开启通话提示。为此,可以先检测是否启用外部通话设备,若未启用外部通话设备,则进一步的检测用户是否通过通话设备的听音设备(如受话器、扬声器)接听通话。而另一种则是识别通话的号码,若通话的号码需要通话提示的概率较大,则自动开启通话提示。例如,对于用户和用户之间的通话,一般无需进行通话提示。而用户拨打紧急求助电话、客服电话等功能性号码时,对方可能使用自动应答机器人等,需要进行通话提示的概率较大。
以下,对检测是否启用外部通话设备以及检测用户是否通过通话设备的听音设备接听通话进行说明。
仅作为示例而非限制,参考图1示出的通话设备结构图,在识别通话设备是否启用外置通话装置播放通话音频时,可以先通过检测通话设备的耳机接口是否有负载来判别耳机接口是否连接有耳机。若耳机接口未检测到负载,即并未连接耳机,则还可以通过获取通话设备的无线通信设备列表判断通话设备当前是否连接了蓝牙耳机、蓝牙音箱等外置通话装置。其中,无线通信设备列表中包含了所有与通话设备连接的无线设备。
若存在连接的耳机或外置通话装置,还需进一步通过读取通话设备的输出音频的设置选项,以确认通话设备是否设置通过耳机或外置通话装置输出音频。若确定通话设备未连接耳机或外置通话装置,或连接了外置通话装置但未通过耳机或外置通话装置输出音频,则确认识别到通话设备未启用外置通话装置播放通话音频。
仅作为示例而非限制,若与通话设备为真无线立体声(True Wireless Stereo,TWS)耳机。则TWS耳机通过蓝牙与通话设备连接,在通话设备的无线通信设备列表里,包含TWS耳机的设备名。
当未佩戴TWS耳机时,可检测到通话设备的耳机接口无负载,无线通信设备列表内包括已连接的外置通话装置,但是在通话设备的输出音频设置选项中,设置输出音频的设备为受话器或扬声器,未通过TWS耳机输出音频。此时,识别结果为未启用外置通话装置播放通话音频。
当佩戴TWS耳机时,TWS耳机检测到耳机放入耳朵后,通过蓝牙向通话设备发送已佩戴的指示信号,通话设备接收到已佩戴指示信号后,设置输出音频的设备为TWS耳机。此时,识别结果为启用外置通话装置播放通话音频。需要说明的是,当通话设备等待接听时,已佩戴的指示信号还可以用于控制通话设备接听通话。
一些实施方式中,识别到用户是否通过通话设备的听音设备收听通话音频,可以先检测用户是否开启扬声器播放音频。例如,读取通话设备的设置选项时,若设置选 项显示音频通过扬声器播放,则确认用户开启扬声器。设置选项显示音频通过受话器或外置通话装置器播放,则确认用户未开启扬声器。
若未开启,则需检测用户是否将通话设备贴在耳旁接听。若检测到用户是将通话设备贴在耳旁接听,则确认用户通过通话设备的听音设备接听通话。反之,若未检测到,则确认用户未通过通话设备的听音设备接听通话。
一些实施方式中,当通话设备设置于受话器附近的接近光传感器或者距离传感器,检测到通话设备受话器附近光线有被遮挡或有障碍物紧贴于受话器附近时,即确认受话器与用户人脸之间的距离小于预设阈值,则可以确认用户将通话设备贴在耳旁接听。或者,当位于通话设备受话器附近的摄像头(如前置摄像头)采集到的图像亮度低于亮度阈值或在图像中识别到皮肤的图像时,也可以确认受话器与用户人脸之间的距离小于预设阈值,即用户将通话设备贴在耳旁接听。仅作为示例而非限制,可以同时使用传感器和摄像头进行检测。例如,若受话器附近的接近光传感器检测到光线的强度小于强度阈值,则启用前置摄像头采集图像。若采集到的图像亮度低于亮度阈值或可以在图像中识别出皮肤,则可以确认用户将通话设备贴在耳旁接听。
在确认通话设备未启用外置通话装置播放通话音频且用户未通过通话设备的听音设备接听通话后,可自动开启通话提示模式。
在通话之前,还可以对自动开启通话提示模式(自动模式)进行设置。一种可能的实施方式中,参考图14,通话设备展示的拨号界面的中,展示了拨号键盘、通话记录、快捷设置菜单的开启区域(本实施例中为右上角竖置排列的三个圆点,但不以此为限)等。当通话设备接收到作用于快捷设置菜单的开启区域的点击操作后,会展示图15所示的快捷设置菜单,若接收到作用于“设置”选项的点击操作,则展示图16所示的设置界面。在接收到作用于设置界面中“通话提示”选项的点击操作后,即可展示图17所示的通话提示的设置界面。在接收到作用于“通话提示的模式”的点击操作后,展示图18所示的通话提示模式选择界面。在图18的界面中,根据接收到的选择操作,确定通话提示的开启模式为自动模式后,可返回图17所示的通话提示的设置面。再接收到作用于“通话提示偏好设定”的点击操作时,会出现图19所示的界面,在该界面中,可以选择当检测到外部通话设备或开启扬声器时的处理策略,处理策略包括:停止通话提示、保持通话提示、提示我。
其中,选择“停止通话提示”时,若通话设备尚未进行通话提示,在检测到外部通话设备或开启扬声器后,终止通话提示模式。若通话设备正在进行通话提示(即确定了通话设备的通话状态),在检测到外部通话设备或开启扬声器后,在通话状态终止时(即通话等待状态中已提示用户接听、等待响应状态中已接收到响应、无法接通状态中已提示用户无法接通)终止通话提示。而选择“保持通话提示”时,则在本次通话中,无论何时检测到外部通话设备或开启扬声器,均保持通话提醒,直到本次通话结束。
参考图20,在选择“提示我”时,可以在检测到外部通话设备或开启扬声器后,展示选择界面,等用户输入,以选择停止通话提示或保持通话提示。若接收到作用于“不再提示”的点击操作,然后又接收到作用于“是”或“否”的点击操作,则可以根据点击操作对应的“是”或“否”将处理策略更改为“保持通话提示”或“停止通 话提示”。
对于检测到通话号码为预设的开启号码,预设的开启号码可以是通话设备从第三方服务器上获取得到的,也可以是在本地进行设置的。例如,通话设备将当前通话的通话号码特征发送至第三方服务器,第三方服务器根据通话号码的特征进行匹配,若匹配到响应的号码,则确认当前通话的通话号码为预设的开启号码。或者,通话设备还可以定时下载第三方服务器上的开启号码数据库至本地,然后在通话时,将通话号码与开启号码数据库中的号码匹配,若匹配到相应的号码,则确认当前通话的通话号码为预设的开启号码。再或者,还可以在本地的开启号码数据库内预存多个号码,若通话时的通话号码与预存的多个号码中的一个匹配,则确认当前通话的通话号码为预设的开启号码。
其中,当预设的开启号码为紧急救援号码时,可启用紧急救援设置。例如,继续参考图9,若接收到作用于“紧急救援”选项的点击操作,则可以展示图14示出的“紧急救援”设置界面。
如图21所示,在设置界面中,可以设置是否使用紧急救援、在未接通时是否重拨、重拨的次数等。同时,还可以设置是否在屏幕上显示紧急信息(当前定位信息、已设置的医疗急救卡、紧急联系人等)、以及选择是否向紧急救援号码发送紧急信息。
在使用紧急救援时,当识别到拨打的号码为紧急求救电话时,可根据设置好的紧急救援选项进行提示。其中,紧急求救电话为报警电话、火警电话、急救电话等,如110、119、120。或者其他国家和地区的紧急求救电话,如911、999、000等。
一些实施方式中,可以根据拨打的紧急求救号码的类型,在屏幕上展示相应的提示。例如,当拨打120时,可以显示医疗急救卡,当拨打119时,可以显示定位信息等。类似的,发送紧急信息也可以根据拨打号码不同而向紧急号码发送不同的紧急信息,在此不做赘述。
另一些实施方式中,参考图21,拨打紧急救援号码时,可以在通话界面上显示提示框,提示用户可以针对当前号码开启紧急救援的通话提示。若接收到用户选择开启的操作,则可根据预设的紧急救援设置进行通话提示。
手动开启条件的判别,实质上就是接收到用户的开启指令,用户的开启指令可以是在设置菜单中进行的开启设置,也可以是预设的操作手势等,在此不做限制。
一种可能的实施方式中,参考图14,通话设备展示的拨号界面的中,展示了拨号键盘、通话记录、快捷设置菜单的开启区域(本实施例中为右上角竖置排列的三个圆点,但不以此为限)等。当通话设备接收到作用于快捷设置菜单的开启区域的点击操作后,会展示图23.所示的快捷设置菜单。若接收到作用于“开启通话提示”的点击操作,则展示图24中的通话提示偏好选择菜单。在菜单中,展示了“自动识别”和多个自定义选项,每个自定义选项对应一个预设的通话提示规则。若接收到作用于“自动识别”选项的点击操作,则开启通话提示模式,通话提示模式的提示方式、提示触发等条件与自动开启时相同。
而在接收到作用于“查话费”、“自定义2”或“自定义3”等自定义选项的点击操作时,则根据自定义选项对应的通话提示规则开启通话提示模式。
一种可能的实施方式中,与自动开启类似,参考图15中示出的快捷设置菜单,若 接收到作用于“设置”选项的点击操作,则展示图16所示的设置界面。
仅作为示例,在“通话提示”选项上,可以设置一个开启按键。图16中示出的开启按键显示为“ON”,即表示通话提示模式开启。若接收到作用于开启按键的点击操作或拖动操作,则关闭通话提示模式,开启按键会显示为“OFF”。便于用户快速开启或关闭通话提示模式。
一些实施方式中,通话提示的设置界面可以如图17所示,在该界面中,可以选择开启或关闭通话提示,图17中开启或关闭通话提示模式与图16中的开启按键联动,即保持相同的设置。例如,若在图16所示的界面中关闭了通话提示模式,进入图17所示的界面中时,通话提示模式也是关闭的。
另一些实施方式中,还可以通过语音指令开启通话提示。当通话设备接收到预设的唤醒命令时,可以根据唤醒命令开始或关闭通话提示。参考图25,例如,若预设的唤醒命令以“智能助手”开头。在通话时,若在接收到的语音中检测到“智能助手”,则通话设备将“智能助手”之后的音频进行分析,获取其所代表的命令,并执行相应的操作。例如,若“智能助手”之后的语音为“开启通话提示”,则其代表的命令可以为通话提示模式开启指令。若“智能助手”之后的语音为“停止通话提示”,则其代表的命令可以为通话提示模式终止指令。
若通话提示模式为开启,则在接收到作用于“通话提示的模式”的点击操作后,展示图18所示的通话提示模式选择界面。在图18的界面中,根据接收到的选择操作,确定通话提示模式为自定义模式后,可返回图17所示的通话提示的设置面。再接收到作用于“通话提示偏好设定”的点击操作时,即展示图26所示的对自定义通话提示模式进行设定的界面。
图26中,展示了多个可选择的用户自定义选项,每个用户自定义选项可通过作用于该选项对应的编辑标记(图中由铅笔形状示出)或删除标记(图中由垃圾桶形状示出)的操作进行编辑操作或删除操作。编辑操作用于更改对应自定义选项的名称和排序。例如,在接收到作用于编辑标记的点击操作后,可以展示名称编辑窗口,以接收输入的定义选项的名称,如“查话费”、“转人工”、“重拨”等。若接收到作用于编辑标记的长按操作,则可以根据接收到的滑动操作,移动自定义选项,以改变对应自定义选项在多个自定义选项中的顺序。如,在接收到作用于“查话费”选项对应的编辑标记的长按操作,然后接收到向下的滑动操作,则“查话费”选项移动至所有自定义选项的最下方,在滑动操作结束后,“查话费”选项即停留在多个自定义选项的末尾。而通过作用于删除标记的点击操作,可以删除已展示在界面上的自定义选项。例如,当接收到作用于“自定义3”后对应的删除标记的点击操作,即可删除“自定义3”选项,界面上只剩下“查话费”和“自定义2”两个选项。最后,还可以在接收到作用于“添加自定义方案”的点击操作,增加一个自定义选项。在增加自定义选项时,可以通过展示弹窗接收用户输入的新增自定义选项的名称,或者,也可以默认命名为“自定义N”,其中N为现有的自定义选项数加一。例如,图26中示出了3个自定义选项,若默认命名,则新增的自定义选项的名字为“自定义4”。
一些实施方式中,在接收到作用于自定义选项的点击操作后,会展示该自定义选项对应的设置界面,例如,接收到作用于“查话费”选项的点击操作后,会展示图17 所示的界面。在图27所示的界面中,可以选择当检测到外部通话设备或开启扬声器时的处理策略。与自动模式相同,自定义模式的处理策略也包括:停止通话提示、保持通话提示、提示我。且每种策略对应的处理方式与自动模式相同,在此不做赘述。
一些实施方式中,在图27所示的界面中,可通过作用于对应的选项的点击操作,选择设置自定义关键词、设置自动按键、设置自动重拨或设置紧急救援。
仅作为示例而非限制,在接收到作用于“自定义关键词”的点击操作后,可以展示图28所示的界面。在图18所示的界面中,可以设置确定通话等待状态的关键词(通话等待的音频特征),如“稍等”、“排队”、“不要挂机”。还可以设置退出通话等待的关键词(第二音频特征),如“喂”、“你好”、“您好”、“先生”、“女士”、“久等”、“抱歉”等。以及确定等待响应状态的关键词(第三音频特征),如“请按”、“请拨”、“请输入”、“请说”等。最后,还可以设置确定无法接通状态的关键词,如“空号”、“暂时无法接通”、“欠费”、“不再服务区”等。
需要说明的是,在接收到输入的自定关键词后,该类别的关键词则以自定义的关键词为准,而不再参考通话状态识别数据库中的对应关系。例如,参考图28中进入通话等待的关键词。若通话状态识别数据库中存在“通话等待状态-稍候”的对应关系,但是自定义的关键词中不存在“稍候”,则在出现“稍候”的音频特征时,不会确定通话状态为通话等待状态。
还需说明,若某个类别未接收到输入的自定义关键词,则该类别的关键词以通话状态识别数据库中的对应关系为准。例如,若等待响应中未输入自定义的关键词,则在通话时根据通话状态识别数据库中预存的对应关系,确定等待响应状态。
一些实施方式中,在接收到作用于“自动按键”的点击操作,可以展示图29所示的界面。在图29所示的界面中,可以设置触发自动按键的号码以及触发词,如“号码7”、“查话费”、“转人工”。以及触发自动按键后,自动输入的触发词,如“手机号码”、“身份证”等。
仅作为示例而非限制,当通话号码为自动按键的号码,且在通话中识别到包含自动按键触发词的语句时,则自动拨出触发词所处语句中指示的按键。例如,若设置了自动按键触发词“查话费”,则在识别到“查话费请按1”时,自动拨“1”。若设置了自动按键触发词“转人工”,则在识别到“转人工请按0”时,自动拨“0”。
一种可能的实施方式中,还可以在识别到自动输入的触发词时,自动输入所需的内容。例如,若设置触发词1为“手机号码”,对应的输入内容1为“号码8”。在识别到“请输入要查询的手机号码,并按#号键结束”时,可以自动拨出“号码8+#号键”。若设置触发词2为“身份证”,对应的输入内容2为“身份证号码1”。在识别到“请输入身份证号码,并按#号键结束”时,可以自动拨出“身份证号码1+#号键”。
需要说明的是,在接收用户的按键操作时,先确定触摸屏接收到点击操作的区域对应的按键,然后生成按键对应数字或字符的按键信息,发送给处理器,其中,按键信息用于指示对相应的数字或字符进行按键操作。处理器根据接收到的多个按键信息对应的数字或字符进行拨号,或者将接收到的按键信息对应的数字或字符发送给正在通话的号码。
自动拨号则可以由通话设备模拟用户的按键操作。例如,当自动拨号涉及的按键为数字0-9、以及符号“*”、“#”时,可以先预存每个数字和符号对应的按键信息。在需要进行自动拨号时,根据需要拨号的数字或符号,将预存的对应的按键信息依次发送给处理器。处理器将接收到的按键信息对应的数字或字符发送给正在通话的号码。
参考图30和上述示例,开启了“查话费”的偏好且拨打的号码为“号码7”,当识别到“查话费”的触发词时,则启用自动按键。在屏幕上提示“正在进行查话费自动按键”,同时,展示“停止自动按键”的提示信息。若未接收到用户的操作,则根据设置好的自动按键参数,进行按键响应。若接收到作用于“停止自动按键”的点击操作,则终止自动按键,等待用户进行响应操作(如点击操作、输入语音等)。
一些实施方式中,在接收到作用于“自动重拨”的点击操作后,可以出现图31所示的界面。在图31所示的界面中,可以设置是否启用自动重拨,以及启用自动重拨后的重拨次数。需要说明的是,为了防止重拨次数过多而导致被叫方被骚扰,可以将重拨次数的上线设置为10次,但不以此为限
S703、开启通话提示模式。
需要说明的是,在开启通话提示模式后,通话提示模式还可以手动关闭。例如,参考图32,当接收到上述作用于“自动识别”选项或自定义选项的点击操作后,若再次接收到作用于快捷设置菜单开启区域的点击操作,可以展示图7中示出的快捷设置菜单。其中,原来的“开启通话提示”变为了“关闭通话提示”,若接收到作用于关闭通话提示的点击操作,即可禁用通话提示(即将手机设置为不使用通话提示模式)。
一些实施方式中,在通话提示启用时,若识别到通话设备满足通话提示模式的终止条件,则中止通话提示。其中,通话提示模式的终止条件包括:在通话时接收到通话提示终止指令或在通话时识别到用户开始收听所述通话音频。其中,通话提示终止指令可以是在通话界面展示的选项按键,也可以是预设的操作,如双击减小音量键,在触摸屏上用手指滑动出预设的轨迹等,在此不做限制。
需要说明的是,S701-S703为图3中S31的一种实施方式。
S704、识别接收到通话音频中的第一音频特征。
仅作为示例而非限制,识别第一音频特征可以先将接收到的通话音频的音频数据进行语音活动检测(Voice Activity Detection,VAD),切除掉音频数据中的静音段,以确定音频数据中存在语音部分的边界。然后,将边界中的音频数据进行分帧,将边界中的音频数据分为多个帧,每个帧对应一段波形。再提取每一帧的梅尔倒谱系数(Mel-scale Frequency Cepstral Coefficients,MFCC)特征,将每一帧波形转换为一个12维向量(假设该音频数据的声学特征共12维)。即可得到一个12行、N列的矩阵(称之为观察序列),该矩阵即可表示上述边界中的音频数据。接着,根据现有的声学模型,确定观察序列中每一帧对应的状态,其中,3个状态可以构成1个音素,单词的发音由多个音素构成。最后,使用隐马尔可夫模型(Hidden Markov Model,HMM),将观察序列中每一帧对应的状进行匹配,确定识别到的文字。若识别到的文字中,存在可以确定通话状态的关键词,则将该关键词作为第一音频特征。
另一种可能的实施方式中,可以参考上述识别关键词的方法,若未识别到关键词,则通话音频可能为音乐、电话信号音等。例如,在某些客服电话中,转人工时播放的 等待音乐、等待对方接听时的彩铃、接通音、占线音等。
仅作为示例而非限制,可以将音频数据与预设的声音数据库中的音频匹配。例如,先通过短时傅里叶变换(Short-Time Fourier Transform,STFT),从频域上提取音频数据的声学特征。然后将该声学特征与预设的声音数据库中的声学特征进行特征匹配,确定音频数据对应的音乐类型。例如,若匹配到上述的等待音乐、彩铃、接通音等,则确定音乐类型为等待接听。若匹配到占线音,则确定音乐类型为无法接通等。最后,将得到的音乐类型作为第一音频特征。
S705、根据第一音频特征确定通话状态。若通话状态为等待响应状态,则执行S706;若通话状态为通话等待状态,则执行S708;若通话状态为无法接通状态,则执行S711;若通话状态无法确定,则执行S712。
还需说明的是,S704-S705为图3中S32的一种实施方式。
S706、通话状态为等待响应状态,根据第一音频特征或第三音频特征,进行操作提示。
S707、接收到响应操作,并根据响应操作进行响应,在响应后退出等待响应状态并执行S702。
其中,S706和S707为S51和S52的一种实施方式,其进行操作提示的方式以及进行操作响应的方式与S51和S52中相同,在此不做赘述。
S708、通话状态为通话等待状态,在通话音频中识别音频特征。
其中,识别音频特征的方式与S704中相同,在此不做赘述。
S709、若识别到第三音频特征,则确定通话状态为等待响应状态,执行S706。
S710、若识别到第二音频特征,则进行接听提示,在提示后退出通话等待状态并执行S702。
其中,S710为S41和S42的一种实施方式,其进行接听提示的方式与S41和S42中相同,在此不做赘述。
S711、通话状态为无法接通状态,进行无法接通提示,并执行挂断操作或重拨操作,在提示后退出无法接通状态并执行S702。
其中,S711为S61和S62一种实施方式,其进行无法接通提示,并执行挂断操作或重拨操作的方式与S61和S62中相同,在此不做赘述。
S712、若通话状态无法确定,则进行接听提示,在提示后执行S702。
一些实施方式中,当通话音频中未识别到第一音频特征时,如通话音频的内容未指示任何一种通话状态,则提示用户接听通话,以防止用户因未接听而错失信息。其中,进行接听提示的方式与S41和S42中相同,在此亦不做赘述。
在本实施例中,通话提示方法是循环进行的,以保证及时提供通话提示。例如,当通话设备拨打了某运营商的服务电话。电话接通后,确认通话设备开启通话提示模式,然后在接收到通话音频后,识别第一音频特征。例如,可能接收到“查询话费请按1、业务办理请按2、转人工请按0”的通话语音,识别的第一音频特征为“请按”指示通话状态为等待响应状态。然后,在屏幕上展示“查询话费”、“业务办理”、“转人工”的提示信息。若接收到作用于“转人工”的点击操作,则退出等待响应状态,向通话方拨出“0”。
通话方在接收到“0”后,进入转人工的流程。继续确认通话设备开启通话提示模式并识别第一音频特征。例如,在转人工时,若接收到“人工坐席忙,请稍候”的通话音频,则第一音频特征为“请稍候”,确认通话状态为通话等待状态。当等待结束后,人工坐席接听时,可能会收到“先生您好,让您久等了”的通话音频,识别到“先生”、“久等”等第二音频特征后,进行震动、展示提示信息等接听提示,并退出通话等待状态,继续确认通话设备开启通话提示模式并识别第一音频特征。
若在通话音频中再次识别到第一音频特征,则进入对应的通话状态并进行提示,直到退出通话提示模式或者通话结束。
基于图32,图33示出了基于检测用户是否接听通话音频开启通话提示的实施例。
在该实施例中,通话提示方法包括:
S801、通话设备开始通话。
S802、识别通话设备的是否启用外置通话装置播放通话音频,若未启用,则执行S803,否则继续识别是否启用外置通话装置播放通话音频。
其中,识别通话设备的是否启用外置通话装置播放通话音频时,可以先检测通话设备的耳机接口是否有负载来判别耳机接口是否连接有耳机。若耳机接口未检测到负载,则再获取通话设备的无线通信设备列表,确定通话设备是否连接了如蓝牙耳机、蓝牙音箱等外置通话装置。若存在连接的耳机或外置通话装置,还需通过读取通话设备的输出音频的设置选项,确认通话设备是否设置通过耳机或外置通话装置输出音频。
若确定通话设备未连接耳机或外置通话装置,或连接了外置通话装置但未通过耳机或外置通话装置输出音频,则确认识别到通话设备未启用外置通话装置播放通话音频。
S803、识别用户是否通过通话设备的听音设备收听通话音频,若未收听,则执行S804,否则继续识别是否启用外置通话装置播放通话音频。
其中,听音设备包括扬声器和受话器。在识别是,可以先读取通话设备的设置选项,若设置选项显示音频通过扬声器播放,则确认用户开启扬声器,即用户通过通话设备的听音设备收听了通话音频。
设置选项显示音频通过受话器或外置通话装置器播放,则需检测用户是否将通话设备贴在耳旁接听。若检测到用户是将通话设备贴在耳旁接听,则确认用户通过通话设备的听音设备接听通话。反之,若未检测到,则确认用户未通过通话设备的听音设备接听通话。
一些实施方式中,当通话设备设置于受话器附近的接近光传感器或者距离传感器,检测到通话设备受话器附近光线有被遮挡或有障碍物紧贴于受话器附近时,则可以确认用户将通话设备贴在耳旁接听。或者,当位于通话设备受话器附近的摄像头(如前置摄像头)采集到的图像亮度低于亮度阈值或在图像中识别到皮肤的图像时,也可以确认用户将通话设备贴在耳旁接听。仅作为示例而非限制,可以同时使用传感器和摄像头进行检测。例如,若受话器附近的接近光传感器检测到光线的强度小于强度阈值,则启用前置摄像头采集图像。若采集到的图像亮度低于亮度阈值或可以在图像中识别出皮肤,则可以确认用户将通话设备贴在耳旁接听。
S804、开启通话提示模式。
一些实施方式中,S802和S803中为通话设备自动识别开启的通话提示模式的一种实施方式,其进行提示时的设置为预设的偏好。预设的偏好可以在通话设备的操作系统中进行更改,其设置方式在S702中已经进行说明,在此不做赘述。
S805、识别接收到通话音频中的第一音频特征。
其中,识别通话音频中的第一音频特征的方式与S704中相同,在此不做赘述。
S806、根据第一音频特征确定通话状态。若通话状态为等待响应状态,则执行S806;若通话状态为通话等待状态,则执行S808;若通话状态为无法接通状态,则执行S811;若通话状态无法确定,则执行S812。
S807、通话状态为等待响应状态,根据第一音频特征或第三音频特征,进行操作提示。
S808、接收到响应操作,并根据响应操作进行响应,在响应后退出等待响应状态并执行S802。
其中,S807和S808中,进行操作提示的方式以及进行操作响应的方式与S51和S52中相同,在此不做赘述。
S809、通话状态为通话等待状态,在通话音频中识别音频特征。
其中,识别音频特征的方式与S805中相同,在此不做赘述。
S810、若识别到第三音频特征,则确定通话状态为等待响应状态,执行S807。
S811、若识别到第二音频特征,则进行接听提示,在提示后退出通话等待状态并执行S802。
其中,S811中,进行接听提示的方式与S41和S42中相同,在此不做赘述。
S812、通话状态为无法接通状态,进行无法接通提示,并执行挂断操作或重拨操作,在提示后退出无法接通状态并执行S802。
其中,S812中,进行无法接通提示,并执行挂断操作或重拨操作的方式与S61和S62中相同,在此不做赘述。
S813、若通话状态无法确定,则进行接听提示,在提示后执行S802。
在本实施例中,通过识别用户是否收听通话音频来开启通话提示模式,能够更有针对性的对用户提供服务,提高用户使用通话设备时的体验。
基于图32,图34示出了基于检测通话号码开启通话提示的实施例。
在该实施例中,通话提示方法包括:
S901、通话设备开始通话。
S902、获取通话的通话号码。
其中,通话的通话号码在通话设备开始通话时可从通话请求中获取。例如,通话设备作为主叫方时,可以在接收用户拨号信息时获取通话号码。通话设备作为被叫方时,可以在接收到通话请求时,获取通话请求中的通话号码。
S903、识别通话号码是否为预设的开启号码,若是,则执行S904,若不是,则直接结束流程。
其中,预设的开启号码可以是通话设备从第三方服务器上获取得到的,也可以是在本地进行设置的。例如,通话设备将当前通话的通话号码特征发送至第三方服务器,第三方服务器根据通话号码的特征进行匹配,若匹配到响应的号码,则确认当前通话 的通话号码为预设的开启号码。或者,通话设备还可以定时下载第三方服务器上的开启号码数据库至本地,然后在通话时,将通话号码与开启号码数据库中的号码匹配,若匹配到相应的号码,则确认当前通话的通话号码为预设的开启号码。再或者,还可以在本地的开启号码数据库内预存多个号码,若通话时的通话号码与预存的多个号码中的一个匹配,则确认当前通话的通话号码为预设的开启号码。
S904、开启通话提示模式。
一些实施方式中,S902和S903中为通话设备自动识别开启的通话提示模式的一种实施方式,其进行提示时的设置为预设的偏好。预设的偏好可以在通话设备的操作系统中进行更改,其设置方式在S702中已经进行说明,在此不做赘述。
S905、识别接收到通话音频中的第一音频特征。
其中,识别通话音频中的第一音频特征的方式与S704中相同,在此不做赘述。
S906、根据第一音频特征确定通话状态。若通话状态为等待响应状态,则执行S906;若通话状态为通话等待状态,则执行S908;若通话状态为无法接通状态,则执行S911;若通话状态无法确定,则执行S912。
S907、通话状态为等待响应状态,根据第一音频特征或第三音频特征,进行操作提示。
S908、接收到响应操作,并根据响应操作进行响应,在响应后退出等待响应状态并执行S905。
其中,S907和S908中,进行操作提示的方式以及进行操作响应的方式与S51和S52中相同,在此不做赘述。
S909、通话状态为通话等待状态,在通话音频中识别音频特征。
其中,识别音频特征的方式与S905中相同,在此不做赘述。
S910、若识别到第三音频特征,则确定通话状态为等待响应状态,执行S907。
S911、若识别到第二音频特征,则进行接听提示,在提示后退出通话等待状态并执行S905。
其中,S911中,进行接听提示的方式与S41和S42中相同,在此不做赘述。
S912、通话状态为无法接通状态,进行无法接通提示,并执行挂断操作或重拨操作,在提示后退出无法接通状态并执行S905。
其中,S912中,进行无法接通提示,并执行挂断操作或重拨操作的方式与S61和S62中相同,在此不做赘述。
S913、若通话状态无法确定,则进行接听提示,在提示后执行S905。
在本实施例中,通过识别通话号码来开启通话提示模式,能够为有较大概率需要进行通话提醒的号码进行通话提醒,可以提高用户使用通话设备时的体验。
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
对应于上文实施例的通话提示方法,图35示出了本申请实施例提供的通话提示装置的结构框图,为了便于说明,仅示出了与本申请实施例相关的部分。
参照图35,该装置包括:
开启模块1001,用于开启通话提示模式。
识别模块1002,用于识别接收到的通话音频的第一音频特征。
确定模块1003,用于根据所述第一音频特征确定通话状态。
提示模块1004,用于根据所述通话状态对应的通话提示方式,进行通话提示。
一些实施方式中,开启模块1001,具体用于若接收到用户输入的预设操作,则开启所述通话提示模式。或,若满足自动开启条件,则开启所述通话提示模式。
一些实施方式中,开启模块1001,具体用于接收到作用于具有开启通话提示模式功能的虚拟按键的触摸操作。或,接收到作用于预设物理按键的按键操作。或,接收到预设的操作手势。
一些实施方式中,开启模块1001,具体用于确认用户未收听所述通话音频。或,识别到通话的通话号码为预设开启号码。
一些实施方式中,开启模块1001,具体用于确认未启用外部通话装置播放所述通话音频,且识别到所述用户未通过所述电子设备的听音设备收听所述通话音频。
一些实施方式中,所述听音设备包括受话器和扬声器。开启模块,具体用于确定所述用户未通过所述受话器收听所述通话音频,且确定所述用户未通过所述扬声器收听所述通话音频。
一些实施方式中,开启模块1001,具体用于获取所述受话器与用户人脸之间的距离,若所述距离大于预设阈值,则确定所述用户未通过所述受话器收听所述通话音频。
一些实施方式中,开启模块1001,具体用于读取所述电子设备的音频播放设置信息。若所述音频播放设置信息中,所述通话音频未通过扬声器播放,则确定所述用户未通过所述扬声器收听所述通话音频。
一些实施方式中,参考图36,该装置还包括读取模块1005,用于读取预先设置的通话提示模式的设置信息。
一些实施方式中,所述设置信息包括关键词信息。识别模块1002,具体用于根据所述设置信息中包含的关键词信息,识别接收到的通话音频的第一音频特征。
一些实施方式中,参考图37所述设置信息包括预设的操作信息。则该装置还包括执行模块1006,用于根据所述预设的操作信息,执行预设操作。
一种可能的实施方式中,通话状态为通话等待状态。提示模块1004,具体用于若在通话音频中识别到指示通话等待状态结束的第二音频特征,则进行接听提示,接听提示用于指示用户接听通话。
一些实施方式中,识别模块1002,还用于在确定通话状态为通话等待状态之后,若在通话音频中识别到指示等待响应状态的第三音频特征,则确定通话状态从通话等待状态切换为等待响应状态。
相应的,提示模块1004,具体用于根据第三音频特征,进行操作提示,操作提示用于提示用户进行通话响应。
一些实施方式中,通话状态为等待响应状态。
提示模块1004,具体用于根据第一音频特征,进行操作提示。操作提示用于提示用户进行通话响应。
一些实施方式中,参考图38该装置还包括响应模块1007,用于接收用户的响应 操作。执行所述响应操作所指示的操作。
一些实施方式中,通话状态为无法接通状态。
提示模块1004,具体用于进行无法接通提示,并执行挂断操作或重拨操作。
一些实施方式中,识别模块1004,具体用于若识别到通话设备满足通话提示模式的终止条件,则中止通话提示。
一些实施方式中,识别模块1004,具体用于在通话时识别到通话中提示终止指令。或者,在通话时识别到用户开始收听通话音频。
一些实施方式中,识别模块1004,具体用于若识别到通话设备启用外置通话装置播放通话音频,或者,识别到用户通过通话设备的听音设备收听通话音频,则终止通话提示模式。
需要说明的是,上述模块之间的信息交互、执行过程等内容,由于与本申请方法实施例基于同一构思,其具体功能及带来的技术效果,具体可参见方法实施例部分,此处不再赘述。
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中,上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。上述系统中单元、模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
本申请实施例还提供了一种网络设备,该网络设备包括:至少一个处理器、存储器以及存储在所述存储器中并可在所述至少一个处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述任意各个方法实施例中的步骤。
图39为本申请一实施例提供的通话设备的结构示意图。如图39所示,该实施例的通话设备1100包括:至少一个处理器1101(图39中仅示出一个)处理器、存储器1102、通话模块1104以及存储在存储器1102中并可在至少一个处理器1101上运行的计算机程序1103,处理器1101执行计算机程序1103时实现上述任意各个通话设备方法实施例中的步骤。
通话设备1100可以是桌上型计算机、笔记本、掌上电脑及云端服务器等计算设备。该通话设备可包括,但不仅限于,处理器1101、存储器1102、通话模块1104。本领域技术人员可以理解,图39仅仅是通话设备1100的举例,并不构成对通话设备1100的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如还可以包括输入输出设备、网络接入设备等。
处理器1101可以是中央处理单元(Central Processing Unit,CPU),该处理器1101还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体 管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
存储器1102在一些实施例中可以是通话设备110的内部存储单元,例如通话设备1100的硬盘或内存。存储器1102在另一些实施例中也可以是通话设备1100的外部存储设备,例如通话设备1100上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,存储器1102还可以既包括通话设备1100的内部存储单元也包括外部存储设备。存储器1102用于存储操作系统、应用程序、引导装载程序(BootLoader)、数据以及其他程序等,例如计算机程序的程序代码等。存储器1102还可以用于暂时地存储已经输出或者将要输出的数据。
通话模块1104可以包括支持GSM、CDMA、WCDMA、LTE、TD-WCDMA、TD-LTE、5G NR等通信标准或协议的通信模块、用于接入SIM卡的插槽、以及天线等组件,用于与其他通话设备进行通信。
本申请实施例还提供了一种计算机可读存储介质,计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现可实现上述各个方法实施例中的步骤。
本申请实施例提供了一种计算机程序产品,当计算机程序产品在通话设备上运行时,使得通话设备执行时实现可实现上述各个方法实施例中的步骤。
本申请实施例提供了一种芯片系统,芯片系统包括存储器和处理器,处理器执行存储器中存储的计算机程序,以实现上述各个方法实施例中的步骤。
本申请实施例提供了一种芯片系统,芯片系统包括处理器,处理器与第四方面提供的计算机可读存储介质耦合,处理器执行计算机可读存储介质中存储的计算机程序,以实现上述各个方法实施例中的步骤。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实现上述实施例方法中的全部或部分流程,可以通过计算机程序来指令相关的硬件来完成,计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,计算机程序包括计算机程序代码,计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。计算机可读介质至少可以包括:能够将计算机程序代码携带到通话设备的任何实体或装置、记录介质、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质。例如U盘、移动硬盘、磁碟或者光盘等。在某些司法管辖区,根据立法和专利实践,计算机可读介质不可以是电载波信号和电信信号。
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。
本领域技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用场景来使用不同方法来实现所描述的功能,但是这种 实现不应认为超出本申请的范围。
在本申请所提供的实施例中,应该理解到,所揭露的通话提示方法、装置和通话设备,可以通过其它的方式实现。例如,以上所描述的通话提示装置和通话设备的实施例仅仅是示意性的。作为示例,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的间接耦合或通讯连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
最后应说明的是:以上,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。
Claims (19)
- 一种通话提示方法,应用于电子设备,其特征在于,所述方法包括:开启通话提示模式;识别接收到的通话音频的第一音频特征;根据所述第一音频特征确定通话状态;根据所述通话状态对应的通话提示方式,进行通话提示。
- 如权利要求1所述的方法,其特征在于,所述开启通话提示模式,包括:若接收到用户输入的预设操作,则开启所述通话提示模式;或,若满足自动开启条件,则开启所述通话提示模式。
- 如权利要求2所述的方法,其特征在于,所述接收到用户输入的预设操作,包括:接收到作用于具有开启通话提示模式功能的虚拟按键的触摸操作;或,接收到作用于预设物理按键的按键操作;或,接收到预设的操作手势。
- 如权利要求2所述的方法,其特征在于,所述满足自动开启条件,包括:确认用户未收听所述通话音频;或,识别到通话的通话号码为预设开启号码。
- 如权利要求4所述的方法,其特征在于,所述确认用户未收听所述通话音频,包括:确认未启用外部通话装置播放所述通话音频,且识别到所述用户未通过所述电子设备的听音设备收听所述通话音频。
- 如权利要求5所述的方法,其特征在于,所述听音设备包括受话器和扬声器;所述识别到所述用户未通过所述电子设备的听音设备收听所述通话音频,包括:确定所述用户未通过所述受话器收听所述通话音频,且确定所述用户未通过所述扬声器收听所述通话音频。
- 如权利要求6所述的方法,其特征在于,所述确定所述用户未通过所述受话器收听所述通话音频,包括:获取所述受话器与用户人脸之间的距离,若所述距离大于预设阈值,则确定所述用户未通过所述受话器收听所述通话音频。
- 如权利要求6或7所述的方法,其特征在于,所述确定所述用户未通过所述扬声器收听所述通话音频,包括:读取所述电子设备的音频播放设置信息;若所述音频播放设置信息中,所述通话音频未通过扬声器播放,则确定所述用户未通过所述扬声器收听所述通话音频。
- 如权利要求1-8任一项所述的方法,其特征在于,在开启通话提示模式之后,还包括:读取预先设置的通话提示模式的设置信息。
- 如权利要求9所述的方法,其特征在于,所述设置信息包括关键词信息;所述识别接收到的通话音频的第一音频特征,包括:根据所述设置信息中包含的关键词信息,识别接收到的通话音频的第一音频特征。
- 如权利要求9所述的方法,其特征在于,所述设置信息包括预设的操作信息;在开启通话提示模式之后,还包括根据所述预设的操作信息,执行预设操作。
- 如权利要求1-11任一项所述的方法,其特征在于,所述通话状态为通话等待状态;根据所述通话状态对应的通话提示方式,进行通话提示,包括:若在所述通话音频中识别到指示通话等待状态结束的第二音频特征,则进行接听提示,所述接听提示用于指示用户接听通话。
- 如权利要求12所述的方法,其特征在于,在确定通话状态为所述通话等待状态之后,若在所述通话音频中识别到指示等待响应状态的第三音频特征,则确定通话状态从所述通话等待状态切换为所述等待响应状态;所述根据所述通话状态对应的通话提示方式,进行通话提示,包括:根据所述第三音频特征,进行操作提示,所述操作提示用于提示用户进行通话响应。
- 如权利要求1-11任一项所述的方法,其特征在于,所述通话状态为等待响应状态;根据所述通话状态对应的通话提示方式,进行通话提示,包括:根据所述第一音频特征,进行操作提示,所述操作提示用于提示用户进行通话响应。
- 如权利要求13或14所述的方法,其特征在于,在进行操作提示之后,还包括:接收用户的响应操作;执行所述响应操作所指示的操作。
- 如权利要求1-11任一项所述的方法,其特征在于,所述通话状态为无法接通状态;根据所述通话状态对应的通话提示方式,进行通话提示,包括:进行无法接通提示,并执行挂断操作或重拨操作。
- 一种通话设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1至16任一项所述的方法。
- 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至16任一项所述的方法。
- 一种芯片系统,所述芯片系统包括处理器,其特征在于,所述处理器与权利要求18所述的计算机可读存储介质耦合,所述处理器执行所述计算机可读存储介质中存储的计算机程序,以实现权利要求1至16任一项所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21833005.8A EP4156666A4 (en) | 2020-06-30 | 2021-03-11 | CALL SOLICITATION METHOD, CALLING APPARATUS, READABLE STORAGE MEDIUM AND SYSTEM ON A CHIP |
US18/011,368 US20230328172A1 (en) | 2020-06-30 | 2021-03-11 | Call Prompt Method, Call Device, Readable Storage Medium, and Chip System |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010618105.9A CN113873077A (zh) | 2020-06-30 | 2020-06-30 | 通话提示方法、通话设备、可读存储介质及芯片系统 |
CN202010618105.9 | 2020-06-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022001170A1 true WO2022001170A1 (zh) | 2022-01-06 |
Family
ID=78981831
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/080230 WO2022001170A1 (zh) | 2020-06-30 | 2021-03-11 | 通话提示方法、通话设备、可读存储介质及芯片系统 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20230328172A1 (zh) |
EP (1) | EP4156666A4 (zh) |
CN (1) | CN113873077A (zh) |
WO (1) | WO2022001170A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116506546A (zh) * | 2023-06-29 | 2023-07-28 | 深圳市易赛通信技术有限公司 | 通信手表的通信方法及通信手表 |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114244960B (zh) * | 2022-02-25 | 2022-07-22 | 荣耀终端有限公司 | 一种来电呼叫的响应方法以及相应的终端、通信系统 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103795873A (zh) * | 2014-02-17 | 2014-05-14 | 宇龙计算机通信科技(深圳)有限公司 | 一种根据通话状态提示用户响应的方法及装置 |
CN105100512A (zh) * | 2015-07-17 | 2015-11-25 | 华为技术有限公司 | 一种提示通话状态改变的方法、用户设备和服务器 |
CN107566647A (zh) * | 2017-09-05 | 2018-01-09 | 联想(北京)有限公司 | 用于电子设备的提示方法和系统 |
CN109151227A (zh) * | 2018-09-21 | 2019-01-04 | 珠海格力电器股份有限公司 | 语音通话方法、装置和终端及计算机存储介质 |
CN111010480A (zh) * | 2019-12-05 | 2020-04-14 | 维沃移动通信有限公司 | 一种通信控制及相关设备 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050069117A1 (en) * | 2003-09-29 | 2005-03-31 | Fernandez Christopher Lawrence | Method for notifying an end user that a party has returned to a communication session |
KR101341504B1 (ko) * | 2007-07-12 | 2013-12-16 | 엘지전자 주식회사 | 휴대 단말기 및 휴대 단말기에서의 멀티미디어 컨텐츠 생성방법 |
CN104125324A (zh) * | 2013-04-24 | 2014-10-29 | 腾讯科技(深圳)有限公司 | 一种通话等待界面显示方法和系统 |
CN104917899A (zh) * | 2015-06-19 | 2015-09-16 | 努比亚技术有限公司 | 通话提示方法及装置 |
CN105827823B (zh) * | 2016-01-29 | 2019-06-07 | 维沃移动通信有限公司 | 一种通话控制方法及移动终端 |
CN109151220A (zh) * | 2018-09-11 | 2019-01-04 | 中国—东盟信息港股份有限公司 | 一种通信话路呼叫失败场景分析系统 |
-
2020
- 2020-06-30 CN CN202010618105.9A patent/CN113873077A/zh active Pending
-
2021
- 2021-03-11 EP EP21833005.8A patent/EP4156666A4/en active Pending
- 2021-03-11 WO PCT/CN2021/080230 patent/WO2022001170A1/zh unknown
- 2021-03-11 US US18/011,368 patent/US20230328172A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103795873A (zh) * | 2014-02-17 | 2014-05-14 | 宇龙计算机通信科技(深圳)有限公司 | 一种根据通话状态提示用户响应的方法及装置 |
CN105100512A (zh) * | 2015-07-17 | 2015-11-25 | 华为技术有限公司 | 一种提示通话状态改变的方法、用户设备和服务器 |
CN107566647A (zh) * | 2017-09-05 | 2018-01-09 | 联想(北京)有限公司 | 用于电子设备的提示方法和系统 |
CN109151227A (zh) * | 2018-09-21 | 2019-01-04 | 珠海格力电器股份有限公司 | 语音通话方法、装置和终端及计算机存储介质 |
CN111010480A (zh) * | 2019-12-05 | 2020-04-14 | 维沃移动通信有限公司 | 一种通信控制及相关设备 |
Non-Patent Citations (1)
Title |
---|
See also references of EP4156666A4 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116506546A (zh) * | 2023-06-29 | 2023-07-28 | 深圳市易赛通信技术有限公司 | 通信手表的通信方法及通信手表 |
CN116506546B (zh) * | 2023-06-29 | 2024-03-15 | 深圳市易赛通信技术有限公司 | 通信手表的通信方法及通信手表 |
Also Published As
Publication number | Publication date |
---|---|
US20230328172A1 (en) | 2023-10-12 |
EP4156666A1 (en) | 2023-03-29 |
EP4156666A4 (en) | 2023-11-29 |
CN113873077A (zh) | 2021-12-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10609198B2 (en) | Personal media system including base station and wireless earbud | |
KR101726945B1 (ko) | 수동 시작/종료 포인팅 및 트리거 구문들에 대한 필요성의 저감 | |
US7035091B2 (en) | Wearable computer system and modes of operating the system | |
WO2018045536A1 (zh) | 声音信号处理的方法、终端和耳机 | |
KR102081926B1 (ko) | 이동 단말기 및 전화 수신 방법 | |
WO2019154182A1 (zh) | 应用程序的音量设置方法及移动终端 | |
CN101720550A (zh) | 多个音频设备中音频的动态选路 | |
TWI543024B (zh) | 用於使用者控制之方法及裝置 | |
WO2022001170A1 (zh) | 通话提示方法、通话设备、可读存储介质及芯片系统 | |
CN111599358A (zh) | 语音交互方法及电子设备 | |
CN108989558A (zh) | 终端通话的方法及装置 | |
CN107864270A (zh) | 一种处理来电的方法、终端及计算机可读存储介质 | |
CN110012172A (zh) | 一种来电处理方法及终端设备 | |
WO2020221024A1 (zh) | 信息提醒方法、移动终端及计算机可读存储介质 | |
US9503556B2 (en) | Handling voice calls | |
WO2022068694A1 (zh) | 电子设备及其唤醒方法 | |
JP7055722B2 (ja) | 音声認識機能を有する電子機器、その電子機器の制御方法およびプログラム | |
JP2016139962A (ja) | 携帯電話機 | |
CN111010482A (zh) | 语音寻回方法、无线设备及计算机可读存储介质 | |
CN112863511B (zh) | 信号处理方法、装置以及存储介质 | |
CN107645604B (zh) | 一种通话处理方法及移动终端 | |
CN111343420A (zh) | 一种语音增强方法及穿戴设备 | |
CN104754120B (zh) | 一种终端 | |
KR200456781Y1 (ko) | 블루투스 컨트롤러 | |
CN111416907B (zh) | 一种来电处理方法及电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21833005 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2021833005 Country of ref document: EP Effective date: 20221223 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |