WO2025195397A1 - Call control method, system, and related apparatus - Google Patents
Call control method, system, and related apparatusInfo
- Publication number
- WO2025195397A1 WO2025195397A1 PCT/CN2025/083335 CN2025083335W WO2025195397A1 WO 2025195397 A1 WO2025195397 A1 WO 2025195397A1 CN 2025083335 W CN2025083335 W CN 2025083335W WO 2025195397 A1 WO2025195397 A1 WO 2025195397A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stylus
- electronic device
- microphone
- user
- audio data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/64—Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations
- H04M1/65—Recording arrangements for recording a message from the calling party
- H04M1/656—Recording arrangements for recording a message from the calling party for recording conversations
Definitions
- the present application relates to the field of terminals, and in particular to a call control method, system and related devices.
- the present application provides a call control method, system and related devices, which realize the acquisition of the status of the stylus when the electronic device starts to collect audio.
- the electronic device collects audio data through the microphone of the electronic device and/or the microphone of the stylus.
- the electronic device determines the microphone to collect audio data based on whether the stylus is held by the user, whether it is adsorbed on the electronic device or whether it is facing the speaking object, so that the electronic device can collect audio data at a shorter distance through its own microphone and collect audio data at a longer distance through the microphone of the stylus, helping users to collect audio data in different call scenarios and providing users with a better call experience.
- the present application provides a call control method, which is applied to an electronic device including a first microphone, the method comprising: receiving a first input; in response to the first input, if it is detected that the stylus is held by the user, collecting audio data through the second microphone of the stylus; if it is detected that the stylus is not held by the user, collecting audio data through the first microphone.
- the electronic device chooses to use the first microphone or the second microphone to collect audio data based on whether the stylus is held by the user.
- the electronic device can collect clearer audio data through the stylus when the user moves or the user is far away from the electronic device.
- the electronic device can also collect audio data of multiple users through the microphone of the electronic device when multiple users are present, which is suitable for scenarios where multiple people hold conference calls through electronic devices.
- the first input is an input for starting audio collection, such as an input for answering/dialing a call, an input for starting recording, etc.
- the electronic device After receiving the input for starting audio data collection, the electronic device obtains the state of the stylus and selects the corresponding microphone.
- audio data is collected through the first microphone, including: if it is detected that the stylus is not being held by the user and is attached to the electronic device, audio data is collected through the first microphone.
- the electronic device detects that the stylus is attached to the electronic device, indicating that the user is not using the stylus.
- the stylus's microphone may also be blocked by the electronic device. The electronic device collects audio data through the first microphone, which better meets the user's audio collection needs and can collect clearer audio.
- the method further includes: if it is detected that the stylus is not held by the user and is not attached to the electronic device, pausing audio data collection and displaying a first prompt message, where the first prompt message is used to prompt the user to mute the microphone.
- the electronic device may tend to assume that the user wants to pause speaking. To protect the user's privacy, the electronic device may mute the microphone and suspend audio data collection.
- the first prompt information may include a mute icon, which may indicate that the electronic device is muted. In this way, the user can understand that the electronic device is muted through the mute icon, which facilitates the user to perform subsequent mute operations.
- audio data is collected via the second microphone of the stylus, including: if the stylus is detected to be held by the user and directed toward the person speaking, audio data is collected via the second microphone.
- audio data is collected via the second microphone of the stylus, including: if the stylus is detected to be held by the user and not pointed at the speaker, audio data is collected via the first microphone and the second microphone. In this way, when the stylus is not pointed at the speaker, multiple speakers near the electronic device may be speaking freely.
- the electronic device can use the first microphone and the second microphone to jointly collect audio data from the nearby speakers, thereby capturing relatively clear audio data from different speakers.
- collecting audio data through the second microphone includes collecting audio data in the direction of the speaker toward which the stylus is pointed.
- the electronic device can collect audio data in that direction through the second microphone.
- the audio data collected by the electronic device through the second microphone includes audio data from the speaker toward which the stylus is pointed.
- the stylus can be used as a microphone to collect audio data from the speaker.
- the electronic device transmits the collected audio data to another electronic device that is in communication with the electronic device, and the other electronic device plays the audio data.
- the method further includes: receiving a first instruction sent by the stylus; and in response to the first instruction, canceling the display of the first prompt information and continuing audio data collection. In this way, when the electronic device pauses audio data collection, the user can use the stylus to trigger the electronic device to resume audio data collection.
- the method further includes: receiving a second instruction sent by the stylus; and adjusting the volume of the electronic device in response to the second instruction. In this way, the user can adjust the volume of the audio played by the electronic device using the stylus while using the stylus, eliminating the need for the user to switch devices, which is more convenient.
- the method further includes: displaying a call interface in response to the first input; receiving a third instruction sent by the stylus; and ending the call and canceling the display of the call interface in response to the third instruction.
- the user can trigger the electronic device to end a call using the stylus while using the stylus, eliminating the need for the user to switch devices, which is more convenient.
- the method further includes: displaying a recording control in response to the first input, the recording control being used to indicate that the electronic device is capturing audio; receiving a third instruction sent by the stylus; and, in response to the third instruction, ending recording and removing the display of the recording control.
- the method further includes: in response to the first input, sending a fourth instruction to the stylus, the fourth instruction being used to instruct the stylus to detect a state of the stylus; and receiving a first state sent by the stylus, the first state comprising one or more of being held by a user, not held by a user, attached to an electronic device, not attached to an electronic device, facing a speaking party, or not facing a speaking party.
- the electronic device instructs the stylus to detect the state of the stylus via the fourth instruction.
- the electronic device determines a microphone for collecting audio data based on the first state of the stylus.
- the present application provides a call control method for a stylus including a second microphone.
- the method comprises: receiving a fourth instruction from an electronic device, the fourth instruction instructing the stylus to detect its state; transmitting a first state to the electronic device, the first state comprising one or more of being held by a user, not held by a user, attached to the electronic device, not attached to the electronic device, facing a speaker, or not facing a speaker; if the first state indicates that the stylus is held by a user, receiving a fifth instruction from the electronic device; responding to the fifth instruction, collecting audio data via the second microphone; and transmitting the audio data to the electronic device.
- the stylus can detect its state and transmit the state back to the electronic device.
- the electronic device can determine which microphone to use based on the stylus state.
- the electronic device receives the first state indicating that the stylus is held by a user, it instructs the stylus to collect audio data via the fifth instruction.
- the stylus can transmit the collected audio data to the electronic device, which then collects the audio data.
- collecting audio data via the second microphone includes: collecting audio data in the direction of the speaker toward which the stylus is directed, via the second microphone.
- the fifth instruction instructs the stylus to collect audio data in the direction of the speaker toward which the stylus is directed.
- the stylus can transmit the collected audio data to the electronic device, and when the speaker speaks, the audio data collected by the electronic device includes the speaker's audio data.
- the method further includes: detecting a second user input; and in response to the second input, sending a first instruction to the electronic device, wherein the first instruction is used to trigger the electronic device to switch a microphone state, where the microphone state includes a mute state and an unmute state.
- the stylus is used to detect user input and trigger the electronic device to perform a corresponding operation.
- the user can control the electronic device without switching the operating electronic device, making it easier for the user to operate the electronic device from a distance.
- the method further includes: detecting a third input from the user; and in response to the third input, sending a second instruction to the electronic device, wherein the second instruction is used to trigger the electronic device to adjust the volume of the electronic device.
- the user speaks with the stylus, they can use the stylus to control the volume of the audio played by the electronic device, making it convenient for the user to adjust the volume of the electronic device remotely.
- the method further includes: detecting a fourth user input; and in response to the fourth input, sending a third instruction to the electronic device, wherein the third instruction is used to trigger the electronic device to end the call.
- the user can end the call directly using the stylus, without having to click the electronic device while holding the stylus, which is more convenient.
- the invention is applied to a first communication system, wherein the first communication system includes an electronic device and a stylus, the electronic device including a first microphone, and the stylus including a second microphone; the method includes: the electronic device receiving a first input; the electronic device sending a fourth instruction to the stylus in response to the first input, the fourth instruction being used to instruct the stylus to detect a state of the stylus; after the stylus receives the fourth instruction, in response to the fourth instruction, sending a first state to the electronic device; if the first state received by the electronic device indicates that the stylus is being held by a user, sending a fifth instruction to the stylus; after the stylus receives the fifth instruction, in response to the fifth instruction, collecting audio data through the second microphone; if the first state received by the electronic device indicates that the stylus is not being held by the user, collecting audio data through the first microphone.
- the first communication system can provide users with a richer range of audio collection scenarios, facilitating the user to conveniently collect the required audio data.
- the audio data is collected through the first microphone. In this way, the electronic device detects that the stylus is not held by the user and directly collects the audio data through the first microphone.
- the electronic device pauses collecting audio data and displays a first prompt message, where the first prompt message is used to prompt the user to mute the microphone. In this way, the electronic device detects that the stylus is attached to the electronic device and pauses collecting audio data.
- the electronic device sends a sixth instruction to the stylus.
- the stylus responds to the sixth instruction by collecting audio data through the second microphone.
- the stylus then sends the audio data to the electronic device. In this way, the electronic device detects that the stylus is being held by the user and is facing the person speaking, and instructs the stylus to collect audio data.
- the electronic device sends a sixth instruction to the stylus, including: if the first state received by the electronic device indicates that the stylus is being held by the user and is not facing the person speaking, collecting audio data via the first microphone and sending the sixth instruction to the stylus. In this way, the electronic device detects that the stylus is being held by the user and is not facing the person speaking, instructs the stylus to collect audio data, and simultaneously collects audio data itself.
- the stylus pen after receiving the sixth instruction, responds to the sixth instruction by collecting audio data through the second microphone, including collecting audio data in the direction of the speaking person that the stylus pen is pointing at through the second microphone. In this way, the electronic device collects audio data of the speaking person through the stylus pen.
- the method further includes: the stylus receiving a second input; the stylus sending a first instruction to the electronic device in response to the second input; and after the electronic device receives the first instruction, the electronic device cancels the display of the first prompt message and resumes collecting audio data in response to the first instruction.
- the electronic device pauses collecting audio data, the user can trigger the electronic device to resume collecting audio data using the stylus.
- the method further includes: the stylus receiving a third input from the user; the stylus sending a second instruction to the electronic device in response to the third input; and the electronic device adjusting the volume of the electronic device in response to the second instruction after receiving the second instruction.
- the stylus receiving a third input from the user; the stylus sending a second instruction to the electronic device in response to the third input; and the electronic device adjusting the volume of the electronic device in response to the second instruction after receiving the second instruction.
- the method further includes: the electronic device displays a call interface in response to the first input; the stylus receives a fourth input from the user; the stylus sends a third instruction to the electronic device in response to the fourth input; and the electronic device cancels the display of the call interface in response to the third instruction after receiving the third instruction.
- the electronic device collects audio data via a first microphone and/or a second microphone
- the method further includes: receiving a fifth input via the stylus; sending a seventh instruction to the electronic device in response to the fifth input; and upon receiving the seventh instruction, the electronic device, in response to the seventh instruction, displays a first prompt message and pauses audio data collection. In this way, while the electronic device is collecting audio, the user can mute the electronic device using the stylus.
- the content of the first instruction and the seventh instruction are the same.
- the present application provides an electronic device comprising: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer executable programs.
- the electronic device executes any possible implementation method as in the first aspect.
- the present application provides a computer-readable storage medium that stores a computer program.
- the computer program runs on a processor of an electronic device, the electronic device executes any possible implementation method as in the first aspect.
- the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute any possible implementation method in the first aspect.
- the present application provides a stylus pen comprising: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer executable programs.
- the stylus pen executes any possible implementation method as in the second aspect.
- the present application provides a computer-readable storage medium storing a computer program.
- the computer program runs on a processor of a stylus pen, the stylus pen executes any possible implementation method as described in the second aspect.
- the present application provides a computer program product, which, when running on a stylus, enables the stylus to execute any possible implementation method in the second aspect.
- FIG1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
- FIG2 is a schematic diagram of the hardware structure of a stylus provided in an embodiment of the present application.
- FIG3 is a schematic diagram of a communication system 10 provided in an embodiment of the present application.
- FIG4 is a flow chart of a call control method according to an embodiment of the present application.
- FIG5 is a flow chart of another call control method provided in an embodiment of the present application.
- Figures 6A-6E are a set of scenario diagrams provided in an embodiment of the present application.
- first and second are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, “plurality” means two or more.
- the electronic device 100 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and/or a smart city device.
- PDA personal digital assistant
- AR augmented reality
- VR virtual reality
- AI artificial intelligence
- wearable device an in-vehicle device
- smart home device a smart home device and/or a smart city device.
- the electronic device 100 may include, but is not limited to, a processor 101, a memory 102, a communication module 103, a power supply 104, a touch screen 105, one or more microphones 106, one or more speakers 107, and an audio module 108, etc.
- the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100.
- the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently.
- the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
- the processor 101 may include one or more processing units.
- the processor 101 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU).
- AP application processor
- GPU graphics processing unit
- ISP image signal processor
- controller a memory
- DSP digital signal processor
- DSP digital signal processor
- NPU neural-network processing unit
- the different processing units may be independent devices or integrated into one or more processors.
- the controller may be the nerve center and command center of the electronic device 100.
- the controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
- Processor 101 may also include a memory for storing instructions and data.
- the memory in processor 101 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 101. If processor 101 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 101's latency, and thus improves system efficiency.
- the processor 101 may include one or more interfaces.
- the interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface.
- I2C inter-integrated circuit
- I2S inter-integrated circuit sound
- PCM pulse code modulation
- UART universal asynchronous receiver/transmitter
- MIPI mobile industry processor interface
- GPIO general-purpose input/output
- SIM subscriber identity module
- USB universal serial bus
- the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100.
- the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
- Memory 102 is coupled to processor 101 and is used to store various software programs and/or multiple sets of instructions.
- memory 102 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
- Memory 102 may store an operating system, such as embedded operating systems such as uCOS, VxWorks, and RTLinux.
- Memory 102 may also store a communication program that can be used to communicate with stylus 200 or other devices.
- the communication module 103 can be used to communicate with other electronic devices (eg, the stylus 200 ).
- the communication module 103 can be used to receive audio data sent by the stylus 200 .
- the power supply 104 can supply power to the electronic device 100.
- the power supply 104 can be a rechargeable lithium battery or a replaceable standard battery, etc.
- the power supply 104 can provide power required by components such as the processor 101, the memory 102, the communication module 103, and the touch screen 105.
- the touch screen 105 may include a display screen and a touch sensor.
- the display screen is used to display images, videos, etc.
- the display screen includes a display panel.
- the display panel may be a liquid crystal display (LCD).
- the display panel may also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, or a quantum dot light-emitting diode (QLED).
- the electronic device 100 may include one or N display screens, where N is a positive integer greater than 1.
- the touch sensor also known as a "touch panel,” may be used to detect movement of the stylus 200 on the touch screen 105.
- the touch sensor may transmit the detected movement operation to the application processor to determine a movement trace of the stylus pen 200 , so that the application processor may provide a visual output related to the touch operation through the display screen.
- the electronic device 100 can implement audio functions through the microphone 106, the speaker 107, the audio module 108 and the processor 101. Among them, one or more microphones 106 can be used to collect audio data. One or more speakers 107 can be used to play audio data.
- the audio module 108 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.
- the audio module 108 can also be used to encode and decode audio signals.
- the audio module 108 can be provided in the processor 101, or some functional modules of the audio module 108 can be provided in the processor 101.
- Microphone 106 also known as a "microphone” or “microphone,” is used to convert sound signals into electrical signals. When making a call, sending a voice message, or recording a voice message, a user can place their mouth close to microphone 106 to input the sound signal into microphone 106 .
- Electronic device 100 can be equipped with two microphones 106 , which not only collect sound signals but also implement noise reduction. In some examples, electronic device 100 can also be equipped with three, four, or more microphones 106 to collect sound signals, reduce noise, identify sound sources, implement directional recording, and more.
- the speaker 107 also called a “speaker”, is used to convert audio electrical signals into sound signals.
- the electronic device 100 can listen to music, listen to hands-free calls, listen to conference calls, etc. through the speaker 107 .
- the stylus pen 200 may include but is not limited to a processor 201 , a memory 202 , a sensor module 203 , one or more microphones 204 , a communication module 205 , a power supply 206 , and the like.
- the processor 201 can be used to read and execute computer-readable instructions.
- the processor 201 may primarily include a controller, an arithmetic unit (ALU), and registers.
- the controller is primarily responsible for decoding instructions and issuing control signals for operations corresponding to the instructions.
- the ALU is primarily responsible for storing register operands and intermediate operation results temporarily stored during instruction execution.
- the hardware architecture of the processor 201 may be an application-specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, or an NP architecture, among others.
- the processor 201 can be used to parse signals received by the communication module 205.
- the processor 201 can respond based on the parsing results and perform corresponding operations. For example, the processor 201 can collect audio data through the microphone 204 based on the signal sent by the electronic device 100, etc.
- the processor 201 can also be used to notify the communication module 205 to send signals to other electronic devices. For example, the processor 201 can send audio data collected by the microphone 204 to the electronic device 100 via the communication module 205, etc.
- the memory 202 is coupled to the processor 201 and is used to store various software programs and/or multiple sets of instructions.
- the memory 202 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
- the memory 202 may store an operating system, such as an embedded operating system such as uCOS, VxWorks, or RTLinux.
- the memory 202 may also store a communication program that can be used to communicate with the electronic device 100 or other devices.
- the sensor module 203 may include, but is not limited to, an ultrasonic sensor 203A (not shown), a pressure sensor 203B (not shown), etc.
- the stylus 200 can determine whether the user is holding the stylus 200 through the sensor module 203, and the stylus 200 can also recognize the user's gestures, etc. through the sensor module 203.
- the stylus 200 can use an ultrasonic sensor 203A to identify whether the user is holding the stylus 200.
- the ultrasonic sensor 203A can be located on the body of the stylus 200 and can transmit ultrasonic waves and receive ultrasonic waves reflected by obstacles. Based on the received ultrasonic waves, the stylus 200 can detect whether the ultrasonic sensor 203A is blocked. When the ultrasonic sensor 203A is blocked, the ultrasonic waves emitted by the ultrasonic sensor 203A are reflected, and the ultrasonic sensor 203A receives the reflected ultrasonic waves. Therefore, the energy of the ultrasonic waves received by the blocked ultrasonic sensor 203A is greater than the energy of the ultrasonic waves received by the unblocked ultrasonic sensor 203A.
- the stylus 200 can determine that the user is holding the stylus 200 when it detects that the ultrasonic sensor 203A located near the tip is blocked. The stylus 200 can also determine that the user is not holding the stylus 200 when it detects that the ultrasonic sensor 203A located near the tip is not blocked.
- the stylus 200 can also recognize user gestures using the ultrasonic sensor 203A.
- the stylus 200 can identify single-click input, double-click input, long-press input, and so on based on the duration that the ultrasonic sensor 203A is blocked by the user.
- the stylus 200 may include multiple ultrasonic sensors 203A located at different locations on the stylus 200. The stylus 200 can identify upward swipe input, downward swipe input, and so on based on the order in which the different ultrasonic sensors 203A are blocked.
- the stylus 200 can identify whether the user is holding the stylus 200 through the pressure sensor 203B.
- the pressure sensor 203B can be located on the body of the stylus 200. The pressure sensor 203B can detect whether the user is pressing the pressure sensor 203B, that is, whether the user is holding the stylus 200, based on the pressure value applied to the pressure sensor 203B.
- the stylus 200 can also recognize user gestures through the pressure sensor 203B, such as single click, double click, long press, etc.
- the pressure sensor 203B can be located at the end of the stylus 200 (also known as the top of the stylus 200) and can be used to detect whether the user inputs to the top of the stylus 200.
- pressure sensor 203B can be provided on the tip of stylus 200. Pressure sensor 203B can be used to detect the pressure felt by the tip. Pressure sensor 203B can send the detected pressure data to processor 201. Processor 201 can control communication module 205 to send different signals based on the pressure data, thereby instructing electronic device 100 to display handwriting of different thicknesses at the location on the touch screen where the tip of stylus 200 passes.
- the stylus 200 is not limited to the ultrasonic sensor 203A.
- the stylus 200 may include a speaker, which transmits ultrasonic waves and receives them via the microphone 204 to detect whether the user is holding the stylus 200 and recognize the user's gestures.
- the stylus 200 may include a touch sensor, which may detect whether the user is holding the stylus 200 and recognize the user's gestures on the stylus 200. This is not limited in the present embodiment.
- the stylus 200 can also detect whether it is facing a designated object.
- the designated object can be a person speaking near the stylus 200.
- the stylus 200 can use near-far field recognition technology to determine the relative position of the speaking object and the stylus 200.
- the stylus 200 can collect sound signals using multiple microphones 204 and, based on the time difference between different microphones capturing the same sound signal, determine the directions of different sound sources relative to the stylus 200, thereby determining the directions of different speaking objects relative to the stylus 200.
- the stylus 200 can use the ultrasonic sensor 203A to identify the outlines of nearby objects and, using an algorithm, determine whether the object outlines belong to the speaking object.
- the stylus 200 can use the ultrasonic sensor 203A to determine the direction of a person relative to the stylus 200, and so on.
- the stylus 200 can use the multiple microphones 204 and the ultrasonic sensor 203A to determine whether it is facing a designated object.
- the stylus 200 may determine the directions of different sound sources relative to the stylus 200 through multiple microphones, and then determine whether there are any obstructions in the directions of different sound sources through the ultrasonic sensor 203A.
- the stylus 200 can obtain the posture of the stylus 200 through a gyroscope or an acceleration sensor.
- the stylus 200 can detect whether the stylus 200 is facing a certain speaker based on the posture of the stylus 200 and the relative direction between the speaker and the stylus 200.
- the stylus 200 when the stylus 200 is pointed toward a designated object, audio data in the direction of the designated object can be collected. Thus, when the designated object makes a sound, the stylus 200 can collect audio data including the sound signal of the stylus 200 pointing toward the designated object. In a scenario where a single person is speaking, the stylus 200 can thus collect the clear speech of the person being pointed at by the stylus 200.
- the stylus 200 can use directional sound pickup technology to collect audio data in the direction of a designated object that the stylus 200 is pointing at.
- the stylus 200 can adjust the recording range of the microphone 204 to collect audio data in the direction of the designated object that the stylus 200 is pointing at.
- the stylus 200 can identify the audio data of the designated object that the stylus 200 is pointing at, and after collecting audio data through the microphone 204, the stylus 200 can filter out the audio data of the designated object that the stylus 200 is pointing at from the collected audio data.
- the stylus 200 can detect the distance of the designated object relative to the stylus 200 and set the recording range to a radius centered on the stylus 200 and the distance of the speaking object that the stylus 200 is pointing at relative to the stylus 200. This allows the stylus 200 to collect audio data of the designated object when the designated object speaks.
- the one or more microphones 204 can be used to collect audio data.
- the microphone 204 also known as a "microphone” or “microphone”
- the user can speak by putting their mouth close to the microphone 204 to input the sound signal into the microphone 204.
- the electronic device 100 can be provided with at least one microphone 204.
- the electronic device 100 can be provided with two microphones 204, which can not only collect sound signals but also realize noise reduction function.
- the electronic device 100 can also be provided with three, four or more microphones 204 to realize the collection of sound signals, noise reduction, identification of sound sources, and directional recording functions, etc.
- the communication module 205 can be used to communicate with the electronic device 100. Specifically, the communication module 205 can transmit audio data collected by one or more microphones 204 to the electronic device 100.
- the communication module 205 can also include a transmitter.
- the transmitter is located at the tip of the stylus 200 and can be used to output a signal that can be detected by the touch screen of the electronic device 100.
- the electronic device 100 can determine the position of the tip of the stylus 200 on the touch screen of the electronic device 100 based on the signal transmitted by the transmitter detected by the touch screen.
- the electronic device 100 can also detect the tilt angle and tilt direction of the tip of the stylus 200 based on the signal transmitted by the transmitter of the stylus 200.
- the power supply 206 can provide power to the stylus 200.
- the power supply 206 can be a rechargeable lithium battery or a replaceable standard battery.
- the power supply 206 can provide power required by components of the stylus 200, such as the processor 201, the memory 202, the sensor module 203, the one or more microphones 204, and the communication module 205.
- the stylus pen 200 may further include a speaker (not shown in the figure), and the stylus pen 200 may play audio data through the speaker.
- the communication system 10 may include, but is not limited to, an electronic device 100 and a stylus 200 .
- the electronic device 100 establishes a communication connection with the stylus 200 .
- the communication connection may be a wireless connection, such as a wireless fidelity (Wi-Fi) connection, a Bluetooth connection, an infrared connection, a near-field communication (NFC) connection, a ZigBee connection, or a connection using a mobile network using 2G, 3G, 4G, 5G, or subsequent standard protocols.
- the Bluetooth connection may support the Bluetooth Low Energy (BLE) protocol or the Classic Bluetooth (also known as Basic Rate/Enhanced Data Rate (BR/EDR) technology) protocol.
- the communication connection may also be a wired connection.
- the stylus 200 and the electronic device 100 may be connected via a data cable, and communication data may be transmitted via the data cable.
- the electronic device 100 can detect input from the stylus 200 on the touch screen and perform operations corresponding to the input from the stylus 200. For example, in response to input from the stylus 200 on an icon, the electronic device 100 can display the interface corresponding to the icon. For another example, in response to movement input from the stylus 200 on the touch screen, the electronic device 100 can display the movement trace of the stylus 200, and so on. In this way, the user can control the electronic device 100 using the stylus 200.
- the stylus 200 includes one or more microphones 204, which can be used to collect audio data.
- the electronic device 100 includes one or more microphones 106, which can also be used to collect audio data.
- the electronic device 100 can detect the status of the stylus 200 during a call. Based on the status of the stylus 200 , the electronic device 100 can determine whether to collect audio data through the microphone 204 and/or the microphone 106 .
- the stylus 200 can be attached to the side of the electronic device 100.
- the stylus 200 can include a magnetic attachment device (e.g., a magnet), and the stylus 200 can be attached to the electronic device 100 via the magnetic attachment device.
- the electronic device 100 and/or the stylus 200 can detect whether the stylus 200 is attached to the electronic device 100.
- the electronic device 100 and/or the stylus 200 can include a magnetometer, and the magnetometer can be used to detect whether the stylus 200 is attached to the electronic device 100.
- the electronic device 100 can charge the stylus 200 using wireless charging technology when the stylus 200 is attached to the side of the electronic device 100.
- An embodiment of the present application provides a call control method.
- the electronic device 100 After the electronic device 100 receives the user's input, it can detect the status of the stylus 200 in response to the input.
- the electronic device 100 can determine whether to use the microphone of the electronic device 100 and/or the microphone of the stylus 200 to collect audio data according to the status of the stylus 200.
- the status of the stylus 200 can indicate whether the stylus 200 is held by the user and whether the stylus 200 is facing a designated object.
- the designated object is the speaking object near the stylus 200. In this way, the electronic device 100 can be combined with the stylus 200 to more flexibly collect audio data of different speaking objects in a call scenario, so that the electronic device 100 can obtain clearer audio data.
- the electronic device 100 may use the microphone of the electronic device 100 to collect audio data when it detects that the stylus 200 is not being held by the user.
- the electronic device 100 may detect whether the microphone of the stylus 200 is facing a designated object when it detects that the stylus 200 is being held by the user.
- the electronic device 100 may use the microphone of the stylus 200 to collect audio data when it detects that the microphone of the stylus 200 is facing a designated object.
- the electronic device 100 may use both the microphone of the electronic device 100 and the microphone of the stylus 200 to collect audio data when it detects that the microphone of the stylus 200 is not facing the designated object.
- the distance between the stylus 200 and the user's vocalization site is typically smaller than the distance between the electronic device 100 and the user's vocalization site.
- the electronic device 100 can collect audio data using the microphone of the stylus 200, enabling closer and clearer audio signals.
- the electronic device 100 can collect audio data using its own microphone.
- the electronic device 100 can collect audio data from the designated object using the microphone of the stylus 200, allowing the electronic device 100 to obtain clearer speech from the designated object.
- the electronic device 100 uses both its own microphone and the microphone of the stylus 200 to collect nearby audio data, enabling hands-free calling.
- the electronic device 100 can use the stylus 200 to implement audio collection for a variety of call scenarios, providing users with a more intelligent and convenient calling experience.
- the electronic device 100 can send the audio data to the device communicating with the electronic device 100.
- the device communicating with the electronic device 100 can play the audio data.
- the call control method provided in the embodiment of the present application includes the following steps:
- the electronic device 100 receives an input to start a call.
- the electronic device 100 may perform steps S402 to S406 multiple times during the call.
- the input for starting a call may be an input for making/answering a call, an input for joining a conference call (also known as joining a conference), an input for making/answering a video call, an input for making/answering a voice call, and the like.
- performing steps S402 to S406 multiple times during a call can be understood as the electronic device 100 being able to detect the state of the stylus 200 in real time during the call and setting a microphone for collecting audio data based on the state of the stylus 200.
- the electronic device 100 detecting the state of the stylus 200 in real time during the call can be understood as the electronic device 100 detecting the state of the stylus 200 at preset intervals (e.g., 10ms) and setting a microphone for collecting audio data based on the state of the stylus 200, which is not limited in this embodiment of the present application.
- the electronic device 100 detects whether the stylus pen 200 is held by the user.
- the electronic device 100 can detect whether the stylus pen 200 is held by the user. When the electronic device 100 detects that the stylus pen 200 is not held by the user, it can execute step S403. When the electronic device 100 detects that the stylus pen 200 is held by the user, it can execute step S404.
- the electronic device 100 may acquire state information from the stylus pen 200 , and based on the acquired state information, detect whether the stylus pen 200 is held by the user.
- the status information may indicate whether the stylus 200 is being held by the user and whether the stylus 200 is facing a designated object.
- the stylus 200 may detect whether the stylus 200 is being held by the user using the ultrasonic sensor 203A and/or the pressure sensor 203B.
- the stylus 200 may also detect whether the stylus 200 is facing a designated object using the ultrasonic sensor 203A or the microphone 204.
- FIG2 please refer to the embodiment shown in FIG2 , which will not be further described here.
- the state information may include sensor data acquired by the sensor module 203 of the stylus 200.
- the state information may include ultrasonic data received by the ultrasonic sensor 203A, or pressure data detected by the pressure sensor 203B.
- the ultrasonic data or pressure data may be used to indicate whether the stylus 200 is being held by the user.
- the state information may also include ultrasonic data received by the ultrasonic sensor 203A, or audio data received by the microphone 204.
- the ultrasonic data or audio data may be used to indicate whether the stylus 200 is facing a designated object.
- the electronic device 100 may send an instruction 41 to the stylus 200, and the stylus 200 may obtain status information in response to the instruction 41 and send the status information to the electronic device 100.
- the instruction 41 may be used to instruct the stylus 200 to start a call with the electronic device 100, or the instruction 41 may be used to instruct the stylus 200 to obtain status information of the stylus 200 and send the status information to the electronic device 100.
- the electronic device 100 may detect whether the electronic device 100 has established a communication connection with the stylus 200.
- the electronic device 100 may execute steps S402 to S406 upon detecting that the electronic device 100 has established a communication connection with the stylus 200.
- the electronic device 100 may collect audio data through the microphone of the electronic device 100 upon detecting that the electronic device 100 has not established a communication connection with the stylus 200.
- the electronic device 100 stops executing steps S402 to S406.
- the electronic device 100 collects audio data through the microphone of the electronic device 100 .
- the electronic device 100 When the electronic device 100 detects that the stylus 200 is not held by the user, it can collect audio data through the microphone of the electronic device 100. In this way, the electronic device 100 can collect audio data from multiple nearby speakers, allowing multiple speakers to participate in the call at the same time, achieving a hands-free call effect.
- the electronic device 100 detects whether the stylus pen 200 is facing a designated object.
- the electronic device 100 When the electronic device 100 detects that the stylus 200 is held by the user, it can detect whether the stylus 200 is facing the designated object. When the electronic device 100 detects that the stylus 200 is facing the designated object, it can execute step S405. When the electronic device 100 detects that the stylus 200 is not facing the designated object, it can execute step S406.
- step S403 is executed.
- step S405 is executed.
- step S405 is executed.
- step S406 is executed. In this way, the electronic device 100 can directly determine the microphone to be used according to the status information.
- the electronic device 100 collects audio data through the microphone of the stylus 200 .
- the electronic device 100 When the electronic device 100 detects that the stylus 200 is pointing toward a designated object, it can collect audio data through the microphone of the stylus 200. In this way, when the stylus 200 is pointing toward the designated object, it is more likely that the distance between the microphone of the stylus 200 and the designated object is closer than the distance between the microphone of the electronic device 100 and the designated object. In this scenario, the stylus 200 can function as a microphone, making it easier for different designated objects to speak.
- the electronic device 100 can use the microphone of the stylus 200 to collect audio data in the direction of the designated object that the stylus 200 is pointing at.
- the electronic device 100 collects audio data in the direction of the designated object that the stylus 200 is pointing at, which can reduce the interference of the voices of other speakers in the surrounding directions when the designated object that the stylus 200 is pointing at speaks.
- the electronic device 100 collects audio data through the microphone of the electronic device 100 and the microphone of the stylus 200 .
- the electronic device 100 When the electronic device 100 detects that the stylus 200 is not pointing toward a designated object, it can collect audio data through the microphones of the electronic device 100 and the stylus 200. This allows the electronic device 100 to collect clearer audio data through the microphones of the electronic device 100 and the stylus 200. Furthermore, when the stylus 200 is not pointing toward a designated object, it can be considered a scene where multiple people are speaking. The electronic device 100 can collect audio data from all nearby speakers to avoid missing any information.
- the electronic device 100 can send the audio data to other electronic devices that are communicating with the electronic device 100.
- the electronic device 100 may instruct the stylus 200 to obtain status information. After obtaining the status information of the stylus 200, the electronic device 100 may detect whether the stylus 200 is being held by the user and whether the stylus 200 is facing a designated object based on the status information. When the status information indicates that the stylus 200 is not being held by the user, the electronic device 100 collects audio data through the microphone of the electronic device 100. When the status information indicates that the stylus 200 is being held by the user and facing a designated object, the electronic device 100 instructs the stylus 200 to collect audio data. The stylus 200 may send the collected audio data to the electronic device 100. When the status information indicates that the stylus 200 is not being held by the user and is not facing a designated object, the electronic device 100 collects audio data through the microphone of the electronic device 100 and instructs the stylus 200 to collect audio data.
- the electronic device 100 may use the microphone of the electronic device 100 to collect audio data when it detects that the stylus 200 is not being held by the user.
- the electronic device 100 may use the microphone of the stylus 200 to collect audio data when it detects that the stylus 200 is being held by the user. In this way, the electronic device 100 can directly select the corresponding microphone based on whether the stylus 200 is being held by the user.
- steps S402 to S406 may be performed multiple times to collect audio data.
- the call control method can be used in a variety of audio collection scenarios to provide users with different audio collection experiences.
- the electronic device 100 may use the microphone of the electronic device 100 to collect audio data when it detects that the stylus 200 is attached to the electronic device 100.
- the electronic device 100 may use the microphone of the stylus 200 to collect audio data when it detects that the stylus 200 is held by the user.
- the electronic device 100 may pause collecting audio data and display a mute prompt message when it detects that the stylus 200 is not attached to the electronic device 100 and is not held by the user.
- the mute prompt message can be used to remind the user that the microphone of the electronic device 100 has been turned off.
- the distance between the stylus 200 and the user's vocal part is usually smaller than the distance between the electronic device 100 and the user's vocal part.
- the electronic device 100 collects audio data through the microphone of the stylus 200 and can collect clearer sound signals at a closer distance.
- the electronic device 100 can collect audio data through its own microphone.
- the electronic device 100 can collect user audio during a call through the microphone of the electronic device 100 and the microphone of the stylus 200.
- the call control method provided in the embodiment of the present application includes the following steps:
- the electronic device 100 receives an input for starting a call.
- the electronic device 100 detects whether the stylus pen 200 is adsorbed onto the electronic device 100 .
- the electronic device 100 can detect whether the stylus 200 is attached to the electronic device 100. When the electronic device 100 detects that the stylus 200 is attached to the electronic device 100, it can execute step S503. When the electronic device 100 detects that the stylus 200 is not attached to the electronic device 100, it can execute step S504. The description of how the electronic device 100 detects whether the stylus 200 is attached to the electronic device 100 can be found in the embodiment shown in FIG. 3 and will not be repeated here. The electronic device 100 can execute steps S502 to S506 multiple times during a call.
- the electronic device 100 collects audio data through the microphone of the electronic device 100 .
- the electronic device 100 may collect audio data through the microphone of the electronic device 100 .
- the electronic device 100 detects whether the stylus pen 200 is held by the user.
- the electronic device 100 When the electronic device 100 detects that the stylus 200 is not attached to the electronic device 100, it can detect whether the stylus 200 is being held by the user. Upon detecting that the stylus 200 is being held by the user, the electronic device 100 can execute step S505. Upon detecting that the stylus 200 is not being held by the user, the electronic device 100 can execute step S506. Specifically, a description of how the electronic device 100 detects whether the stylus 200 is being held by the user can be found in the embodiment shown in FIG. 4 and will not be repeated here.
- the electronic device 100 collects audio data through the microphone of the stylus pen 200 .
- the electronic device 100 detects that the stylus pen 200 is held by the user, and collects audio data through the microphone of the stylus pen 200 .
- the electronic device 100 can detect whether the stylus 200 is facing a designated object when the user is holding the stylus 200. When the electronic device 100 detects that the stylus 200 is facing the designated object, it can use the microphone of the stylus 200 to collect audio data in the direction of the designated object. When the electronic device 100 detects that the stylus 200 is not facing the designated object, it can use the microphone of the stylus 200 to collect nearby audio data, or it can use both the microphone of the electronic device 100 and the microphone of the stylus 200 to collect nearby audio data.
- the electronic device 100 pauses collecting audio data and displays a mute prompt message, which can be used to prompt the user to mute the microphone.
- the electronic device 100 When the electronic device 100 detects that the stylus 200 is not being held by the user and is not attached to the electronic device 100, it pauses audio data collection and displays a mute prompt.
- the mute prompt may include, but is not limited to, text, voice, image, animation, and the like.
- the mute prompt may include the text message "Current microphone muted.” This allows the user to mute the electronic device 100 by putting the stylus 200 aside, for example, by placing it on a table. This allows the user to avoid being heard by the other party when they do not wish to speak.
- the electronic device 100 collects audio data through the microphone of the stylus 200 , if the electronic device 100 detects that the stylus 200 is not held by the user and is not attached to the electronic device 100 , the stylus 200 is instructed to stop collecting audio data.
- the method is not limited to first detecting whether the stylus 200 is attached to the electronic device 100, and then detecting whether the stylus 200 is held by the user when it is detected that the stylus 200 is not attached to the electronic device 100.
- the electronic device 100 can instruct the stylus to send status information including information indicating whether the stylus 200 is held by the user and whether the stylus 200 is attached to the electronic device to the electronic device 100.
- step S503 is executed.
- step S505 is executed.
- step S506 is executed.
- the electronic device 100 can directly determine the microphone to be used based on the status information.
- the status information may include one or more of whether the stylus 200 is being held by the user, whether the stylus 200 is attached to the electronic device, and whether the stylus 200 is facing a designated object.
- the electronic device 100 may determine the microphone to use based on the status information. For details, please refer to the above embodiment and will not be repeated here.
- the electronic device 100 when the electronic device 100 is in recording, receives voice input, etc., it can also collect audio data by executing steps S502 to S506 multiple times.
- the electronic device 100 may, after receiving an input to start a call, detect whether the stylus 200 is within a preset range and is not being held by the user. When the electronic device 100 detects that the stylus 200 is within the preset range and is not being held by the user, it may collect audio data through the microphone of the electronic device 100. When the electronic device 100 detects that the stylus 200 is within the preset range and is being held by the user, it may collect audio data through the microphone of the stylus 200. When the electronic device 100 detects that the stylus 200 is outside the preset range, it may pause collecting audio data and display a mute prompt message.
- the preset range may be a range that includes the electronic device 100 and is less than a preset distance (e.g., 2 cm) from the edge of the electronic device 100.
- the electronic device 100 may detect the distance between the stylus 200 and the edge of the electronic device 100 using the ultrasonic sensor 203A of the stylus 200. In this way, when the stylus pen 200 cannot be adsorbed on the electronic device 100, the user can also place the stylus pen 200 within a preset range of the electronic device 100, for example, place the stylus pen 200 above the electronic device 100, so that the user can switch between different audio collection modes.
- the electronic device 100 may detect whether the stylus 200 is being held by the user after receiving an input to start a call.
- step S505 is executed.
- the electronic device 100 may collect audio data through the microphone of the electronic device 100, or pause audio data collection and display a mute prompt message. In this way, the user can change the method of collecting audio data by whether or not the stylus 200 is being held.
- the electronic device 100 may detect whether a communication connection has been established between the electronic device 100 and the stylus 200 after receiving an input to start a call. Upon detecting that a communication connection has not been established between the electronic device 100 and the stylus 200, the electronic device 100 may collect audio data through the microphone of the electronic device 100. Upon detecting that a communication connection has been established between the electronic device 100 and the stylus 200, the electronic device 100 may detect whether the stylus 200 is being held by the user. For details, please refer to the above embodiments and will not be repeated here.
- the electronic device 100 may use the microphone of the electronic device 100 and the microphone of the stylus pen 200 to collect audio data.
- the electronic device 100 can detect the status of the stylus 200 in real time during a call and set a microphone for collecting audio data based on the status of the stylus 200. It should be noted that the electronic device 100 detecting the status of the stylus 200 in real time during a call can be understood as the electronic device 100 detecting the status of the stylus 200 at preset intervals (for example, 10ms) and setting a microphone for collecting audio data based on the status of the stylus 200, which is not limited in this embodiment of the present application.
- the electronic device 100 detects that the call is ended, the electronic device 100 stops detecting the status of the stylus 200 and collecting audio data.
- the electronic device 100 displays a desktop 600.
- the desktop 600 may include multiple application icons, such as a conference application icon 601, a dialing application icon, and the like.
- the conference application icon 601 may be used to trigger the electronic device 100 to display the interface of the conference application (e.g., the conference interface 610 shown in FIG6B ).
- the conference application may be used to initiate/access a conference.
- the dialing application icon may be used to trigger the electronic device 100 to display a call interface, which may be used to make/answer a call.
- a status bar 603 may also be displayed above the desktop 600.
- the status bar 603 may display a Bluetooth icon 603A.
- the Bluetooth icon 603A may be used to indicate that the electronic device 100 has established a Bluetooth connection with the stylus 200. It should be noted that the connection is not limited to the Bluetooth icon 603A.
- the electronic device 100 and the stylus 200 establish a communication connection via a communication technology other than Bluetooth, the electronic device 100 may display icons corresponding to other communication connections. This embodiment of the present application is not limited to this.
- the electronic device 100 can respond to the input and display the conference interface 610 as shown in Figure 6B.
- the conference interface 610 includes a "Join Conference" control 611.
- the "Join Conference" control 611 can be used to trigger the electronic device 100 to establish a call connection with other electronic devices, so that the user can access the conference.
- the conference interface 610 can also include a conference ID column and a participant column. Among them, the conference ID column can be used to enter the conference ID, so that the electronic device 100 can access the conference indicated by the conference ID. Among them, the participant column can be used to enter the name of the participant, so that the participant can determine the person who is currently speaking based on the participant name.
- the electronic device 100 may detect the state of the stylus 200 in response to the input. Upon detecting that the stylus 200 is held by the user and is directed toward the designated object A, the electronic device 100 may collect audio data of the designated object A through the microphone 204 and display the meeting interface 620 shown in FIG6C .
- the conference interface 620 can be used by users to participate in online meetings.
- the conference interface 620 may include a microphone control 621.
- the microphone control 621 can be used to indicate that the microphone is not muted.
- the microphone control 621 can also be used to trigger the electronic device 100 to mute. When the microphone is muted, the electronic device 100 does not perform the operation of collecting audio data. When the microphone is not muted, the electronic device 100 performs the operation of collecting audio data based on the status of the stylus 200.
- the microphone control 621 indicates that the microphone is not muted.
- the conference interface 620 may also include a list of participants, the name of the speaker, and a speaker control. The list of participants can be used to remind the user of the members participating in the online meeting. The name of the speaker can be used to remind the user who is speaking.
- the speaker control can be used to indicate whether the speaker is turned off.
- the speaker control can also be used to trigger the electronic device 100 to turn the speaker off/on.
- the electronic device 100 and the stylus 200 are in the scene shown in Figure 6C, if the user points the stylus 200 at the designated object B, the electronic device 100 can detect that the stylus 200 is held by the user and is facing the designated object B, and collect audio data of the designated object B through the microphone 204.
- the electronic device 100 may detect the state of the stylus 200 in response to the input.
- the electronic device 100 may collect audio data through the microphone 106 and the microphone 204, as shown in FIG6D .
- the electronic device 100 may detect the state of the stylus 200 in response to the input.
- the electronic device 100 may detect that the stylus 200 is not being held by the user, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG6C and the user puts the stylus 200 down, the electronic device 100 may detect that the stylus 200 is not being held by the user, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG6D and the user puts the stylus 200 down, the electronic device 100 may collect audio data through the microphone 106, as shown in FIG6E .
- the electronic device 100 may collect audio data in the direction of designated object A when it detects that the user is holding the stylus 200 and that the stylus 200 is pointing toward designated object A.
- the electronic device 100 may also collect audio data in the direction of designated object B when it detects that the user is holding the stylus 200 and that the stylus 200 is pointing toward designated object B. In this way, when the stylus 200 is pointed toward designated object A, it can collect audio data in that direction.
- designated object A makes a sound
- the audio data collected by the stylus 200 includes audio data from designated object A.
- the stylus 200 is pointed toward designated object B, it can collect audio data from that direction.
- the audio data collected by the stylus 200 includes audio data from designated object B. In this way, even when the designated object is farther away from the electronic device 100, the electronic device 100 can capture the designated object's sound more clearly through the microphone of the stylus 200.
- the electronic device 100 After detecting input from the stylus 200 to the "Join Meeting" control 611 shown in FIG. 6B , the electronic device 100 can detect the status of the stylus 200 in response to the input. Upon detecting that the stylus 200 is attached to the electronic device 100, the electronic device 100 can collect audio data via the microphone 106, as shown in FIG.
- the inputs to the conference interface 620 shown in FIG. 7A can be found in the above-described embodiment and will not be further described here.
- the microphone control 621 indicates that the microphone is not muted.
- the electronic device 100 can detect the state of the stylus 200 in response to the input.
- the electronic device 100 detects that the stylus 200 is attached to the electronic device 100, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG. 7A , and the user picks up the stylus 200, the electronic device 100 can detect that the stylus 200 is being held by the user, and collect audio data through the microphone 204, as shown in FIG.
- the microphone control 621 indicates that the microphone is not muted.
- the electronic device 100 may detect the status of the stylus 200 in response to the input.
- the electronic device 100 detects that the stylus 200 is not attached to the electronic device 100 and is not being held, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG7A
- the electronic device 100 may detect that the stylus 200 is not attached to the electronic device 100 and is not being held by the user, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG7B
- the electronic device 100 may detect that the stylus 200 is not attached to the electronic device 100 and is not being held by the user, the electronic device 100 may pause collecting audio data and mute the electronic device 100, as shown in FIG7C .
- the electronic device 100 displays a microphone control 701, which can indicate that the microphone is in a mu
- the electronic device 100 establishes a communication connection with the stylus 200.
- the stylus 200 can detect the user's designated input and, through the communication connection, instruct the electronic device 100 to perform a designated operation corresponding to the designated input.
- the user can remotely control the electronic device 100 through the stylus 200 to perform a designated operation while using the stylus 200, without the user having to operate the electronic device 100 through the touch screen of the electronic device 100.
- the designated input may include one or more of designated input 1, designated input 2, and designated input 3.
- Designated input 1, designated input 2, and designated input 3 are different.
- Designated input 1 can be used to trigger the electronic device 100 to mute or unmute.
- Designated input 2 can be used to trigger the electronic device 100 to end a call.
- Designated input 3 can be used to trigger the electronic device 100 to adjust the volume. In this way, during a call, the user can remotely control the electronic device 100 through the stylus 200, which is convenient for user operation.
- the tip portion of the stylus 200 includes a pressure sensor.
- the pressure sensor can be used to detect user input to the tip portion of the stylus 200.
- the electronic device 100 collects audio data through the microphone of the electronic device 100 and/or the microphone of the stylus 200.
- the stylus 200 can instruct the electronic device 100 to mute after receiving the user input to the tip portion of the stylus 200 (for example, a single click).
- the electronic device 100 can pause collecting audio data after receiving the instruction from the stylus 200.
- the stylus 200 can instruct the electronic device 100 to unmute after receiving the user input to the tip portion of the stylus 200 (for example, a single click).
- the electronic device 100 can determine the microphone that collects audio data based on the state of the stylus 200 after receiving the instruction from the stylus 200 and collect audio data through the determined microphone. In this way, when the user holds the stylus 200, the user can control the electronic device 100 to mute/unmute through the stylus 200, without the user having to operate the icon of the electronic device 100 for controlling the electronic device 100 to mute/unmute the electronic device 100, so that the user can control the electronic device 100 to mute/unmute more conveniently.
- the conference interface 620 includes a microphone control 701 , which can indicate that the electronic device 100 is muted.
- the stylus 200 can, in response to the input, instruct the electronic device 100 to unmute.
- the electronic device 100 can detect that the stylus 200 is being held by the user.
- the electronic device 100 can collect the user's audio data via the microphone 204 and display the conference interface 620 shown in FIG. 7B .
- the electronic device 100 can collect audio data via the microphone 106 and the microphone 204 and display the conference interface 620 shown in FIG. 6D .
- the electronic device 100 can collect the user's audio data through the microphone 204 and display the conference interface 620 shown in Figure 7B after receiving the instruction that the stylus 200 is unmuted, or collect audio data through the microphone 106 and the microphone 204 and display the conference interface 620 shown in Figure 6D. In this way, the electronic device 100 can reduce the number of operations required to detect the status of the stylus 200, and the electronic device 100 can perform the operation of collecting audio data more quickly.
- the stylus 200 can, after receiving the user's input to the pressure sensor 203B on the tip of the stylus 200, respond to the input and instruct the electronic device 100 to mute. After receiving the instruction to mute the stylus 200, the electronic device 100 can stop collecting audio data and display the conference interface 620 shown in FIG8A.
- the stylus 200 can, after receiving input from the user to the pressure sensor 203B on the tip of the stylus 200, suspend the collection of audio data and instruct the electronic device 100 to mute the sound in response to the input. In this way, the stylus 200 can quickly stop collecting audio data through the microphone.
- a pressure sensor here is only an example and is not limited to a pressure sensor.
- the stylus 200 can also detect user input to the stylus 200 through an ultrasonic sensor, a touch sensor, etc., and the embodiment of the present application is not limited to this.
- the tip of the stylus 200 includes a pressure sensor.
- the pressure sensor can be used to detect user input to the tip of the stylus 200. While the electronic device 100 is in a call, the stylus 200 can end the call after receiving user input (e.g., a double-click) from the tip of the stylus 200. This allows the user to control the electronic device 100 to end the call while holding the stylus 200, making it easier for the user to exit the call.
- the electronic device 100 displays the conference interface 620 shown in FIG8A , and the electronic device 100 is in a conference call.
- the stylus 200 can, in response to the input, instruct the electronic device 100 to exit the conference.
- the electronic device 100 can exit the conference and display the conference interface 610 shown in FIG6B . In this way, the user can remotely control the electronic device 100 to exit the conference using the stylus 200.
- the stylus 200 can receive user input (e.g., double-click, long press, etc.) from the pressure sensor 203B on the tip of the stylus 200 and, in response to the input, instruct the electronic device 100 to end the call.
- user input e.g., double-click, long press, etc.
- the electronic device 100 can end the call and display the interface that was displayed before the call began. In this way, the user can remotely control the electronic device 100 to end the call using the stylus 200.
- the input for muting/unmuting the electronic device 100 is different from the input for ending a call on the electronic device 100 and is not limited to a pressure sensor.
- the stylus 200 may also receive user input via a touch sensor.
- the stylus 200 is not limited to receiving input from a pressure sensor located at the tip of the stylus 200.
- the stylus 200 may also receive other user inputs to mute/unmute the electronic device 100 or end a call.
- the stylus 200 may include a pressure sensor or a touch sensor at the tip of the stylus.
- the stylus 200 may receive user input from the sensor at the tip of the stylus to mute/unmute the electronic device 100 or end a call. This is not a limitation in the present embodiment.
- the body of the stylus 200 is provided with a touch sensor.
- the touch sensor can be used to detect user input on the body of the stylus 200.
- the stylus 200 can instruct the electronic device 100 to adjust the volume of the electronic device 100 after receiving user input (e.g., a sliding input) on the body of the stylus 200.
- the stylus 200 can instruct the electronic device 100 to increase the volume of the electronic device 100 after receiving user input by sliding the stylus 200 upward.
- the stylus 200 can also instruct the electronic device 100 to decrease the volume of the electronic device 100 after receiving user input by sliding the stylus 200 downward. In this way, when the user holds the stylus 200, they can control the volume of the electronic device 100 through the stylus 200, which is more convenient and quick.
- the stylus pen 200 or the electronic device 100 stores a correspondence between sliding distances and volume adjustment values.
- the volume adjustment value is the difference between the volume after adjustment by the electronic device 100 and the volume before adjustment. The longer the stylus pen 200 detects the user sliding along the pen body, the greater the volume adjustment value. The shorter the stylus pen 200 detects the user sliding along the pen body, the smaller the volume adjustment value.
- the electronic device 100 is in a conference call and displays the conference interface 620 shown in FIG6D or the conference interface 620 shown in FIG7B .
- the stylus pen 200 may instruct the electronic device 100 to increase the volume by the volume adjustment value.
- the electronic device 100 may adjust the volume of the electronic device 100 according to the volume adjustment value and display the conference interface 620 shown in FIG8B .
- the conference interface 620 includes a volume adjustment bar 801 .
- the volume adjustment bar 801 can be used to indicate the current volume of the electronic device 100 .
- the volume adjustment bar 801 can also be used to receive a sliding input from the user to adjust the volume of the electronic device 100 .
- detecting the user's input to the stylus 200 through a touch sensor is only an example and is not limited to a touch sensor.
- the stylus 200 may also detect the user's input to the stylus 200 through an ultrasonic sensor or the like, and the embodiment of the present application does not limit this.
- the above-mentioned designated operations performed by the electronic device 100 controlled by the stylus 200 include inputs such as mute/unmute, end call, and adjust volume. These designated operations are only examples.
- the embodiments of the present application can also provide designated inputs for controlling the electronic device 100 to perform other designated operations through the stylus 200. For example, when the electronic device 100 displays a slide in a meeting, the stylus 200 can receive user input (for example, swipe left, swipe right) to trigger the electronic device 100 to switch the displayed slide. For another example, the stylus 200 can trigger the electronic device 100 to turn off or turn on the speaker, etc. when it detects that the user is shaking the stylus 200 through a sensor such as a gyroscope. The embodiments of the present application are not limited to this.
- the electronic device 100 establishes a communication connection with the stylus 200, and the electronic device 100 may instruct the stylus 200 to start a call after receiving an input to start a call.
- the stylus 200 may detect the status of the stylus 200 after receiving the instruction from the electronic device 100.
- the electronic device 100 may be instructed to collect audio data on its own.
- the stylus 200 determines to use the microphone of the stylus 200 to collect audio data based on the status of the stylus 200
- the collected audio data may be sent to the electronic device 100.
- the electronic device 100 may be instructed to collect audio data and send the collected audio data to the electronic device 100.
- the stylus 200 determines whether to use the microphone of the electronic device 100 and/or the microphone of the stylus 200 to collect audio data based on the state of the stylus 200. Please refer to the above embodiment for a description, which will not be repeated here. In this way, the stylus 200 can independently determine whether to collect audio data.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
Abstract
Description
本申请要求要求于2024年03月21日提交中国专利局、申请号为202410330913.3、申请名称为“一种通话控制方法、系统及相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the China Patent Office on March 21, 2024, with application number 202410330913.3 and application name “A call control method, system and related devices”, the entire contents of which are incorporated by reference into this application.
本申请涉及终端领域,尤其涉及一种通话控制方法、系统及相关装置。The present application relates to the field of terminals, and in particular to a call control method, system and related devices.
随着手机和平板等电子设备的普及化,电子设备的输入方式也越加多样。如今,用户通常会将手写笔作为常用的输入设备,通过手写笔实现在电子设备上点击、绘画、文字录入等功能。但是,当前手写笔的应用场景有限,手写笔的功能较为单一,无法满足用户日益增长的使用需求。With the increasing popularity of electronic devices such as mobile phones and tablets, input methods for these devices are becoming increasingly diverse. Nowadays, users often use styluses as a common input device, enabling functions such as clicking, drawing, and text entry on electronic devices. However, current stylus applications are limited, and their functions are relatively simple, failing to meet users' growing usage needs.
本申请提供了一种通话控制方法、系统及相关装置,实现了电子设备开始采集音频时,获取手写笔的状态。电子设备基于手写笔的状态,通过电子设备的麦克风和/或手写笔的麦克风采集音频数据。电子设备根据手写笔是否被用户持握,是否被吸附于电子设备上或者是否朝向说话对象,决定采集音频数据的麦克风,使得电子设备能够通过自身的麦克风采集更短距离的音频数据,通过手写笔的麦克风采集更远距离的音频数据,帮助用户在不同通话场景下采集音频数据,给用户提供更好的通话体验。The present application provides a call control method, system and related devices, which realize the acquisition of the status of the stylus when the electronic device starts to collect audio. Based on the status of the stylus, the electronic device collects audio data through the microphone of the electronic device and/or the microphone of the stylus. The electronic device determines the microphone to collect audio data based on whether the stylus is held by the user, whether it is adsorbed on the electronic device or whether it is facing the speaking object, so that the electronic device can collect audio data at a shorter distance through its own microphone and collect audio data at a longer distance through the microphone of the stylus, helping users to collect audio data in different call scenarios and providing users with a better call experience.
第一方面,本申请提供了一种通话控制方法,应用于包括第一麦克风的电子设备,方法包括:接收到第一输入;响应于第一输入,若检测到手写笔被用户持握,通过手写笔的第二麦克风采集音频数据;若检测到手写笔未被用户持握,通过第一麦克风采集音频数据。这样,电子设备通过手写笔是否被用户持握,选择使用第一麦克风或第二麦克风采集音频数据,电子设备可以在用户移动或用户距离电子设备较远时,通过手写笔采集更加清晰的音频数据。电子设备还可以在多个用户在场时,通过电子设备的麦克风采集多个用户的音频数据,适合多人通过电子设备会议通话的场景。In a first aspect, the present application provides a call control method, which is applied to an electronic device including a first microphone, the method comprising: receiving a first input; in response to the first input, if it is detected that the stylus is held by the user, collecting audio data through the second microphone of the stylus; if it is detected that the stylus is not held by the user, collecting audio data through the first microphone. In this way, the electronic device chooses to use the first microphone or the second microphone to collect audio data based on whether the stylus is held by the user. The electronic device can collect clearer audio data through the stylus when the user moves or the user is far away from the electronic device. The electronic device can also collect audio data of multiple users through the microphone of the electronic device when multiple users are present, which is suitable for scenarios where multiple people hold conference calls through electronic devices.
在一些示例中,第一输入为开始采集音频的输入,例如,接听/拨通通话的输入,开始录音的输入等。这样,电子设备在接收到开始采集音频数据的输入后,获取手写笔的状态,并选择对应的麦克风。In some examples, the first input is an input for starting audio collection, such as an input for answering/dialing a call, an input for starting recording, etc. Thus, after receiving the input for starting audio data collection, the electronic device obtains the state of the stylus and selects the corresponding microphone.
在一种可能的实现方式中,若检测到手写笔未被用户持握,通过第一麦克风采集音频数据,包括:若检测到手写笔未被用户持握且被吸附于电子设备上,通过第一麦克风采集音频数据。这样,电子设备检测到手写笔被吸附于电子设备上,表明用户未使用手写笔,手写笔的麦克风还可能被电子设备遮挡,电子设备通过第一麦克风采集音频数据,更加符合用户采集音频的需求,可以采集到更加清晰的音频。In one possible implementation, if it is detected that the stylus is not being held by the user, audio data is collected through the first microphone, including: if it is detected that the stylus is not being held by the user and is attached to the electronic device, audio data is collected through the first microphone. In this way, the electronic device detects that the stylus is attached to the electronic device, indicating that the user is not using the stylus. The stylus's microphone may also be blocked by the electronic device. The electronic device collects audio data through the first microphone, which better meets the user's audio collection needs and can collect clearer audio.
在一种可能的实现方式中,方法还包括:若检测到手写笔未被用户持握且未被吸附于电子设备上,暂停采集音频数据且显示第一提示信息,第一提示信息用于提示用户麦克风静音。这样,电子设备可以在手写笔被闲置时,例如,手写笔被放置在桌面上时,倾向于认为用户想要暂停说话,为了保护用户的隐私,电子设备可以将麦克风静音,暂停采集音频数据。In one possible implementation, the method further includes: if it is detected that the stylus is not held by the user and is not attached to the electronic device, pausing audio data collection and displaying a first prompt message, where the first prompt message is used to prompt the user to mute the microphone. In this way, when the stylus is idle, for example, when the stylus is placed on a desktop, the electronic device may tend to assume that the user wants to pause speaking. To protect the user's privacy, the electronic device may mute the microphone and suspend audio data collection.
在一些示例中,第一提示信息可以包括静音图标,该静音图标可以表示电子设备静音。这样,用户可以通过静音图标了解到电子设备静音,便于用户执行后续接触静音的操作。In some examples, the first prompt information may include a mute icon, which may indicate that the electronic device is muted. In this way, the user can understand that the electronic device is muted through the mute icon, which facilitates the user to perform subsequent mute operations.
在一种可能的实现方式中,若检测到手写笔被用户持握,通过手写笔的第二麦克风采集音频数据,包括:若检测到手写笔被用户持握且手写笔朝向说话对象,通过第二麦克风采集音频数据。这样,手写笔朝向说话对象时,手写笔的麦克风与说话对象之间的距离小于电子设备的麦克风与说话对象之间的距离的概率较大,电子设备可以通过手写笔采集到说话对象的更加清晰的音频数据。In one possible implementation, if the stylus is detected to be held by the user, audio data is collected via the second microphone of the stylus, including: if the stylus is detected to be held by the user and directed toward the person speaking, audio data is collected via the second microphone. In this way, when the stylus is directed toward the person speaking, there is a high probability that the distance between the microphone of the stylus and the person speaking is smaller than the distance between the microphone of the electronic device and the person speaking, and the electronic device can collect clearer audio data from the person speaking through the stylus.
在一种可能的实现方式中,若检测到手写笔被用户持握,通过手写笔的第二麦克风采集音频数据,包括:若检测到手写笔被用户持握且手写笔未朝向说话对象,通过第一麦克风和第二麦克风采集音频数据。这样,手写笔未朝向说话对象时,电子设备附近的多个说话对象可能在随意发言,电子设备可以通过第一麦克风和第二麦克风共同采集附近的说话对象的音频数据,在不同说话对象发言时,都可以采集到较为清晰的音频数据。In one possible implementation, if the stylus is detected to be held by the user, audio data is collected via the second microphone of the stylus, including: if the stylus is detected to be held by the user and not pointed at the speaker, audio data is collected via the first microphone and the second microphone. In this way, when the stylus is not pointed at the speaker, multiple speakers near the electronic device may be speaking freely. The electronic device can use the first microphone and the second microphone to jointly collect audio data from the nearby speakers, thereby capturing relatively clear audio data from different speakers.
在一种可能的实现方式中,通过第二麦克风采集音频数据,包括:通过第二麦克风采集手写笔朝向的说话对象方向上的音频数据。这样,手写笔朝向某个说话对象时,电子设备可以通过第二麦克风采集手写笔朝向方向上的音频数据,当手写笔朝向的说话对象在发言时,电子设备通过第二麦克风采集的音频数据包括手写笔朝向的说话对象的音频数据。在单人发言的场景下,可以将手写笔作为话筒,采集该说话对象的音频数据。In one possible implementation, collecting audio data through the second microphone includes collecting audio data in the direction of the speaker toward which the stylus is pointed. Thus, when the stylus is pointed toward a speaker, the electronic device can collect audio data in that direction through the second microphone. When the speaker toward which the stylus is pointed is speaking, the audio data collected by the electronic device through the second microphone includes audio data from the speaker toward which the stylus is pointed. In scenarios where a single person is speaking, the stylus can be used as a microphone to collect audio data from the speaker.
在一些示例中,电子设备将采集到的音频数据发送到与电子设备通话的其他电子设备。其他电子设备播放该音频数据。In some examples, the electronic device transmits the collected audio data to another electronic device that is in communication with the electronic device, and the other electronic device plays the audio data.
在一种可能的实现方式中,在暂停采集音频数据且显示第一提示信息之后,方法还包括:接收到手写笔发送的第一指令;响应于第一指令,取消显示第一提示信息并继续采集音频数据。这样,电子设备在暂停采集音频数据时,用户可以通过手写笔触发电子设备继续采集音频数据。In one possible implementation, after pausing audio data collection and displaying the first prompt information, the method further includes: receiving a first instruction sent by the stylus; and in response to the first instruction, canceling the display of the first prompt information and continuing audio data collection. In this way, when the electronic device pauses audio data collection, the user can use the stylus to trigger the electronic device to resume audio data collection.
在一种可能的实现方式中,方法还包括:接收到手写笔发送的第二指令;响应于第二指令,调整电子设备的音量。这样,用户可以在使用手写笔的过程中,通过手写笔调整电子设备播放音频的音量,使得用户不需要切换操作的设备,更加方便。In one possible implementation, the method further includes: receiving a second instruction sent by the stylus; and adjusting the volume of the electronic device in response to the second instruction. In this way, the user can adjust the volume of the audio played by the electronic device using the stylus while using the stylus, eliminating the need for the user to switch devices, which is more convenient.
在一种可能的实现方式中,方法还包括:响应于第一输入,显示通话界面;接收到手写笔发送的第三指令;响应于第三指令,结束通话并取消显示通话界面。这样,用户可以在使用手写笔的过程中,通过手写笔触发电子设备结束通话,使得用户不需要切换操作的设备,更加方便。In one possible implementation, the method further includes: displaying a call interface in response to the first input; receiving a third instruction sent by the stylus; and ending the call and canceling the display of the call interface in response to the third instruction. In this way, the user can trigger the electronic device to end a call using the stylus while using the stylus, eliminating the need for the user to switch devices, which is more convenient.
在一些示例中,方法还包括:响应于第一输入,显示录制控件,录制控件用于表示电子设备正在采集音频;接收到手写笔发送的第三指令;响应于第三指令,结束录制并取消显示录制控件。这样,用户可以在使用手写笔的过程中,通过手写笔触发电子设备结束录音,或者,结束采集语音,使得用户不需要切换操作的设备,更加方便。In some examples, the method further includes: displaying a recording control in response to the first input, the recording control being used to indicate that the electronic device is capturing audio; receiving a third instruction sent by the stylus; and, in response to the third instruction, ending recording and removing the display of the recording control. This allows the user to trigger the electronic device to end recording or voice capture using the stylus while using the stylus, eliminating the need for the user to switch devices, which is more convenient.
在一种可能的实现方式中,方法还包括:响应于第一输入,向手写笔发送第四指令,第四指令用于指示手写笔检测手写笔的状态;接收到手写笔发送的第一状态,第一状态包括被用户持握,未被用户持握,被吸附于电子设备上,未被吸附于电子设备上,朝向说话对象,未朝向说话对象中的一项或多项。这样,电子设备在接收到第一输入后,通过第四指令指示手写笔检测手写笔的状态。电子设备接收到手写笔的第一状态后,按照手写笔的第一状态,确定采集音频数据的麦克风。In one possible implementation, the method further includes: in response to the first input, sending a fourth instruction to the stylus, the fourth instruction being used to instruct the stylus to detect a state of the stylus; and receiving a first state sent by the stylus, the first state comprising one or more of being held by a user, not held by a user, attached to an electronic device, not attached to an electronic device, facing a speaking party, or not facing a speaking party. Thus, after receiving the first input, the electronic device instructs the stylus to detect the state of the stylus via the fourth instruction. After receiving the first state of the stylus, the electronic device determines a microphone for collecting audio data based on the first state of the stylus.
第二方面,本申请提供了一种通话控制方法,应用于包括第二麦克风的手写笔,方法包括:接收到电子设备发送的第四指令,第四指令用于指示手写笔检测手写笔的状态;向电子设备发送第一状态,第一状态包括被用户持握,未被用户持握,被吸附于电子设备上,未被吸附于电子设备上,朝向说话对象,未朝向说话对象中的一项或多项;若第一状态表示手写笔被用户持握,接收到电子设备发送的第五指令;响应于第五指令,通过第二麦克风采集音频数据;向电子设备发送音频数据。这样,手写笔在接收到电子设备发送的第四指令后,可以检测手写笔的状态,并将手写笔的状态反馈到电子设备。电子设备可以按照手写笔的状态,确定使用的麦克风。电子设备接收到表示手写笔被用户持握的第一状态时,通过第五指令指示手写笔采集音频数据。手写笔可以将采集的音频数据发送到电子设备,电子设备可以采集到音频数据。In a second aspect, the present application provides a call control method for a stylus including a second microphone. The method comprises: receiving a fourth instruction from an electronic device, the fourth instruction instructing the stylus to detect its state; transmitting a first state to the electronic device, the first state comprising one or more of being held by a user, not held by a user, attached to the electronic device, not attached to the electronic device, facing a speaker, or not facing a speaker; if the first state indicates that the stylus is held by a user, receiving a fifth instruction from the electronic device; responding to the fifth instruction, collecting audio data via the second microphone; and transmitting the audio data to the electronic device. Thus, after receiving the fourth instruction from the electronic device, the stylus can detect its state and transmit the state back to the electronic device. The electronic device can determine which microphone to use based on the stylus state. When the electronic device receives the first state indicating that the stylus is held by a user, it instructs the stylus to collect audio data via the fifth instruction. The stylus can transmit the collected audio data to the electronic device, which then collects the audio data.
在一种可能的实现方式中,若第一状态表示手写笔被用户持握且手写笔朝向说话对象;响应于第五指令,通过第二麦克风采集音频数据,包括:通过第二麦克风采集手写笔朝向的说话对象方向上的音频数据。这样,电子设备接收到表示手写笔被用户持握且手写笔朝向说话对象的第一状态时,通过第五指令指示手写笔采集手写笔朝向的说话对象方向上的音频数据。手写笔可以将采集的音频数据发送到电子设备,该说话对象发声时,电子设备可以采集到的音频数据包括该说话对象的音频数据。In one possible implementation, if the first state indicates that the stylus is being held by a user and directed toward a speaker, in response to a fifth instruction, collecting audio data via the second microphone includes: collecting audio data in the direction of the speaker toward which the stylus is directed, via the second microphone. Thus, when the electronic device receives the first state indicating that the stylus is being held by a user and directed toward a speaker, the fifth instruction instructs the stylus to collect audio data in the direction of the speaker toward which the stylus is directed. The stylus can transmit the collected audio data to the electronic device, and when the speaker speaks, the audio data collected by the electronic device includes the speaker's audio data.
在一种可能的实现方式中,方法还包括:检测到用户的第二输入;响应于第二输入,向电子设备发送第一指令,第一指令用于触发电子设备切换麦克风状态,麦克风状态包括静音状态和非静音状态。这样,这样,手写笔用于检测用户输入,触发电子设备执行相应的操作,用户在使用手写笔时,不需要切换操作电子设备,即可控制电子设备,便于用户远距离操作电子设备。In one possible implementation, the method further includes: detecting a second user input; and in response to the second input, sending a first instruction to the electronic device, wherein the first instruction is used to trigger the electronic device to switch a microphone state, where the microphone state includes a mute state and an unmute state. In this way, the stylus is used to detect user input and trigger the electronic device to perform a corresponding operation. When using the stylus, the user can control the electronic device without switching the operating electronic device, making it easier for the user to operate the electronic device from a distance.
在一种可能的实现方式中,方法还包括:检测到用户的第三输入;响应于第三输入,向电子设备发送第二指令,第二指令用于触发电子设备调整电子设备的音量。这样,用户通过手写笔说话时,可以通过手写笔控制电子设备播放音频的音量,便于用户远距离调整电子设备的音量。In one possible implementation, the method further includes: detecting a third input from the user; and in response to the third input, sending a second instruction to the electronic device, wherein the second instruction is used to trigger the electronic device to adjust the volume of the electronic device. In this way, while the user speaks with the stylus, they can use the stylus to control the volume of the audio played by the electronic device, making it convenient for the user to adjust the volume of the electronic device remotely.
在一种可能的实现方式中,方法还包括:检测到用户的第四输入;响应于第四输入,向电子设备发送第三指令,第三指令用于触发电子设备结束通话。这样,用户可以通过手写笔直接结束通话,不需要在持握手写笔时,再去点击电子设备,操作更加便利。In one possible implementation, the method further includes: detecting a fourth user input; and in response to the fourth input, sending a third instruction to the electronic device, wherein the third instruction is used to trigger the electronic device to end the call. In this way, the user can end the call directly using the stylus, without having to click the electronic device while holding the stylus, which is more convenient.
第三方面,应用于第一通信系统,第一通信系统包括电子设备和手写笔,电子设备包括第一麦克风,手写笔包括第二麦克风;方法包括:电子设备接收到第一输入;电子设备响应于第一输入,向手写笔发送第四指令,第四指令用于指示手写笔检测手写笔的状态;手写笔接收到第四指令后,响应于第四指令,向电子设备发送第一状态;若电子设备接收到的第一状态表示手写笔被用户持握,向手写笔发送第五指令;手写笔接收到第五指令后,响应于第五指令,通过第二麦克风采集音频数据;若电子设备接收到的第一状态表示手写笔未被用户持握,通过第一麦克风采集音频数据。这样,第一通信系统可以给用户提供更加丰富的采集音频的场景,便于用户便捷的采集所需的音频数据。In a third aspect, the invention is applied to a first communication system, wherein the first communication system includes an electronic device and a stylus, the electronic device including a first microphone, and the stylus including a second microphone; the method includes: the electronic device receiving a first input; the electronic device sending a fourth instruction to the stylus in response to the first input, the fourth instruction being used to instruct the stylus to detect a state of the stylus; after the stylus receives the fourth instruction, in response to the fourth instruction, sending a first state to the electronic device; if the first state received by the electronic device indicates that the stylus is being held by a user, sending a fifth instruction to the stylus; after the stylus receives the fifth instruction, in response to the fifth instruction, collecting audio data through the second microphone; if the first state received by the electronic device indicates that the stylus is not being held by the user, collecting audio data through the first microphone. In this way, the first communication system can provide users with a richer range of audio collection scenarios, facilitating the user to conveniently collect the required audio data.
在一种可能的实现方式中,若电子设备接收到的第一状态表示手写笔未被用户持握,通过第一麦克风采集音频数据。这样,电子设备检测到手写笔未被用户持握,直接通过第一麦克风采集音频数据。In one possible implementation, if the first state received by the electronic device indicates that the stylus is not held by the user, the audio data is collected through the first microphone. In this way, the electronic device detects that the stylus is not held by the user and directly collects the audio data through the first microphone.
在一种可能的实现方式中,若电子设备接收到的第一状态表示手写笔未被用户持握且未被吸附于电子设备上,电子设备暂停采集音频数据且显示第一提示信息,第一提示信息用于提示用户麦克风静音。这样,电子设备检测到手写笔被吸附于电子设备上,暂停采集音频数据。In one possible implementation, if the first state received by the electronic device indicates that the stylus is not held by the user and is not attached to the electronic device, the electronic device pauses collecting audio data and displays a first prompt message, where the first prompt message is used to prompt the user to mute the microphone. In this way, the electronic device detects that the stylus is attached to the electronic device and pauses collecting audio data.
在一种可能的实现方式中,若电子设备接收到的第一状态表示手写笔被用户持握且手写笔朝向说话对象,电子设备向手写笔发送第六指令;手写笔接收到第六指令后,响应于第六指令,通过第二麦克风采集音频数据;手写笔将音频数据发送到电子设备。这样,电子设备检测到手写笔被用户持握且手写笔朝向说话对象,指示手写笔采集音频数据。In one possible implementation, if the first state received by the electronic device indicates that the stylus is being held by the user and is facing the person speaking, the electronic device sends a sixth instruction to the stylus. After receiving the sixth instruction, the stylus responds to the sixth instruction by collecting audio data through the second microphone. The stylus then sends the audio data to the electronic device. In this way, the electronic device detects that the stylus is being held by the user and is facing the person speaking, and instructs the stylus to collect audio data.
在一种可能的实现方式中,若电子设备接收到的第一状态表示手写笔被用户持握且手写笔朝向说话对象,电子设备向手写笔发送第六指令,包括:若电子设备接收到的第一状态表示手写笔被用户持握且手写笔未朝向说话对象,通过第一麦克风采集音频数据,并向手写笔发送第六指令。这样,电子设备检测到手写笔被用户持握且手写笔未朝向说话对象,指示手写笔采集音频数据,同时自行采集音频数据。In one possible implementation, if the first state received by the electronic device indicates that the stylus is being held by the user and is facing the person speaking, the electronic device sends a sixth instruction to the stylus, including: if the first state received by the electronic device indicates that the stylus is being held by the user and is not facing the person speaking, collecting audio data via the first microphone and sending the sixth instruction to the stylus. In this way, the electronic device detects that the stylus is being held by the user and is not facing the person speaking, instructs the stylus to collect audio data, and simultaneously collects audio data itself.
在一种可能的实现方式中,手写笔接收到第六指令后,响应于第六指令,通过第二麦克风采集音频数据,包括:通过第二麦克风采集手写笔朝向的说话对象方向上的音频数据。这样,电子设备通过手写笔采集该说话对象的音频数据。In one possible implementation, after receiving the sixth instruction, the stylus pen responds to the sixth instruction by collecting audio data through the second microphone, including collecting audio data in the direction of the speaking person that the stylus pen is pointing at through the second microphone. In this way, the electronic device collects audio data of the speaking person through the stylus pen.
在一种可能的实现方式中,在电子设备暂停采集音频数据且显示第一提示信息之后,方法还包括:手写笔接收第二输入;手写笔响应于第二输入,向电子设备发送第一指令;电子设备接收到第一指令后,响应于第一指令,取消显示第一提示信息并继续采集音频数据。这样,电子设备在暂停采集音频数据时,用户可以通过手写笔触发电子设备继续采集音频数据。In one possible implementation, after the electronic device pauses collecting audio data and displays a first prompt message, the method further includes: the stylus receiving a second input; the stylus sending a first instruction to the electronic device in response to the second input; and after the electronic device receives the first instruction, the electronic device cancels the display of the first prompt message and resumes collecting audio data in response to the first instruction. In this way, when the electronic device pauses collecting audio data, the user can trigger the electronic device to resume collecting audio data using the stylus.
在一种可能的实现方式中,方法还包括:手写笔接收到用户的第三输入;手写笔响应于第三输入,向电子设备发送第二指令;电子设备接收到第二指令后,响应于第二指令,调整电子设备的音量。这样,用户通过手写笔说话时,可以通过手写笔控制电子设备播放音频的音量,便于用户远距离调整电子设备的音量。In one possible implementation, the method further includes: the stylus receiving a third input from the user; the stylus sending a second instruction to the electronic device in response to the third input; and the electronic device adjusting the volume of the electronic device in response to the second instruction after receiving the second instruction. In this way, while the user is speaking with the stylus, they can use the stylus to control the volume of the audio played by the electronic device, making it easier for the user to adjust the volume of the electronic device remotely.
在一种可能的实现方式中,方法还包括:电子设备响应于第一输入,显示通话界面;手写笔接收到用户的第四输入;手写笔响应于第四输入,向电子设备发送第三指令;电子设备接收到第三指令后,响应于第三指令取消显示通话界面。这样,用户可以通过手写笔直接结束通话,不需要在持握手写笔时,再去点击电子设备,操作更加便利。In one possible implementation, the method further includes: the electronic device displays a call interface in response to the first input; the stylus receives a fourth input from the user; the stylus sends a third instruction to the electronic device in response to the fourth input; and the electronic device cancels the display of the call interface in response to the third instruction after receiving the third instruction. This allows the user to end the call directly using the stylus, eliminating the need to click the electronic device while holding the stylus, making the operation more convenient.
在一些示例中,电子设备通过第一麦克风和/或第二麦克风采集音频数据,方法还包括:手写笔接收第五输入;手写笔响应于第五输入,向电子设备发送第七指令;电子设备接收到第七指令后,响应于第七指令,显示第一提示信息并暂停采集音频数据。这样,电子设备在采集音频时,用户可以通过手写笔控制电子设备静音。在一些示例中,第一指令的内容与第七指令的内容相同。In some examples, the electronic device collects audio data via a first microphone and/or a second microphone, and the method further includes: receiving a fifth input via the stylus; sending a seventh instruction to the electronic device in response to the fifth input; and upon receiving the seventh instruction, the electronic device, in response to the seventh instruction, displays a first prompt message and pauses audio data collection. In this way, while the electronic device is collecting audio, the user can mute the electronic device using the stylus. In some examples, the content of the first instruction and the seventh instruction are the same.
第四方面,本申请提供了一种电子设备,包括:一个或多个处理器和一个或多个存储器;一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机可执行程序,当一个或多个处理器在执行计算机可执行程序时,使得电子设备执行如第一方面中任一种可能的实现方法。In a fourth aspect, the present application provides an electronic device comprising: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer executable programs. When the one or more processors execute the computer executable programs, the electronic device executes any possible implementation method as in the first aspect.
第五方面,本申请提供了一种计算机可读存储介质,存储计算机程序,当计算机程序在电子设备的处理器上运行时,使得电子设备执行如第一方面中任一种可能的实现方法。In a fifth aspect, the present application provides a computer-readable storage medium that stores a computer program. When the computer program runs on a processor of an electronic device, the electronic device executes any possible implementation method as in the first aspect.
第六方面,本申请提供了一种计算机程序产品,当计算机程序产品在电子设备上运行时,使得电子设备执行如第一方面中任一种可能的实现方法。In a sixth aspect, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute any possible implementation method in the first aspect.
第七方面,本申请提供了一种手写笔,包括:一个或多个处理器和一个或多个存储器;一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机可执行程序,当一个或多个处理器在执行计算机可执行程序时,使得手写笔执行如第二方面中任一种可能的实现方法。In the seventh aspect, the present application provides a stylus pen comprising: one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer executable programs. When the one or more processors execute the computer executable programs, the stylus pen executes any possible implementation method as in the second aspect.
第八方面,本申请提供了一种计算机可读存储介质,存储计算机程序,当计算机程序在手写笔的处理器上运行时,使得手写笔执行如第二方面中任一种可能的实现方法。In an eighth aspect, the present application provides a computer-readable storage medium storing a computer program. When the computer program runs on a processor of a stylus pen, the stylus pen executes any possible implementation method as described in the second aspect.
第九方面,本申请提供了一种计算机程序产品,当计算机程序产品在手写笔上运行时,使得手写笔执行如第二方面中任一种可能的实现方法。In a ninth aspect, the present application provides a computer program product, which, when running on a stylus, enables the stylus to execute any possible implementation method in the second aspect.
图1为本申请实施例提供的一种电子设备的硬件结构示意图;FIG1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;
图2为本申请实施例提供的一种手写笔的硬件结构示意图;FIG2 is a schematic diagram of the hardware structure of a stylus provided in an embodiment of the present application;
图3为本申请实施例提供的一种通信系统10的示意图;FIG3 is a schematic diagram of a communication system 10 provided in an embodiment of the present application;
图4为本申请实施例提供的一种通话控制方法的流程示意图;FIG4 is a flow chart of a call control method according to an embodiment of the present application;
图5为本申请实施例提供的另一种通话控制方法的流程示意图;FIG5 is a flow chart of another call control method provided in an embodiment of the present application;
图6A-图6E为本申请实施例提供的一组场景示意图;Figures 6A-6E are a set of scenario diagrams provided in an embodiment of the present application;
图7A-图7C为本申请实施例提供的另一组场景示意图;7A-7C are another set of scenario schematic diagrams provided in an embodiment of the present application;
图8A-图8B为本申请实施例提供的另一组场景示意图。8A-8B are another set of scenario schematic diagrams provided in an embodiment of the present application.
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况,另外,在本申请实施例的描述中,“多个”是指两个或多于两个。The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.
接下来介绍本申请实施例提供的电子设备100的硬件结构示意图。Next, a hardware structure diagram of the electronic device 100 provided in an embodiment of the present application is introduced.
电子设备100可以是手机、平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备,本申请实施例对该电子设备的具体类型不作特殊限制。The electronic device 100 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and/or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.
图1示出了电子设备100的硬件结构示意图。电子设备100可以包括但不限于处理器101,存储器102,通信模块103,电源104,触控屏105,一个或多个麦克风106,一个或多个扬声器107以及音频模块108,等等。1 shows a schematic diagram of the hardware structure of an electronic device 100. The electronic device 100 may include, but is not limited to, a processor 101, a memory 102, a communication module 103, a power supply 104, a touch screen 105, one or more microphones 106, one or more speakers 107, and an audio module 108, etc.
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
处理器101可以包括一个或多个处理单元,例如:处理器101可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The processor 101 may include one or more processing units. For example, the processor 101 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
处理器101中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器101中的存储器为高速缓冲存储器。该存储器可以保存处理器101刚用过或循环使用的指令或数据。如果处理器101需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器101的等待时间,因而提高了系统的效率。Processor 101 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 101 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 101. If processor 101 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 101's latency, and thus improves system efficiency.
在一些实施例中,处理器101可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。In some embodiments, the processor 101 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface.
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
存储器102与处理器101耦合,用于存储各种软件程序和/或多组指令。具体实现中,存储器102可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器102可以存储操作系统,例如uCOS,VxWorks、RTLinux等嵌入式操作系统。存储器102还可以存储通信程序,该通信程序可用于与手写笔200,或其他设备进行通信。Memory 102 is coupled to processor 101 and is used to store various software programs and/or multiple sets of instructions. In a specific implementation, memory 102 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 102 may store an operating system, such as embedded operating systems such as uCOS, VxWorks, and RTLinux. Memory 102 may also store a communication program that can be used to communicate with stylus 200 or other devices.
通信模块103可以用于与其他电子设备(例如,手写笔200)通信。例如,通信模块103可以用于接收手写笔200发送的音频数据。The communication module 103 can be used to communicate with other electronic devices (eg, the stylus 200 ). For example, the communication module 103 can be used to receive audio data sent by the stylus 200 .
电源104可以给电子设备100供电。例如,电源104可以为可充电锂电池或者可更换标准电池等等。该电源104可以提供给处理器101,存储器102,通信模块103以及触控屏105等器件所需要的电源。The power supply 104 can supply power to the electronic device 100. For example, the power supply 104 can be a rechargeable lithium battery or a replaceable standard battery, etc. The power supply 104 can provide power required by components such as the processor 101, the memory 102, the communication module 103, and the touch screen 105.
触控屏105可以包括显示屏和触摸传感器。显示屏用于显示图像,视频等。显示屏包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD)。显示屏面板还可以采用有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),miniled,microled,micro-oled,量子点发光二极管(quantum dot light emitting diodes,QLED)等制造。在一些实施例中,电子设备100可以包括1个或N个显示屏,N为大于1的正整数。触摸传感器,也称“触控面板”。触摸传感器可以用于检测作用于触控屏105上的手写笔200的移动操作。触摸传感器可以将检测到的移动操作传递给应用处理器,以确定手写笔200的移动痕迹,使得应用处理器可以通过显示屏提供与触摸操作相关的视觉输出。The touch screen 105 may include a display screen and a touch sensor. The display screen is used to display images, videos, etc. The display screen includes a display panel. The display panel may be a liquid crystal display (LCD). The display panel may also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device 100 may include one or N display screens, where N is a positive integer greater than 1. The touch sensor, also known as a "touch panel," may be used to detect movement of the stylus 200 on the touch screen 105. The touch sensor may transmit the detected movement operation to the application processor to determine a movement trace of the stylus pen 200 , so that the application processor may provide a visual output related to the touch operation through the display screen.
电子设备100可以通过麦克风106,扬声器107,音频模块108以及处理器101等实现音频功能。其中,一个或多个麦克风106可以用于采集音频数据。一个或多个扬声器107可以用于播放音频数据。The electronic device 100 can implement audio functions through the microphone 106, the speaker 107, the audio module 108 and the processor 101. Among them, one or more microphones 106 can be used to collect audio data. One or more speakers 107 can be used to play audio data.
其中,音频模块108用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块108还可以用于对音频信号编码和解码。在一些示例中,音频模块108可以设置于处理器101中,或将音频模块108的部分功能模块设置于处理器101中。The audio module 108 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 108 can also be used to encode and decode audio signals. In some examples, the audio module 108 can be provided in the processor 101, or some functional modules of the audio module 108 can be provided in the processor 101.
麦克风106,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息或录音时,用户可以通过人嘴靠近麦克风106发声,将声音信号输入到麦克风106。电子设备100可以设置两个麦克风106,除了采集声音信号,还可以实现降噪功能。在一些示例中,电子设备100还可以设置三个,四个或更多麦克风106,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。Microphone 106 , also known as a "microphone" or "microphone," is used to convert sound signals into electrical signals. When making a call, sending a voice message, or recording a voice message, a user can place their mouth close to microphone 106 to input the sound signal into microphone 106 . Electronic device 100 can be equipped with two microphones 106 , which not only collect sound signals but also implement noise reduction. In some examples, electronic device 100 can also be equipped with three, four, or more microphones 106 to collect sound signals, reduce noise, identify sound sources, implement directional recording, and more.
扬声器107,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通过扬声器107收听音乐,收听免提通话,收听会议通话等等。The speaker 107 , also called a “speaker”, is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music, listen to hands-free calls, listen to conference calls, etc. through the speaker 107 .
接下来介绍本申请实施例提供的手写笔200的硬件结构示意图。Next, a schematic diagram of the hardware structure of the stylus pen 200 provided in an embodiment of the present application is introduced.
如图2所示,手写笔200可以包括但不限于处理器201、存储器202、传感器模块203、一个或多个麦克风204、通信模块205以及电源206,等等。As shown in FIG. 2 , the stylus pen 200 may include but is not limited to a processor 201 , a memory 202 , a sensor module 203 , one or more microphones 204 , a communication module 205 , a power supply 206 , and the like.
其中,处理器201可用于读取和执行计算机可读指令。具体实现中,处理器201可主要包括控制器、运算器和寄存器。其中,控制器主要负责指令译码,并为指令对应的操作发出控制信号。运算器主要负责保存指令执行过程中临时存放的寄存器操作数和中间操作结果等。具体实现中,处理器201的硬件架构可以是专用集成电路(ASIC)架构、MIPS架构、ARM架构或者NP架构等等。The processor 201 can be used to read and execute computer-readable instructions. In a specific implementation, the processor 201 may primarily include a controller, an arithmetic unit (ALU), and registers. The controller is primarily responsible for decoding instructions and issuing control signals for operations corresponding to the instructions. The ALU is primarily responsible for storing register operands and intermediate operation results temporarily stored during instruction execution. In a specific implementation, the hardware architecture of the processor 201 may be an application-specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, or an NP architecture, among others.
其中,处理器201可以用于解析通信模块205接收到的信号。处理器201可以根据解析结果进行响应,执行相应的操作。例如,处理器201可以基于电子设备100发送的信号,通过麦克风204采集音频数据,等等。其中,处理器201还可以用于通知通信模块205向其他电子设备发送信号。例如,处理器201可以通过通信模块205向电子设备100发送通过麦克风204采集的音频数据,等等。The processor 201 can be used to parse signals received by the communication module 205. The processor 201 can respond based on the parsing results and perform corresponding operations. For example, the processor 201 can collect audio data through the microphone 204 based on the signal sent by the electronic device 100, etc. The processor 201 can also be used to notify the communication module 205 to send signals to other electronic devices. For example, the processor 201 can send audio data collected by the microphone 204 to the electronic device 100 via the communication module 205, etc.
存储器202与处理器201耦合,用于存储各种软件程序和/或多组指令。具体实现中,存储器202可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器202可以存储操作系统,例如uCOS,VxWorks、RTLinux等嵌入式操作系统。存储器202还可以存储通信程序,该通信程序可用于与电子设备100,或其他设备进行通信。The memory 202 is coupled to the processor 201 and is used to store various software programs and/or multiple sets of instructions. In a specific implementation, the memory 202 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 202 may store an operating system, such as an embedded operating system such as uCOS, VxWorks, or RTLinux. The memory 202 may also store a communication program that can be used to communicate with the electronic device 100 or other devices.
传感器模块203可以包括但不限于超声波传感器203A(图中未示出),压力传感器203B(图中未示出)等等。在本申请实施例中,手写笔200可以通过传感器模块203确定出用户是否持握手写笔200,手写笔200还可以通过传感器模块203识别用户的手势等等。The sensor module 203 may include, but is not limited to, an ultrasonic sensor 203A (not shown), a pressure sensor 203B (not shown), etc. In the embodiment of the present application, the stylus 200 can determine whether the user is holding the stylus 200 through the sensor module 203, and the stylus 200 can also recognize the user's gestures, etc. through the sensor module 203.
在一些示例中,手写笔200可以通过超声波传感器203A识别用户是否持握手写笔200。超声波传感器203A可以处于手写笔200的笔身部分,超声波传感器203A可以发送超声波并且接收被障碍物反射的超声波。手写笔200可以基于接收到的超声波检测超声波传感器203A是否被遮挡,其中,超声波传感器203A被遮挡时,超声波传感器203A发出的超声波被反射,超声波传感器203A可以接收到反射的超声波。因此,被遮挡的超声波传感器203A接收到的超声波的能量大于未被遮挡的超声波传感器203A接收到的超声波的能量。手写笔200可以在检测到被设置于笔尖附近的超声波传感器203A被遮挡时,确定出手写笔200被用户持握。手写笔200可以在检测到被设置于笔尖附近的超声波传感器203A未被遮挡时,确定出手写笔200未被用户持握。In some examples, the stylus 200 can use an ultrasonic sensor 203A to identify whether the user is holding the stylus 200. The ultrasonic sensor 203A can be located on the body of the stylus 200 and can transmit ultrasonic waves and receive ultrasonic waves reflected by obstacles. Based on the received ultrasonic waves, the stylus 200 can detect whether the ultrasonic sensor 203A is blocked. When the ultrasonic sensor 203A is blocked, the ultrasonic waves emitted by the ultrasonic sensor 203A are reflected, and the ultrasonic sensor 203A receives the reflected ultrasonic waves. Therefore, the energy of the ultrasonic waves received by the blocked ultrasonic sensor 203A is greater than the energy of the ultrasonic waves received by the unblocked ultrasonic sensor 203A. The stylus 200 can determine that the user is holding the stylus 200 when it detects that the ultrasonic sensor 203A located near the tip is blocked. The stylus 200 can also determine that the user is not holding the stylus 200 when it detects that the ultrasonic sensor 203A located near the tip is not blocked.
在一些示例中,手写笔200还可以通过超声波传感器203A识别用户的手势。例如,手写笔200可以通过超声波传感器203A被用户遮挡的时长,识别出单击输入,双击输入,长按输入等等。再例如,手写笔200包括多个超声波传感器203A,该多个超声波传感器203A处于手写笔200的笔身上的不同位置。手写笔200可以通过不同超声波传感器203A被遮挡的先后顺序,识别出上滑输入,下滑输入等等。In some examples, the stylus 200 can also recognize user gestures using the ultrasonic sensor 203A. For example, the stylus 200 can identify single-click input, double-click input, long-press input, and so on based on the duration that the ultrasonic sensor 203A is blocked by the user. For another example, the stylus 200 may include multiple ultrasonic sensors 203A located at different locations on the stylus 200. The stylus 200 can identify upward swipe input, downward swipe input, and so on based on the order in which the different ultrasonic sensors 203A are blocked.
在一些示例中,手写笔200可以通过压力传感器203B识别出手写笔200是否被用户持握。例如,压力传感器203B可以处于手写笔200的笔身部分,压力传感器203B可以基于施加于压力传感器203B上的压力值,检测用户是否按压压力传感器203B,即用户是否持握手写笔200。In some examples, the stylus 200 can identify whether the user is holding the stylus 200 through the pressure sensor 203B. For example, the pressure sensor 203B can be located on the body of the stylus 200. The pressure sensor 203B can detect whether the user is pressing the pressure sensor 203B, that is, whether the user is holding the stylus 200, based on the pressure value applied to the pressure sensor 203B.
在一些示例中,手写笔200还可以通过压力传感器203B识别出用户的手势,例如,单击,双击,长按等手势。例如,压力传感器203B可以处于手写笔200的笔尾部分(又称为手写笔200的顶部),可以用于检测用户是否对手写笔200的顶部输入。In some examples, the stylus 200 can also recognize user gestures through the pressure sensor 203B, such as single click, double click, long press, etc. For example, the pressure sensor 203B can be located at the end of the stylus 200 (also known as the top of the stylus 200) and can be used to detect whether the user inputs to the top of the stylus 200.
在一些示例中,压力传感器203B可以设置于手写笔200的笔尖上,压力传感器203B可用于检测笔尖所感受到的压力。压力传感器203B可将检测到的压力数据发送到处理器201。处理器201可以基于该压力数据控制通信模块205发出不同的信号,从而指示电子设备100在触控屏上手写笔200的笔尖经过的位置显示出不同粗细的笔迹。In some examples, pressure sensor 203B can be provided on the tip of stylus 200. Pressure sensor 203B can be used to detect the pressure felt by the tip. Pressure sensor 203B can send the detected pressure data to processor 201. Processor 201 can control communication module 205 to send different signals based on the pressure data, thereby instructing electronic device 100 to display handwriting of different thicknesses at the location on the touch screen where the tip of stylus 200 passes.
需要说明的是,不限于超声波传感器203A,手写笔200可以包括扬声器,手写笔200可以通过扬声器发送超声波,通过麦克风204接收扬声器发送的超声波,检测用户是否持握手写笔200以及识别用户的手势。或者,手写笔200可以包括触摸传感器,手写笔200可以通过触摸传感器检测用户是否持握手写笔200,识别用户在手写笔200上的手势,等等,本申请实施例对此不作限定。It should be noted that the stylus 200 is not limited to the ultrasonic sensor 203A. The stylus 200 may include a speaker, which transmits ultrasonic waves and receives them via the microphone 204 to detect whether the user is holding the stylus 200 and recognize the user's gestures. Alternatively, the stylus 200 may include a touch sensor, which may detect whether the user is holding the stylus 200 and recognize the user's gestures on the stylus 200. This is not limited in the present embodiment.
在一些示例中,手写笔200还可以检测手写笔200是否朝向指定对象。其中,指定对象可以为手写笔200附近的说话对象。例如,手写笔200可以通过远近场识别技术,确定出说话对象与手写笔200的相对位置关系。其中,手写笔200可以通过多个麦克风204采集声音信号,并基于不同麦克风采集相同声音信号的时间差,确定出不同声源相对于手写笔200的方向,即确定出不同说话对象相对于手写笔200的方向。再例如,手写笔200可以通过超声波传感器203A识别出附近的各个物体的轮廓,通过算法识别物体的轮廓是否属于说话对象。之后,手写笔200还可以通过超声波传感器203A确定出人物相对于手写笔200的方向,等等。再例如,手写笔200可以通过多个麦克风204以及超声波传感器203A确定出是否朝向指定对象。其中,手写笔200可以通过多个麦克风确定出不同声源相对于手写笔200的方向,再通过超声波传感器203A确定出不同声源方向上是否存在遮挡。In some examples, the stylus 200 can also detect whether it is facing a designated object. The designated object can be a person speaking near the stylus 200. For example, the stylus 200 can use near-far field recognition technology to determine the relative position of the speaking object and the stylus 200. The stylus 200 can collect sound signals using multiple microphones 204 and, based on the time difference between different microphones capturing the same sound signal, determine the directions of different sound sources relative to the stylus 200, thereby determining the directions of different speaking objects relative to the stylus 200. For another example, the stylus 200 can use the ultrasonic sensor 203A to identify the outlines of nearby objects and, using an algorithm, determine whether the object outlines belong to the speaking object. Subsequently, the stylus 200 can use the ultrasonic sensor 203A to determine the direction of a person relative to the stylus 200, and so on. For another example, the stylus 200 can use the multiple microphones 204 and the ultrasonic sensor 203A to determine whether it is facing a designated object. The stylus 200 may determine the directions of different sound sources relative to the stylus 200 through multiple microphones, and then determine whether there are any obstructions in the directions of different sound sources through the ultrasonic sensor 203A.
其中,手写笔200可以通过陀螺仪或加速度传感器,获取手写笔200的姿态。手写笔200可以基于手写笔200的姿态以及说话对象与手写笔200的相对方向关系,检测手写笔200是否朝向某个说话对象。The stylus 200 can obtain the posture of the stylus 200 through a gyroscope or an acceleration sensor. The stylus 200 can detect whether the stylus 200 is facing a certain speaker based on the posture of the stylus 200 and the relative direction between the speaker and the stylus 200.
在一些示例中,手写笔200朝向指定对象的方向时,可以采集手写笔200朝向指定对象的方向上的音频数据。这样,当指定对象发出声音时,手写笔200可以采集包括手写笔200朝向指定对象的声音信号的音频数据,在单人发言的场景中,手写笔200可以据此采集到被手写笔200指示的说话对象的清晰发言。In some examples, when the stylus 200 is pointed toward a designated object, audio data in the direction of the designated object can be collected. Thus, when the designated object makes a sound, the stylus 200 can collect audio data including the sound signal of the stylus 200 pointing toward the designated object. In a scenario where a single person is speaking, the stylus 200 can thus collect the clear speech of the person being pointed at by the stylus 200.
其中,手写笔200可以通过指向性拾音技术采集手写笔200朝向的指定对象方向上的音频数据。或者,手写笔200可以调整麦克风204的录音范围,采集手写笔200朝向的指定对象方向上的音频数据。或者,手写笔200可以识别手写笔200朝向的指定对象的音频数据,手写笔200可以在通过麦克风204采集音频数据后,从采集的音频数据中筛选出手写笔200朝向的指定对象的音频数据。在一些示例中,手写笔200可以检测手写笔200朝向的指定对象相对于手写笔200的距离,将录音范围设置为以手写笔200为中心,手写笔200指向的说话对象相对于手写笔200的距离为半径的范围,使得手写笔200可以在指定对象发声时采集到指定对象的音频数据。The stylus 200 can use directional sound pickup technology to collect audio data in the direction of a designated object that the stylus 200 is pointing at. Alternatively, the stylus 200 can adjust the recording range of the microphone 204 to collect audio data in the direction of the designated object that the stylus 200 is pointing at. Alternatively, the stylus 200 can identify the audio data of the designated object that the stylus 200 is pointing at, and after collecting audio data through the microphone 204, the stylus 200 can filter out the audio data of the designated object that the stylus 200 is pointing at from the collected audio data. In some examples, the stylus 200 can detect the distance of the designated object relative to the stylus 200 and set the recording range to a radius centered on the stylus 200 and the distance of the speaking object that the stylus 200 is pointing at relative to the stylus 200. This allows the stylus 200 to collect audio data of the designated object when the designated object speaks.
其中,该一个或多个麦克风204可以用于采集音频数据。麦克风204,也称“话筒”,“传声器”,可以将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风204发声,将声音信号输入到麦克风204。电子设备100可以设置至少一个麦克风204。在一些示例中,电子设备100可以设置两个麦克风204,除了采集声音信号,还可以实现降噪功能。在另一些示例中,电子设备100还可以设置三个,四个或更多麦克风204,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。Among them, the one or more microphones 204 can be used to collect audio data. The microphone 204, also known as a "microphone" or "microphone", can convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 204 to input the sound signal into the microphone 204. The electronic device 100 can be provided with at least one microphone 204. In some examples, the electronic device 100 can be provided with two microphones 204, which can not only collect sound signals but also realize noise reduction function. In other examples, the electronic device 100 can also be provided with three, four or more microphones 204 to realize the collection of sound signals, noise reduction, identification of sound sources, and directional recording functions, etc.
通信模块205可以用于与电子设备100通信。其中,通信模块205可以将一个或多个麦克风204采集的音频数据发送到电子设备100。通信模块205还可以包括发射器。该发射器位于手写笔200的笔尖部分,可以用于输出电子设备100的触控屏可以检测到的信号。电子设备100可以根据触控屏检测到的发射器发射的信号,确定出手写笔200的笔尖在电子设备100的触控屏上的位置。电子设备100还可以基于手写笔200的发射器发送的信号,检测手写笔200的笔尖的倾斜角度和倾斜方向。The communication module 205 can be used to communicate with the electronic device 100. Specifically, the communication module 205 can transmit audio data collected by one or more microphones 204 to the electronic device 100. The communication module 205 can also include a transmitter. The transmitter is located at the tip of the stylus 200 and can be used to output a signal that can be detected by the touch screen of the electronic device 100. The electronic device 100 can determine the position of the tip of the stylus 200 on the touch screen of the electronic device 100 based on the signal transmitted by the transmitter detected by the touch screen. The electronic device 100 can also detect the tilt angle and tilt direction of the tip of the stylus 200 based on the signal transmitted by the transmitter of the stylus 200.
电源206可以给手写笔200供电。例如,电源206可以为可充电锂电池或者可更换标准电池等等。该电源206可以提供给手写笔200的处理器201、存储器202、传感器模块203、一个或多个麦克风204以及通信模块205等器件所需要的电源。The power supply 206 can provide power to the stylus 200. For example, the power supply 206 can be a rechargeable lithium battery or a replaceable standard battery. The power supply 206 can provide power required by components of the stylus 200, such as the processor 201, the memory 202, the sensor module 203, the one or more microphones 204, and the communication module 205.
可选的,手写笔200还可以包括扬声器(图中未示出),手写笔200可以通过扬声器播放音频数据。Optionally, the stylus pen 200 may further include a speaker (not shown in the figure), and the stylus pen 200 may play audio data through the speaker.
接下来介绍本申请实施例提供的一种通信系统10的示意图。Next, a schematic diagram of a communication system 10 provided in an embodiment of the present application is introduced.
示例性的,如图3所示,该通信系统10可以包括但不限于电子设备100和手写笔200。其中,电子设备100与手写笔200建立通信连接。其中,该通信连接可以为无线连接,例如,无线保真通信(wireless fidelity,Wi-Fi)连接、蓝牙连接、红外线连接、近距离无线通信技术(near field communication,NFC)连接、ZigBee连接等方式连接,以及2G,3G,4G,5G以及后续标准协议的移动网络等方式连接,等等。其中,该蓝牙连接可以为支持蓝牙低功耗(bluetooth low energe,BLE)协议,或者,经典蓝牙(又可被称为:基础速率/增强数据速率(basic rate/enhanced data rate,BR/EDR)技术)协议的通信连接。在一些示例中,该通信连接也可以是有线连接。例如,手写笔200与电子设备100可以通过数据线相连,并且通过该数据线传输通信数据。For example, as shown in FIG3 , the communication system 10 may include, but is not limited to, an electronic device 100 and a stylus 200 . The electronic device 100 establishes a communication connection with the stylus 200 . The communication connection may be a wireless connection, such as a wireless fidelity (Wi-Fi) connection, a Bluetooth connection, an infrared connection, a near-field communication (NFC) connection, a ZigBee connection, or a connection using a mobile network using 2G, 3G, 4G, 5G, or subsequent standard protocols. The Bluetooth connection may support the Bluetooth Low Energy (BLE) protocol or the Classic Bluetooth (also known as Basic Rate/Enhanced Data Rate (BR/EDR) technology) protocol. In some examples, the communication connection may also be a wired connection. For example, the stylus 200 and the electronic device 100 may be connected via a data cable, and communication data may be transmitted via the data cable.
其中,电子设备100可以检测手写笔200在触控屏上的输入,执行与手写笔200的输入对应的操作。例如,电子设备100可以响应于手写笔200对某个图标的输入,显示该图标对应的界面。再例如,电子设备100可以响应于手写笔200在触控屏上的移动输入,显示手写笔200的移动痕迹,等等。这样,用户可以通过手写笔200控制电子设备100。The electronic device 100 can detect input from the stylus 200 on the touch screen and perform operations corresponding to the input from the stylus 200. For example, in response to input from the stylus 200 on an icon, the electronic device 100 can display the interface corresponding to the icon. For another example, in response to movement input from the stylus 200 on the touch screen, the electronic device 100 can display the movement trace of the stylus 200, and so on. In this way, the user can control the electronic device 100 using the stylus 200.
手写笔200包括一个或多个麦克风204,该一个或多个麦克风204可以用于采集音频数据。电子设备100包括一个或多个麦克风106,该一个或多个麦克风106也可以用于采集音频数据。The stylus 200 includes one or more microphones 204, which can be used to collect audio data. The electronic device 100 includes one or more microphones 106, which can also be used to collect audio data.
在本申请实施例中,电子设备100可以在通话过程中,检测手写笔200的状态。电子设备100可以基于手写笔200的状态,确定出通过麦克风204和/或麦克风106采集音频数据。In the embodiment of the present application, the electronic device 100 can detect the status of the stylus 200 during a call. Based on the status of the stylus 200 , the electronic device 100 can determine whether to collect audio data through the microphone 204 and/or the microphone 106 .
在一些示例中,手写笔200可以被吸附于电子设备100侧面。例如,手写笔200可以包括磁力吸附装置(例如,磁铁),手写笔200可以通过磁力吸附装置吸附于电子设备100上。其中,电子设备100和/或手写笔200可以检测手写笔200是否被吸附于电子设备100上。例如,电子设备100和/或手写笔200可以包括磁力计,该磁力计可以用于检测手写笔200是否被吸附于电子设备100上。可选的,电子设备100可以在手写笔200被吸附于电子设备100侧面时,通过无线充电技术给手写笔200充电。In some examples, the stylus 200 can be attached to the side of the electronic device 100. For example, the stylus 200 can include a magnetic attachment device (e.g., a magnet), and the stylus 200 can be attached to the electronic device 100 via the magnetic attachment device. The electronic device 100 and/or the stylus 200 can detect whether the stylus 200 is attached to the electronic device 100. For example, the electronic device 100 and/or the stylus 200 can include a magnetometer, and the magnetometer can be used to detect whether the stylus 200 is attached to the electronic device 100. Optionally, the electronic device 100 can charge the stylus 200 using wireless charging technology when the stylus 200 is attached to the side of the electronic device 100.
本申请实施例提供了一种通话控制方法。电子设备100接收到用户的输入后,可以响应于该输入,检测手写笔200的状态。电子设备100可以按照手写笔200的状态,确定出使用电子设备100的麦克风和/或手写笔200的麦克风采集音频数据。其中,手写笔200的状态可以表示手写笔200是否被用户持握以及手写笔200是否朝向指定对象。其中,指定对象为手写笔200附近的说话对象。这样,电子设备100可以结合手写笔200,在通话场景中,更加灵活的采集不同说话对象的音频数据,使得电子设备100可以获取到更加清晰的音频数据。An embodiment of the present application provides a call control method. After the electronic device 100 receives the user's input, it can detect the status of the stylus 200 in response to the input. The electronic device 100 can determine whether to use the microphone of the electronic device 100 and/or the microphone of the stylus 200 to collect audio data according to the status of the stylus 200. The status of the stylus 200 can indicate whether the stylus 200 is held by the user and whether the stylus 200 is facing a designated object. The designated object is the speaking object near the stylus 200. In this way, the electronic device 100 can be combined with the stylus 200 to more flexibly collect audio data of different speaking objects in a call scenario, so that the electronic device 100 can obtain clearer audio data.
具体的,电子设备100可以在检测到手写笔200未被用户持握时,使用电子设备100的麦克风采集音频数据。电子设备100可以在检测到手写笔200被用户持握时,检测手写笔200的麦克风是否朝向指定对象。电子设备100检测到手写笔200的麦克风朝向指定对象时,使用手写笔200的麦克风采集音频数据。电子设备100可以在检测到手写笔200的麦克风未朝向指定对象时,使用电子设备100的麦克风以及手写笔200的麦克风共同采集音频数据。Specifically, the electronic device 100 may use the microphone of the electronic device 100 to collect audio data when it detects that the stylus 200 is not being held by the user. The electronic device 100 may detect whether the microphone of the stylus 200 is facing a designated object when it detects that the stylus 200 is being held by the user. The electronic device 100 may use the microphone of the stylus 200 to collect audio data when it detects that the microphone of the stylus 200 is facing a designated object. The electronic device 100 may use both the microphone of the electronic device 100 and the microphone of the stylus 200 to collect audio data when it detects that the microphone of the stylus 200 is not facing the designated object.
这样,用户持握手写笔200时,手写笔200与用户的发声部位之间的距离通常小于电子设备100与用户的发声部位之间的距离,电子设备100通过手写笔200的麦克风采集音频数据,可以更近距离的采集到更清晰的声音信号。用户未持握手写笔200时,可以认为用户暂时不想使用手写笔200,电子设备100可以通过自身的麦克风采集音频数据。其中,当手写笔200指向指定对象时,电子设备100可以通过手写笔200的麦克风采集该指定对象的音频数据,使得电子设备100可以获取指定对象更清晰的发言。当手写笔200未指向指定对象时,电子设备100通过自身的麦克风以及手写笔200的麦克风共同采集附近的音频数据,实现免提通话的效果。电子设备100可以通过手写笔200实现多种通话场景的音频采集功能,给用户带来更智能、方便的通话体验。In this way, when the user holds the stylus 200, the distance between the stylus 200 and the user's vocalization site is typically smaller than the distance between the electronic device 100 and the user's vocalization site. The electronic device 100 can collect audio data using the microphone of the stylus 200, enabling closer and clearer audio signals. When the user is not holding the stylus 200, it can be assumed that the user is temporarily unwilling to use the stylus 200, and the electronic device 100 can collect audio data using its own microphone. When the stylus 200 is pointed at a designated object, the electronic device 100 can collect audio data from the designated object using the microphone of the stylus 200, allowing the electronic device 100 to obtain clearer speech from the designated object. When the stylus 200 is not pointed at the designated object, the electronic device 100 uses both its own microphone and the microphone of the stylus 200 to collect nearby audio data, enabling hands-free calling. The electronic device 100 can use the stylus 200 to implement audio collection for a variety of call scenarios, providing users with a more intelligent and convenient calling experience.
可以理解的是,电子设备100采集到音频数据后,可以将音频数据发送到与电子设备100通话的设备。该与电子设备100通话的设备可以播放该音频数据。It is understandable that after the electronic device 100 collects the audio data, it can send the audio data to the device communicating with the electronic device 100. The device communicating with the electronic device 100 can play the audio data.
示例性的,如图4所示,本申请实施例提供的通话控制方法包括以下步骤:For example, as shown in FIG4 , the call control method provided in the embodiment of the present application includes the following steps:
S401.电子设备100接收到开始通话的输入。S401. The electronic device 100 receives an input to start a call.
电子设备100可以在接收到开始通话的输入后,在通话过程中多次执行步骤S402至步骤S406。其中,该开始通话的输入可以为拨打/接听电话的输入,接入会议通话(又称为接入会议)的输入,拨打/接听视频通话的输入,拨打/接听语音通话的输入,等等。After receiving the input for starting a call, the electronic device 100 may perform steps S402 to S406 multiple times during the call. The input for starting a call may be an input for making/answering a call, an input for joining a conference call (also known as joining a conference), an input for making/answering a video call, an input for making/answering a voice call, and the like.
需要说明的是,在通话过程中多次执行步骤S402至步骤S406可以理解为电子设备100可以在通话过程中实时检测手写笔200的状态,并且根据手写笔200的状态,设置采集音频数据的麦克风。在一些示例中,电子设备100在通话过程中实时检测手写笔200的状态可以理解为电子设备100每隔预设间隔时长(例如,10ms),检测手写笔200的状态,并且根据手写笔200的状态,设置采集音频数据的麦克风,本申请实施例对此不作限定。It should be noted that performing steps S402 to S406 multiple times during a call can be understood as the electronic device 100 being able to detect the state of the stylus 200 in real time during the call and setting a microphone for collecting audio data based on the state of the stylus 200. In some examples, the electronic device 100 detecting the state of the stylus 200 in real time during the call can be understood as the electronic device 100 detecting the state of the stylus 200 at preset intervals (e.g., 10ms) and setting a microphone for collecting audio data based on the state of the stylus 200, which is not limited in this embodiment of the present application.
S402.电子设备100检测手写笔200是否被用户持握。S402. The electronic device 100 detects whether the stylus pen 200 is held by the user.
电子设备100在接收到开始通话的输入后,可以检测手写笔200是否被用户持握。电子设备100可以在检测到手写笔200未被用户持握时,执行步骤S403。电子设备100可以在检测到手写笔200被用户持握时,执行步骤S404。After receiving the input to start a call, the electronic device 100 can detect whether the stylus pen 200 is held by the user. When the electronic device 100 detects that the stylus pen 200 is not held by the user, it can execute step S403. When the electronic device 100 detects that the stylus pen 200 is held by the user, it can execute step S404.
其中,电子设备100可以从手写笔200获取状态信息,并且基于获取的状态信息,检测手写笔200是否被用户持握。The electronic device 100 may acquire state information from the stylus pen 200 , and based on the acquired state information, detect whether the stylus pen 200 is held by the user.
在一些示例中,状态信息可以表示手写笔200是否被用户持握以及手写笔200是否朝向指定对象。其中,手写笔200可以通过超声波传感器203A和/或压力传感器203B检测手写笔200是否被用户持握。手写笔200可以通过超声波传感器203A或麦克风204检测手写笔200是否朝向指定对象。具体的,可以参见图2所示实施例,在此不再赘述。In some examples, the status information may indicate whether the stylus 200 is being held by the user and whether the stylus 200 is facing a designated object. Specifically, the stylus 200 may detect whether the stylus 200 is being held by the user using the ultrasonic sensor 203A and/or the pressure sensor 203B. The stylus 200 may also detect whether the stylus 200 is facing a designated object using the ultrasonic sensor 203A or the microphone 204. For details, please refer to the embodiment shown in FIG2 , which will not be further described here.
在一些示例中,状态信息可以包括手写笔200的传感器模块203获取的传感器数据。例如,该状态信息可以包括超声波传感器203A接收到的超声波数据,或,压力传感器203B检测到的压力数据。其中,超声波数据或压力数据可以用于表示手写笔200是否被用户持握。该状态信息还可以包括超声波传感器203A接收到的超声波数据,或,麦克风204接收到的音频数据。其中,超声波数据或音频数据可以用于表示手写笔200是否朝向指定对象。In some examples, the state information may include sensor data acquired by the sensor module 203 of the stylus 200. For example, the state information may include ultrasonic data received by the ultrasonic sensor 203A, or pressure data detected by the pressure sensor 203B. The ultrasonic data or pressure data may be used to indicate whether the stylus 200 is being held by the user. The state information may also include ultrasonic data received by the ultrasonic sensor 203A, or audio data received by the microphone 204. The ultrasonic data or audio data may be used to indicate whether the stylus 200 is facing a designated object.
在一些示例中,电子设备100可以向手写笔200发送指令41,手写笔200可以响应于指令41,获取状态信息,并将状态信息发送至电子设备100。其中,指令41可以用于指示手写笔200电子设备100开始通话,或者,指令41可以用于指示手写笔200获取手写笔200的状态信息并将该状态信息发送至电子设备100。In some examples, the electronic device 100 may send an instruction 41 to the stylus 200, and the stylus 200 may obtain status information in response to the instruction 41 and send the status information to the electronic device 100. The instruction 41 may be used to instruct the stylus 200 to start a call with the electronic device 100, or the instruction 41 may be used to instruct the stylus 200 to obtain status information of the stylus 200 and send the status information to the electronic device 100.
在另一些示例中,电子设备100可以在接收到开始通话的输入之后,检测电子设备100是否与手写笔200建立通信连接。电子设备100可以在检测到电子设备100与手写笔200建立通信连接时,执行步骤S402至步骤S406。电子设备100可以在检测到电子设备100与手写笔200未建立通信连接时,通过电子设备100的麦克风采集音频数据。In other examples, after receiving an input to start a call, the electronic device 100 may detect whether the electronic device 100 has established a communication connection with the stylus 200. The electronic device 100 may execute steps S402 to S406 upon detecting that the electronic device 100 has established a communication connection with the stylus 200. The electronic device 100 may collect audio data through the microphone of the electronic device 100 upon detecting that the electronic device 100 has not established a communication connection with the stylus 200.
可以理解的是,电子设备100在接收到结束通话的输入后,停止执行步骤S402至步骤S406。It is understandable that after receiving the input to end the call, the electronic device 100 stops executing steps S402 to S406.
S403.电子设备100通过电子设备100的麦克风采集音频数据。S403 . The electronic device 100 collects audio data through the microphone of the electronic device 100 .
电子设备100检测到手写笔200未被用户持握时,可以通过电子设备100的麦克风采集音频数据。这样,电子设备100可以采集附近的多个说话对象的音频数据,使得多个说话对象可以同时参与通话,实现免提通话的效果。When the electronic device 100 detects that the stylus 200 is not held by the user, it can collect audio data through the microphone of the electronic device 100. In this way, the electronic device 100 can collect audio data from multiple nearby speakers, allowing multiple speakers to participate in the call at the same time, achieving a hands-free call effect.
S404.电子设备100检测手写笔200是否朝向指定对象。S404 . The electronic device 100 detects whether the stylus pen 200 is facing a designated object.
电子设备100检测到手写笔200被用户持握时,可以检测手写笔200是否朝向指定对象。电子设备100可以在检测手写笔200朝向指定对象时,执行步骤S405。电子设备100可以在检测手写笔200未朝向指定对象时,执行步骤S406。When the electronic device 100 detects that the stylus 200 is held by the user, it can detect whether the stylus 200 is facing the designated object. When the electronic device 100 detects that the stylus 200 is facing the designated object, it can execute step S405. When the electronic device 100 detects that the stylus 200 is not facing the designated object, it can execute step S406.
需要说明的是,不限于先检测手写笔200是否被用户持握,并在检测到用户被用户持握时再检测手写笔200是否朝向指定对象,电子设备100可以指示手写笔将包括用于指示手写笔是否被用户持握,手写笔是否朝向指定对象的状态信息发送到电子设备100。其中,电子设备100确定出状态信息指示手写笔200未被用户持握时,执行步骤S403。电子设备100确定出状态信息指示手写笔200被用户持握且朝向指定对象时,执行步骤S405。电子设备100确定出状态信息指示手写笔200被用户持握且未朝向指定对象时,执行步骤S406。这样,电子设备100可以直接按照状态信息,确定出使用的麦克风。It should be noted that it is not limited to first detecting whether the stylus 200 is held by the user, and then detecting whether the stylus 200 is facing the designated object when it is detected that the stylus 200 is held by the user. The electronic device 100 can instruct the stylus to send status information including information indicating whether the stylus 200 is held by the user and whether the stylus is facing the designated object to the electronic device 100. When the electronic device 100 determines that the status information indicates that the stylus 200 is not held by the user, step S403 is executed. When the electronic device 100 determines that the status information indicates that the stylus 200 is held by the user and is facing the designated object, step S405 is executed. When the electronic device 100 determines that the status information indicates that the stylus 200 is held by the user and is not facing the designated object, step S406 is executed. In this way, the electronic device 100 can directly determine the microphone to be used according to the status information.
S405.电子设备100通过手写笔200的麦克风采集音频数据。S405 . The electronic device 100 collects audio data through the microphone of the stylus 200 .
电子设备100可以在检测手写笔200朝向指定对象时,通过手写笔200的麦克风采集音频数据。这样,手写笔200朝向指定对象时,手写笔200的麦克风与指定对象的距离相比于电子设备100的麦克风与指定对象的距离更近的可能性更大,手写笔200可以在该场景下实现话筒的功能,便于不同的指定对象发言。When the electronic device 100 detects that the stylus 200 is pointing toward a designated object, it can collect audio data through the microphone of the stylus 200. In this way, when the stylus 200 is pointing toward the designated object, it is more likely that the distance between the microphone of the stylus 200 and the designated object is closer than the distance between the microphone of the electronic device 100 and the designated object. In this scenario, the stylus 200 can function as a microphone, making it easier for different designated objects to speak.
在一些示例中,电子设备100可以通过手写笔200的麦克风采集手写笔200朝向的指定对象方向上的音频数据,具体的,可以参见图2所示实施例,在此不再赘述。这样,电子设备100采集手写笔200朝向的指定对象方向上的音频数据,可以实现在手写笔200朝向的指定对象发言时,减弱周围其他方向上的说话对象的声音的干扰。In some examples, the electronic device 100 can use the microphone of the stylus 200 to collect audio data in the direction of the designated object that the stylus 200 is pointing at. For details, please refer to the embodiment shown in Figure 2, which will not be described in detail here. In this way, the electronic device 100 collects audio data in the direction of the designated object that the stylus 200 is pointing at, which can reduce the interference of the voices of other speakers in the surrounding directions when the designated object that the stylus 200 is pointing at speaks.
S406.电子设备100通过电子设备100的麦克风以及手写笔200的麦克风采集音频数据。S406 . The electronic device 100 collects audio data through the microphone of the electronic device 100 and the microphone of the stylus 200 .
电子设备100可以在检测手写笔200未朝向指定对象时,通过电子设备100的麦克风以及手写笔200的麦克风采集音频数据。这样,电子设备100通过电子设备100的麦克风以及手写笔200的麦克风采集音频数据,可以采集到更加清晰的音频数据。并且,当手写笔200未朝向指定对象,可以认为处于多人发言的场景,电子设备100可以采集附近所有的音频数据,避免遗漏信息。When the electronic device 100 detects that the stylus 200 is not pointing toward a designated object, it can collect audio data through the microphones of the electronic device 100 and the stylus 200. This allows the electronic device 100 to collect clearer audio data through the microphones of the electronic device 100 and the stylus 200. Furthermore, when the stylus 200 is not pointing toward a designated object, it can be considered a scene where multiple people are speaking. The electronic device 100 can collect audio data from all nearby speakers to avoid missing any information.
可以理解的是,电子设备100在采集音频数据后,可以将音频数据发送到与电子设备100通话的其他电子设备。It is understandable that after collecting audio data, the electronic device 100 can send the audio data to other electronic devices that are communicating with the electronic device 100.
在一些示例中,电子设备100可以在接收到开始通话的输入后,指示手写笔200获取状态信息。电子设备100可以在获取到手写笔200的状态信息后,基于该状态信息,检测手写笔200是否被用户持握以及手写笔200是否朝向指定对象。当该状态信息表示手写笔200未被用户持握时,电子设备100通过电子设备100的麦克风采集音频数据。当该状态信息表示手写笔200被用户持握且朝向指定对象时,电子设备100指示手写笔200采集音频数据。手写笔200可以将采集的音频数据发送到电子设备100。当该状态信息表示手写笔200未被用户持握且未朝向指定对象时,电子设备100通过电子设备100的麦克风采集音频数据并指示手写笔200采集音频数据。In some examples, after receiving an input to start a call, the electronic device 100 may instruct the stylus 200 to obtain status information. After obtaining the status information of the stylus 200, the electronic device 100 may detect whether the stylus 200 is being held by the user and whether the stylus 200 is facing a designated object based on the status information. When the status information indicates that the stylus 200 is not being held by the user, the electronic device 100 collects audio data through the microphone of the electronic device 100. When the status information indicates that the stylus 200 is being held by the user and facing a designated object, the electronic device 100 instructs the stylus 200 to collect audio data. The stylus 200 may send the collected audio data to the electronic device 100. When the status information indicates that the stylus 200 is not being held by the user and is not facing a designated object, the electronic device 100 collects audio data through the microphone of the electronic device 100 and instructs the stylus 200 to collect audio data.
在另一些示例中,电子设备100可以在检测到手写笔200未被用户持握时,使用电子设备100的麦克风采集音频数据。电子设备100可以在检测到手写笔200被用户持握时,使用手写笔200的麦克风采集音频数据。这样,电子设备100可以直接基于手写笔200是否被用户持握,选择对应的麦克风。In other examples, the electronic device 100 may use the microphone of the electronic device 100 to collect audio data when it detects that the stylus 200 is not being held by the user. The electronic device 100 may use the microphone of the stylus 200 to collect audio data when it detects that the stylus 200 is being held by the user. In this way, the electronic device 100 can directly select the corresponding microphone based on whether the stylus 200 is being held by the user.
需要说明的是,不限于通话场景,电子设备100处于录音,接收到语音输入等场景时,也可以多次执行步骤S402至步骤S406,采集音频数据。这样,电子设备100通过通话控制方法,可以适用于更多样的音频采集场景,给用户提供不同的音频采集体验。It should be noted that this is not limited to call scenarios. When the electronic device 100 is recording or receiving voice input, steps S402 to S406 may be performed multiple times to collect audio data. In this way, the call control method can be used in a variety of audio collection scenarios to provide users with different audio collection experiences.
在另一些示例中,电子设备100可以在检测到手写笔200吸附于电子设备100上时,使用电子设备100的麦克风采集音频数据。电子设备100可以在检测到手写笔200被用户持握时,使用手写笔200的麦克风采集音频数据。电子设备100可以在检测到手写笔200未吸附于电子设备100上且未被用户持握时,暂停采集音频数据并且显示静音提示信息,静音提示信息可以用于提示用户电子设备100已关闭麦克风。In other examples, the electronic device 100 may use the microphone of the electronic device 100 to collect audio data when it detects that the stylus 200 is attached to the electronic device 100. The electronic device 100 may use the microphone of the stylus 200 to collect audio data when it detects that the stylus 200 is held by the user. The electronic device 100 may pause collecting audio data and display a mute prompt message when it detects that the stylus 200 is not attached to the electronic device 100 and is not held by the user. The mute prompt message can be used to remind the user that the microphone of the electronic device 100 has been turned off.
这样,用户持握手写笔200时,手写笔200与用户的发声部位之间的距离通常小于电子设备100与用户的发声部位之间的距离,电子设备100通过手写笔200的麦克风采集音频数据,可以更近距离的采集到更清晰的声音信号。用户将手写笔200吸附于电子设备100上时,可以认为用户暂时不想使用手写笔200,电子设备100可以通过自身的麦克风采集音频数据。用户未持握手写笔200且未将手写笔200吸附于电子设备100上时,可以认为用户想要暂停采集音频,电子设备100可以暂停执行通过麦克风采集音频数据的操作。电子设备100可以通过电子设备100的麦克风以及手写笔200的麦克风共同实现通话过程中,对用户音频采集。In this way, when the user holds the stylus 200, the distance between the stylus 200 and the user's vocal part is usually smaller than the distance between the electronic device 100 and the user's vocal part. The electronic device 100 collects audio data through the microphone of the stylus 200 and can collect clearer sound signals at a closer distance. When the user adsorbs the stylus 200 on the electronic device 100, it can be considered that the user does not want to use the stylus 200 temporarily, and the electronic device 100 can collect audio data through its own microphone. When the user does not hold the stylus 200 and does not adsorb the stylus 200 on the electronic device 100, it can be considered that the user wants to pause audio collection, and the electronic device 100 can pause the operation of collecting audio data through the microphone. The electronic device 100 can collect user audio during a call through the microphone of the electronic device 100 and the microphone of the stylus 200.
示例性的,如图5所示,本申请实施例提供的通话控制方法包括以下步骤:For example, as shown in FIG5 , the call control method provided in the embodiment of the present application includes the following steps:
S501.电子设备100接收到开始通话的输入。S501. The electronic device 100 receives an input for starting a call.
S502.电子设备100检测手写笔200是否被吸附于电子设备100上。S502 . The electronic device 100 detects whether the stylus pen 200 is adsorbed onto the electronic device 100 .
电子设备100在接收到开始通话的输入后,可以检测手写笔200是否被吸附于电子设备100上。电子设备100可以在检测到手写笔200被吸附于电子设备100上时,执行步骤S503。电子设备100可以在检测到手写笔200未被吸附于电子设备100上时,执行步骤S504。其中,电子设备100检测手写笔200是否被吸附于电子设备100上的描述可以参见图3所示实施例,在此不再赘述。电子设备100在通话过程中可以多次执行步骤S502至步骤S506。After receiving the input to start a call, the electronic device 100 can detect whether the stylus 200 is attached to the electronic device 100. When the electronic device 100 detects that the stylus 200 is attached to the electronic device 100, it can execute step S503. When the electronic device 100 detects that the stylus 200 is not attached to the electronic device 100, it can execute step S504. The description of how the electronic device 100 detects whether the stylus 200 is attached to the electronic device 100 can be found in the embodiment shown in FIG. 3 and will not be repeated here. The electronic device 100 can execute steps S502 to S506 multiple times during a call.
S503.电子设备100通过电子设备100的麦克风采集音频数据。S503 . The electronic device 100 collects audio data through the microphone of the electronic device 100 .
电子设备100检测到手写笔200被吸附于电子设备100上时,可以通过电子设备100的麦克风采集音频数据。When the electronic device 100 detects that the stylus pen 200 is attached to the electronic device 100 , the electronic device 100 may collect audio data through the microphone of the electronic device 100 .
S504.电子设备100检测手写笔200是否被用户持握。S504. The electronic device 100 detects whether the stylus pen 200 is held by the user.
电子设备100检测到手写笔200未被吸附于电子设备100上时,可以检测手写笔200是否被用户持握。电子设备100可以在检测到手写笔200被用户持握时,执行步骤S505。电子设备100可以在检测到手写笔200未被用户持握时,执行步骤S506。具体的,电子设备100检测手写笔200是否被用户持握的描述可以参见图4所示实施例,在此不再赘述。When the electronic device 100 detects that the stylus 200 is not attached to the electronic device 100, it can detect whether the stylus 200 is being held by the user. Upon detecting that the stylus 200 is being held by the user, the electronic device 100 can execute step S505. Upon detecting that the stylus 200 is not being held by the user, the electronic device 100 can execute step S506. Specifically, a description of how the electronic device 100 detects whether the stylus 200 is being held by the user can be found in the embodiment shown in FIG. 4 and will not be repeated here.
S505.电子设备100通过手写笔200的麦克风采集音频数据。S505 . The electronic device 100 collects audio data through the microphone of the stylus pen 200 .
电子设备100检测到手写笔200被用户持握,通过手写笔200的麦克风采集音频数据。The electronic device 100 detects that the stylus pen 200 is held by the user, and collects audio data through the microphone of the stylus pen 200 .
在一些示例中,电子设备100可以检测到手写笔200被用户持握时,还可以检测手写笔200是否朝向指定对象。电子设备100可以在检测到手写笔200朝向指定对象时,通过手写笔200的麦克风采集指定对象方向上的音频数据。电子设备100可以在检测到手写笔200未朝向指定对象时,通过手写笔200的麦克风采集附近的音频数据,或者,通过电子设备100的麦克风和手写笔200的麦克风采集附近的音频数据。In some examples, the electronic device 100 can detect whether the stylus 200 is facing a designated object when the user is holding the stylus 200. When the electronic device 100 detects that the stylus 200 is facing the designated object, it can use the microphone of the stylus 200 to collect audio data in the direction of the designated object. When the electronic device 100 detects that the stylus 200 is not facing the designated object, it can use the microphone of the stylus 200 to collect nearby audio data, or it can use both the microphone of the electronic device 100 and the microphone of the stylus 200 to collect nearby audio data.
S506.电子设备100暂停采集音频数据并且显示静音提示信息,静音提示信息可以用于提示用户麦克风静音。S506. The electronic device 100 pauses collecting audio data and displays a mute prompt message, which can be used to prompt the user to mute the microphone.
电子设备100检测到手写笔200未被用户持握且未被吸附于电子设备100上时,暂停采集音频数据并显示静音提示信息。其中,静音提示信息可以包括但不限于文本类提示信息,语音类提示信息,图像类提示信息,动画类提示信息等等。例如,静音提示信息可以包括文本类提示信息:“当前麦克风静音”。这样,用户可以通过将手写笔200搁置,例如,将手写笔200放置在桌面上,触发电子设备100静音,便于用户在不想发言时,不被通话对象听到用户的声音。When the electronic device 100 detects that the stylus 200 is not being held by the user and is not attached to the electronic device 100, it pauses audio data collection and displays a mute prompt. The mute prompt may include, but is not limited to, text, voice, image, animation, and the like. For example, the mute prompt may include the text message "Current microphone muted." This allows the user to mute the electronic device 100 by putting the stylus 200 aside, for example, by placing it on a table. This allows the user to avoid being heard by the other party when they do not wish to speak.
可以理解的是,在电子设备100通过手写笔200的麦克风采集音频数据的过程中,若电子设备100检测到手写笔200未被用户持握且未被吸附于电子设备100上时,指示手写笔200停止采集音频数据。It is understandable that, when the electronic device 100 collects audio data through the microphone of the stylus 200 , if the electronic device 100 detects that the stylus 200 is not held by the user and is not attached to the electronic device 100 , the stylus 200 is instructed to stop collecting audio data.
需要说明的是,不限于先检测手写笔200是被吸附于电子设备100上,并在检测到手写笔200未被吸附于电子设备100上时再检测手写笔200是否被用户持握,电子设备100可以指示手写笔将包括用于指示手写笔是否被用户持握,手写笔200是否被吸附于电子设备上的状态信息发送到电子设备100。其中,电子设备100确定出状态信息指示手写笔200被吸附于电子设备100上时,执行步骤S503。电子设备100确定出状态信息指示手写笔200未被吸附于电子设备100且被用户持握时,执行步骤S505。电子设备100确定出状态信息指示手写笔200未被吸附于电子设备100且未被用户持握时,执行步骤S506。这样,电子设备100可以直接按照状态信息,确定出使用的麦克风。同理,状态信息可以包括用于指示手写笔200是否被用户持握,手写笔200是否被吸附于电子设备上,手写笔200是否朝向指定对象中的一项或多项。电子设备100可以按照状态信息确定出使用的麦克风,具体的,可以参见上述实施例,在此不再赘述。It should be noted that the method is not limited to first detecting whether the stylus 200 is attached to the electronic device 100, and then detecting whether the stylus 200 is held by the user when it is detected that the stylus 200 is not attached to the electronic device 100. The electronic device 100 can instruct the stylus to send status information including information indicating whether the stylus 200 is held by the user and whether the stylus 200 is attached to the electronic device to the electronic device 100. When the electronic device 100 determines that the status information indicates that the stylus 200 is attached to the electronic device 100, step S503 is executed. When the electronic device 100 determines that the status information indicates that the stylus 200 is not attached to the electronic device 100 and is held by the user, step S505 is executed. When the electronic device 100 determines that the status information indicates that the stylus 200 is not attached to the electronic device 100 and is not held by the user, step S506 is executed. In this way, the electronic device 100 can directly determine the microphone to be used based on the status information. Similarly, the status information may include one or more of whether the stylus 200 is being held by the user, whether the stylus 200 is attached to the electronic device, and whether the stylus 200 is facing a designated object. The electronic device 100 may determine the microphone to use based on the status information. For details, please refer to the above embodiment and will not be repeated here.
需要说明的是,不限于通话场景,电子设备100处于录音,接收到语音输入等场景时,也可以通过多次执行步骤S502至步骤S506,采集音频数据。It should be noted that, not limited to call scenarios, when the electronic device 100 is in recording, receives voice input, etc., it can also collect audio data by executing steps S502 to S506 multiple times.
在一些示例中,当手写笔200无法吸附于电子设备100上时,电子设备100可以在接收到开始通话的输入后,检测手写笔200是否处于预设范围内且手写笔200未被用户持握。电子设备100检测到手写笔200处于预设范围内且未被用户持握时,可以通过电子设备100的麦克风采集音频数据。电子设备100检测到手写笔200处于预设范围内且被用户持握时,可以通过手写笔200的麦克风采集音频数据。电子设备100检测到手写笔200处于预设范围外时,可以暂停采集音频数据并显示静音提示信息。其中,预设范围可以为包括电子设备100且与电子设备100边缘的距离小于预设距离(例如,2厘米)的范围。例如,电子设备100可以通过手写笔200的超声波传感器203A检测手写笔200与电子设备100的边缘之间的距离。这样,手写笔200无法吸附于电子设备100上时,用户也可以通过将手写笔200放置于电子设备100的预设范围内,例如,将手写笔200放置于电子设备100的上方,便于用户切换不同的音频采集方式。In some examples, when the stylus 200 cannot be attached to the electronic device 100, the electronic device 100 may, after receiving an input to start a call, detect whether the stylus 200 is within a preset range and is not being held by the user. When the electronic device 100 detects that the stylus 200 is within the preset range and is not being held by the user, it may collect audio data through the microphone of the electronic device 100. When the electronic device 100 detects that the stylus 200 is within the preset range and is being held by the user, it may collect audio data through the microphone of the stylus 200. When the electronic device 100 detects that the stylus 200 is outside the preset range, it may pause collecting audio data and display a mute prompt message. The preset range may be a range that includes the electronic device 100 and is less than a preset distance (e.g., 2 cm) from the edge of the electronic device 100. For example, the electronic device 100 may detect the distance between the stylus 200 and the edge of the electronic device 100 using the ultrasonic sensor 203A of the stylus 200. In this way, when the stylus pen 200 cannot be adsorbed on the electronic device 100, the user can also place the stylus pen 200 within a preset range of the electronic device 100, for example, place the stylus pen 200 above the electronic device 100, so that the user can switch between different audio collection modes.
在另一些示例中,当手写笔200无法吸附于电子设备100上时,电子设备100可以在接收到开始通话的输入后,检测手写笔200是否被用户持握。当电子设备100检测到手写笔200被用户持握时,执行步骤S505。电子设备100可以在检测到手写笔200未被用户持握时,通过电子设备100的麦克风采集音频数据,或者,暂停采集音频数据并显示静音提示信息。这样,用户可以通过是否持握手写笔200,改变采集音频数据的方式。In other examples, when the stylus 200 cannot be attached to the electronic device 100, the electronic device 100 may detect whether the stylus 200 is being held by the user after receiving an input to start a call. When the electronic device 100 detects that the stylus 200 is being held by the user, step S505 is executed. When the electronic device 100 detects that the stylus 200 is not being held by the user, the electronic device 100 may collect audio data through the microphone of the electronic device 100, or pause audio data collection and display a mute prompt message. In this way, the user can change the method of collecting audio data by whether or not the stylus 200 is being held.
可选的,当手写笔200无法吸附于电子设备100上时,电子设备100可以在接收到开始通话的输入后,检测电子设备100是否与手写笔200建立通信连接。电子设备100可以在检测到电子设备100与手写笔200未建立通信连接时,通过电子设备100的麦克风采集音频数据。电子设备100可以在检测到电子设备100与手写笔200建立通信连接时,检测手写笔200是否被用户持握。具体的,可以参见上述实施例,在此不再赘述。Optionally, when the stylus 200 cannot be attached to the electronic device 100, the electronic device 100 may detect whether a communication connection has been established between the electronic device 100 and the stylus 200 after receiving an input to start a call. Upon detecting that a communication connection has not been established between the electronic device 100 and the stylus 200, the electronic device 100 may collect audio data through the microphone of the electronic device 100. Upon detecting that a communication connection has been established between the electronic device 100 and the stylus 200, the electronic device 100 may detect whether the stylus 200 is being held by the user. For details, please refer to the above embodiments and will not be repeated here.
在另一些示例中,电子设备100可以在检测到手写笔200吸附于电子设备100上时,使用电子设备100的麦克风以及手写笔200的麦克风共同采集音频数据。In other examples, when the electronic device 100 detects that the stylus pen 200 is attached to the electronic device 100 , the electronic device 100 may use the microphone of the electronic device 100 and the microphone of the stylus pen 200 to collect audio data.
可以理解的是,电子设备100可以在通话过程中实时检测手写笔200的状态,并且根据手写笔200的状态,设置采集音频数据的麦克风。需要说明的是,电子设备100在通话过程中实时检测手写笔200的状态可以理解为电子设备100每隔预设间隔时长(例如,10ms),检测手写笔200的状态,并且根据手写笔200的状态,设置采集音频数据的麦克风,本申请实施例对此不作限定。It is understandable that the electronic device 100 can detect the status of the stylus 200 in real time during a call and set a microphone for collecting audio data based on the status of the stylus 200. It should be noted that the electronic device 100 detecting the status of the stylus 200 in real time during a call can be understood as the electronic device 100 detecting the status of the stylus 200 at preset intervals (for example, 10ms) and setting a microphone for collecting audio data based on the status of the stylus 200, which is not limited in this embodiment of the present application.
还可以理解的是,当电子设备100检测通话结束时,电子设备100停止执行检测手写笔200的状态以及采集音频数据的操作。It can also be understood that when the electronic device 100 detects that the call is ended, the electronic device 100 stops detecting the status of the stylus 200 and collecting audio data.
接下来结合具体应用场景介绍图4所示的通话控制方法。Next, the call control method shown in FIG4 is introduced in conjunction with a specific application scenario.
示例性的,如图6A所示,电子设备100显示有桌面600。其中,桌面600可以包括多个应用图标,例如,会议应用图标601,拨号应用图标等等。其中,该会议应用图标601可以用于触发电子设备100显示会议应用的界面(例如,图6B所示的会议界面610)。其中,会议应用可以用于发起/接入会议。其中,拨号应用图标可以用于触发电子设备100显示通话界面,通话界面可以用于拨叫/接听通话。其中,桌面600的上方还可以显示状态栏603,该状态栏603中可以显示蓝牙图标603A,蓝牙图标603A可以用于指示电子设备100与手写笔200建立蓝牙连接。需要说明的是,不限于蓝牙图标603A,当电子设备100与手写笔200通过蓝牙以外的通信技术建立通信连接时,电子设备100可以显示其他通信连接对应的图标,本申请实施例对此不作限定。For example, as shown in FIG6A , the electronic device 100 displays a desktop 600. The desktop 600 may include multiple application icons, such as a conference application icon 601, a dialing application icon, and the like. The conference application icon 601 may be used to trigger the electronic device 100 to display the interface of the conference application (e.g., the conference interface 610 shown in FIG6B ). The conference application may be used to initiate/access a conference. The dialing application icon may be used to trigger the electronic device 100 to display a call interface, which may be used to make/answer a call. A status bar 603 may also be displayed above the desktop 600. The status bar 603 may display a Bluetooth icon 603A. The Bluetooth icon 603A may be used to indicate that the electronic device 100 has established a Bluetooth connection with the stylus 200. It should be noted that the connection is not limited to the Bluetooth icon 603A. When the electronic device 100 and the stylus 200 establish a communication connection via a communication technology other than Bluetooth, the electronic device 100 may display icons corresponding to other communication connections. This embodiment of the present application is not limited to this.
电子设备100可以在检测到手写笔200对会议应用图标601的输入后,响应于该输入,显示如图6B所示的会议界面610。如图6B所示,会议界面610包括“加入会议”控件611。“加入会议”控件611可以用于触发电子设备100与其他电子设备建立通话连接,使得用户可以接入会议。会议界面610还可以包括会议ID栏和参会人员栏。其中,会议ID栏可以用于键入会议ID,使得电子设备100可以接入会议ID指示的会议。其中,参会人员栏可以用于键入参会人员名称,使得参会人员可以根据参会人员名称确定出当前正在发言的对象。After detecting the input of the stylus 200 to the conference application icon 601, the electronic device 100 can respond to the input and display the conference interface 610 as shown in Figure 6B. As shown in Figure 6B, the conference interface 610 includes a "Join Conference" control 611. The "Join Conference" control 611 can be used to trigger the electronic device 100 to establish a call connection with other electronic devices, so that the user can access the conference. The conference interface 610 can also include a conference ID column and a participant column. Among them, the conference ID column can be used to enter the conference ID, so that the electronic device 100 can access the conference indicated by the conference ID. Among them, the participant column can be used to enter the name of the participant, so that the participant can determine the person who is currently speaking based on the participant name.
电子设备100可以在检测到手写笔200对“加入会议”控件611的输入后,响应于该输入,检测手写笔200的状态。电子设备100可以在检测到手写笔200被用户持握且手写笔200朝向指定对象A时,通过麦克风204采集指定对象A的音频数据并且显示如图6C所示的会议界面620。After detecting an input from the stylus 200 to the "Join Meeting" control 611, the electronic device 100 may detect the state of the stylus 200 in response to the input. Upon detecting that the stylus 200 is held by the user and is directed toward the designated object A, the electronic device 100 may collect audio data of the designated object A through the microphone 204 and display the meeting interface 620 shown in FIG6C .
如图6C所示,会议界面620可以用于用户参加线上会议。会议界面620可以包括麦克风控件621。麦克风控件621可以用于表示麦克风未静音。麦克风控件621还可以用于触发电子设备100静音。当麦克风被静音时,电子设备100不执行采集音频数据的操作。当麦克风未被静音时,电子设备100基于手写笔200的状态,执行采集音频数据的操作。在此,麦克风控件621表示麦克风未被静音。其中,会议界面620还可以包括参会人员列表,说话人员名称以及扬声器控件等。其中,参会人员列表可以用于提示用户参与线上会议的成员。说话人员名称可以用于提示用户正在发言的对象。扬声器控件可以用于表示扬声器是否被关闭。扬声器控件还可以用于触发电子设备100关闭/打开扬声器。As shown in Figure 6C, the conference interface 620 can be used by users to participate in online meetings. The conference interface 620 may include a microphone control 621. The microphone control 621 can be used to indicate that the microphone is not muted. The microphone control 621 can also be used to trigger the electronic device 100 to mute. When the microphone is muted, the electronic device 100 does not perform the operation of collecting audio data. When the microphone is not muted, the electronic device 100 performs the operation of collecting audio data based on the status of the stylus 200. Here, the microphone control 621 indicates that the microphone is not muted. The conference interface 620 may also include a list of participants, the name of the speaker, and a speaker control. The list of participants can be used to remind the user of the members participating in the online meeting. The name of the speaker can be used to remind the user who is speaking. The speaker control can be used to indicate whether the speaker is turned off. The speaker control can also be used to trigger the electronic device 100 to turn the speaker off/on.
需要说明的是,电子设备100和手写笔200处于如图6C所示的场景时,若用户将手写笔200对准指定对象B,电子设备100可以检测到手写笔200被用户持握且手写笔200朝向指定对象B,通过麦克风204采集指定对象B的音频数据。It should be noted that when the electronic device 100 and the stylus 200 are in the scene shown in Figure 6C, if the user points the stylus 200 at the designated object B, the electronic device 100 can detect that the stylus 200 is held by the user and is facing the designated object B, and collect audio data of the designated object B through the microphone 204.
电子设备100可以在检测到手写笔200对“加入会议”控件611的输入后,响应于该输入,检测手写笔200的状态。电子设备100可以在检测到手写笔200被用户持握且手写笔200未朝向指定对象时,或者,电子设备100和手写笔200处于如图6C所示的场景,若用户将手写笔200移动至不对准任何指定对象,电子设备100可以检测到手写笔200被用户持握且手写笔200未朝向指定对象时,通过麦克风106和麦克风204采集音频数据,如图6D所示。After detecting an input from the stylus 200 to the "Join Meeting" control 611, the electronic device 100 may detect the state of the stylus 200 in response to the input. When the electronic device 100 detects that the stylus 200 is held by the user and is not directed toward a designated object, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG6C , and the user moves the stylus 200 so that it is not directed toward any designated object, the electronic device 100 may collect audio data through the microphone 106 and the microphone 204, as shown in FIG6D .
电子设备100可以在检测到手写笔200对“加入会议”控件611的输入后,响应于该输入,检测手写笔200的状态。电子设备100可以在检测到手写笔200未被用户持握时,或者,电子设备100和手写笔200处于如图6C所示的场景,若用户将手写笔200放下,电子设备100可以检测到手写笔200未被用户持握时,或者,电子设备100和手写笔200处于如图6D所示的场景,若用户将手写笔200放下,电子设备100可以检测到手写笔200未被用户持握时,通过麦克风106采集音频数据,如图6E所示。After detecting an input from the stylus 200 to the "Join Meeting" control 611, the electronic device 100 may detect the state of the stylus 200 in response to the input. When the electronic device 100 detects that the stylus 200 is not being held by the user, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG6C and the user puts the stylus 200 down, the electronic device 100 may detect that the stylus 200 is not being held by the user, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG6D and the user puts the stylus 200 down, the electronic device 100 may collect audio data through the microphone 106, as shown in FIG6E .
在一些示例中,电子设备100可以在检测到手写笔200被用户持握且手写笔200朝向指定对象A时,采集指定对象A方向上的音频数据。电子设备100可以在检测到手写笔200被用户持握且手写笔200朝向指定对象B时,采集指定对象B方向上的音频数据。这样,手写笔200可以在对准指定对象A所在方位时,采集该方位上的音频数据。当指定对象A发声时,手写笔200采集的音频数据包括指定对象A的音频数据。同理,手写笔200可以在对准指定对象B所在方位时,采集该方位上的音频数据。当指定对象B发声时,手写笔200采集的音频数据包括指定对象B的音频数据。这样,当指定对象距离电子设备100较远时,电子设备100也通过手写笔200的麦克风采集到指定对象更加清晰的声音。In some examples, the electronic device 100 may collect audio data in the direction of designated object A when it detects that the user is holding the stylus 200 and that the stylus 200 is pointing toward designated object A. The electronic device 100 may also collect audio data in the direction of designated object B when it detects that the user is holding the stylus 200 and that the stylus 200 is pointing toward designated object B. In this way, when the stylus 200 is pointed toward designated object A, it can collect audio data in that direction. When designated object A makes a sound, the audio data collected by the stylus 200 includes audio data from designated object A. Similarly, when the stylus 200 is pointed toward designated object B, it can collect audio data from that direction. When designated object B makes a sound, the audio data collected by the stylus 200 includes audio data from designated object B. In this way, even when the designated object is farther away from the electronic device 100, the electronic device 100 can capture the designated object's sound more clearly through the microphone of the stylus 200.
接下来结合具体应用场景介绍图5所示的通话控制方法。Next, the call control method shown in FIG5 is introduced in conjunction with a specific application scenario.
电子设备100可以在检测到手写笔200对图6B所示的“加入会议”控件611的输入后,响应于该输入,检测手写笔200的状态。电子设备100可以在检测到手写笔200被吸附于电子设备100上时,通过麦克风106采集音频数据,如图7A所示。其中,图7A所示的会议界面620的输入可以参见上述实施例,在此不再赘述。在此,麦克风控件621表示麦克风未处于静音状态。After detecting input from the stylus 200 to the "Join Meeting" control 611 shown in FIG. 6B , the electronic device 100 can detect the status of the stylus 200 in response to the input. Upon detecting that the stylus 200 is attached to the electronic device 100, the electronic device 100 can collect audio data via the microphone 106, as shown in FIG. The inputs to the conference interface 620 shown in FIG. 7A can be found in the above-described embodiment and will not be further described here. Here, the microphone control 621 indicates that the microphone is not muted.
电子设备100可以在检测到手写笔200对图6B所示的“加入会议”控件611的输入后,响应于该输入,检测手写笔200的状态。电子设备100可以在检测到手写笔200被吸附于电子设备100上时,或者,电子设备100和手写笔200处于如图7A所示的场景,若用户将手写笔200拿起,电子设备100可以检测到手写笔200被用户持握时,通过麦克风204采集音频数据,如图7B所示。在此,麦克风控件621表示麦克风未处于静音状态。After detecting an input from the stylus 200 to the "Join Meeting" control 611 shown in FIG. 6B , the electronic device 100 can detect the state of the stylus 200 in response to the input. When the electronic device 100 detects that the stylus 200 is attached to the electronic device 100, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG. 7A , and the user picks up the stylus 200, the electronic device 100 can detect that the stylus 200 is being held by the user, and collect audio data through the microphone 204, as shown in FIG. Here, the microphone control 621 indicates that the microphone is not muted.
电子设备100可以在检测到手写笔200对图6B所示的“加入会议”控件611的输入后,响应于该输入,检测手写笔200的状态。电子设备100可以在检测到手写笔200未被吸附于电子设备100上且未被持握时,或者,电子设备100和手写笔200处于如图7A所示的场景,若用户将手写笔200从电子设备100上移走且放置在一旁,电子设备100可以检测到手写笔200未被吸附于电子设备100上且未被用户持握时,或者,电子设备100和手写笔200处于如图7B所示的场景,若用户将手写笔200放置在一旁,电子设备100可以检测到手写笔200未被吸附于电子设备100上且未被用户持握时,暂停采集音频数据,电子设备100静音,如图7C所示。在此,电子设备100显示麦克风控件701,麦克风控件701可以表示麦克风处于静音状态。麦克风控件701还可以用于触发电子设备100解除静音。After detecting an input from the stylus 200 to the "Join Meeting" control 611 shown in FIG6B , the electronic device 100 may detect the status of the stylus 200 in response to the input. When the electronic device 100 detects that the stylus 200 is not attached to the electronic device 100 and is not being held, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG7A , if the user removes the stylus 200 from the electronic device 100 and places it aside, the electronic device 100 may detect that the stylus 200 is not attached to the electronic device 100 and is not being held by the user, or when the electronic device 100 and the stylus 200 are in the scenario shown in FIG7B , if the user places the stylus 200 aside, the electronic device 100 may detect that the stylus 200 is not attached to the electronic device 100 and is not being held by the user, the electronic device 100 may pause collecting audio data and mute the electronic device 100, as shown in FIG7C . Here, the electronic device 100 displays a microphone control 701, which can indicate that the microphone is in a muted state. The microphone control 701 can also be used to trigger the electronic device 100 to unmute.
在一种可能的实现方式中,电子设备100与手写笔200建立通信连接。手写笔200可以检测用户的指定输入,通过该通信连接指示电子设备100执行指定输入对应的指定操作。这样,用户可以在使用手写笔200的过程中,通过手写笔200遥控电子设备100执行指定操作,不需要用户通过电子设备100的触控屏操作电子设备100。例如,指定输入可以包括指定输入1,指定输入2以及指定输入3中的一种或多种。指定输入1,指定输入2和指定输入3不同。指定输入1可以用于触发电子设备100静音或解除静音。指定输入2可以用于触发电子设备100结束通话。指定输入3可以用于触发电子设备100调节音量。这样,在通话过程中,用户可以通过手写笔200远距离控制电子设备100,便于用户操作。In one possible implementation, the electronic device 100 establishes a communication connection with the stylus 200. The stylus 200 can detect the user's designated input and, through the communication connection, instruct the electronic device 100 to perform a designated operation corresponding to the designated input. In this way, the user can remotely control the electronic device 100 through the stylus 200 to perform a designated operation while using the stylus 200, without the user having to operate the electronic device 100 through the touch screen of the electronic device 100. For example, the designated input may include one or more of designated input 1, designated input 2, and designated input 3. Designated input 1, designated input 2, and designated input 3 are different. Designated input 1 can be used to trigger the electronic device 100 to mute or unmute. Designated input 2 can be used to trigger the electronic device 100 to end a call. Designated input 3 can be used to trigger the electronic device 100 to adjust the volume. In this way, during a call, the user can remotely control the electronic device 100 through the stylus 200, which is convenient for user operation.
在一些示例中,手写笔200的笔头部分包括压力传感器。压力传感器可以用于检测用户对手写笔200的笔头部分的输入。电子设备100通过电子设备100的麦克风和/或手写笔200的麦克风采集音频数据,手写笔200可以在接收到用户对手写笔200的笔头部分的输入(例如,单击)后,指示电子设备100静音,电子设备100可以在接收到手写笔200的指示后暂停采集音频数据。电子设备100静音时,手写笔200可以在接收到用户对手写笔200的笔头部分的输入(例如,单击)后,指示电子设备100解除静音,电子设备100可以在接收到手写笔200的指示后,基于手写笔200的状态,确定采集音频数据的麦克风并且通过确定出的麦克风采集音频数据。这样,用户手持手写笔200时,可以通过手写笔200控制电子设备100静音/解除静音,不需要用户对电子设备100的用于控制电子设备100静音/解除静音的图标进行操作,使得用户可以更加方便的控制电子设备100静音/解除静音。In some examples, the tip portion of the stylus 200 includes a pressure sensor. The pressure sensor can be used to detect user input to the tip portion of the stylus 200. The electronic device 100 collects audio data through the microphone of the electronic device 100 and/or the microphone of the stylus 200. The stylus 200 can instruct the electronic device 100 to mute after receiving the user input to the tip portion of the stylus 200 (for example, a single click). The electronic device 100 can pause collecting audio data after receiving the instruction from the stylus 200. When the electronic device 100 is muted, the stylus 200 can instruct the electronic device 100 to unmute after receiving the user input to the tip portion of the stylus 200 (for example, a single click). The electronic device 100 can determine the microphone that collects audio data based on the state of the stylus 200 after receiving the instruction from the stylus 200 and collect audio data through the determined microphone. In this way, when the user holds the stylus 200, the user can control the electronic device 100 to mute/unmute through the stylus 200, without the user having to operate the icon of the electronic device 100 for controlling the electronic device 100 to mute/unmute the electronic device 100, so that the user can control the electronic device 100 to mute/unmute more conveniently.
示例性的,电子设备100显示如图8A所示的会议界面620时,电子设备100处于静音状态。会议界面620包括麦克风控件701,该麦克风控件701可以表示电子设备100静音。For example, when the electronic device 100 displays the conference interface 620 shown in FIG8A , the electronic device 100 is in a muted state. The conference interface 620 includes a microphone control 701 , which can indicate that the electronic device 100 is muted.
手写笔200可以在接收到用户对手写笔200的笔头部分的压力传感器203B的输入后,响应于该输入,指示电子设备100解除静音状态。电子设备100可以在接收到手写笔200解除静音的指示后,检测到手写笔200被用户持握。电子设备100可以通过麦克风204采集用户的音频数据并显示如图7B所示的会议界面620,或者,电子设备100可以通过麦克风106和麦克风204采集音频数据,并显示如图6D所示的会议界面620。After receiving input from the user to the pressure sensor 203B on the tip of the stylus 200, the stylus 200 can, in response to the input, instruct the electronic device 100 to unmute. After receiving the instruction to unmute the stylus 200, the electronic device 100 can detect that the stylus 200 is being held by the user. The electronic device 100 can collect the user's audio data via the microphone 204 and display the conference interface 620 shown in FIG. 7B . Alternatively, the electronic device 100 can collect audio data via the microphone 106 and the microphone 204 and display the conference interface 620 shown in FIG. 6D .
在一些示例中,由于手写笔200可以在接收到用户对手写笔200的笔头部分的压力传感器203B的输入可以表示用户持握手写笔200,电子设备100可以在接收到手写笔200解除静音的指示后,通过麦克风204采集用户的音频数据并显示如图7B所示的会议界面620,或者,通过麦克风106和麦克风204采集音频数据,并显示如图6D所示的会议界面620。这样,可以减少电子设备100检测手写笔200状态的操作,电子设备100可以更快执行采集音频数据的操作。In some examples, since the stylus 200 can receive input from the user to the pressure sensor 203B on the tip of the stylus 200, which indicates that the user is holding the stylus 200, the electronic device 100 can collect the user's audio data through the microphone 204 and display the conference interface 620 shown in Figure 7B after receiving the instruction that the stylus 200 is unmuted, or collect audio data through the microphone 106 and the microphone 204 and display the conference interface 620 shown in Figure 6D. In this way, the electronic device 100 can reduce the number of operations required to detect the status of the stylus 200, and the electronic device 100 can perform the operation of collecting audio data more quickly.
可以理解的是,电子设备100通过麦克风204和/或麦克风106采集音频数据时,手写笔200可以在接收到用户对手写笔200的笔头部分的压力传感器203B的输入后,响应于该输入,指示电子设备100静音。电子设备100可以在接收到手写笔200静音的指示后,停止采集音频数据并且显示如图8A所示的会议界面620。It is understood that when the electronic device 100 collects audio data through the microphone 204 and/or the microphone 106, the stylus 200 can, after receiving the user's input to the pressure sensor 203B on the tip of the stylus 200, respond to the input and instruct the electronic device 100 to mute. After receiving the instruction to mute the stylus 200, the electronic device 100 can stop collecting audio data and display the conference interface 620 shown in FIG8A.
可选的,电子设备100通过麦克风204采集音频数据时,手写笔200可以在接收到用户对手写笔200的笔头部分的压力传感器203B的输入后,响应于该输入,暂停采集音频数据并指示电子设备100静音。这样,手写笔200可以快速停止通过麦克风采集音频数据。Optionally, when the electronic device 100 is collecting audio data through the microphone 204, the stylus 200 can, after receiving input from the user to the pressure sensor 203B on the tip of the stylus 200, suspend the collection of audio data and instruct the electronic device 100 to mute the sound in response to the input. In this way, the stylus 200 can quickly stop collecting audio data through the microphone.
需要说明的是,此处通过压力传感器检测用户对手写笔200的输入仅为示例,不限于压力传感器,手写笔200也可以通过超声波传感器,触摸传感器等检测用户对手写笔200的输入,本申请实施例对此不作限定。It should be noted that the detection of user input to the stylus 200 by a pressure sensor here is only an example and is not limited to a pressure sensor. The stylus 200 can also detect user input to the stylus 200 through an ultrasonic sensor, a touch sensor, etc., and the embodiment of the present application is not limited to this.
在一些示例中,手写笔200的笔头部分包括压力传感器。压力传感器可以用于检测用户对手写笔200的笔头部分的输入。电子设备100处于通话中,手写笔200可以在接收到用户对手写笔200的笔头部分的输入(例如,双击)后,结束通话。这样,用户手持手写笔200时,可以通过手写笔200控制电子设备100结束通话,用户可以更加方便的控制电子设备100退出通话。In some examples, the tip of the stylus 200 includes a pressure sensor. The pressure sensor can be used to detect user input to the tip of the stylus 200. While the electronic device 100 is in a call, the stylus 200 can end the call after receiving user input (e.g., a double-click) from the tip of the stylus 200. This allows the user to control the electronic device 100 to end the call while holding the stylus 200, making it easier for the user to exit the call.
示例性的,电子设备100显示如图8A所示的会议界面620,电子设备100处于会议通话中。手写笔200可以在接收到用户对手写笔200的笔头部分的压力传感器203B的输入(例如,双击,长按等)后,响应于该输入,指示电子设备100退出会议。电子设备100可以在接收到手写笔200退出会议的指示后,退出会议并且显示如图6B所示的会议界面610。这样,用户可以通过手写笔200远程控制电子设备100退出会议。For example, the electronic device 100 displays the conference interface 620 shown in FIG8A , and the electronic device 100 is in a conference call. After receiving user input (e.g., double-click, long press, etc.) from the pressure sensor 203B on the tip of the stylus 200, the stylus 200 can, in response to the input, instruct the electronic device 100 to exit the conference. Upon receiving the instruction to exit the conference from the stylus 200, the electronic device 100 can exit the conference and display the conference interface 610 shown in FIG6B . In this way, the user can remotely control the electronic device 100 to exit the conference using the stylus 200.
同理,电子设备100正在通话中并且显示通话界面时,手写笔200可以在接收到用户对手写笔200的笔头部分的压力传感器203B的输入(例如,双击,长按等)后,响应于该输入,指示电子设备100结束通话。电子设备100可以在接收到手写笔200结束通话的指示后,结束此次通话,并显示开始通话前显示的界面。这样,用户可以通过手写笔200远程控制电子设备100结束通话。Similarly, when the electronic device 100 is in a call and the call interface is displayed, the stylus 200 can receive user input (e.g., double-click, long press, etc.) from the pressure sensor 203B on the tip of the stylus 200 and, in response to the input, instruct the electronic device 100 to end the call. Upon receiving the instruction from the stylus 200 to end the call, the electronic device 100 can end the call and display the interface that was displayed before the call began. In this way, the user can remotely control the electronic device 100 to end the call using the stylus 200.
可以理解的是,触发电子设备100静音/解除静音的输入与触发电子设备100结束通话的输入不同,不限于压力传感器,手写笔200也可以通过触摸传感器接收用户的输入。不限于对设置于手写笔200的笔头部分的压力传感器的输入,手写笔200也可以接收用户的其他输入,触发电子设备100静音/解除静音或结束通话,例如,手写笔200可以在笔尖部分设置压力传感器或触摸传感器,手写笔200可以接收用户对笔尖部分的传感器的输入,触发电子设备100静音/解除静音或结束通话等,本申请实施例对此不作限定。It is understood that the input for muting/unmuting the electronic device 100 is different from the input for ending a call on the electronic device 100 and is not limited to a pressure sensor. The stylus 200 may also receive user input via a touch sensor. The stylus 200 is not limited to receiving input from a pressure sensor located at the tip of the stylus 200. The stylus 200 may also receive other user inputs to mute/unmute the electronic device 100 or end a call. For example, the stylus 200 may include a pressure sensor or a touch sensor at the tip of the stylus. The stylus 200 may receive user input from the sensor at the tip of the stylus to mute/unmute the electronic device 100 or end a call. This is not a limitation in the present embodiment.
在一些示例中,手写笔200的笔身设置有触摸传感器。触摸传感器可以用于检测用户对手写笔200的笔身部分的输入。电子设备100处于通话中,手写笔200可以在接收到用户对手写笔200的笔身部分的输入(例如,滑动输入)后,指示电子设备100调整电子设备100的音量。例如,手写笔200可以在接收到用户在手写笔200的笔身部分上滑的输入后,指示电子设备100调高电子设备100的音量。手写笔200可以在接收到用户在手写笔200的笔身部分下滑的输入后,指示电子设备100调低电子设备100的音量。这样,用户手持手写笔200时,可以通过手写笔200控制电子设备100调整音量,更加方便快捷。In some examples, the body of the stylus 200 is provided with a touch sensor. The touch sensor can be used to detect user input on the body of the stylus 200. When the electronic device 100 is in a call, the stylus 200 can instruct the electronic device 100 to adjust the volume of the electronic device 100 after receiving user input (e.g., a sliding input) on the body of the stylus 200. For example, the stylus 200 can instruct the electronic device 100 to increase the volume of the electronic device 100 after receiving user input by sliding the stylus 200 upward. The stylus 200 can also instruct the electronic device 100 to decrease the volume of the electronic device 100 after receiving user input by sliding the stylus 200 downward. In this way, when the user holds the stylus 200, they can control the volume of the electronic device 100 through the stylus 200, which is more convenient and quick.
其中,手写笔200或电子设备100存储有滑动距离与音量调节值的对应关系。其中,音量调节值为电子设备100调整后的音量与电子设备100调整前的音量之间的差值。手写笔200检测到用户在笔身部分滑动的距离越长,调节音量值越大。手写笔200检测到用户在笔身部分滑动的距离越短,调节音量值越小。The stylus pen 200 or the electronic device 100 stores a correspondence between sliding distances and volume adjustment values. The volume adjustment value is the difference between the volume after adjustment by the electronic device 100 and the volume before adjustment. The longer the stylus pen 200 detects the user sliding along the pen body, the greater the volume adjustment value. The shorter the stylus pen 200 detects the user sliding along the pen body, the smaller the volume adjustment value.
示例性的,电子设备100正在会议通话中,显示图6D所示的会议界面620或图7B所示的会议界面620。手写笔200可以在接收到用户在笔身部分上滑的输入后,指示电子设备100将音量调高音量调节值。电子设备100接收到手写笔200发送的将音量调高音量调节值的指示后,可以按照音量调节值调整电子设备100的音量,并且显示如图8B所示的会议界面620。For example, the electronic device 100 is in a conference call and displays the conference interface 620 shown in FIG6D or the conference interface 620 shown in FIG7B . Upon receiving an upward swipe input from the user on the stylus pen body, the stylus pen 200 may instruct the electronic device 100 to increase the volume by the volume adjustment value. Upon receiving the instruction from the stylus pen 200 to increase the volume by the volume adjustment value, the electronic device 100 may adjust the volume of the electronic device 100 according to the volume adjustment value and display the conference interface 620 shown in FIG8B .
如图8B所示,会议界面620包括音量调节条801。音量调节条801可以用于表示电子设备100当前的音量。音量调节条801还可以用于接收用户的滑动输入,调整电子设备100的音量。As shown in FIG8B , the conference interface 620 includes a volume adjustment bar 801 . The volume adjustment bar 801 can be used to indicate the current volume of the electronic device 100 . The volume adjustment bar 801 can also be used to receive a sliding input from the user to adjust the volume of the electronic device 100 .
可以理解的是,此处通过触摸传感器检测用户对手写笔200的输入仅为示例,不限于触摸传感器,手写笔200也可以通过超声波传感器等检测用户对手写笔200的输入,本申请实施例对此不作限定。It is understandable that detecting the user's input to the stylus 200 through a touch sensor is only an example and is not limited to a touch sensor. The stylus 200 may also detect the user's input to the stylus 200 through an ultrasonic sensor or the like, and the embodiment of the present application does not limit this.
需要说明的是,上述通过手写笔200控制电子设备100执行的指定操作包括静音/解除静音,结束通话,调整音量等输入,该些指定操作仅为示例,本申请实施例还可以提供通过手写笔200控制电子设备100执行其他指定操作的指定输入。例如,电子设备100在会议中显示幻灯片时,手写笔200可以接收用户的输入(例如,左滑,右滑),触发电子设备100切换显示的幻灯片。再例如,手写笔200可以在通过陀螺仪等传感器检测到用户摇晃手写笔200时,触发电子设备100关闭扬声器或打开扬声器等等,本申请实施例对此不作限定。It should be noted that the above-mentioned designated operations performed by the electronic device 100 controlled by the stylus 200 include inputs such as mute/unmute, end call, and adjust volume. These designated operations are only examples. The embodiments of the present application can also provide designated inputs for controlling the electronic device 100 to perform other designated operations through the stylus 200. For example, when the electronic device 100 displays a slide in a meeting, the stylus 200 can receive user input (for example, swipe left, swipe right) to trigger the electronic device 100 to switch the displayed slide. For another example, the stylus 200 can trigger the electronic device 100 to turn off or turn on the speaker, etc. when it detects that the user is shaking the stylus 200 through a sensor such as a gyroscope. The embodiments of the present application are not limited to this.
在另一些示例中,电子设备100与手写笔200建立通信连接,电子设备100可以在接收到开始通话的输入后,指示手写笔200开始通话。手写笔200可以在接收到电子设备100的指示后,检测手写笔200的状态。当手写笔200基于手写笔200的状态,确定出使用电子设备100的麦克风采集音频数据时,可以指示电子设备100自行采集音频数据。当手写笔200基于手写笔200的状态,确定出使用手写笔200的麦克风采集音频数据时,可以将采集的音频数据发送至电子设备100。当手写笔200基于手写笔200的状态,确定出使用电子设备100的麦克风和手写笔200的麦克风采集音频数据时,可以指示电子设备100采集音频数据并将采集的音频数据发送至电子设备100。具体的,手写笔200基于手写笔200的状态,确定使用电子设备100的麦克风和/或手写笔200的麦克风采集音频数据的描述可以参见上述实施例,在此不再赘述。这样,手写笔200可以自行判断是否需要采集音频数据。In other examples, the electronic device 100 establishes a communication connection with the stylus 200, and the electronic device 100 may instruct the stylus 200 to start a call after receiving an input to start a call. The stylus 200 may detect the status of the stylus 200 after receiving the instruction from the electronic device 100. When the stylus 200 determines to use the microphone of the electronic device 100 to collect audio data based on the status of the stylus 200, the electronic device 100 may be instructed to collect audio data on its own. When the stylus 200 determines to use the microphone of the stylus 200 to collect audio data based on the status of the stylus 200, the collected audio data may be sent to the electronic device 100. When the stylus 200 determines to use the microphone of the electronic device 100 and the microphone of the stylus 200 based on the status of the stylus 200, the electronic device 100 may be instructed to collect audio data and send the collected audio data to the electronic device 100. Specifically, the stylus 200 determines whether to use the microphone of the electronic device 100 and/or the microphone of the stylus 200 to collect audio data based on the state of the stylus 200. Please refer to the above embodiment for a description, which will not be repeated here. In this way, the stylus 200 can independently determine whether to collect audio data.
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims (22)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410330913.3 | 2024-03-21 | ||
| CN202410330913.3A CN120692346A (en) | 2024-03-21 | 2024-03-21 | A call control method, system and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025195397A1 true WO2025195397A1 (en) | 2025-09-25 |
Family
ID=97073606
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2025/083335 Pending WO2025195397A1 (en) | 2024-03-21 | 2025-03-19 | Call control method, system, and related apparatus |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN120692346A (en) |
| WO (1) | WO2025195397A1 (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20050010373A (en) * | 2003-07-19 | 2005-01-27 | 삼성전자주식회사 | Stylus pen with microphone for portable terminal |
| US20090022332A1 (en) * | 2007-05-29 | 2009-01-22 | Andy Van Schaack | Enhanced Audio Recording For Smart Pen Computing Systems |
| US20150032457A1 (en) * | 2013-07-25 | 2015-01-29 | Samsung Electronics Co., Ltd. | Apparatus and method of controlling voice input in electronic device supporting voice recognition |
| CN205121493U (en) * | 2015-11-12 | 2016-03-30 | 联想(北京)有限公司 | Writing pen and electronic equipment |
| CN105554201A (en) * | 2015-07-31 | 2016-05-04 | 宇龙计算机通信科技(深圳)有限公司 | Audio frequency circuit selection method, apparatus, and circuit, and hand-held terminal |
-
2024
- 2024-03-21 CN CN202410330913.3A patent/CN120692346A/en active Pending
-
2025
- 2025-03-19 WO PCT/CN2025/083335 patent/WO2025195397A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20050010373A (en) * | 2003-07-19 | 2005-01-27 | 삼성전자주식회사 | Stylus pen with microphone for portable terminal |
| US20090022332A1 (en) * | 2007-05-29 | 2009-01-22 | Andy Van Schaack | Enhanced Audio Recording For Smart Pen Computing Systems |
| US20150032457A1 (en) * | 2013-07-25 | 2015-01-29 | Samsung Electronics Co., Ltd. | Apparatus and method of controlling voice input in electronic device supporting voice recognition |
| CN105554201A (en) * | 2015-07-31 | 2016-05-04 | 宇龙计算机通信科技(深圳)有限公司 | Audio frequency circuit selection method, apparatus, and circuit, and hand-held terminal |
| CN205121493U (en) * | 2015-11-12 | 2016-03-30 | 联想(北京)有限公司 | Writing pen and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN120692346A (en) | 2025-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101183737B1 (en) | A multi earphone device capable recognizing actions and a method of recognizing actions thereof | |
| US11644904B2 (en) | Snap motion gesture detection and response | |
| EP2698787B1 (en) | Method for providing voice call using text data and electronic device thereof | |
| US20140179380A1 (en) | Method and apparatus for controlling audio signal in portable terminal | |
| CN111371949A (en) | Application switching method, device, storage medium and touch terminal | |
| CN107257525A (en) | Portable terminal and in portable terminal indicate sound source position method | |
| WO2016177296A1 (en) | Video generation method and apparatus | |
| KR20150099156A (en) | Wireless receiver and method for controlling the same | |
| JP2022537012A (en) | Multi-terminal multimedia data communication method and system | |
| CN107291242B (en) | A control method of an intelligent terminal and an intelligent terminal | |
| CN112806067A (en) | Voice switching method, electronic equipment and system | |
| CN112150778A (en) | Environmental sound processing method and related device | |
| CN107743178A (en) | A kind of message player method and mobile terminal | |
| CN106982286A (en) | A kind of way of recording, equipment and computer-readable recording medium | |
| CN114520002A (en) | Method for processing voice and electronic equipment | |
| WO2023151526A1 (en) | Audio acquisition method and apparatus, electronic device and peripheral component | |
| WO2021244058A1 (en) | Process execution method, device, and readable medium | |
| WO2023184825A1 (en) | Video recording control method of electronic device, electronic device, and readable medium | |
| WO2024114233A1 (en) | Call method and electronic device | |
| CN112019895B (en) | Function operation control method, function operation control device, and storage medium | |
| CN104104899B (en) | The method and apparatus that information transmits in video conference | |
| WO2025195397A1 (en) | Call control method, system, and related apparatus | |
| WO2021098708A1 (en) | Calling method, and terminal apparatus | |
| CN111556196A (en) | Call method and device and electronic equipment | |
| CN107682770B (en) | A kind of application control method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 25773143 Country of ref document: EP Kind code of ref document: A1 |