CN109478131A - Audio input output method and terminal device - Google Patents

Audio input output method and terminal device Download PDF

Info

Publication number
CN109478131A
CN109478131A CN201780043557.5A CN201780043557A CN109478131A CN 109478131 A CN109478131 A CN 109478131A CN 201780043557 A CN201780043557 A CN 201780043557A CN 109478131 A CN109478131 A CN 109478131A
Authority
CN
China
Prior art keywords
terminal device
human body
audio
close
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201780043557.5A
Other languages
Chinese (zh)
Inventor
赵心宇
陈运哲
金庆浩
张泽狮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN109478131A publication Critical patent/CN109478131A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics

Abstract

A kind of input output method and terminal device of audio can be realized terminal device and automatically determine audio input/output mode.The terminal device supports bone-conduction mode and air transmitted mode to carry out the input/output of audio, which comprises when the terminal device needs to carry out audio service, determines whether the terminal device is in close to the position of human body skull;If it is determined that the terminal device is in close to the position of human body skull, the input/output of audio is carried out using bone-conduction mode.

Description

Audio input output method and terminal device Technical field
This application involves audio input/output field more particularly to audio input/output methods and terminal device.
Background technique
With popularizing for terminal device, requirement of the user to terminal device is also higher and higher, such as call privacy, the clarity of audio output, quick conversation etc..In addition, being directed to different application scenarios, such as voice calling mode, audio-frequency play mode.Demand of the user to audio is different, and terminal device is unable to satisfy user to the different demands of audio service using traditional loudspeaker and microphone at present, and user experience needs to be further increased.
Summary of the invention
The embodiment of the present application provides the input/output method and terminal device of a kind of audio, can be realized terminal device and automatically determines audio input/output mode.
In the embodiment of the present application, terminal device can support bone-conduction mode and air transmitted mode to carry out the input/output of audio.
Optionally, which can be the wearable devices such as electronic watch, electronics bracelet, finger ring.
In a first aspect, providing a kind of input/output method of audio, when the terminal device needs to carry out audio service, determine whether the terminal device is in close to the position of human body skull;If it is determined that the terminal device is in close to the position of human body skull, the input/output of audio is carried out using bone-conduction mode.
Determine whether the terminal device is in the movement close to the position of human body skull alternatively it is also possible to execute under other conditions.
Optionally it is determined that it may include: around the determining terminal device with the presence or absence of human body skull that whether the terminal device, which is in the position close to human body skull,.
Optionally, whether which, which is in the position close to human body skull, can indicate whether user by hand is placed on head.
In this way, by determining whether the terminal device is in close to the position of human body skull, and in the case where determining that the terminal device is in close to the position of human body skull, the input/output of audio is carried out using bone-conduction mode, the input/output that audio can be carried out according to user intention, to improve user experience.
In the first possible implementation of the first aspect, this method further include: if it is determined that the terminal device is not in close to the position of human body skull, the input/output of audio is carried out using air transmitted mode.
Above-mentioned possible implementation with reference to first aspect, in the second possible implementation of the first aspect, whether the determination terminal device is in close to the position of human body skull, comprising: the human body skull around the terminal device is detected by first detection unit;If detecting the presence of human body skull, determine that the terminal device is in close to the position of human body skull.
Optionally, which includes at least one of lower sensor: ultrasonic sensor, infrared structure optical sensor and the IR Flight timer of multiple spot distribution of multiple spot distribution.
Optionally, which can be specially array of ultrasonic sensors.
Optionally, the side which can be specifically used for detecting the terminal device whether there is human body skull.
Above-mentioned possible implementation with reference to first aspect, in a third possible implementation of the first aspect, before whether the determination terminal device is in the position close to human body skull, this method further include: it is single to pass through the second detection Member detects the motion profile of the terminal device;Whether the determination terminal device is in close to the position of human body skull, comprising: if the motion profile meets preset condition, determines whether the terminal device is in close to the position of human body skull.
Optionally, which includes at least one of lower sensor: acceleration transducer, gyroscope and compass detector.
Optionally, which can be specially six axle sensors being made of acceleration transducer and gyroscope.
Optionally, which can detecte the motion profile of the terminal device, wherein the motion profile of the terminal device is determined for the motion profile of user's wrist, i.e. user gesture.
It is alternatively possible to whether meet preset condition by user gesture corresponding to the motion profile for determining the terminal device, to determine whether the motion profile meets preset condition.
Optionally, it is lift hand gesture which, which includes: the corresponding user gesture of the motion profile,.
Optionally, which can detecte the motion profile of hand or arm, and the motion profile that will test is compared with predetermined movement track.
Optionally, if the matching degree of the motion profile detected and predetermined movement track corresponding with lift hand gesture is greater than first threshold, lift hand gesture can be confirmly detected.
Optionally, if the matching degree between the motion profile detected and predetermined movement track corresponding with hand gesture is fallen is greater than second threshold, it can confirmly detect and fall hand gesture.
Optionally, which can be identical or different.
Optionally, this method further include: if the motion profile meets the second preset condition, it is determined that carry out the input/output of audio using air transmitted mode.
Optionally, it is to fall hand gesture which, which may include: the corresponding user gesture of the motion profile,.
In this way, by detecting the motion profile of terminal device, and when the motion profile for determining terminal device meets preset condition, executes and determine whether terminal device is in the movement close to the position of human body skull, the power consumption of terminal device can be reduced while preventing erroneous judgement.
Optionally, which may include main part and fitting part, wherein the fitting part includes the first sound collection unit, for carrying out the acquisition of audio under bone-conduction mode;The main part may include second sound acquisition unit, for carrying out the acquisition of audio under air transmitted mode.
Optionally, first sound collection unit and the second sound acquisition unit can be specially microphone.
Optionally, under bone-conduction mode, the output of audio can be carried out by osteoacusis unit.Under air transmitted mode, the output of audio can be carried out by loudspeaker.
Above-mentioned possible implementation with reference to first aspect, in a fourth possible implementation of the first aspect, this method further include: if it is determined that the terminal device is in close to the position of human body skull, the display unit for controlling the terminal device is in OFF state.
Optionally, when determining the input/output using bone-conduction mode progress audio, that is, when the audio mode for determining terminal device is bone-conduction mode, the display screen of terminal device can be extinguished.
Optionally, determining that when the audio mode for determining terminal device is air transmitted mode (or being speaker mode), the display screen that can control terminal device is in bright screen state when carrying out the input/output of audio using air transmitted mode.
In this way, the display screen by the controlling terminal equipment under bone-conduction mode is in OFF state, the power consumption of terminal device can reduce.
Above-mentioned possible implementation with reference to first aspect, in a fourth possible implementation of the first aspect, this method further include: if the audio service is specially incoming call business and determines that the terminal device is in close to the position of human body skull, connect the incoming call.
In this way, user experience can be further increased by the turn on automatically incoming call when determining the input/output using bone-conduction mode progress audio.
Second aspect provides a kind of terminal device, the method in any possible implementation for executing above-mentioned first aspect or first aspect.
Specifically, which may include the unit for executing the method in any possible implementation of above-mentioned first aspect or first aspect.
The third aspect provides a kind of wearable device, the method in any possible implementation for executing above-mentioned first aspect or first aspect.
Specifically, which may include the unit for executing the method in any possible implementation of above-mentioned first aspect or first aspect.
Fourth aspect, provide a kind of terminal device, it include: processor, bone conduction vibrator, loudspeaker, the first microphone, second microphone and first sensor, wherein, first microphone can be used for carrying out the acquisition of audio under bone-conduction mode, and the bone conduction vibrator under bone-conduction mode for carrying out the output of audio;The second microphone under air transmitted mode for carrying out the acquisition of audio, and the loudspeaker under air transmitted mode for carrying out the output of audio.The first sensor can be used for detecting with the presence or absence of human body skull around terminal device, which can be used for the testing result according to the first sensor, determine the input/output that audio is carried out using bone-conduction mode or air transmitted mode.
Optionally, which can be specially wearable device.
Optionally, if the terminal device is specially electronic watch, which can be located in watchband, which can be located in dial plate.
Optionally, which can also include second sensor, for detecting the motion profile of terminal device.The processor can be also used for the motion profile detected according to the second sensor, determine user gesture, and when the user gesture is lift hand gesture, indicate around first sensor detection terminal device with the presence or absence of human body skull.
5th aspect, provide a kind of terminal device, it include: memory and processor, the memory is for storing instruction, the processor is used to execute the instruction of memory storage, and when the processor executes the instruction of memory storage, the execution is so that the processor executes the method in any possible implementation of first aspect or first aspect.
6th aspect, provides a kind of computer-readable medium, for storing computer program, which includes the instruction for executing the method in any possible implementation of first aspect or first aspect.
Detailed description of the invention
Fig. 1 is the configuration diagram of the terminal device of the embodiment of the present application application.
Fig. 2 is the schematic flow chart of the input/output method of audio provided by the embodiments of the present application.
Fig. 3 is the schematic flow chart of another input/output method of audio provided by the embodiments of the present application.
Fig. 4 is the schematic diagram of the fixation position of the bone conduction vibrator in terminal device provided by the embodiments of the present application.
Fig. 5 is the exemplary schematic diagram of input/output method of the audio of electronic watch provided by the embodiments of the present application.
Fig. 6 is the schematic block diagram of terminal device provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application is described.
Fig. 1 shows the terminal device 100 of the embodiment of the present application application, which can support bone-conduction mode and air transmitted mode carries out audio input/output, and the audio mode that can be used determine according to actual needs.
The terminal device 100 may include processor, memory, six axle sensors, array of ultrasonic sensors, bone conduction vibrator, the first microphone (MIC), loudspeaker and the 2nd MIC.
Specifically, memory can be used for storing data and/or instruction.
Six axle sensors may include acceleration transducer and gyroscope, for detecting the motion track of terminal device 100, wherein the motion track detected is determined for user gesture.Array of ultrasonic sensors may include 3 × N number of ultrasonic sensor, for detecting the human body skull around terminal device 100.
Processor can be by being internally integrated (Inter-Integrated Circuit, I2C) bus or other modes are from six axle sensors and array of ultrasonic sensors acquisition data, and the audio mode used is determined according to the data got.Optionally, which can be specially application processor, but the embodiment of the present application is without being limited thereto.
2nd MIC and loudspeaker can be used for carrying out outputting and inputting for audio under air transmitted mode, and the first MIC and bone conduction vibrator can be used for carrying out outputting and inputting for audio under bone-conduction mode.
It should be understood that the terminal device 100 can also include other component, for sake of simplicity, which is not described herein again.
In the embodiment of the present application, which can be the portable terminal that smart phone, tablet computer etc. are able to carry out voice service.Optionally, which can be specially wearable device, such as electronics bracelet, electronic watch or other kinds of wearable device, the embodiment of the present application do not limit this.
Fig. 2 shows provided by the embodiments of the present application 200.This 200 can be applied to terminal device 100 shown in FIG. 1, but the embodiment of the present application is without being limited thereto.
S210, determines whether terminal device is in close to the position of human body skull.
Optionally, terminal device can execute S210 when the terminal device needs to carry out audio service, wherein audio service, which can refer to, is arbitrarily related to the business of audio output and/or audio input, for example, call, broadcasting audio or video, recording etc..For example, the terminal device can be when entering voice Interaction Interface, such as when entering video or audio broadcasting or call interface, execute S210.For another example can also be when receiving the triggering information for carrying out audio service, such as call instruction, the call request of other terminal devices, the broadcasting of user or record command of user, etc., execution S210.For another example terminal device can also periodically carry out S210, etc. during carrying out audio service, the embodiment of the present application is not limited this.For another example the terminal device can execute S210 when receiving the user instruction of input/output of the instruction using bone-conduction mode progress audio.For another example the terminal device can also periodically carry out S210, the embodiment of the present application executes the actual conditions of S210 without limitation to the terminal device.
In S210, it whether there is human body skull within the scope of the preset length of terminal device it is alternatively possible to determine.If there is human body skull, then it can determine that the terminal device is in close to the position of human body skull.Optionally, if there is no human body skull, then it can determine that the terminal device is not in close to the position of human body skull.Wherein, which can be predefined, also may rely on by the ability of terminal device itself, be also possible to what user specified, and the embodiment of the present application does not limit this.
As an alternative embodiment, it can determine whether terminal device is in close to the position of human body skull by sensor.Specifically, human body skull can be detected by first detection unit, wherein, optionally, the first detection unit may include IR Flight time (the Time Of Flight of ultrasonic sensor, infrared structure optical sensor and the multiple spot distribution of multiple spot distribution, TOF) one of sensor or a variety of, but the embodiment of the present application is without being limited thereto.Optionally, if the first detection unit detects the presence of human body skull, it can determine that the terminal device is in close to the position of human body skull. Otherwise, optionally, if the presence of human body skull is not detected in the first sensor, it can determine that the terminal device is not in close to the position of human body skull, but the embodiment of the present application is without being limited thereto.
As an example, if the terminal device is specially electronic watch or electronics bracelet, whether the side that then first sensor can be specifically used for detection terminal device has the presence of human body skull, wherein, the side of the terminal device can refer to the side of dial plate and/or watchband, but the embodiment of the present application is without being limited thereto.
S220, however, it is determined that the terminal device is in close to the position of human body skull, and the input/output of audio is carried out using bone-conduction mode.
Optionally, in method 200, however, it is determined that the terminal device is not in close to the position of human body skull, and the input/output of audio can be carried out using air transmitted mode.
Specifically, under bone-conduction mode, the input/output of audio can be carried out using the first audio input/output unit.For example, the acquisition of audio can be carried out using the first sound collection unit, and/or the output of audio is carried out using osteoacusis vibration unit.
Under air transmitted mode, the input/output of audio can be carried out using the second audio input/output unit.For example, the acquisition of audio can be carried out using second sound acquisition unit, and/or the output of audio is carried out using loudspeaker.
As an optional example, which may include main part and fitting part, wherein first sound collection unit can be located at the fitting part, which can be located at main part.At this time, if it is determined that the terminal device is in close to the position of human body skull, then the acquisition of sound can be carried out using the first sound collection unit of fitting part.If it is determined that the terminal device is not in close to the position of human body skull, then the acquisition of sound can be carried out using the second sound acquisition unit of main part, but the embodiment of the present application is without being limited thereto.
Optionally, the osteoacusis vibration unit may include bone conduction vibrator, the main part of terminal device can be located at, the fitting part of terminal device can also be located at, at this time, the bone conduction vibrator can be independently arranged or be integrated in the same component with second input unit, and the embodiment of the present application does not limit this.
Optionally, loudspeaker can be located at the main part of the terminal device, but the embodiment of the present application is without being limited thereto.
As an alternative embodiment, if it is determined that the terminal device is in close to the position of human body skull, and the display unit that can also control the terminal device is in OFF state.
For example, if the display screen of the terminal device is currently at display state (or being bright screen state) and determines that the terminal device is in close to the position of human body skull the display screen of the terminal device can be extinguished, to reduce the power consumption of terminal device.
As another alternative embodiment, if it is determined that the terminal device is not in close to the position of human body skull, then the display unit that can control the terminal device is in display state.
Such as, if it is determined that the terminal device is not in close to the position of human body skull, when the display screen of the terminal device is currently at display state, the display screen can be made to continue to keep display state;When the display screen of the terminal device is currently at OFF state, which can be converted to display state, but the embodiment of the present application is without being limited thereto.
As an alternative embodiment, if the terminal device receives incoming call, and S210 determines that terminal device is in close to the position of human body skull, then can connect the incoming call, button operation or touch display screen are carried out without user, to improve user experience.
Optionally, user can preset the function that turn on automatically incoming call whether is opened under bone-conduction mode.At this point it is possible in the case where user pre-sets the function of turn on automatically incoming call under bone-conduction mode, turn on automatically incoming call when determining that terminal device is in close to the position of human body skull, but the embodiment of the present application is without being limited thereto.
As an alternative embodiment, before S210, this method 200 further include:
The motion profile of the terminal device is detected by second detection unit;
Correspondingly, S210, determines whether the terminal device is in close to the position of human body skull, if may include: that the motion profile meets preset condition, determines whether the terminal device is in close to the position of human body skull.
Optionally, it can use the motion profile of six axle sensors detection terminal device, wherein, six axle sensor may include one of 3-axis acceleration sensor, three-axis gyroscope, compass detector (alternatively referred to as geomagnetic sensor) etc. or a variety of, and the embodiment of the present application does not limit this.
Optionally, which can be predefined, be also possible to that user is pre-set, and the embodiment of the present application does not limit this.
As an example, which can determine the motion track of user's wrist or finger, and then determine user gesture by the motion profile of detection terminal device.Optionally, which may include the corresponding user gesture of motion profile of the terminal device to lift hand gesture, but the embodiment of the present application is without being limited thereto.At this time, if the second detection unit detects lift hand gesture, then whether first sensor can detecte the terminal device currently in the position close to human body skull, detection or the second detection unit are carried out simultaneously compared with carrying out detection after the first sensor detects with the first sensor and the second detection unit, can save the power consumption of terminal device.
As another example, if the second detection unit, which detects, falls hand gesture, it can then determine the input/output that audio is carried out using air transmitted mode, at this time, optionally, the first sensor can be without determining the step of whether terminal device is in close to the position of human body skull, but the embodiment of the present application is without being limited thereto.
Specifically, which can determine user gesture, but the embodiment of the present application is without being limited thereto by the motion profile and final carriage of detection terminal device.
Optionally, terminal device can be when determination needs to carry out audio service, such as when entering speech enabled (i.e. audio input and/or output) interface, starts the detection of user gesture.For example, the terminal device can use gyroscope detection user gesture.Specifically, which can detecte the motion profile of hand or arm, and the motion profile that will test is compared with predetermined movement track.Optionally, if the matching degree of the motion profile detected and predetermined movement track corresponding with lift hand gesture is greater than first threshold, lift hand gesture can be confirmly detected.Optionally, if the matching degree between the motion profile detected and predetermined movement track corresponding with hand gesture is fallen is greater than second threshold, it can confirmly detect and fall hand gesture.Wherein, at least one in the first threshold and the second threshold can pre-define, or be preset by user, and the embodiment of the present application does not limit this.
Optionally, which can be identical or different.Furthermore, the corresponding predetermined movement track of lift hand gesture and/or fall the corresponding predetermined movement track of hand gesture can be it is predetermined, either user pre-enters, or made of being also possible to the motion trace data fitting for multiple hand/arm that terminal device is detected according to sensor (such as gyroscope), the embodiment of the present application is not limited this.
Therefore, the input/output method of audio provided by the embodiments of the present application, by determining whether terminal device is in close to the position of human body skull, in the case where terminal device is in close to the position of human body skull, the input/output of audio is carried out using bone-conduction mode, and in the case where terminal device is not in close to the position of human body skull, the input/output of audio is carried out using air transmitted mode, audio mode can be determined according to the needs of users, to improve terminal device performance, user experience is improved.
It should be understood that magnitude of the sequence numbers of the above procedures are not meant that the order of the execution order, the execution sequence of each process be should be determined by its function and internal logic, and the implementation process without coping with the embodiment of the present application constitutes any restriction.
Below in conjunction with specific example, the input/output method of audio provided by the embodiments of the present application is described in detail.
Fig. 3 shows the schematic flow chart of the input/output method 300 of another audio provided by the embodiments of the present application.
S310, terminal device enter voice Interaction Interface.
S320, initiation gesture detection.
Optionally, if detecting lift hand gesture, S330 is executed.Optionally, hand gesture is fallen if detecting, executes S340.
S330 whether there is human body skull around ultrasound examination terminal device.
It is alternatively possible to using there are the probability of human body skull around ultrasound examination terminal device, but the embodiment of the present application is without being limited thereto.If detecting the presence of human body skull around terminal device, S350 can be executed, optionally, if human body skull is not detected around terminal device, S340 can be executed, but the embodiment of the present application is without being limited thereto.
S340 carries out outputting and inputting for audio by dial plate MIC and loudspeaker.
S350 carries out outputting and inputting for audio by bone conduction vibrator and watchband MIC.
In the examples below, it is assumed that the terminal device is electronic watch.The electronic watch may include dial plate and watchband, wherein the dial plate may include loudspeaker and second microphone, which may include the first microphone.Optionally, which can also include bone conduction vibrator, as shown in figure 4, the fixed bit of the bone conduction vibrator is equipped with two schemes: one is in insertion wearable device main body, i.e., insertion dial plate, another kind are insertion watchbands.The fixed location schemes of the difference of the bone conduction vibrator can correspond to different wrist contact points, thus corresponding different audition mode, but the embodiment of the present application is without being limited thereto.
The electronic watch can also include the ultrasonic sensor that six axle sensors and multiple spot are distributed.Wherein, six axle sensors inside the electronic watch can be used for the purposes such as step counting, lift hand detection, and optionally, which can be timing wake-up mode, but the embodiment of the present application is without being limited thereto.
As shown in figure 5, can detect first by 3-axis acceleration sensor inside wearable device and three-axis gyroscope to wrist motion profile, the motion profile of wrist is depicted by algorithm, exports actually detected track and models the similarity degree value of track.It may then pass through the sensors such as ultrasonic wave, infrared TOF, the infrared structure light on wearable device, the ambient enviroment of wearable device detected, to determine whether the side of wearable device is skull, and judge the probability for having human body skull.Finally, can judge whether user places a finger at skull by above two test result.If it is determined that user places a finger at skull, then can control voice-frequency channel inside wearable device is bone-conduction mode.If it is determined that hand is not placed at skull by user, then can control voice-frequency channel inside wearable device is air transmitted mode (being referred to as speaker mode), but the embodiment of the present application is without being limited thereto.
It is to help those skilled in the art it should be understood that above-mentioned and more fully understands the embodiment of the present application, and the range of the embodiment of the present application have to be limited.Those skilled in the art are according to given above-mentioned example, it is clear that can carry out the modification or variation of various equivalences, such modification or variation are also fallen into the range of the embodiment of the present application.
Fig. 6 shows terminal device 400 provided by the embodiments of the present application, it include: to carry out the first audio input of audio input/output/output unit 410 using osteoacusis and carry out the second audio input of audio input/output/output unit 420 using air transmitted, correspondingly, which can support bone-conduction mode and air transmitted mode to carry out audio input/output.
Optionally, first audio input/output unit 410 may include the first audio collection unit and osteoacusis vibration unit, correspondingly, under bone-conduction mode, the acquisition of audio can be carried out using the first audio collection unit, and the output of audio can be carried out using osteoacusis vibration unit.
Optionally, second audio input/output unit 420 may include the second audio collection unit and loudspeaker, correspondingly, under air transmitted mode, the acquisition of audio can be carried out using the second audio collection unit, and the output of audio can be carried out using loudspeaker.
It should be noted that the first audio collection unit and the second audio collection unit here can be identical or different component, and it can be located on same chip or different chips, or can integrate in the same component, the embodiment of the present application does not limit this.
The terminal device 400 can also include processing unit 430, for determining terminal device 400 whether in the position close to human body skull, if and the terminal device 400 is in close to the position of human body skull, determines the input/output for carrying out audio using the first audio input/output unit 410.
It should be understood that terminal device 400 is embodied in the form of functional unit.In an optional example, it will be understood by those skilled in the art that terminal device 400 can be specially the terminal device in above method embodiment, terminal device 400 can be used for executing each process and/or step in above method embodiment, to avoid repeating, details are not described herein.
It will also be understood that, in the embodiment of the present application, term " unit " can refer to using peculiar integrated circuit (Application Specific Integrated Circuit, ASIC), electronic circuit, processing unit (such as shared processing unit, proprietary processing unit or group processing unit etc.) and memory for executing one or more softwares or firmware program, merge logic circuit and/or other appropriate components for supporting described function.
The embodiment of the present application also provides a kind of processors, for executing each process and/or step in above method embodiment.
It should be understood that, processor in the embodiment of the present application can be central processing unit (Central Processing Unit, CPU), which can also be other General Porcess Unit, digital up-link signal processing unit (DSP), specific integrated circuit (ASIC), ready-made programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hardware components etc..General Porcess Unit can be microprocessing unit or the processing unit is also possible to any conventional processing unit etc..
Memory may include read-only memory and random access memory, and provide instruction and data to processing unit.The a part of of memory can also include nonvolatile RAM.For example, memory can be with the information of storage device type.The processing unit can be used for executing the instruction stored in memory, and when the processing unit executes the instruction, which can execute each step corresponding with terminal device in above method embodiment.
During realization, each step of the above method can through the processing unit in the integrated logic circuit of hardware or the instruction of software form complete.The step of method in conjunction with disclosed in the embodiment of the present application, can be embodied directly in hardware processing element and execute completion, or in processing unit hardware and software module combination execute completion.Software module can be located at random access memory, flash memory, read-only memory, in the storage medium of this fields such as programmable read only memory or electrically erasable programmable memory, register maturation.The step of storage medium is located at memory, and processing unit executes the instruction in memory, completes the above method in conjunction with its hardware.To avoid repeating, it is not detailed herein.
It should be understood that focusing on the difference emphasized between each embodiment to the description of the embodiment of the present application above, the same or similar place that do not mention can be referred to mutually, for sake of simplicity, which is not described herein again.
In addition, the terms " system " and " network " are often used interchangeably herein.The terms "and/or", only a kind of incidence relation for describing affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
Those of ordinary skill in the art may be aware that unit described in conjunction with the examples disclosed in the embodiments of the present disclosure and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Professional technician can use different methods to achieve the described function each specific application, but this realization should not be recognized For beyond scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, system, the specific work process of device and unit of foregoing description can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods may be implemented in other ways.Such as, the apparatus embodiments described above are merely exemplary, such as, the division of the unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, and component shown as a unit may or may not be physical unit, it can and it is in one place, or may be distributed over multiple network units.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in each embodiment of the application can integrate in one processing unit, it is also possible to each unit and physically exists alone, can also be integrated in one unit with two or more units.
If the function is realized in the form of SFU software functional unit and when sold or used as an independent product, can store in a computer readable storage medium.Based on this understanding, substantially the part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products the technical solution of the application in other words, the computer software product is stored in a storage medium, it uses including some instructions so that a computer equipment (can be personal computer, server or the network equipment etc.) execute each embodiment the method for the application all or part of the steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), the various media that can store program code such as random access memory (Random Access Memory, RAM), magnetic or disk.
It is described above; the only specific embodiment of the application, but the protection scope of the application is not limited thereto, and anyone skilled in the art is within the technical scope of the present application; it can easily think of the change or the replacement, should all cover within the scope of protection of this application.Therefore, the protection scope of the application shall be subject to the protection scope of the claim.

Claims (24)

  1. A kind of input/output method of audio, which is characterized in that be applied to terminal device, the terminal device supports bone-conduction mode and air transmitted mode to carry out the input/output of audio, which comprises
    When the terminal device needs to carry out audio service, determine whether the terminal device is in close to the position of human body skull;
    If it is determined that the terminal device is in close to the position of human body skull, the input/output of audio is carried out using bone-conduction mode.
  2. The method according to claim 1, wherein further include:
    If it is determined that the terminal device is not in close to the position of human body skull, the input/output of audio is carried out using air transmitted mode.
  3. Method according to claim 1 or 2, which is characterized in that whether the determination terminal device is in close to the position of human body skull, comprising:
    The human body skull around the terminal device is detected by first detection unit;
    If detecting the presence of human body skull, determine that the terminal device is in close to the position of human body skull.
  4. According to the method described in claim 3, it is characterized in that, the first detection unit includes at least one of lower sensor: ultrasonic sensor, infrared structure optical sensor and the IR Flight timer of multiple spot distribution of multiple spot distribution.
  5. Method according to claim 1 to 4, which is characterized in that before whether the determination terminal device is in the position close to human body skull, the method also includes:
    The motion profile of the terminal device is detected by second detection unit;
    Whether the determination terminal device is in close to the position of human body skull, comprising:
    If the motion profile meets preset condition, determine whether the terminal device is in close to the position of human body skull.
  6. According to the method described in claim 5, it is characterized in that, it is lift hand gesture that the preset condition, which includes: the corresponding user gesture of the motion profile,.
  7. Method according to claim 5 or 6, which is characterized in that the second detection unit includes at least one of lower sensor: acceleration transducer, gyroscope and compass detector.
  8. Method according to any one of claim 1 to 7, which is characterized in that the terminal device includes main part and fitting part, wherein the fitting part includes the first sound collection unit for carrying out audio collection under the bone-conduction mode;
    The input/output that audio is carried out using bone-conduction mode, comprising:
    The acquisition of audio is carried out using first sound collection unit of the fitting part;And/or
    The output of audio is carried out using the osteoacusis vibration unit in the terminal device.
  9. Method according to any one of claim 1 to 8, which is characterized in that the method also includes:
    If it is determined that the terminal device is in close to the position of human body skull, the display unit for controlling the terminal device is in OFF state.
  10. Method according to any one of claim 1 to 8, which is characterized in that the method also includes:
    If the audio service is specially incoming call business and determines that the terminal device is in close to the position of human body skull, the incoming call is connected.
  11. Method according to any one of claim 1 to 10, which is characterized in that the terminal device is specially wearable device.
  12. A kind of terminal device, comprising:
    First audio input/output unit, for carrying out audio input/output under bone-conduction mode;
    Second audio input/output unit, for carrying out audio input/output under air transmitted mode;
    Processing unit, for when the terminal device needs to carry out audio service, determine whether the terminal device is in close to the position of human body skull, if and the terminal device is in close to the position of human body skull, determines the input/output for carrying out audio using first audio input/output unit.
  13. Terminal device according to claim 12, which is characterized in that the processing unit is also used to: if the terminal device is not in close to the position of human body skull, the input/output that audio is carried out using second audio input/output unit is determined.
  14. Terminal device according to claim 12 or 13, which is characterized in that the terminal device further include:
    First detection unit, for detecting the human body skull around the terminal device;
    The processing unit determines whether the terminal device is in close to the position of human body skull, comprising:
    If the first detection unit detects the presence of human body skull, the processing unit determines that the terminal device is in close to the position of human body skull.
  15. Terminal device according to claim 14, which is characterized in that the first detection unit includes at least one of following: ultrasonic sensor, infrared structure optical sensor and the IR Flight timer of multiple spot distribution of multiple spot distribution.
  16. Terminal device described in any one of 2 to 15 according to claim 1, which is characterized in that the terminal device further include:
    Second detection unit, for detecting the motion profile of the terminal device before the processing unit determines whether the terminal device is in the position close to human body skull;
    If the processing unit is specifically used for the motion profile that the second detection unit detects and meets preset condition, determine whether the terminal device is in close to the position of human body skull.
  17. Terminal device according to claim 16, which is characterized in that the processing unit is also used to: the motion profile detected according to the detection unit determines user gesture;
    The preset condition includes: that the corresponding user gesture of the motion profile is lift hand gesture.
  18. Terminal device according to claim 16 or 17, which is characterized in that the second detection unit includes at least one of lower sensor: acceleration transducer, gyroscope and compass detector.
  19. Terminal device described in any one of 2 to 18 according to claim 1, which is characterized in that the terminal device includes main part and fitting part, wherein
    First audio input/output unit includes the first sound collection unit and osteoacusis vibration unit positioned at the fitting part;
    Second audio input/output unit includes microphone and the second sound acquisition unit positioned at the main part.
  20. Terminal device described in any one of 2 to 19 according to claim 1, which is characterized in that the terminal device further include: display unit,
    The processing unit is also used to: if it is determined that the terminal device is in close to the position of human body skull, being controlled the display unit and is in OFF state.
  21. Terminal device described in any one of 2 to 20 according to claim 1, it is characterized in that, the processing unit is also used to: if the audio service is specially incoming call business and determines that the terminal device is in close to the position of human body skull, connecting the incoming call.
  22. Terminal device described in any one of 2 to 21 according to claim 1, which is characterized in that the terminal device is specially wearable device.
  23. A kind of terminal device, it is characterized in that, it include: memory and processor, the memory is for storing instruction, the processor is used to execute the instruction of the memory storage, and when the processor executes the instruction of the memory storage, so that the processor executes the method as described in any one of claims 1 to 11.
  24. A kind of computer-readable medium, for storing computer program, the computer program includes the instruction for executing the method as described in any one of claims 1 to 11.
CN201780043557.5A 2016-11-22 2017-07-07 Audio input output method and terminal device Pending CN109478131A (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
CN201611045922 2016-11-22
CN201611045922X 2016-11-22
CN201710225687 2017-04-07
CN2017102256872 2017-04-07
PCT/CN2017/092161 WO2018095044A1 (en) 2016-11-22 2017-07-07 Audio input/output method and terminal device

Publications (1)

Publication Number Publication Date
CN109478131A true CN109478131A (en) 2019-03-15

Family

ID=62195422

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780043557.5A Pending CN109478131A (en) 2016-11-22 2017-07-07 Audio input output method and terminal device

Country Status (2)

Country Link
CN (1) CN109478131A (en)
WO (1) WO2018095044A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111786B (en) * 2019-04-30 2023-11-10 西藏灿雨伦珠科技有限公司 Audio processing method, equipment and computer readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103760982A (en) * 2014-01-22 2014-04-30 深圳市金立通信设备有限公司 Method and terminal for controlling state of terminal screen
CN104783765A (en) * 2015-03-09 2015-07-22 陈王胜 Method and device for measuring body temperature through intelligent wrist type wearable equipment
WO2015141402A1 (en) * 2014-03-19 2015-09-24 ソニー株式会社 Acoustic output device
CN205160790U (en) * 2015-11-10 2016-04-13 福建太尔电子科技股份有限公司 Take osteoacusis intelligence wrist -watch audiphone of bluetooth and speech exchange
CN105684401A (en) * 2013-10-24 2016-06-15 罗姆股份有限公司 Bracelet-type transmission/reception device and bracelet-type notification device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10108984B2 (en) * 2013-10-29 2018-10-23 At&T Intellectual Property I, L.P. Detecting body language via bone conduction
CN104618595B (en) * 2015-01-30 2018-01-19 广东欧珀移动通信有限公司 Talking mode switching method and apparatus
CN104915175A (en) * 2015-05-15 2015-09-16 广东小天才科技有限公司 Automatic bone conduction playback mode switching method and device and intelligent watch
CN205040805U (en) * 2015-10-20 2016-02-24 马国伟 Intelligence ring and bracelet communication device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105684401A (en) * 2013-10-24 2016-06-15 罗姆股份有限公司 Bracelet-type transmission/reception device and bracelet-type notification device
CN103760982A (en) * 2014-01-22 2014-04-30 深圳市金立通信设备有限公司 Method and terminal for controlling state of terminal screen
WO2015141402A1 (en) * 2014-03-19 2015-09-24 ソニー株式会社 Acoustic output device
CN104783765A (en) * 2015-03-09 2015-07-22 陈王胜 Method and device for measuring body temperature through intelligent wrist type wearable equipment
CN205160790U (en) * 2015-11-10 2016-04-13 福建太尔电子科技股份有限公司 Take osteoacusis intelligence wrist -watch audiphone of bluetooth and speech exchange

Also Published As

Publication number Publication date
WO2018095044A1 (en) 2018-05-31

Similar Documents

Publication Publication Date Title
KR102535726B1 (en) Method for detecting earphone position, storage medium and electronic device therefor
US20150123898A1 (en) Digital device and control method thereof
KR102330655B1 (en) Vein scanning device for automatic gesture and finger recognition
CN107742523B (en) Voice signal processing method and device and mobile terminal
KR102033334B1 (en) Wrist wearable apparatus with transformable material
CN108681498B (en) CPU occupancy rate monitoring method and device and mobile terminal
CN108777731B (en) Key configuration method and device, mobile terminal and storage medium
CN107870674B (en) Program starting method and mobile terminal
WO2020207376A1 (en) Denoising method and electronic device
US11644904B2 (en) Snap motion gesture detection and response
CN109994111B (en) Interaction method, interaction device and mobile terminal
US20170010669A1 (en) Method for operating electronic apparatus and electronic apparatus supporting the method
US9772815B1 (en) Personalized operation of a mobile device using acoustic and non-acoustic information
CN105607738B (en) Determine the method and device of one hand pattern
CN111683329B (en) Microphone detection method, device, terminal and storage medium
CN109388326A (en) A kind of electronic equipment, the control method and device of dual-screen electronic device
CN108270928B (en) Voice recognition method and mobile terminal
CN108536404A (en) Display control method, bendable pack terminal and computer readable storage medium
CN109478131A (en) Audio input output method and terminal device
CN109040457B (en) Screen brightness adjusting method and mobile terminal
CN113744736B (en) Command word recognition method and device, electronic equipment and storage medium
CN109144461A (en) Sounding control method, device, electronic device and computer-readable medium
CN109032008A (en) Sounding control method, device and electronic device
CN108966094B (en) Sound production control method and device, electronic device and computer readable medium
WO2020187112A1 (en) Parameter adjustment method and terminal device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190315

RJ01 Rejection of invention patent application after publication