CN107360500B - Sound output method and device - Google Patents
Sound output method and device Download PDFInfo
- Publication number
- CN107360500B CN107360500B CN201710706531.6A CN201710706531A CN107360500B CN 107360500 B CN107360500 B CN 107360500B CN 201710706531 A CN201710706531 A CN 201710706531A CN 107360500 B CN107360500 B CN 107360500B
- Authority
- CN
- China
- Prior art keywords
- user
- distance
- equipment
- determining
- angle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Abstract
The application provides a sound output method, which is applied to sound output equipment and comprises the following steps: determining the distance and the angle between the position of the user and the equipment according to the number of users needing to receive the sound, the states of the users and the equipment and a positioning technology; determining a direction area of sound output according to the determined distance and angle between the position of the user and the equipment; and outputting sound for the corresponding user according to the determined direction area. Based on the same inventive concept, the application also provides a sound output device which can improve the hearing experience of a user and increase the confidentiality.
Description
Technical Field
The invention relates to the technical field of intelligent positioning, in particular to a sound output method and a sound output device.
Background
There are several sound output methods in the existing implementations:
the first method comprises the following steps: conventional speakers output sound.
The traditional loudspeaker can not effectively control the transmission direction and the area of sound when transmitting sound, sound waves are spread towards a 360-degree sphere in a three-dimensional mode, loss is large, directivity is absent, and a user cannot hear clearly when much noise exists.
And the second method comprises the following steps: the direction of sound propagation is controlled physically, for example in directional sound transmission television sets, by sound insulating material or by an array of loudspeakers.
The direction of sound is limited by physically controlling the sound propagation direction, the user can only listen to the sound in a relevant area by matching with the equipment, the equipment is not suitable for the user, the operation is very humanized, and the operation cost is high even if the sound direction can be manually changed.
And the third is that: the sound directional transmission method based on image positioning judges the position of a user by capturing the image of the user to perform directional sound transmission.
The sound directional transmission method based on image positioning must capture the user image through the video capture device, and cannot deal with the situation that the user is not in the range of the video capture device, such as not in front of the camera but still needs to listen to the sound, or when the video capture device cannot work, such as a mobile phone is put in a pocket, the camera is occupied by other programs, and other related scenes. Moreover, the image processing needs a long time, the precision is poor, the computer resources are consumed greatly, the power consumption is large, and the like.
And fourthly: the volume can be adjusted in a self-adaptive manner, and the volume such as prompt tone, ring tone, output sound and the like can be intelligently adjusted according to factors such as surrounding environment sound and the like, so that a user can hear the sound of the equipment.
When the volume is adjusted in a self-adaptive manner, if the noise is too large, a good effect cannot be achieved; if the environment sound is large like a movie theater, but the equipment of the user cannot produce sound, the other people can be seriously influenced by turning the sound large.
And a fifth mode: the output of a loudspeaker and an earphone is switched through a sensor on the intelligent device, so that a user can clearly hear the target sound.
The speaker and the receiver are intelligently switched, and the confidentiality and the definition cannot be unified. And the earphone can also cause the problem of unclear sound because of insufficient maximum volume under the condition of excessive ambient noise.
Thus, there is no solution that provides an effective location of the user to accurately transmit sound to the area where the user is located in the current implementation.
Disclosure of Invention
In view of this, the present application provides a sound output method and apparatus, which can improve the user hearing experience and increase the security.
In order to solve the technical problem, the technical scheme of the application is realized as follows:
a sound output method is applied to a sound output device, and comprises the following steps:
determining the distance and the angle between the position of the user and the equipment according to the number of users needing to receive the sound, the states of the users and the equipment and a positioning technology;
determining a direction area of sound output according to the determined distance and angle between the position of the user and the equipment;
and outputting sound for the corresponding user according to the determined direction area.
An audio output apparatus for use with an audio output device, the apparatus comprising: a first determining unit, a second determining unit and an output unit;
the first determining unit is used for determining the distance and the angle between the position of the user and the equipment according to the number of users needing to receive sound, the states of the users and the equipment and a positioning technology;
the second determining unit is used for determining a direction area of sound output according to the distance and the angle between the position of the user and the equipment determined by the determining unit;
and the output unit is used for outputting sound for the corresponding user according to the direction area determined by the second determination unit.
According to the technical scheme, the distance and the angle between the position of the user and the equipment are effectively determined according to the number of the users receiving the sound, the states of the users and the sound output equipment and the positioning technology, the direction area of sound output is further determined, and the sound is output to the users. The technical scheme can improve the hearing experience of the user and increase the confidentiality.
Drawings
FIG. 1 is a schematic flow chart of an audio output method according to an embodiment of the present application;
FIG. 2 is a schematic diagram illustrating a sound output process according to an embodiment of the present application;
fig. 3 is a schematic flow chart illustrating sound output by a mobile phone when a user watches a video in the embodiment of the present application;
FIG. 4 is a schematic view illustrating an audio output process according to a third embodiment of the present application;
FIG. 5 is a schematic view illustrating an audio output process according to a fourth embodiment of the present application;
FIG. 6 is a schematic diagram illustrating the respective output of sounds for two users in the embodiment of the present application;
FIG. 7 is a schematic diagram of sound output when a user moves according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an apparatus applied to the above-described technology in the embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clearly apparent, the technical solutions of the present invention are described in detail below with reference to the accompanying drawings and examples.
The embodiment of the application provides a sound output method, which is applied to sound output equipment, and can effectively determine the distance and the angle between the position of a user and the sound output equipment according to the number of users needing to receive sound, the states of the users and the sound output equipment and a positioning technology, further determine the direction area of sound output and output the sound to the users. The technical scheme can improve the hearing experience of the user and increase the confidentiality.
The following describes in detail a flow of implementing sound output in the embodiments of the present application with reference to the drawings.
Referring to fig. 1, fig. 1 is a schematic diagram of a sound output process in an embodiment of the present application. The method comprises the following specific steps:
In the embodiment of the application, the setting mode is a single-user mode and a non-single-user mode according to the number of users needing to receive sound, namely the single-user mode and the multi-user mode;
the state of the user is divided into a state that the moving speed is greater than a preset speed threshold value and is not greater than the preset speed threshold value;
dividing the sound playing equipment into mobile equipment and fixed equipment according to the state of the sound playing equipment; there are also classifications of in-use and out-of-use for mobile devices. Mobile devices include, but are not limited to, devices that can be carried around, such as smartphones, smartwatches, etc.; stationary devices include, but are not limited to, stationary devices such as desktop computers, televisions, and the like.
The loudspeaker of the sound output equipment is an active directional loudspeaker, and sound output can be carried out in a certain direction area according to needs.
Positioning technology, using different technologies for different scenes, such as bluetooth and pyroelectric infrared technology for fixed equipment; bluetooth technology, optical sensors, gravity sensors, gyroscopes, distance sensors, etc. are being used for mobile devices.
And 102, the sound output equipment determines a direction area of sound output according to the determined distance and angle between the position of the user and the equipment.
And 103, outputting the sound for the corresponding user according to the determined direction area by the sound output equipment.
In the following, with reference to the accompanying drawings, how the sound output device outputs sound for a corresponding user when the sound output device is directed to different application scenarios in the embodiment of the present application is described in detail.
When the method is specifically implemented, whether the switch of the sound output mode provided by the application is used or not can be set on the sound output equipment to determine whether the mode is used for sound output or not.
Example one
And (3) aiming at a single user, when the sound output equipment is mobile equipment, outputting the sound for the user.
Referring to fig. 2, fig. 2 is a schematic view illustrating a sound output process according to a first embodiment of the present application. The method comprises the following specific steps:
in step 201, the sound output device configures a single user mode.
The user can know in advance whether the voice output is required to be performed by a single user or a plurality of users, so that the voice output equipment can be configured according to the operation instruction when the voice output equipment manually selects the single-user mode or the non-single-user mode and receives the operation of the user.
Whether the user who needs to receive sound wears the wearing equipment that can be fixed a position is confirmed through the location module on the sound output equipment, and during concrete implementation, if the location module is bluetooth module, then can carry out bluetooth and pair, whether can connect the first-class mode and confirm.
The distance from the user to the sound output device is determined in the embodiment of the application, so that whether the distance and the angle from the position of the user to the sound output device can be determined by using a positioning technology matched with the wearable device capable of being positioned.
The relative position of the user and the sound output device can only be located using a location technology that matches the wearable device that can be located when the distance is greater than a certain threshold.
Such a scenario is suitable for a user listening to music using a mobile device, but not carrying the mobile device on his body.
For example, when the device is placed aside and a call comes, a ring tone scene is output.
In a specific implementation, a user can determine whether the user is using the sound output device through the APP operation state, the light sensor and the screen off state.
If an APP is running, it is determined that the user is using the sound output device.
If there is no APP running and the light sensor senses light, then it is determined that the device, although not in use, is placed outside;
if no APP is running and the light sensor does not sense light, determining that the sound output device is in a bag, or a pocket, etc.; if the screen is sensed to be bright, a new APP is about to be started, such as an incoming call, a short message and the like.
The above description has given several examples for whether to use the sound output device, and in concrete implementation, it can be determined whether the user uses the sound output device according to actual configuration, in combination with the APP running state, the light sensor, and the screen turning-off state.
206, the sound output device determines whether the user's head is facing the device, and if so, performs step 207; otherwise, step 209 is performed.
In a specific implementation, when a user is using a sound playing device, the user may be required to look at the screen of the sound playing device with eyes in some cases, and the user may not be required in some cases.
If what APP can be configured in advance, the head of the user is required to face the sound playing device, and the head of the user is not required to face the sound playing device in other cases; then for those APPs that are configured, if they are in the running state, it is determined that the user is head-on with the sound playing device.
If the video player is configured, the QQ game is used and the user is required to face the sound playing device, the user determines that the user's head is facing the sound playing device when the video player is used, or the QQ game is used.
Take the example that the user is watching a video using a mobile phone:
referring to fig. 3, fig. 3 is a schematic flow chart of sound output by a mobile phone when a user watches a video in the embodiment of the present application.
In fig. 3, the angle formed between the mobile phone and the gravity vertical line is determined by the mobile phone through the gravity sensor; namely, the transverse screen playing of the mobile phone is sensed; determining the tilt angle of the mobile phone, namely the gyroscope information in fig. 3, by using a gyroscope, assuming that the tilt angle of the mobile phone is 65 degrees from the horizontal plane; the distance between the mobile phone and the head of the user is determined through the distance sensor, namely the information of the distance sensor in fig. 3, and if an obstacle is determined to be in the position which is about 80 centimeters right ahead of the vertical screen of the mobile phone, the distance is 80 centimeters.
Positioning information is configured according to habits of users, for example, when the users are judged to watch videos, the angle between the head of the users and the mobile phone is judged according to the angle between the mobile phone and the horizontal plane, the positions of the two ears of the users above the 25-degree horizontal plane of the loudspeaker are determined, the distance is about 70-90 cm, the coverage range is 60-120 degrees, the users are still, and the direction area is further determined.
In the embodiment, the mobile phone has a fixed sound direction area for the user to output, the sound output by the mobile phone received by the user is clearer and is not disturbed by environmental sound, and the sound of the speaker of the mobile phone of the user does not influence surrounding users.
If the user is walking and receives a video call, the direction area of the sound output can also be determined by the method, if the preset configuration is provided for the application, the determined distance and angle are adjusted according to the preset information, and if the relevant sound output information is not configured, the direction area is determined according to the relevant information obtained by the positioning equipment.
The environment is noisy on the road in the scene, the user does not carry an earphone, the video call cannot be answered by being close to ears, the camera is occupied by the telephone, the general directional sound transmission based on the video capture equipment cannot be realized, and by using the technical scheme provided by the embodiment, the sound of the video telephone is clear and audible, and the confidentiality of the call is enhanced.
This step is implemented specifically by determining whether the sound output device is at an angle from the vertical line of gravity and the angle at which the sound output device is tilted can determine the distance and angle from the head of the user to the sound output device, based on the determined distance from the head of the user.
And step 209, the sound output device determines the motion state and the motion direction of the device, the turning angle of the device, the display orientation and preset configuration information through a gyroscope, and determines the distance and the angle between the position of the head of the user and the device.
This step is a process of determining the distance and angle between the head of the user and the sound output apparatus in the case where the head of the user is not directed to the sound output apparatus.
Preset configuration information including, but not limited to: the motion state of the user, the motion state and the direction of the mobile phone, and the distance and the angle between the sound output equipment and the head of the user.
Assuming that the preset configuration content is that the motion state of the equipment is a vertical screen state; the moving direction is as follows: standing; the turning angle is 90 degrees, correspondingly, the sound output equipment is placed in a trouser pocket, and the user is in a state of still sitting on the seat, at the moment, the head of the user is preset to be about 30 degrees in the oblique direction of the mobile phone at about 70-70 cm, and the coverage range is 60-120 degrees.
When the user is in the above-mentioned description state, the mobile phone ring sounds, and the area range of the sound output is determined by the determined distance and angle.
If the user is watching a movie in a cinema at present, the technical scheme can enable the user to clearly hear the ring tone without influencing other people, namely, the influence on surrounding users is reduced to the minimum.
The sound output apparatus determines a direction area of sound output according to the determined distance and angle, step 210.
By using the above scheme provided in the embodiment of the present application, the specific position of the user cannot be located, and when the direction area of the sound output cannot be further determined, the sound is output to the user according to the configured implementation manner, that is, the sound is output to the user according to the existing implementation manner.
Example two
And aiming at a plurality of users, when the sound output equipment is mobile equipment, outputting sound for the plurality of users.
And when the sound output equipment is mobile equipment, if the mode is set to be a non-single-user mode, outputting sound according to the configured sound output mode. In other words, the present application does not propose an improved technical solution for the output mode of the sound in such a scenario.
EXAMPLE III
And (3) aiming at a single user, when the sound output equipment is fixed equipment, outputting the sound for the user.
Referring to fig. 4, fig. 4 is a schematic diagram of a sound output process in the third embodiment of the present application. The method comprises the following specific steps:
in step 401, the sound output device configures a single user mode.
Taking the example that the user watches the television in front of the television, when the user wears wearable equipment which can be positioned, such as a bluetooth watch, the position of the user is positioned through a positioning technology matched with the wearable equipment which can be positioned, if the user is determined to be 2.8 meters away from the television and the angle range is 85-95 degrees, the user is determined to be right in front of the television, and sound is output to the user in a direction area with the distance of 2.8 meters in the range of 85-95 degrees of the direction in which the television faces.
Such an implementation enables the user to hear the sound clearly without affecting the daily life or rest of others at home.
Still taking the example of a user watching television, if the user does not wear a wearable device that can be located, the user's location information is determined using pyroelectric infrared technology.
The technology cannot locate the user in a room outside the room where the television is located, therefore, the user is located and the user gives a sound to the determined direction area, and the implementation scheme can enable the user to hear the sound clearly, and cannot influence the daily life or rest of the user in other rooms.
And step 406, the sound output device outputs sound for the corresponding user according to the determined direction area.
Example four
And aiming at a non-single user, when the sound output equipment is fixed equipment, outputting sound for a plurality of users.
Referring to fig. 5, fig. 5 is a schematic diagram of a sound output process in the fourth embodiment of the present application. The method comprises the following specific steps:
in step 501, the sound output device configures a non-single user mode.
People with wall barriers, such as bedrooms, cannot be detected.
And step 504, the sound output equipment determines the distance and the angle between all the users and the equipment as a whole according to the distance and the angle between the position of each user and the equipment.
And step 505, the sound output device determines a direction area of sound output according to the determined distance and angle, and outputs sound for all users in the direction area, and the flow is ended.
A scenario is given for the application of the embodiment: about 30 people are dancing in square near a certain residential area, and the surrounding driving vehicles are many and the environment is noisy.
Through pyroelectric infrared information, a large number of human hot spot signals exist in the range of 10-160 degrees in front of the device, and the distance is from 2 meters to 50 meters.
When positioning is carried out on a plurality of users, positioning is carried out on each user, and then the whole direction area is determined to be used or one direction area is determined on each user according to the distance between each user.
As in the case of square dance, the distance between users is not particularly far and the number of users is large, and the direction area of the users is determined by using the overall positioning method.
Referring to fig. 6, fig. 6 is a schematic diagram illustrating sound output by two users respectively according to the embodiment of the present application.
In fig. 6, when two users are watching tv, but it is determined that the distance between the two users is greater than the preset distance threshold, the direction area determined for each user is determined, and sound is output for the corresponding user according to the corresponding direction area.
EXAMPLE five
In the embodiment of the application, the positioning for the user is performed periodically, that is, the distance and the angle between the position where the user is located and the device are determined periodically.
After the sound output device determines the distance and the angle between the position of the user and the device, and before determining the direction area of the sound output according to the determined distance and the angle between the position of the user and the device, the method further comprises the following steps:
determining the moving speed of the user according to the distance and the angle between the position of the user and the equipment determined in the current period and the distance and the angle between the position of the user and the equipment determined in the previous period;
further determining whether the moving speed of the user is greater than a preset speed threshold value, and if so, outputting sound according to a default sound output mode; otherwise, determining the direction area of the sound output according to the distance and the angle between the determined position of the user and the equipment.
Referring to fig. 7, fig. 7 is a schematic diagram of sound output when a user moves in the embodiment of the present application.
In fig. 7, it is assumed that the user is located at position 1 in the t-th period, the user is located at position 2 in the t + 1-th period, the moving speed of the user 1 is determined according to the moving distance of the user and the time interval of the period, and when it is determined that the moving speed of the user is greater than the preset speed threshold, the sound is output to the user according to the configured sound output mode; otherwise, sound is output for the user according to the currently located directional region, and fig. 7 shows a schematic of sound output for the user 1 according to the currently located directional region.
Based on the same inventive concept, the application also provides a sound output device which is applied to sound output equipment. Referring to fig. 8, fig. 8 is a schematic structural diagram of an apparatus applied to the above technology in the embodiment of the present application. The device includes: a first determination unit 801, a second determination unit 802, and an output unit 803;
a first determining unit 801, configured to determine, according to the number of users who need to receive sound, the states of the users and the device, and a positioning technology, a distance and an angle between a location where the user is located and the device;
a second determining unit 802, configured to determine a direction area of sound output according to the distance and angle between the location of the user and the device determined by the determining unit;
the output unit is configured to output a sound for a corresponding user according to the direction area determined by the second determining unit 802.
Preferably, the first determination unit includes 801: a first determining subunit one 8011 and a bluetooth module 8012;
a first determining subunit — 8011, configured to determine whether the device is a mobile device, a set user mode, whether the user wears a wearable device that can be positioned, and whether a distance between the user and the device is greater than a preset threshold
The bluetooth module 8012 is configured to, when the first determining subunit 8011 determines that the device is a mobile device, if the device is set to the single-user mode, wear a wearable device that can be located corresponding to a user, and determine, according to a positioning technology matched with the wearable device that can be located, that a distance between the user and the device is greater than a preset distance threshold, determine, by using the positioning technology matched with the wearable device that can be located, a distance and an angle between a location of the user and the device.
Preferably, the first determination unit 801 includes: a first determining subunit one 8011, a distance sensor 8013, a gravity sensor 8014, a gyroscope 8015 and a first determining subunit two 8016;
a first determining subunit — 8011, configured to determine whether the device is a mobile device, a set user mode, whether a user wears a wearable device that can be positioned, whether a distance between the user and the device is greater than a preset threshold, whether the device is in a use state, and whether a head of the user faces the device;
a distance sensor 8013, configured to determine that the device is a mobile device when the first determining subunit 8011 determines that the device is a mobile device; when the single-user mode is set, the wearable device capable of being positioned is worn by the corresponding user, and the distance between the user and the wearable device is determined to be not more than a preset distance threshold value according to the positioning technology matched with the wearable device capable of being positioned; or when the mode is set to the single-user mode and the corresponding user does not wear the wearable device which can be positioned; further determining that the equipment is in a use state and the head of the user faces the equipment, and determining the distance between the equipment and the head of the user;
the gravity sensor 8014 is used for judging that the device forms an angle with a gravity vertical line when the distance sensor 8013 determines the distance between the device and the head of a user;
a gyroscope 8015 for determining the angle at which the device is tilted when the distance sensor 8013 determines the distance between the device and the head of the user;
a second determining subunit 8016, configured to determine, according to the distance from the head of the user determined by the distance sensor 8013, the angle that the device makes with the vertical line of gravity determined by the gravity sensor 8014, and the distance and the angle that the head of the user is located at determined by the angle that the device is tilted determined by the gyroscope 8015.
Preferably, the first determination unit 801 includes: a first determining subunit one 8011, a gyroscope 8015 and a first determining subunit two 8016;
a first determining subunit one 8011, configured to determine whether the device is a mobile device, a user mode, whether a user wears bluetooth, and whether a distance between the user and the device is greater than a preset distance threshold; whether the equipment is in a use state or not and whether the head of a user faces the equipment or not;
a gyroscope 8015, configured to determine that the device is a mobile device if the first determining subunit 8011 is configured to determine that the device is a mobile device; when the single-user mode is set, the wearable device capable of being positioned is worn by the corresponding user, and the distance between the user and the wearable device is determined to be not more than a preset distance threshold value according to the positioning technology matched with the wearable device capable of being positioned; or when the mode is set to the single-user mode and the corresponding user does not wear the wearable device which can be positioned; further determining that the equipment is not in a use state, or when the head is not opposite to the equipment in the use state, judging the motion state and the motion direction of the equipment and the overturning angle of the equipment, and displaying the orientation;
a second determining subunit 8016, configured to determine, according to the motion state, the motion direction, the device flipping angle, the display orientation, and preset configuration information of the device determined by the gyroscope 8015, a distance and an angle between the device and a position of the head of the user.
Preferably, the first and second liquid crystal films are made of a polymer,
an output unit 803, further configured to, if the first determining unit 801 determines that the device is a mobile device; when it is determined that the non-single user mode is set, outputting a sound in the configured sound output mode.
Preferably, the first determination unit 801 includes: a first determining subunit one 8011 and a bluetooth module 8012;
a first determining subunit — 8011, configured to determine whether the device is a fixed device, a user mode, and whether a user wears a wearable device that can be positioned;
a bluetooth module 8012, configured to determine that the device is a fixed device if the first determining subunit 8011 determines that the device is a fixed device; when the mode is set to be the single-user mode and the wearable device capable of being positioned is worn by the corresponding user, the distance and the angle between the position where the user is located and the wearable device are determined by using the positioning technology matched with the wearable device capable of being positioned.
Preferably, the first determination unit 801 includes: a first determining subunit 8011 and an infrared module 8017;
a first determining subunit — 8011, configured to determine whether the device is a fixed device, a user mode, and whether a user wears a wearable device that can be positioned;
an infrared module 8017, configured to determine that the device is a fixed device if the first determining subunit 8011 determines that the device is a fixed device; when the single-user mode is determined to be set, the corresponding user does not wear the wearable device which can be positioned; or when the mode is determined to be set to the non-single-user mode, determining the distance and the angle between the position of the user and the device by using the pyroelectric infrared technology.
Preferably, the first and second liquid crystal films are made of a polymer,
and the output unit 803 is further used for outputting sound for the user according to the configured sound output mode when the first determination unit 801 cannot determine the distance and the angle between the position of the user and the equipment.
Preferably, the first and second liquid crystal films are made of a polymer,
a second determining unit 802, configured to determine, when the first determining unit determines that the mode is set to the non-single-user mode and determines the direction area of the sound output according to the determined distance and angle between the location where the user is located and the device, whether the distance between the users is greater than a preset distance threshold, if so, determine the distance and angle between all the users as a whole and the device according to the distance and angle between the location where each user is located and the device, and determine the direction area of the sound output according to the determined distance and angle; otherwise, respectively determining the direction area corresponding to each user according to the distance and the angle between the position of each user and the equipment.
Preferably, the first and second liquid crystal films are made of a polymer,
a first determining unit 801, configured to periodically determine a distance and an angle between a location of a user and the present apparatus.
Preferably, the first and second liquid crystal films are made of a polymer,
the first determining unit 801 is further configured to determine, after determining the distance and the angle between the location of the user and the device, the moving speed of the user according to the distance and the angle between the location of the user and the device determined in the current cycle and the distance and the angle between the location of the user and the device determined in the previous cycle; further determining whether the moving speed of the user is greater than a preset speed threshold value, if so, triggering the output unit to output sound according to a default sound output mode; otherwise, the second determining unit 802 is triggered to determine the direction area of the sound output according to the determined distance and angle between the location of the user and the device.
The distance sensor, the gravity sensor and the gyroscope only exist in the mobile equipment, and the infrared module only exists in the fixed equipment.
The units of the above embodiments may be integrated into one body, or may be separately deployed; may be combined into one unit or further divided into a plurality of sub-units.
To sum up, the number of users receiving sound according to needs, the states of the users and the sound output equipment, and the distance and the angle between the position of the user and the equipment are effectively determined by the positioning technology, so that the direction area of sound output is determined, and sound is output to the users. The technical scheme can improve the hearing experience of the user and increase the confidentiality; and the device has low power consumption, high precision, fast response and strong real-time property.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (20)
1. A sound output method applied to a sound output device is characterized by comprising the following steps:
determining the distance and the angle between the position of the user and the equipment according to the number of users needing to receive the sound, the states of the users and the equipment and a positioning technology;
determining a direction area of sound output according to the determined distance and angle between the position of the user and the equipment;
outputting sound for a corresponding user according to the determined direction area;
when the mode is set to be the non-single-user mode, the determining the direction area of the sound output according to the determined distance and angle between the position of the user and the equipment comprises the following steps:
determining whether the distance between the users is greater than a preset distance threshold value, if so, determining the distance and the angle between all the users as a whole and the equipment according to the distance and the angle between the position of each user and the equipment, and determining a direction area of sound output according to the determined distance and angle; otherwise, respectively determining the direction area corresponding to each user according to the distance and the angle between the position of each user and the equipment.
2. The method of claim 1, wherein when the sound output device is a mobile device;
if the mode is set to be the single-user mode, the corresponding user wears the wearable device which can be positioned, and the distance between the user and the device is determined to be larger than the preset distance threshold value according to the positioning technology matched with the wearable device which can be positioned, then the distance and the angle between the position where the user is located and the device are determined, and the method comprises the following steps:
and determining the distance and the angle of the position of the user from the device by using a positioning technology matched with the wearable device which can be positioned.
3. The method of claim 1, wherein if the audio output device is a mobile device;
when the single-user mode is set, the wearable device capable of being positioned is worn by the corresponding user, and the distance between the user and the wearable device is determined to be not more than a preset distance threshold value according to the positioning technology matched with the wearable device capable of being positioned; or when the mode is set to the single-user mode and the corresponding user does not wear the wearable device which can be positioned;
further confirm this equipment is in the user state, and when the user head faces this equipment, confirm the distance and the angle of user's position and this equipment, include:
determining the distance between the device and the head of the user through a distance sensor;
judging an angle formed between the equipment and a gravity vertical line through a gravity sensor;
determining the inclination angle of the equipment through a gyroscope;
and determining the distance and the angle of the head of the user from the device according to the determined distance between the device and the head of the user, the angle between the device and the gravity vertical line and the inclined angle of the device.
4. The method of claim 1, wherein if the audio output device is a mobile device;
when the single-user mode is set, the wearable device capable of being positioned is worn by the corresponding user, and the distance between the user and the wearable device is determined to be not more than a preset distance threshold value according to the positioning technology matched with the wearable device capable of being positioned; or when the mode is set to the single-user mode and the corresponding user does not wear the wearable device which can be positioned;
further determining that the device is not in use, or when the head of the user is not facing the device in use, the determining the distance and angle between the position of the user and the device includes:
the motion state and the motion direction of the equipment and the overturning angle of the equipment are judged through the gyroscope, the display orientation and preset configuration information are obtained, and the distance and the angle between the position of the head of the user and the equipment are determined.
5. The method of claim 1, wherein if the audio output device is a mobile device;
when the non-single user mode is set, the sound is output according to the configured sound output mode.
6. The method of claim 1, wherein if the audio output device is a stationary device;
when the mode is set to the single-user mode and the corresponding user wears the wearable device which can be positioned, the distance and the angle between the position where the user is located and the device are determined, and the method comprises the following steps:
and determining the distance and the angle of the position of the user from the device by using a positioning technology matched with the wearable device which can be positioned.
7. The method of claim 1, wherein if the audio output device is a stationary device;
when the mode is set to the single-user mode, the corresponding user does not wear the wearable device which can be positioned;
or the like, or, alternatively,
when set to non-single user mode;
the determining the distance and the angle between the position of the user and the device comprises the following steps:
the pyroelectric infrared technology is used for determining the distance and the angle between the position of the user and the device.
8. The method of claim 1, further comprising:
and when the distance and the angle between the position of the user and the equipment cannot be determined, outputting the sound for the user according to the configured sound output mode.
9. The method according to any one of claims 1-8, wherein the method further comprises: the distance and angle between the position of the user and the device are determined periodically.
10. The method of claim 9, wherein after determining the distance and angle between the location of the user and the device, and before determining the directional region of the sound output according to the determined distance and angle between the location of the user and the device, the method further comprises:
determining the moving speed of the user according to the distance and the angle between the position of the user and the equipment determined in the current period and the distance and the angle between the position of the user and the equipment determined in the previous period;
further determining whether the moving speed of the user is greater than a preset speed threshold value, if so, outputting sound according to a default sound output mode; otherwise, determining the direction area of the sound output according to the distance and the angle between the determined position of the user and the equipment.
11. An audio output apparatus for use with an audio output device, the apparatus comprising: a first determining unit, a second determining unit and an output unit;
the first determining unit is used for determining the distance and the angle between the position of the user and the equipment according to the number of users needing to receive sound, the states of the users and the equipment and a positioning technology;
the second determining unit is used for determining a direction area of sound output according to the distance and the angle between the position of the user and the equipment determined by the determining unit;
the output unit is used for outputting sound for the corresponding user according to the direction area determined by the second determination unit;
wherein the content of the first and second substances,
the second determining unit is specifically configured to determine whether the distance between the users is greater than a preset distance threshold value when the first determining unit determines that the mode is set to the non-single-user mode and determines the direction area of the sound output according to the distance and the angle between the determined position of the user and the device, if so, determine the distance and the angle between all the users and the device as a whole according to the distance and the angle between the position of each user and the device, and determine the direction area of the sound output according to the determined distance and the angle; otherwise, respectively determining the direction area corresponding to each user according to the distance and the angle between the position of each user and the equipment.
12. The apparatus according to claim 11, wherein the first determining unit comprises: the first determining subunit I and the Bluetooth module;
the first determining subunit, configured to determine whether the device is a mobile device, a set user mode, whether a user wears a wearable device that can be located, and whether a distance between the user and the device is greater than a preset threshold;
the Bluetooth module is used for wearing the positionable wearing device corresponding to the user if the device is determined to be set to be in the single-user mode when the device is the mobile device, and determining that the distance between the user and the device is larger than a preset distance threshold value according to the positioning technology matched with the positionable wearing device, and determining the distance and the angle between the position of the user and the device by using the positioning technology matched with the positionable wearing device.
13. The apparatus according to claim 11, wherein the first determining unit comprises: the device comprises a first determining subunit I, a distance sensor, a gravity sensor, a gyroscope and a first determining subunit II;
the first determining subunit one is used for determining whether the device is a mobile device, a set user mode, whether a user wears wearable equipment which can be positioned, whether the distance between the user and the device is greater than a preset threshold value, whether the device is in a use state, and whether the head of the user faces the device;
the distance sensor is used for determining whether the equipment is mobile equipment or not when the first determining subunit determines that the equipment is mobile equipment; when the single-user mode is set, the wearable device capable of being positioned is worn by the corresponding user, and the distance between the user and the wearable device is determined to be not more than a preset distance threshold value according to the positioning technology matched with the wearable device capable of being positioned; or when the mode is set to the single-user mode and the corresponding user does not wear the wearable device which can be positioned; further determining that the equipment is in a use state and the head of the user faces the equipment, and determining the distance between the equipment and the head of the user;
the gravity sensor is used for judging that the angle formed between the equipment and a gravity vertical line is formed when the distance sensor determines the distance between the equipment and the head of a user;
the gyroscope is used for determining the inclination angle of the equipment when the distance sensor determines the distance between the equipment and the head of the user;
and the second first determining subunit is configured to determine, according to the distance between the device and the head of the user determined by the distance sensor, an angle formed by the device and a gravity vertical line determined by the gravity sensor, and an angle at which the device is tilted determined by the gyroscope, a distance and an angle between the position of the head of the user and the device.
14. The apparatus according to claim 11, wherein the first determining unit comprises: the gyroscope comprises a first determining subunit I, a gyroscope and a first determining subunit II;
the first determining subunit is configured to determine whether the device is a mobile device, whether a user mode is used, whether a user wears bluetooth, and whether a distance between the user and the device is greater than a preset distance threshold; whether the equipment is in a use state or not and whether the head of a user faces the equipment or not;
the gyroscope is used for determining that the equipment is mobile equipment if the first determining unit determines that the equipment is mobile equipment; when the single-user mode is set, the wearable device capable of being positioned is worn by the corresponding user, and the distance between the user and the wearable device is determined to be not more than a preset distance threshold value according to the positioning technology matched with the wearable device capable of being positioned; or when the mode is set to the single-user mode and the corresponding user does not wear the wearable device which can be positioned; further determining that the equipment is not in a use state, or when the head is not opposite to the equipment in the use state, judging the motion state and the motion direction of the equipment and the overturning angle of the equipment, and displaying the orientation;
and the second first determining subunit is configured to determine, according to the motion state, the motion direction, the device turning angle, the display orientation, and preset configuration information of the device determined by the gyroscope, a distance and an angle between the position of the head of the user and the device.
15. The apparatus of claim 11,
the output unit is further configured to determine that the device is a mobile device if the first determination unit determines that the device is a mobile device; when it is determined that the non-single user mode is set, outputting a sound in the configured sound output mode.
16. The apparatus according to claim 11, wherein the first determining unit comprises: the first determining subunit I and the Bluetooth module;
the first determining subunit one is used for determining whether the device is a fixed device, a user mode and whether a user wears a wearable device which can be positioned;
the Bluetooth module is used for determining that the equipment is fixed equipment if the first determining subunit determines that the equipment is fixed equipment; when the mode is set to be the single-user mode and the wearable device capable of being positioned is worn by the corresponding user, the distance and the angle between the position where the user is located and the wearable device are determined by using the positioning technology matched with the wearable device capable of being positioned.
17. The apparatus according to claim 11, wherein the first determining unit comprises: the first determining subunit I and the infrared module;
the first determining subunit one is used for determining whether the device is a fixed device, a user mode and whether a user wears a wearable device which can be positioned;
the infrared module is used for determining that the equipment is fixed equipment if the first determining subunit determines that the equipment is fixed equipment; when the single-user mode is determined to be set, the corresponding user does not wear the wearable device which can be positioned; or when the mode is determined to be set to the non-single-user mode, determining the distance and the angle between the position of the user and the device by using the pyroelectric infrared technology.
18. The apparatus of claim 11,
the output unit is further used for outputting sound for the user according to the configured sound output mode when the first determination unit cannot determine the distance and the angle between the position where the user is located and the equipment.
19. The apparatus according to any one of claims 11-18,
the first determination unit is used for periodically determining the distance and the angle between the position of the user and the device.
20. The apparatus of claim 19,
the first determining unit is further configured to determine a moving speed of the user according to the distance and the angle between the position of the user and the device determined in the current cycle and the distance and the angle between the position of the user and the device determined in the previous cycle after determining the distance and the angle between the position of the user and the device; further determining whether the moving speed of the user is greater than a preset speed threshold value, if so, triggering the output unit to output sound according to a default sound output mode; otherwise, triggering the second determining unit to determine the direction area of sound output according to the determined distance and angle between the position of the user and the equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710706531.6A CN107360500B (en) | 2017-08-17 | 2017-08-17 | Sound output method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710706531.6A CN107360500B (en) | 2017-08-17 | 2017-08-17 | Sound output method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107360500A CN107360500A (en) | 2017-11-17 |
| CN107360500B true CN107360500B (en) | 2020-02-18 |
Family
ID=60286625
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710706531.6A Active CN107360500B (en) | 2017-08-17 | 2017-08-17 | Sound output method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107360500B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111385649B (en) * | 2018-12-28 | 2022-01-04 | 深圳Tcl新技术有限公司 | Television sound transmission control method and device, smart television and storage medium |
| CN111818223A (en) * | 2020-06-24 | 2020-10-23 | 瑞声科技(新加坡)有限公司 | Mode switching method, device, equipment, medium and sound production system for sound playing |
| CN213457687U (en) * | 2020-09-29 | 2021-06-15 | 瑞声科技(新加坡)有限公司 | Intelligent watch |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003309892A (en) * | 2002-04-12 | 2003-10-31 | Mitsubishi Electric Corp | Speaker output device |
| CN106325808A (en) * | 2016-08-26 | 2017-01-11 | 北京小米移动软件有限公司 | Sound effect adjustment method and device |
| CN106535048A (en) * | 2016-12-27 | 2017-03-22 | 广东小天才科技有限公司 | Method for processing sound effect sound and wearable equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102263695B1 (en) * | 2014-01-20 | 2021-06-10 | 삼성전자 주식회사 | Apparatus and control method for mobile device using multiple cameras |
-
2017
- 2017-08-17 CN CN201710706531.6A patent/CN107360500B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003309892A (en) * | 2002-04-12 | 2003-10-31 | Mitsubishi Electric Corp | Speaker output device |
| CN106325808A (en) * | 2016-08-26 | 2017-01-11 | 北京小米移动软件有限公司 | Sound effect adjustment method and device |
| CN106535048A (en) * | 2016-12-27 | 2017-03-22 | 广东小天才科技有限公司 | Method for processing sound effect sound and wearable equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107360500A (en) | 2017-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110764730B (en) | Method and device for playing audio data | |
| WO2019128592A1 (en) | Method and apparatus for live broadcasting | |
| TW201511578A (en) | Earpieces with gesture control | |
| CN110769271B (en) | Method and device for adjusting code rate of multi-path code stream | |
| KR101183737B1 (en) | A multi earphone device capable recognizing actions and a method of recognizing actions thereof | |
| JP6481210B2 (en) | Information processing apparatus, control method, and program | |
| WO2013158996A1 (en) | Auto detection of headphone orientation | |
| CN106454644B (en) | Audio playing method and device | |
| CN107360500B (en) | Sound output method and device | |
| CN109061903B (en) | Data display method and device, intelligent glasses and storage medium | |
| CN109121047B (en) | Stereo realization method of double-screen terminal, terminal and computer readable storage medium | |
| CN110708630B (en) | Method, device and equipment for controlling earphone and storage medium | |
| WO2016123901A1 (en) | Terminal and method for directionally playing audio signal thereby | |
| CN110996305A (en) | Method, device, electronic equipment and medium for connecting Bluetooth equipment | |
| CN111464830A (en) | Method, device, system, equipment and storage medium for image display | |
| US20230379615A1 (en) | Portable audio device | |
| CN110856152A (en) | Method, device, electronic equipment and medium for playing audio data | |
| CN110677781B (en) | System and method for directing speaker and microphone arrays using coded light | |
| CN106454494B (en) | Processing method, system, multimedia equipment and the terminal device of multimedia messages | |
| WO2022267974A1 (en) | Screen projection method and related apparatus | |
| CN114449393B (en) | Sound enhancement method, earphone control method, device and earphone | |
| CN109460171A (en) | Information interacting method, device, terminal and storage medium | |
| CN111586433B (en) | Code rate adjusting method, device, equipment and storage medium | |
| US11163522B2 (en) | Fine grain haptic wearable device | |
| CN114567840B (en) | Audio output method and device, mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |