CN112733655A - Information processing method and device, directional sounding device and storage medium - Google Patents
Information processing method and device, directional sounding device and storage medium Download PDFInfo
- Publication number
- CN112733655A CN112733655A CN202011618082.8A CN202011618082A CN112733655A CN 112733655 A CN112733655 A CN 112733655A CN 202011618082 A CN202011618082 A CN 202011618082A CN 112733655 A CN112733655 A CN 112733655A
- Authority
- CN
- China
- Prior art keywords
- relative position
- sounding
- head
- array element
- directional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 45
- 238000003672 processing method Methods 0.000 title claims abstract description 26
- 238000004519 manufacturing process Methods 0.000 claims abstract description 95
- 230000005236 sound signal Effects 0.000 claims abstract description 61
- 238000000034 method Methods 0.000 claims description 32
- 230000015654 memory Effects 0.000 claims description 27
- 230000006399 behavior Effects 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 5
- 230000003542 behavioural effect Effects 0.000 claims 1
- 238000002604 ultrasonography Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 230000001755 vocal effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 210000005069 ears Anatomy 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the application discloses an information processing method, which comprises the following steps: detecting head characteristic information of an object in an environment where the directional sound production device is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object; if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position; controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element. The embodiment of the application also discloses an information processing device, a directional sounding device and a computer storage medium.
Description
Technical Field
The present application relates to, but not limited to, the field of computer technologies, and in particular, to an information processing method, an information processing apparatus, a directional sound generating device, and a computer storage medium.
Background
In the process of playing the audio signal by the traditional sound production equipment, the audio signal is propagated by 360 degrees, which not only can interfere other people, but also has no privacy.
Disclosure of Invention
Embodiments of the present application are intended to provide an information processing method, an information processing apparatus, a directional sound production device, and a computer storage medium.
The technical scheme of the application is realized as follows:
an information processing method, the method comprising:
detecting head characteristic information of an object in an environment where the directional sound production device is located; wherein the head feature information includes a relative position between the head of the subject and the directional sound emission device, and feature points of the head of the subject;
if the relative position is in the relative position range and the feature points are matched with the target feature points, determining the position of the sounding array element of the directional sounding equipment based on the relative position;
controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so as to demodulate the ultrasonic carrier signal into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating the audio signal to be output by the sounding array element.
An information processing apparatus, the information processing apparatus comprising:
the detection module is used for detecting the head characteristic information of the object in the environment where the directional sounding equipment is located; wherein the head feature information includes a relative position between the head of the subject and the directional sound emission device, and feature points of the head of the subject;
the processing module is used for determining the orientation of the sounding array element of the directional sounding equipment based on the relative position if the relative position is in the relative position range and the characteristic point is matched with the target characteristic point;
the transmitting module is used for controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating the audio signal to be output by the sounding array element.
A directional sound production device, the directional sound production device comprising: a processor, a memory, and a communication bus; the communication bus is used for realizing communication connection between the processor and the memory;
the processor is used for executing the information processing program stored in the memory so as to realize the steps of the information processing method.
A storage medium stores executable instructions for causing a processor to implement the steps of the information processing method described above when executed.
The information processing method, the information processing device, the directional sound production equipment and the computer storage medium provided by the embodiment of the application detect the head characteristic information of an object in the environment where the directional sound production equipment is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object; if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position; controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element; the problem of sound production equipment 360 spread at the in-process sound wave of playing audio signal among the correlation technique, can disturb other people, do not have privacy can be said is solved, ensure that directional sound production equipment has better pronunciation directive property, realize following the effect of sound production to the specific position of specific object head.
Drawings
Fig. 1 is a first flowchart illustrating an information processing method according to an embodiment of the present application;
fig. 2 is a schematic flowchart illustrating an information processing method according to an embodiment of the present application;
fig. 3 is a third schematic flowchart of an information processing method according to an embodiment of the present application;
fig. 4 is a fourth schematic flowchart of an information processing method according to an embodiment of the present application;
fig. 5 is a schematic view of an application scenario of a directional sound generating apparatus provided in an embodiment of the present application;
fig. 6 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a directional sound generating apparatus according to an embodiment of the present application.
Detailed Description
The present application will now be described in further detail with reference to the accompanying drawings, wherein the described embodiments are not to be considered as limiting the application, and all other embodiments obtained by those skilled in the art without making any inventive step are within the scope of the present application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.
An embodiment of the present application provides an information processing method applied to a directional sound production device, and as shown in fig. 1, the method includes the following steps:
Wherein the head feature information includes a relative position between the head of the object and the directional sound emission device, and a feature point of the head of the object. The number of objects in the environment in which the directional sound emitting device is located may be one or more.
The relative position includes, but is not limited to, the relative distance and/or azimuth between the head of the subject and the directional sound production device. For example, the azimuth angle may be a horizontal angle between a head of the above-mentioned object as a reference point and a target direction line from a north-seeking direction of the reference point, where the target direction line is a connection line between the head and the directional sound production device. Of course, the azimuth angle may also be a horizontal included angle between the directional sound production device as a reference point and a target direction line from the north direction of the reference point along the clockwise direction, where the target direction line is a connection line between the head and the directional sound production device. The relative distance may be the distance between the head of the subject and the directional sound production device.
The feature points of the head of the subject include, but are not limited to, feature points of ears on the head of the subject and/or feature points of the peripheries of the ears.
In some embodiments of the present application, the directional sound production device detects, through the camera module, a feature point of a head of an object in an environment where the directional sound production device is located and a relative position between the head and the directional sound production device; at this time, the camera module is a structured light module or a time of flight Imaging camera (TOF Range Imaging camera); that is, the directional sound emitting device may detect both the ear of the subject and the relative position, e.g., relative distance, between the ear and the directional sound emitting device via the TOF camera.
In other embodiments of the application, the directional sound production equipment senses the relative position between the head of the object in the environment where the directional sound production equipment is located and the directional sound production equipment through the sensor, and detects the characteristic points of the head of the object in the environment where the directional sound production equipment is located through the camera module; in this case, the sensor includes, but is not limited to, at least one of an ultrasonic sensor, an infrared sensor, and a distance sensor as follows. The camera module can be a TOF camera and can also be other cameras capable of collecting images.
In the embodiment of the present application, the directional sound production device may include a mobile terminal device such as a mobile phone, a camera, a wearable device, and the like, and a fixed terminal device such as a desktop computer, a household appliance, an audio/video player, and the like.
And 102, if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position.
In the embodiment of the present application, the position of the sounding array element includes the direction and the position of the sounding array element. The position of the vocal array elements is used to indicate the position of the directional sound source. The relative position of directional sound production equipment between the head that acquires above-mentioned object and directional sound production equipment to and under the condition of the characteristic point of the head of above-mentioned object, confirm the relative position in the relative position within range, and characteristic point and target characteristic point match, then confirm the position of directional sound production equipment's vocal array element based on the relative position, adjust the position of vocal array element promptly according to the relative position is nimble, and then realize the nimble adjustment of the position of directional sound source, ensure that directional sound production equipment has better vocal directivity, the realization is followed the effect of sound production to the specific position of specific object head like the ear.
And 103, controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point.
The ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element.
The number of the sounding array elements in the embodiment of the present application may be one or more. The directional sound generating device has an array element or a plurality of array elements facing the object. When the directional sound generating device has one array element oriented to the object, the sound generating array element refers to the only array element. When the directional sound generating device has a plurality of elements oriented towards the object, the sound generating elements refer to partial elements of the plurality of elements. In the embodiment of the present application, each array element refers to a transducer, the directional sound production device may be provided with a transducer array, the transducer array refers to an array formed by arranging a plurality of transducers in a certain form, and each transducer in the transducer array is referred to as an array element. During the process of sounding by the directional sounding device, the sounding array elements face the object.
The high directionality of the directional sound-emitting device provided by the present application allows a subject to hear sound clearly, while other subjects in the same area but outside the area corresponding to the sound beam hear no or very little sound, by modulating the audio signal to an ultrasonic carrier signal by the sound-emitting array elements, i.e. modulating the audio signal to one or more ultrasonic carrier frequencies.
In some realizable scenes, after the directional sound production equipment modulates the audio signal into the ultrasonic carrier signal, the ultrasonic carrier signal can be driven and amplified, and then the sound production array element with the determined direction is controlled to emit the amplified ultrasonic carrier signal based on the relative position, so that the ultrasonic carrier signal is demodulated into the audio signal at the characteristic point such as the position of the ear.
The information processing method provided by the embodiment of the application detects the head characteristic information of an object in the environment where the directional sounding equipment is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object; if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position; controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element; the problem of sound production equipment 360 spread at the in-process sound wave of playing audio signal among the correlation technique, can disturb other people, do not have privacy can be said is solved, ensure that directional sound production equipment has better pronunciation directive property, realize following the effect of sound production to the specific position of specific object head.
An embodiment of the present application provides an information processing method applied to a directional sound production device, and as shown in fig. 2, the method includes the following steps:
Wherein the head feature information includes a relative position between the head of the object and the directional sound emission device, and a feature point of the head of the object.
Wherein the directional sound generating device has a plurality of array elements directed towards the object. In this embodiment, have a plurality of array elements towards the object with directional sound production equipment, and then confirm partial array element as the vocal array element from a plurality of array elements, realize directional sound production.
And step 202, if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining partial array elements corresponding to the relative position from the plurality of array elements.
In the embodiment of the application, under the condition that the relative position and the feature point are obtained, the directional sound production device further determines whether the relative position is in the relative position range or not, and determines whether the feature point is matched with the target feature point or not. For example, when the directional sound-emitting device acquires the relative distance and/or the azimuth angle between the head and the directional sound-emitting device, it is further determined whether the relative distance is smaller than a distance threshold and/or whether the azimuth angle is within a target azimuth intersection range, and whether the similarity between the feature point and the target feature point meets a similarity threshold.
And the directional sounding equipment determines that the relative position is in the relative position range, and the characteristic points are matched with the target characteristic points, so that part of the array elements corresponding to the relative position are determined to be sounding array elements from the multiple array elements.
And step 203, determining the orientation of part of the array elements as the orientation of the sounding array elements.
In the embodiment of the application, after the directional sounding device screens out the partial array elements corresponding to the relative positions from the multiple array elements, the position of the determined partial array elements is the position of the sounding array elements.
In other embodiments of the present application, the relative position includes a relative distance, and the directional sound generating device may further adjust the loudness of the audio signal to be output according to the relative distance. For example, if the directional sound production device determines that the relative distance is within the first distance range, the loudness of the audio signal to be output is adjusted to be the first loudness; if the directional sounding equipment determines that the relative distance exceeds the first distance range but is within the second distance range, adjusting the loudness of the audio signal to be output to be a second loudness; the first loudness is smaller than the second loudness, and the second distance range refers to a range which can be reached by a sound signal in the directional sound production process of the directional sound production equipment; therefore, the directional sounding device can flexibly adjust the hearing experience of the object while sounding directionally.
And 204, controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point.
The ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element.
In the embodiment of the application, after directional sound production equipment is selected out part of array elements from a plurality of array elements based on relative position is nimble as the sound production array element, directional sound production equipment control is the sound production array element after the position is confirmed, ultrasonic carrier signal is transmitted based on relative position, so that ultrasonic carrier signal is demodulated as the audio signal of treating the output in characteristic point place position, so, not only realize that directional sound production ensures that audio signal can be heard at the object that relative position within range and characteristic point and target characteristic point match, and realize concentrated directional sound production and select part of array elements based on relative position promptly and sound production, further reduce the region of the sound beam that sound production array element produced, ensure that the object that characteristic point and target characteristic point match can be heard, audio signal can not heard to other objects, directional sound production equipment's high directionality has further been improved.
In some embodiments of the present application, any two of the plurality of array elements have a phase difference of less than 90 degrees. In the embodiment of the application, the phase difference of any two array elements in a plurality of array elements of the directional sound production equipment is less than 90 degrees, so that the total distortion degree of the modulated ultrasonic carrier signal in the air after self-demodulation is less than the distortion degree threshold value, the quality of the demodulated audio signal is improved, and the hearing experience of a user is improved.
It should be noted that, for the descriptions of the same steps and the same contents in this embodiment as those in other embodiments, reference may be made to the descriptions in other embodiments, which are not described herein again.
An embodiment of the present application provides an information processing method applied to a directional sound production device, and as shown in fig. 3, the method includes the following steps:
Wherein the head feature information includes a relative position between the head of the object and the directional sound emission device, and a feature point of the head of the object.
And 302, if the relative position is in the relative position range, matching the characteristic points with the target characteristic points, and controlling a driving module of the directional sounding equipment to change the direction and/or position of the sounding array element, wherein the relative position does not accord with the target relative position.
And the relative position between the sounding array element and the head after the direction and/or the position are/is changed accords with the target relative position. The driving module comprises an ultrasonic horn pusher used for changing the direction and/or the position of the sounding array element.
In the embodiment of the application, the directional sounding device is provided with one array element or a plurality of array elements facing to the object, and the direction and/or the position of the array elements can be adjusted.
In the embodiment of the application, under the condition that the relative position and the feature point are obtained, the directional sound production device further determines whether the relative position is in the relative position range or not, and determines whether the feature point is matched with the target feature point or not. For example, when the directional sound-emitting device acquires the relative distance and/or the azimuth angle between the head and the directional sound-emitting device, it is further determined whether the relative distance is smaller than a distance threshold and/or whether the azimuth angle is within a target azimuth intersection range, and whether the similarity between the feature point and the target feature point meets a similarity threshold.
And the directional sounding equipment determines that the relative position is in the relative position range, the characteristic points are matched with the target characteristic points, and whether the relative position accords with the target relative position is further judged. The relative position range in this embodiment may be different from the relative position range in the embodiment corresponding to step 202, for example, the relative position range in this embodiment includes the relative position range in the embodiment corresponding to step 202. That is, when the directional sound production device preliminarily determines that the relative position is within a relatively large relative position range and the feature point is matched with the target feature point, it is further determined whether the relative position is the target relative position, where the target relative position refers to the optimal sound production distance and/or sound production angle between the sound production array element and the object in the directional sound production scene.
And if the directional sounding equipment determines that the relative position does not accord with the target relative position, controlling a driving module of the directional sounding equipment to change the direction and/or position of the sounding array element, and ensuring that the relative position between the sounding array element and the head after the direction and/or position is changed is the target relative position.
And step 303, controlling the sounding array element with the determined direction and/or position, and transmitting the ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into the audio signal to be output at the position of the characteristic point.
The ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element.
In the embodiment of the application, after directional sound production equipment control directional sound production equipment's drive module changed the direction and/or the position of sound production array element, the sound production array element after direction and/or position is confirmed in control, based on relative position transmission ultrasonic carrier signal, so that ultrasonic carrier signal is the audio signal of treating output in the demodulation of characteristic point place position, so, realize audio signal along fixed direction, fixed angular propagation, the sound of ultrasonic loudspeaker conveying can not be heard in other regions beyond the ear scope of audio signal's specific receiving object.
It should be noted that, for the descriptions of the same steps and the same contents in this embodiment as those in other embodiments, reference may be made to the descriptions in other embodiments, which are not described herein again.
An embodiment of the present application provides an information processing method applied to a directional sound production device, and as shown in fig. 4, the method includes the following steps:
In the embodiment of the application, the directional sound production device can acquire three-dimensional image information of an object in an environment where the directional sound production device is located through the TOF camera.
Wherein the head feature information includes a relative position between the head of the object and the directional sound emission device, and a feature point of the head of the object.
In the embodiment of the application, after the directional sound production device acquires the three-dimensional image information of the object, the relative position between the head of the object and the directional sound production device and the feature point of the head of the object are determined from the three-dimensional image information.
And step 403, detecting the behavior characteristics of the object.
In the embodiment of the application, the directional sounding device collects the image including the object, and then identifies the image to obtain the behavior characteristics of the object.
And step 404, if the behavior characteristics are matched with the target behavior characteristics, the relative position is in the relative position range, the characteristic points are matched with the target characteristic points, and the position of the sounding array element of the directional sounding device is determined based on the relative position.
In the embodiment of the application, the target behavior characteristics are used for screening a receiving object of the audio signal when the directional sound production device produces sound. The behavior characteristics are matched with the target behavior characteristics to represent that the behavior of the object has a target posture and/or the object performs target operation on a target object in the image.
In one implementation scenario, referring to fig. 5, a directional sound generating device, such as a smart sound box 501, collects an image including a plurality of objects, and identifies the image to obtain behavior characteristics of each object. The first object 502 and the second object 503 are objects sitting at a conference table and using a notebook, and the third object 504 is an object standing in a conference room. At this time, smart sound box 501 determines that the behavior features of first object 502 and second object 503 match the target behavior features, the relative position is within the relative position range, and the feature point matches the target feature point, and then determines the orientation of the sounding array element of smart sound box 501 based on the relative position, for example, a first partial array element corresponding to first object 502 and a second partial array element corresponding to second object 503 in the plurality of array elements are sounding array elements, and determines the orientation of the first partial array element and the second partial array element as the orientation of the sounding array element. And then, it is ensured that smart sound box 501 controls the sound emitting array element after determining the orientation to emit the ultrasonic carrier signal based on the relative position, so that the ultrasonic carrier signal demodulates the audio signal at the position of the ear of first object 502 and demodulates the audio signal at the position of the ear of second object 503, sound is emitted for first object 502 and second object 503, and the audio signal cannot be heard by third object 504.
And 405, controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point.
The ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element.
It should be noted that, for the descriptions of the same steps and the same contents in this embodiment as those in other embodiments, reference may be made to the descriptions in other embodiments, which are not described herein again.
An embodiment of the present application provides an information processing apparatus that can be applied to an information processing method provided in an embodiment corresponding to fig. 1 to 4, and as shown with reference to fig. 6, the information processing apparatus 6 includes:
the detection module 601 is configured to detect head feature information of an object in an environment where the directional sound generating apparatus is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object;
the processing module 602 is configured to determine, based on the relative position, a position of a sounding array element of the directional sounding device if the relative position is within the relative position range and the feature point matches the target feature point;
the transmitting module 603 is configured to control the sounding array element after determining the orientation, and transmit the ultrasonic carrier signal based on the relative position, so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the feature point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element.
In other embodiments of the present application, the directional sound generating apparatus has a plurality of array elements facing the object, and the processing module 602 is further configured to determine a part of the array elements corresponding to the relative position from the plurality of array elements; and determining the orientation of the partial array elements as the orientation of the sounding array elements.
In other embodiments of the present application, a phase difference between any two of the plurality of array elements is less than 90 degrees.
In other embodiments of the present application, the relative position is a relative position between the head and the sounding array element, and the processing module 602 is further configured to control the driving module of the directional sounding device to change the direction and/or position of the sounding array element if the relative position does not conform to the target relative position; and the relative position between the sounding array element and the head after the direction and/or the position are/is changed accords with the target relative position.
In other embodiments of the present application, the relative position includes a relative distance, and the processing module 602 is further configured to adjust the loudness of the audio signal to be output according to the relative distance.
In other embodiments of the present application, the detection module 601 is further configured to detect behavior characteristics of an object; the processing module 602 is further configured to determine the orientation of the sound production array element based on the relative position if the behavior feature matches the target behavior feature, the relative position is within the relative position range, and the feature point matches the target feature point.
In other embodiments of the present application, the detection module 601 is further configured to obtain three-dimensional image information of an object; head feature information is determined from the three-dimensional image information.
The directional sound-generating device provided by the embodiment of the application detects the head characteristic information of an object in the environment where the directional sound-generating equipment is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object; if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position; controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element; the problem of sound production equipment 360 spread at the in-process sound wave of playing audio signal among the correlation technique, can disturb other people, do not have privacy can be said is solved, ensure that directional sound production equipment has better pronunciation directive property, realize following the effect of sound production to the specific position of specific object head.
It should be noted that, in this embodiment, specific implementation processes of steps executed by each module may refer to implementation processes in the information processing method provided in the embodiments corresponding to fig. 1 to 4, and are not described herein again.
An embodiment of the present application provides a directional sound generating apparatus, which may be applied to an information processing method provided in the corresponding embodiment of fig. 1 to 4, and as shown in fig. 7, the directional sound generating apparatus 7 includes: a processor 701, a memory 702, and a communication bus 703, wherein:
a processor 701, a memory 702, and a communication bus 703, wherein:
the communication bus 703 is used to enable communication connections between the processor 701 and the memory 702.
The processor 701 is configured to execute the information processing program stored in the memory 702 to implement the following steps:
detecting head characteristic information of an object in an environment where the directional sound production device is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object;
if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position;
controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element.
In other embodiments of the present application, the directional sound emitting device has a plurality of elements oriented towards the object, and the processor 701 is configured to execute the information processing program stored in the memory 702 to implement the following steps:
determining a part of array elements corresponding to the relative positions from the plurality of array elements;
and determining the orientation of the partial array elements as the orientation of the sounding array elements.
In other embodiments of the present application, any two of the plurality of array elements are out of phase by less than 90 degrees.
In other embodiments of the present application, the relative position is a relative position between the head and the sound production array element, and the processor 701 is configured to execute the information processing program stored in the memory 702 to implement the following steps:
if the relative position does not accord with the target relative position, controlling a driving module of the directional sounding equipment to change the direction and/or position of the sounding array element; and the relative position between the sounding array element and the head after the direction and/or the position are/is changed accords with the target relative position.
In other embodiments of the present application, the relative position comprises a relative distance, and the processor 701 is configured to execute an information processing program stored in the memory 702 to implement the steps of:
and adjusting the loudness of the audio signal to be output according to the relative distance.
In other embodiments of the present application, the processor 701 is configured to execute an information processing program stored in the memory 702 to implement the following steps:
detecting the behavior characteristics of the object;
and if the behavior characteristics are matched with the target behavior characteristics, the relative position is in the relative position range, and the characteristic points are matched with the target characteristic points, and determining the orientation of the sounding array elements based on the relative position.
In other embodiments of the present application, the processor 701 is configured to execute an information processing program stored in the memory 702 to implement the following steps: acquiring three-dimensional image information of an object;
head feature information is determined from the three-dimensional image information.
The directional sound-generating device provided by the embodiment of the application detects the head characteristic information of an object in the environment where the directional sound-generating device is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object; if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position; controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element; the problem of sound production equipment 360 spread at the in-process sound wave of playing audio signal among the correlation technique, can disturb other people, do not have privacy can be said is solved, ensure that directional sound production equipment has better pronunciation directive property, realize following the effect of sound production to the specific position of specific object head.
It should be noted that, for a specific implementation process of the steps executed by the processor in this embodiment, reference may be made to an implementation process in the information processing method provided in the embodiment corresponding to fig. 1 to 4, and details are not described here again.
By way of example, the Processor may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like, wherein the general purpose Processor may be a microprocessor or any conventional Processor or the like.
The embodiment of the present application provides a storage medium storing executable instructions, where the executable instructions are stored, and when executed by a processor, the executable instructions will cause the processor to execute the method provided in the embodiment of the present application, so as to implement an information processing method provided in the embodiment corresponding to fig. 1 to 4.
The storage medium provided by the embodiment of the application detects the head characteristic information of an object in the environment where the directional sound-generating device is located; wherein the head feature information comprises a relative position between the head of the object and the directional sound production device, and feature points of the head of the object; if the relative position is in the relative position range and the characteristic points are matched with the target characteristic points, determining the position of the sounding array element of the directional sounding equipment based on the relative position; controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating an audio signal to be output by a sounding array element; the problem of sound production equipment 360 spread at the in-process sound wave of playing audio signal among the correlation technique, can disturb other people, do not have privacy can be said is solved, ensure that directional sound production equipment has better pronunciation directive property, realize following the effect of sound production to the specific position of specific object head.
The computer storage medium may be a Memory such as a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); or may be various directional sound emitting devices, such as mobile phones, computers, tablet devices, personal digital assistants, etc., including one or any combination of the above-mentioned memories.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which respond via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present application, and is not intended to limit the scope of the present application.
Claims (10)
1. An information processing method, the method comprising:
detecting head characteristic information of an object in an environment where the directional sound production device is located; wherein the head feature information includes a relative position between the head of the subject and the directional sound emission device, and feature points of the head of the subject;
if the relative position is in the relative position range and the feature points are matched with the target feature points, determining the position of the sounding array element of the directional sounding equipment based on the relative position;
controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so as to demodulate the ultrasonic carrier signal into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating the audio signal to be output by the sounding array element.
2. The method of claim 1, the directional sound-emitting device having a plurality of elements directed towards the subject, the determining an orientation of a sound-emitting element of the directional sound-emitting device based on the relative position comprising:
determining a partial array element corresponding to the relative position from the plurality of array elements;
and determining the orientation of the partial array elements as the orientation of the sounding array elements.
3. The method of claim 2, any two of the plurality of array elements being out of phase by less than 90 degrees.
4. The method of claim 1, the relative position being a relative position between the head and the sound-emitting array element, the determining an orientation of the sound-emitting array element of the directional sound-emitting device based on the relative position comprising:
if the relative position does not accord with the target relative position, controlling a driving module of the directional sounding equipment to change the direction and/or position of the sounding array element; wherein the relative position between the sounding array element and the head after changing direction and/or position conforms to the target relative position.
5. The method of claim 1, the relative position comprising a relative distance, the controlling the sound-emitting array elements after determining the orientation, prior to transmitting an ultrasound carrier signal based on the relative position, comprising:
and adjusting the loudness of the audio signal to be output according to the relative distance.
6. The method of claim 1, further comprising:
detecting a behavioral characteristic of the object;
correspondingly, if the relative position is within the relative position range and the feature points are matched with the target feature points, determining the orientation of the sounding array element of the directional sounding device based on the relative position includes:
and if the behavior characteristics are matched with the target behavior characteristics, the relative position is in the relative position range, the feature points are matched with the target feature points, and the position of the sounding array element is determined based on the relative position.
7. The method of any one of claims 1 to 6, the detecting head feature information of an object in an environment in which a directional sound emitting device is located, comprising:
acquiring three-dimensional image information of the object;
determining the head feature information from the three-dimensional image information.
8. An information processing apparatus, the information processing apparatus comprising:
the detection module is used for detecting the head characteristic information of the object in the environment where the directional sounding equipment is located; wherein the head feature information includes a relative position between the head of the subject and the directional sound emission device, and feature points of the head of the subject;
the processing module is used for determining the orientation of the sounding array element of the directional sounding equipment based on the relative position if the relative position is in the relative position range and the characteristic point is matched with the target characteristic point;
the transmitting module is used for controlling the sounding array element after the orientation is determined, and transmitting an ultrasonic carrier signal based on the relative position so that the ultrasonic carrier signal is demodulated into an audio signal to be output at the position of the characteristic point; the ultrasonic carrier signal is formed by modulating the audio signal to be output by the sounding array element.
9. A directional sound production device, the directional sound production device comprising: a processor, a memory, and a communication bus; the communication bus is used for realizing communication connection between the processor and the memory;
the processor is configured to execute an information processing program stored in the memory to implement the steps of the information processing method according to any one of claims 1 to 7.
10. A storage medium storing executable instructions for causing a processor to perform the steps of the information processing method of any one of claims 1 to 7 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011618082.8A CN112733655A (en) | 2020-12-31 | 2020-12-31 | Information processing method and device, directional sounding device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011618082.8A CN112733655A (en) | 2020-12-31 | 2020-12-31 | Information processing method and device, directional sounding device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112733655A true CN112733655A (en) | 2021-04-30 |
Family
ID=75607935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011618082.8A Pending CN112733655A (en) | 2020-12-31 | 2020-12-31 | Information processing method and device, directional sounding device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112733655A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110611861A (en) * | 2019-09-06 | 2019-12-24 | Oppo广东移动通信有限公司 | Directional sound production control method and device, sound production equipment, medium and electronic equipment |
| CN110703906A (en) * | 2019-09-06 | 2020-01-17 | 中国第一汽车股份有限公司 | Directional sounding system and method |
| CN110933558A (en) * | 2019-12-17 | 2020-03-27 | 京东方科技集团股份有限公司 | Directional sound production method and device, ultrasonic transducer and electronic equipment |
-
2020
- 2020-12-31 CN CN202011618082.8A patent/CN112733655A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110611861A (en) * | 2019-09-06 | 2019-12-24 | Oppo广东移动通信有限公司 | Directional sound production control method and device, sound production equipment, medium and electronic equipment |
| CN110703906A (en) * | 2019-09-06 | 2020-01-17 | 中国第一汽车股份有限公司 | Directional sounding system and method |
| CN110933558A (en) * | 2019-12-17 | 2020-03-27 | 京东方科技集团股份有限公司 | Directional sound production method and device, ultrasonic transducer and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10575117B2 (en) | Directional sound modification | |
| US10405081B2 (en) | Intelligent wireless headset system | |
| US10165386B2 (en) | VR audio superzoom | |
| US7492913B2 (en) | Location aware directed audio | |
| US10257637B2 (en) | Shoulder-mounted robotic speakers | |
| US20100123785A1 (en) | Graphic Control for Directional Audio Input | |
| CN104995681A (en) | Video analysis assisted generation of multi-channel audio data | |
| JP2015056905A (en) | Reachability of sound | |
| CN106792341A (en) | A kind of audio-frequency inputting method, device and terminal device | |
| US11140507B2 (en) | Rendering of spatial audio content | |
| KR20190130797A (en) | Apparatus and method for recognizing object in electronic device | |
| KR20200006757A (en) | Apparatus and method for confirming object in electronic device | |
| US20180217806A1 (en) | Method of providing virtual reality using omnidirectional cameras and microphones, sound signal processing apparatus, and image signal processing apparatus for performing method thereof | |
| CN110597477A (en) | Directional sound modification | |
| CN112672251A (en) | Control method and system of loudspeaker, storage medium and loudspeaker | |
| US20190121601A1 (en) | Dual-vision display device and driving method thereof | |
| CN112733655A (en) | Information processing method and device, directional sounding device and storage medium | |
| CN117319874A (en) | Sound effect control method, device, equipment and storage medium of sound equipment | |
| US10171906B1 (en) | Configurable microphone array and method for configuring a microphone array | |
| US9992532B1 (en) | Hand-held electronic apparatus, audio video broadcasting apparatus and broadcasting method thereof | |
| CN103716540A (en) | Locating method, related equipment and system | |
| CN113347532B (en) | Method for controlling sound source of designated object and sound source processing device using same | |
| US20150016615A1 (en) | Audio and location arrangements | |
| CN116709154B (en) | Sound field calibration method and related device | |
| US20230140204A1 (en) | Method and device for recording sound of electronic device using earphones |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |