CN113938780A

CN113938780A - Sound pickup apparatus, electronic device, and control method

Info

Publication number: CN113938780A
Application number: CN202111443414.8A
Authority: CN
Inventors: 焦阳
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2021-11-30
Filing date: 2021-11-30
Publication date: 2022-01-14

Abstract

The embodiment of the application discloses a pickup device, electronic equipment and a control method; wherein, the pickup apparatus includes: a body; the microphone array is arranged on the body and formed by at least two microphones and is used for collecting audio signals in a space where the microphone array is arranged; the adjusting mechanism is arranged on the body and is correspondingly connected with at least one microphone in the microphone array so as to adjust the position of the at least one microphone; and after the position of the at least one microphone is changed, the working parameters of the microphone array are correspondingly changed.

Description

Sound pickup apparatus, electronic device, and control method

Technical Field

The embodiment of the application relates to electronic technology, in particular to but not limited to a sound pickup device, electronic equipment and a control method.

Background

At present, as the speech technology is gradually matured, the application of speech interaction is increasingly widespread, and accordingly, the speech input demand of equipment is higher and higher, and therefore, the microphone array becomes an application hotspot. However, the microphone array cannot be adjusted after shipment from the factory with the sound pickup apparatus.

Disclosure of Invention

In view of this, the sound pickup apparatus and the control method provided in the embodiments of the present application are implemented as follows:

the pickup device that this application embodiment provided includes: a body; the microphone array is arranged on the body and formed by at least two microphones and is used for collecting audio signals in a space where the microphone array is arranged; the adjusting mechanism is arranged on the body and is correspondingly connected with at least one microphone in the microphone array so as to adjust the position of the at least one microphone; and after the position of the at least one microphone is changed, the working parameters of the microphone array are correspondingly changed.

The sound pickup device provided by the embodiment of the application comprises a microphone array and at least one adjusting mechanism, wherein the adjusting mechanism is connected with at least one microphone in the microphone array and can adjust the position of the connected microphone; therefore, the position-adjustable microphone array can be suitable for devices of various sizes, and the working requirements of the microphones can be met. That is to say, under the condition that the device size is less, the microphone array makes the operating parameters between the microphones of the adjusted microphone array meet the requirements, such as the sound pickup requirements and/or the noise elimination requirements, by the above-mentioned position-adjustable mode, so that under the condition that the requirement that the device size is less is met, accurate positioning and/or accurate noise elimination is also achieved.

The control method provided by the embodiment of the application comprises the following steps: obtaining environmental parameters of a space where the sound pickup device is located; and adjusting the shape and/or position of an adjusting mechanism at least based on the environment parameters so as to adjust the working parameters of a microphone array arranged on the sound pickup device, wherein the adjusting mechanism is a mechanism arranged on the sound pickup device and used for adjusting the position of a microphone in the microphone array.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.

Fig. 1 is a structural diagram of a sound pickup apparatus according to an embodiment of the present disclosure;

fig. 2 is a mounting structure diagram of an adjusting mechanism according to an embodiment of the present disclosure;

fig. 3 is a mounting structure diagram of an adjusting mechanism according to an embodiment of the present disclosure;

fig. 4 is a structural diagram of a sound pickup apparatus according to an embodiment of the present application;

fig. 5 is a structural diagram of a sound pickup apparatus according to an embodiment of the present application;

fig. 6 is a schematic diagram of a microphone array according to an embodiment of the present disclosure;

fig. 7 is a structural diagram of a sound pickup apparatus according to an embodiment of the present application;

fig. 8 is a structural diagram of a sound pickup apparatus according to an embodiment of the present application;

fig. 9 is a structural diagram of a sound pickup apparatus according to an embodiment of the present application;

fig. 10 is a structural diagram of relative movement between a first body and a second body according to an embodiment of the present application;

FIG. 11 is a block diagram illustrating extension of an adjustment mechanism provided in accordance with an embodiment of the present application;

FIG. 12 is a block diagram illustrating extension of an adjustment mechanism provided in accordance with an embodiment of the present application;

FIG. 13 is a schematic diagram of a retraction mechanism according to an embodiment of the present application;

fig. 14 is a schematic flow chart illustrating an implementation of a control method according to an embodiment of the present application;

fig. 15 is a schematic implementation flow diagram of a control method according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, specific technical solutions of the present application will be described in further detail below with reference to the accompanying drawings in the embodiments of the present application. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

It should be noted that the terms "first \ second \ third" are used herein to distinguish similar or different objects and do not denote a particular order or importance to the objects, and it should be understood that "first \ second \ third" may be interchanged with a particular order or sequence where permissible to enable embodiments of the present application described herein to be practiced otherwise than as shown or described herein.

Fig. 1 is a structural view of a sound pickup apparatus provided in an embodiment of the present application, and as shown in fig. 1, the sound pickup apparatus includes a body 11, a microphone array 12, and an adjusting mechanism 13;

wherein: a microphone array 12 formed by at least two microphones and arranged on the body 11 and used for collecting audio signals in the space;

at least one adjusting mechanism 13 disposed on the body 11 is correspondingly connected to at least one microphone in the microphone array 12, so as to adjust a position of the at least one microphone; wherein, after the position of the at least one microphone is changed, the working parameters of the microphone array 12 are changed correspondingly.

In some embodiments, the body 11 may include a first body and a second body that can be lifted and lowered relative to each other, and accordingly, the microphone array 12 and the adjustment mechanism 13 may be disposed on either body, which is not limited thereto.

In the embodiment of the present application, the number of the microphone arrays 12 in the sound pickup device is not limited, and the number of the microphone arrays may be two or more. When the sound pickup device includes a plurality of microphone arrays, the form of the microphone array is not limited, for example, the sound pickup device includes four microphone arrays, and the four microphone arrays may be two linear arrays, or one annular array, or one linear array and one annular array, or may be microphone arrays of any form.

In the embodiment of the present application, the type of the adjustment mechanism is not limited. For example, the adjustment mechanism is a retractable slide bar; alternatively, the adjustment mechanism is a spring assembly or the like, and it is only necessary to know that it is a device capable of achieving extension and retraction.

As shown in fig. 2, in some embodiments, the adjusting mechanism 13 includes a first end with adjustable distance and a second end, the first end is fixedly or movably connected with the body 11, and the second end is used for connecting with at least one microphone, so that the microphone can move in the horizontal direction and/or the vertical direction relative to the body 11.

Here, the movable connection between the first end of the adjusting mechanism 13 and the body 11 is not limited, and may be, for example, a rotary connection, a hinge connection, a rotary hinge connection, or the like.

As shown in fig. 3, in some embodiments, the adjusting mechanism 13 includes a first end and a second end with adjustable spacing, the first end and the second end are both connected with at least one microphone, and the first end or any position between the first end and the second end of the adjusting mechanism 13 is fixedly or movably connected with the body 11, so that the microphone can move in a horizontal direction and/or a vertical direction relative to the body 11.

In some embodiments, the microphones of the microphone array 12 that are not correspondingly connected to the adjustment mechanism 13 may be fixed at positions where there is no obstruction on the outer surface of the body 11. Therefore, the position of each microphone does not need to be adjusted, and the requirements of accurate positioning and/or noise elimination can be met, so that hardware components can be saved, and operation steps can be saved.

In some embodiments, at least one of the microphones of the microphone array 12 disposed on the body 11 may be combined with at least one of the microphones of another sound pickup device to form a new microphone array. Thus, when the number of the perfect microphones in the current sound pickup device is not enough to support the microphone array to work, the perfect microphones in the sound pickup device can be combined with at least one microphone in other sound pickup devices to form at least one new microphone array so as to support the current sound pickup device to work.

In the embodiment of the present application, the working parameters of the microphone array 12 may be a requirement for achieving an interval between microphones to pick up sound, or a requirement for achieving an interval between microphones to cancel noise.

It will be appreciated that in practical applications, the spacing requirements between any two microphones may be different for microphone arrays produced by different manufacturers when performing sound pickup localization and/or sound pickup noise cancellation. For example, the microphone array produced by manufacturer a requires a distance of 5cm between microphones, and can realize accurate positioning and/or noise elimination; and the microphone array produced by the manufacturer B has the requirement of 1cm on the distance between the microphones, so that accurate positioning and/or noise elimination can be realized, but the microphone of the manufacturer B has high manufacturing cost and cannot be put into use in a large range, and in equipment with small size limitation on a sound pickup device, if the microphone array with large distance requirement is adopted, accurate positioning and/or noise elimination cannot be realized.

Based on this, in some embodiments, the distance required by the microphones in the microphone array when positioning and/or denoising can be determined according to the type of the microphone array included in the sound pickup apparatus, and the positions of the microphones can be automatically adjusted according to the required distance, so that the distance between the adjusted positions of the microphones and other microphones meets the positioning and/or denoising requirements. In addition, when the microphone array is not used, the microphone array can be controlled to automatically retract into the body, so that the overall appearance of the sound pickup device is small and portable.

The sound pickup device provided by the embodiment of the application comprises a microphone array and at least one adjusting mechanism, wherein the adjusting mechanism is connected with at least one microphone in the microphone array, and can adjust the position of the microphone connected with the adjusting mechanism. Therefore, the microphone array with the adjustable position can be suitable for pickup devices with various sizes, and the working requirements of microphones in the pickup devices with different sizes can be met. That is to say, even under the condition that the device size is smaller, the microphone array can enable working parameters between the microphones of the adjusted microphone array to meet requirements, such as positioning requirements and/or noise elimination requirements, through the position-adjustable mode, so that under the condition that the requirement that the sound pickup device size is smaller is met, accurate positioning and/or accurate noise elimination is achieved.

Fig. 4 is a structural diagram of the sound pickup apparatus provided in the embodiment of the present application, and as shown in fig. 4, the sound pickup apparatus includes a body 41, a microphone array 42, an adjusting mechanism 43, a driving module 44, and a control module 45.

A microphone array 42 formed by at least two microphones and arranged on the body 41, for collecting audio signals in the space; at least one adjusting mechanism 43 disposed on the body 41 is correspondingly connected to at least one microphone in the microphone array 42, so as to adjust the position of the at least one microphone; wherein, after the position of the at least one microphone is changed, the operating parameter of the microphone array 42 is changed correspondingly.

A driving module 44 connected to the adjusting mechanism 43 for providing a driving force to the adjusting mechanism 43; and the control module 45 is in signal connection with the driving module 44 and can control the driving module 44 to drive the adjusting mechanism 43 to adjust the position of the microphone.

In some embodiments, the sound pickup apparatus may not include the driving module, but adjust the position of the microphone connected thereto by manually adjusting, for example, manually shaking or pulling the adjusting mechanism 43.

Fig. 5 is a structural view of the sound pickup apparatus provided in the embodiment of the present application, and as shown in fig. 5, the sound pickup apparatus includes a main body 51, a microphone array 52, an adjusting mechanism 53, a driving module 54, a control module 55, and a detecting piece 56.

A microphone array 52 formed by at least two microphones and arranged on the body 51, for collecting audio signals in the space; at least one adjusting mechanism 53 disposed on the body 51 is correspondingly connected to at least one microphone in the microphone array 52, so as to adjust the position of the at least one microphone; wherein, after the position of the at least one microphone is changed, the operating parameters of the microphone array 52 are correspondingly changed. A driving module 54 connected to the adjusting mechanism 53 for providing a driving force to the adjusting mechanism 53; and the control module 55 is in signal connection with the driving module 54 and can control the driving module 54 to drive the adjusting mechanism 53 to adjust the position of the microphone.

In some embodiments, the detecting element 56 is in signal connection with the control module 55, and is used for detecting the current environment information of the pickup apparatus, and the control module 55 can generate a first control signal according to the environment information, so that the driving module 54 drives the adjusting mechanism 53 based on the first control signal.

In some embodiments, the form and/or orientation of the microphone array may be selectively adjusted according to the current environment information of the sound pickup apparatus, so as to adapt the adjusted microphone array to the current working requirement.

The sound pickup device can support different microphone array morphologies, such as a linear array and/or a ring array. As shown in fig. 6, the Linear microphone Array, whose Array element centers are located on the same straight line, can be further divided into a Uniform Linear Array (ULA) and a nested Linear Array according to whether the adjacent Array element distances are the same. And the centers of array elements of the annular microphone array are distributed on a plane. In fig. 6, circles indicate positions of microphones, and lines between the microphones are only for illustrating the form of the microphone array, and do not indicate actual connections between the microphones.

The sound pickup device can detect the environmental information of the current location of the sound pickup device through the detection piece 56, and transmit the environmental information to the control module 55, so that the control module 55 generates a first control signal according to the received environmental information, thereby driving the adjusting mechanism 53 to selectively adjust the form or orientation of the microphone array.

The current environment information of the sound pickup apparatus can be various, for example, the relative position of the sound pickup apparatus in the current environment is detected by the detecting element 56, such as the sound pickup apparatus is in the center of a room, on a wall in the room, on a ceiling, on a floor, at a corner, or on a desk in the center of the room, etc.; alternatively, the sound pickup apparatus is detected by the detection member 56 to be located in a place such as a square, a park, a mall, or a stadium.

In some embodiments, after detecting the environmental information of the sound pickup apparatus, the control module 55 may adjust the form of the microphone array according to the environmental information. For example, when the detecting element 56 detects that the sound pickup apparatus and the user are close and the sound is in a single direction, in this scenario, the microphone array does not need to support far-field sound pickup, and the optimal form of the microphone array is a linear array or a dual microphone. For another example, when the sound pickup apparatus is detected in an office or a living room by the detection member, it can be predicted that the sound will come from different directions, and in this scenario, there is a need for interaction between a near field and a far field, and in this case, the optimal form of the microphone array is a circular array to support the far field. For another example, when the sound pickup apparatus is detected by the detection member to be beside the television cabinet or at a dining table, the sound source is only from 180 degrees because the sound pickup apparatus is against the wall or other equipment, and in such a scenario, the far field needs to be supported, and the optimal form is a linear microphone array.

In some embodiments, after detecting the environmental information of the sound pickup apparatus, the control module 55 may further adjust the orientation of the microphone array according to the environmental information. For example, when only a single sound source is detected in the current environment, the orientation of the adjusted microphone may be towards that sound source; when detecting that a plurality of sound source directions exist in the current environment, the plurality of microphones in the microphone array can be respectively adjusted to face one sound source direction; when the existence of noise in the current environment is detected, the position or the orientation of the microphone is adjusted, so that the adjusted microphone array avoids the direction of the noise source, or at least avoids the direction of the main noise.

In other embodiments, the control module 55 can also send a second control signal to the drive module 54 based on the obtained target operation or the operation from the target equipment, so that the drive module 54 drives the adjustment mechanism 53 based on the second control signal.

Fig. 7 is a structural view of the sound pickup apparatus provided in the embodiment of the present application, and as shown in fig. 7, the sound pickup apparatus includes a body 71, a microphone array 72, an adjusting mechanism 73, a driving module 74, a control module 75, a detecting piece 76, and a camera module 77.

The microphone array 72 is arranged on the body 71 and is formed by at least two microphones and used for collecting audio signals in a space; at least one adjusting mechanism 73 provided on the body 71 is connected to at least one microphone of the microphone array 72 (indicated by a solid line in fig. 7) to adjust the position of the at least one microphone; wherein, after the position of the at least one microphone is changed, the working parameters of the microphone array 72 are changed correspondingly. A driving module 74 connected to the adjusting mechanism 73 for providing a driving force to the adjusting mechanism 73; the control module 75 is connected to the driving module 74 by signals (the signal connection is indicated by a dotted line in fig. 7), and can control the driving module 74 to drive the adjusting mechanism 73 to adjust the position of the microphone.

The camera module 77 is arranged on the body and used for collecting image contents in the space where the camera module is arranged;

the camera module 77 and the microphone array 72 are disposed at different positions of the body 71, and the positions of the microphones in the microphone array 72 can be adjusted according to the working state of the camera module 77.

In the embodiment of the present application, the microphone array 72 can work in cooperation with the camera module 77 to achieve auxiliary sound source localization or noise cancellation of images. For example, under the condition that a plurality of participants participate in a conference, the participants are distributed around a table, a sound pickup device comprising a camera module and a microphone array can be placed in the center of the table, and the images collected by the camera module cannot be used for judging which participant is speaking (for example, the face of the participant is blocked, and which participant is speaking cannot be judged by the images), at the moment, the sound can be obtained by the microphone array, the position of the speaker is positioned according to the obtained sound, so that the speaker is determined, and the auxiliary sound source positioning of the images is realized.

However, in some embodiments, in order to meet the requirements of portability and miniaturization, the size of the sound pickup apparatus including the camera module is getting smaller, and the diameter of the housing of the sound pickup apparatus can be made 3cm or less. However, for the conventional microphone array, the diagonal diameter between the microphones needs to be larger than 5cm to achieve accurate positioning, and if it is placed in the miniaturized sound pickup apparatus described above, the sound pickup requirement cannot be satisfied.

In some embodiments, the diameter of the housing of the sound pickup apparatus including the camera is increased by taking the maximum size of the housing into consideration, but the apparatus cannot be miniaturized and is not portable.

Based on this, in the embodiment of the present application, the adjusting mechanism is correspondingly connected to the microphones to adjust the position of the at least one microphone, so that after the position of the at least one microphone changes, the operating parameters of the microphone array 72 correspondingly change, and the microphone array 72 can realize accurate positioning and/or accurate noise cancellation.

In some embodiments, the position of the microphone in the microphone array 72 can be adjusted according to the working state of the camera module 77, and can be adjusted according to the variation parameter of the position of the microphone according to the focal length direction of the camera module 77. For example, first, a variation parameter of the focal length direction of the camera module 77 is obtained, where the variation parameter of the focal length direction of the camera module 77 is used to make an object in an image acquired in real time after the focal length direction of the camera module 77 is changed different from an object in an image acquired in real time before the focal length of the camera module 77 is changed. In the process of the specific implementation, the position of the microphone is adjusted based on the variation parameter of the focal length direction of the camera module 77, so that the sound source collection area of the microphone array is changed.

In some embodiments, the body includes a first body 711 and a second body 712 capable of moving relatively, wherein the specific arrangement positions of the microphone array 72 and the camera module 77 are not limited. For example, assuming that the first body 711 is on top and the second body 712 is on bottom, at least the microphone array 72 is disposed on the first body 711 and the camera module 77 is disposed on the second body 712; alternatively, at least the microphone array 72 is provided on the second body 712, and the camera module 77 is provided on the first body 711.

In some embodiments, the annular microphone is arranged on the base of the camera module, but due to the blockage of the camera module, the annular microphone reflects and interferes with sound, so that the accuracy of pickup positioning is affected. Accordingly, in order to prevent the microphone array 72 from being blocked by the camera module 77 during sound collection, the microphone array 72 may be selectively provided on the first body 711 and the camera module 77 may be selectively provided on the second body 712.

As shown in fig. 8, for example, the first body of the sound pickup device is provided with 4 guide grooves intersecting in a cross shape, the guide grooves are arranged at the top of the first body shell, an adjusting mechanism 73 is placed in each guide groove, and a microphone is arranged at the end of the adjusting mechanism 73; the camera module 77 is disposed on the first body of the sound pickup apparatus, and the dots in the figure represent the positions of the microphones.

As shown in fig. 9, in some embodiments, the control module 75, in signal connection with the driving module 74, can control the driving module 74 to drive the adjusting mechanism 73 to adjust the position of the microphone, so that the microphone moves horizontally outward to a specified position, and thus the distance between different microphones in the microphone array meets the requirement of accurate positioning and/or accurate noise cancellation.

In addition, in the embodiment of the present application, the first body 711 and the second body 712 can be relatively movable, and may be relatively movable up and down or relatively expandable, that is, as shown in fig. 10, the first body and the second body can relatively move in a vertical direction and also relatively move in a horizontal direction; alternatively, the first body and the second body may be opened and closed to a certain angle. The shape of the body shown in fig. 10 is an example of the body, and does not mean to limit the shape of the body shown in fig. 10.

It can be understood that when the camera module shoots, the shooting range is conical (namely, the camera has a large visual angle, and the viewing range is large). In some embodiments, when the position of the microphone and/or the adjusting mechanism changes (e.g., extends out of the main body), the camera module 77 enters the viewing range, so as to block the camera module from shooting.

Based on this, in some embodiments, under the condition that the microphone and/or the adjusting mechanism do not extend or contract, the position relation between the first body and the second body can be changed under the action force of the operating body or the action force of the driving module, so that the microphone and/or the adjusting mechanism placed on the first body is moved out of the view range of the camera module.

The driving module for driving the change of the position relation between the first body and the second body and the driving module for driving the change of the position of the adjusting mechanism can be the same as or different from each other.

In some embodiments, the position relationship between the first body and the second body is changed, and the position change can be realized by rotating or extending or retracting any one of the first bodies relative to the other one, for example, changing the position of the body where the camera module 77 is located, so that the microphone and/or the adjusting mechanism is moved out of the view range of the camera module 77.

In some embodiments, the form and/or position of the adjustment mechanism may be changed under the action of the operating body or the driving force of the driving module without changing the relative position relationship between the first body and the second body, so that the microphone and/or the adjustment mechanism moves out of the viewing range of the camera module. Wherein, the regulation mode at least has the following conditions:

(1) the extending direction of the adjusting mechanism 73 is parallel to the first plane of the camera module; the first plane is parallel to the display plane of the sound pickup device; a control module 75 for determining a first distance to be extended of the driving module 74 according to the reference value of the microphone spacing; and under the condition that the camera module 77 works, controlling the driving module 74 to extend the first distance to be extended along the extending direction, so as to move at least one microphone out of the view finding range of the camera module 77, and further enabling the distance between every two microphones in the microphone array to meet the requirements of accurate positioning and/or accurate noise elimination.

(2) As shown in fig. 11, a control module 75 for determining a second to-be-extended distance and a first to-be-tilted angle of the driving module 74 according to the microphone distance reference value; and under the condition that the camera module 77 works, after the driving module 74 is controlled to extend the second distance to be extended along the direction from the second end to the first end of the adjusting mechanism 73, the driving module 74 is controlled to incline the first angle to be extended, so that the first microphone moves a certain distance along the direction far away from the view range of the camera module, and the distance between every two microphones in the microphone array meets the requirements of accurate positioning and/or accurate noise elimination. In this case, the adjustment mechanism is tilted after being extended a certain distance.

(3) The control module 75 is configured to determine a second to-be-tilted angle of the driving module 74 according to the reference value of the microphone distance; and under the condition that the camera module works, controlling the driving module 74 to incline the second inclination angle to enable the first microphone to move for a certain distance along the direction away from the view finding range of the camera module 77, and further enabling the distance between every two microphones in the microphone array to meet the requirements of accurate positioning and/or accurate noise elimination. In this case, the adjusting mechanism only inclines for a certain angle, but because the adjusting mechanism itself also has a length value, under the condition of only inclining for a certain angle, also can satisfy the interval requirement between two microphones under the condition of moving out the viewing range of the camera module.

In some embodiments, the plurality of microphones in the microphone array for positioning the sound source are laid out on a horizontal plane, so that only the judgment of the sound source angle in the horizontal direction can be realized, the height above and below the microphone array cannot be distinguished, and the positioning in the vertical direction cannot be realized.

Based on this, in some embodiments, as shown in fig. 12, 1 or more adjusting mechanisms can be independently controlled to independently tilt for a certain angle, so that the height difference between the microphones is formed, and the sound source orientation in the vertical direction can be further judged.

For example, in some embodiments, the extension direction of the at least two adjustment mechanisms 73 is parallel to a first plane of the camera module 77; the first plane is parallel to the display plane of the sound pickup device; a control module 75, configured to determine a distance to be extended of each adjusting mechanism 73 according to the microphone distance reference value; and, in the case of the operation of the camera module 77, respectively controlling the respective adjusting mechanisms 73 to extend a specific distance along the respective extending directions; under the condition that the different microphones after moving are in the same parallel plane of the first plane of the camera module 77, at least one of the adjusting mechanisms 73 is controlled to incline by a specific angle, so that the at least two adjusted microphones are not in the same parallel plane, thereby forming a height difference between the at least two microphones, and further judging the sound source direction in the vertical direction.

Of course, in the case that the camera module stops working, as shown in fig. 13, the control module 75 can also control the adjusting mechanism 73 to retract back into the sound pickup device, so as to facilitate carrying.

The embodiment of the present application provides a control method, which is applied to an electronic device, which may be various types of devices with information processing capability in the process of specific embodiments, wherein the electronic device includes a display apparatus and a sound pickup apparatus described in the above embodiments. For example, the electronic device may include a cell phone, a tablet, a desktop, a personal digital assistant, a navigator, a digital phone, a video phone, a television, and so on. In the embodiment of the present application, the electronic device needs to have a microphone.

The following implementation steps of a control method applied to electronic equipment are given:

obtaining environmental parameters of a space where the electronic equipment is located;

and adjusting the shape and/or position of an adjusting mechanism arranged in a sound pickup device of the electronic equipment at least based on the environment parameters so as to adjust the working parameters of a microphone array arranged in the sound pickup device of the electronic equipment.

Fig. 14 is a schematic flow chart illustrating an implementation of a control method applied to a sound pickup apparatus according to an embodiment of the present application, and as shown in fig. 14, the method may include the following steps 1401 to 1402:

step 1401, obtaining environmental parameters of a space where the sound pickup apparatus is located.

In some embodiments, the environmental parameter of the space where the sound pickup device is located can be detected through a detection piece contained in the sound pickup device.

The current environment information of the sound pickup apparatus can be various, for example, the relative position of the sound pickup apparatus in the current environment is detected by the detecting element 56, such as the sound pickup apparatus is in the center of a room, on a wall in the room, on a ceiling, on a floor, at a corner, or on a desk in the center of the room, etc.; alternatively, the sound pickup apparatus is detected to be located in a place such as a square, a park, a mall, or a stadium by the detection unit 56; or provided (mounted) to other electronic devices.

And 1402, adjusting the shape and/or position of an adjusting mechanism at least based on the environmental parameter to adjust the working parameter of a microphone array arranged on the sound pickup device.

Wherein the adjusting mechanism is a mechanism arranged on the sound pickup device and used for adjusting the position of the microphone in the microphone array.

After determining the environmental parameters of the sound pickup device, the application scene of the sound pickup device can be determined based on the environmental parameters, and the microphone array can be adjusted based on the application scene.

For example, when the detection member detects that the sound pickup apparatus and the user are close and the sound is in a single direction, the microphone array does not need to support far-field sound pickup in this scenario, and the optimal form of the microphone array is a linear array. For another example, when the sound pickup apparatus is detected in an office or a living room by the detection member, it can be predicted that the sound will come from different directions, and in this scenario, there is a need for interaction between a near field and a far field, and in this case, the optimal form of the microphone array is a circular array to support the far field. For another example, when the sound pickup apparatus is detected by the detection member to be beside the television cabinet or at a dining table, the sound source is only from 180 degrees because the sound pickup apparatus is against the wall or other equipment, and in such a scenario, the far field needs to be supported, and the optimal form is a linear microphone array.

In some embodiments, the form and/or position of the adjusting mechanism may be adjusted to adjust the operating parameters of the microphone array disposed on the sound pickup apparatus, and the adjustment may be performed in combination with the operating information of the electronic device.

For example, when the television device runs a live broadcast application, the microphone array can be adjusted into a linear array for noise cancellation by adjusting the form and/or position of the adjusting mechanism; for another example, when the electronic device runs a conference application, the microphone array may be adjusted to a ring array for positioning by adjusting the form and/or position of the adjustment mechanism.

Fig. 15 is a schematic flow chart of an implementation of a control method applied to a sound pickup apparatus according to an embodiment of the present application, and as shown in fig. 15, the method may include the following steps 1501 to 1502:

step 1501, obtaining environmental parameters of a space where the sound pickup device is located;

1502, acquiring the working state of the camera module, and adjusting the form and/or position of the adjusting mechanism based on the environmental parameters and the working state; or obtaining the use parameters of the sound pickup device, and adjusting the form and/or position of an adjusting mechanism based on the use parameters and the environment parameters so as to adjust the working parameters of a microphone array arranged on the sound pickup device.

In some embodiments, in the case that the camera module is operated (e.g., powered on), the position of the adjusting mechanism may be adjusted according to the requirement of accurate positioning and/or noise elimination of the microphone array, so that the adjusting mechanism extends out of the sound pickup apparatus, thereby increasing the distance between the microphones, so that the operating parameters of the microphone array in the adjusted sound pickup apparatus meet the requirement of accurate positioning and/or noise elimination.

As shown in fig. 11, in some embodiments, if the algorithm requires that the adjusting mechanism drives the microphone to extend for an excessively long distance, which may cause the horizontally extending adjusting mechanism to block the view angle of the camera, the adjusting mechanism may be controlled to tilt upwards at a certain angle (e.g., form an umbrella shape) after the adjusting mechanism extends for a certain distance, so that the adjusting mechanism and/or the microphone may move out of the view range of the camera.

As shown in fig. 12, in some embodiments, in order to realize sound source localization in the vertical direction, after the adjustment mechanism is extended for a certain distance, one or more adjustment mechanisms may be individually controlled to tilt upwards at a certain angle (at least one adjustment mechanism is kept in a horizontal position), so as to form a height difference between microphones, and thus, the sound source orientation in the vertical direction can be determined; alternatively, the plurality of adjusting mechanisms can be controlled to tilt upwards at different angles to form height difference between the adjusting mechanisms and/or the microphones.

In some embodiments, as shown in fig. 13, in the case that the camera module stops working, the adjusting mechanism can also be controlled to retract back into the sound pickup device, so as to be convenient for carrying.

Embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps in the methods provided in the above embodiments.

Embodiments of the present application provide a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of the method provided by the above-described method embodiments.

Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium, the storage medium and the device of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" or "some embodiments" means that a particular feature, structure or characteristic described in connection with the embodiments is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" or "in some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. The foregoing description of the various embodiments is intended to highlight various differences between the embodiments, and the same or similar parts may be referred to each other, and for brevity, will not be described again herein.

The term "and/or" herein is merely an association relationship describing an associated object, and means that three relationships may exist, for example, object a and/or object B, may mean: the object A exists alone, the object A and the object B exist simultaneously, and the object B exists alone.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice, such as: multiple modules or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or modules may be electrical, mechanical or other.

The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules; can be located in one place or distributed on a plurality of network units; some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be separately regarded as one unit, or two or more modules may be integrated into one unit; the integrated module can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

The apparatus disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new apparatus embodiments.

Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.

Features disclosed in several of the apparatus or device embodiments provided herein may be combined in any combination to yield a new apparatus embodiment or device embodiment without conflict.

The above description is only for the embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A sound pickup apparatus comprising:

a body;

the microphone array is arranged on the body and formed by at least two microphones and is used for collecting audio signals in a space where the microphone array is arranged;

the adjusting mechanism is arranged on the body and is correspondingly connected with at least one microphone in the microphone array so as to adjust the position of the at least one microphone;

and after the position of the at least one microphone is changed, the working parameters of the microphone array are correspondingly changed.

2. The device of claim 1, wherein the adjustment mechanism comprises a first end and a second end, the first end being fixedly or movably connected to the body and the second end being adapted to be connected to at least one microphone to enable the microphone to be moved in a horizontal and/or vertical direction relative to the body.

3. The apparatus of claim 2, wherein the pickup apparatus further comprises:

the driving module is connected with the adjusting mechanism and used for providing driving force for the adjusting mechanism;

the control module is in signal connection with the driving module and can control the driving module to drive the adjusting mechanism to adjust the position of the microphone.

4. The device of claim 3, wherein the pickup device further comprises at least one detection element in signal connection with the control module, the detection element is used for detecting current environment information, and the control module can generate a first control signal according to the environment information, so that the driving module drives the adjusting mechanism based on the first control signal; and/or the presence of a gas in the atmosphere,

the control module is further capable of sending a second control signal to the drive module based on the obtained target operation or an operation from a target device to cause the drive module to drive the adjustment mechanism based on the second control signal.

5. The apparatus of any of claims 1 to 4, further comprising:

the camera module is arranged on the body and used for collecting image contents in the space where the camera module is arranged;

the camera module and the microphone array are arranged at different positions of the body, and the positions of the microphones in the microphone array can be adjusted along with the working state of the camera module.

6. The device of claim 5, wherein the body comprises a first body and a second body which are relatively movable, the microphone array is arranged at least on the first body, and the camera module is arranged on the second body;

the position relation between the first body and the second body can be changed under the action of the acting force of the operating body or the driving force of the driving module, so that the microphone and/or the adjusting mechanism can move out of the view finding range of the camera module; and/or the presence of a gas in the atmosphere,

the shape and/or position of the adjusting mechanism are/is changed under the action of the acting force of the operating body or the driving force of the driving module, so that the microphone and/or the adjusting mechanism are/is moved out of the view finding range of the camera module.

7. An apparatus as in claim 5 wherein the adjustment mechanism is capable of adjusting the microphone array to a linear array and/or a circular array.

8. An electronic device comprising a display device and the sound pickup device according to any one of claims 1 to 7.

9. A control method, comprising:

obtaining environmental parameters of a space where the sound pickup device is located;

and adjusting the shape and/or position of an adjusting mechanism at least based on the environment parameters so as to adjust the working parameters of a microphone array arranged on the sound pickup device, wherein the adjusting mechanism is a mechanism arranged on the sound pickup device and used for adjusting the position of a microphone in the microphone array.

10. The method of claim 9, wherein said adjusting a morphology and/or position of an adjustment mechanism based at least on said environmental parameter comprises:

obtaining the working state of the camera module, and adjusting the form and/or position of the adjusting mechanism based on the environmental parameters and the working state; or the like, or, alternatively,

and obtaining the use parameters of the sound pickup device, and adjusting the form and/or position of the adjusting mechanism based on the use parameters and the environment parameters.