CN116055858A - Control method, control device, electronic equipment and storage medium - Google Patents

Abstract

The present disclosure provides a control method, apparatus, device, and storage medium, by obtaining initial output parameters of multimedia data to be output, where the multimedia data to be output includes multimedia data obtained by collecting a target object through an acquisition module of an electronic device; determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment; outputting target multimedia data of a target object under the control parameters; the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output, the effect of optimizing the picture and the tone quality of the speaking object in real time can be achieved, and the user experience is improved.

Description

Control method, control device, electronic equipment and storage medium

Technical Field

The disclosure relates to the technical field of computer applications, and in particular relates to a control method, a control device, electronic equipment and a storage medium.

Background

In small-and-medium-sized conference, live broadcast and home office learning, the camera device is usually placed in front of the speaker, but when a plurality of speakers speak interactively, the problem of poor picture quality caused by untimely capturing of the speaker picture, poor light and other reasons often occurs.

The prior art has a scheme of solving the above problems by providing a plurality of cameras or using rotatable cameras, but the improvement effect is not good.

Disclosure of Invention

According to a first aspect of the present disclosure, there is provided a control method including:

obtaining initial output parameters of multimedia data to be output, wherein the multimedia data to be output comprises multimedia data obtained by collecting a target object through an acquisition module of electronic equipment;

determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment;

outputting target multimedia data of a target object under the control parameters;

wherein the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output.

In an embodiment, the obtaining the initial output parameters of the multimedia data to be output includes:

determining a target object, and controlling an acquisition module of electronic equipment to acquire image data and/or sound data of the target object;

and obtaining display output parameters and/or audio output parameters for outputting the image data and/or sound data.

In one embodiment, determining the target object includes at least one of:

determining an object in a designated area in a space environment where the electronic equipment is located as the target object;

determining an object matched with a target voiceprint as the target object;

determining an object with the motion parameter meeting a first condition as the target object;

determining an object with the motion parameter meeting a second condition in the first time period as the target object;

determining an object with a target identifier as the target object;

an object that matches the requested content from the remote device is determined as the target object.

In an embodiment, the determining the control parameter of the auxiliary acquisition module of the electronic device based on the initial output parameter and the usage information of the electronic device includes at least one of:

acquiring using object information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using object information;

acquiring using environment information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using environment information;

And obtaining the use scene information of the electronic equipment, and determining the control parameters of the auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use scene information.

In an embodiment, determining the control parameter of the auxiliary acquisition module of the electronic device based on the initial output parameter and the usage object information includes one of:

obtaining a first target output parameter of the target object based on the using object information, and determining a control parameter of an auxiliary acquisition module of the electronic equipment based on a difference between the first target output parameter and the initial output parameter, wherein the first target output parameter is a historical output parameter or an expected output parameter corresponding to the target object;

obtaining the quantity information of the target objects based on the using object information, determining a second target output parameter matched with the quantity information based on the quantity information, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the second target output parameter and the initial output parameter;

and obtaining the position information of the target object and the position relation between the target objects based on the using object information, determining a third target output parameter matched with the position information and the position relation, and determining the control parameter of an auxiliary acquisition module of the electronic equipment based on the difference between the third target output parameter and the initial output parameter.

In an embodiment, determining the control parameter of the auxiliary acquisition module of the electronic device based on the initial output parameter and the usage environment information includes at least one of:

determining a compensation parameter based on the use environment information and the initial output parameter, and determining a control parameter of an auxiliary acquisition module of the electronic equipment based on the compensation parameter;

and determining the position relation among the acquisition module, the target object and the auxiliary acquisition module based on the using environment information, and determining the control parameters of the auxiliary acquisition module based on the position relation and the initial output parameters.

In an embodiment, determining the control parameter of the auxiliary acquisition module of the electronic device based on the initial output parameter and the usage scenario information includes at least one of:

determining a fourth target output parameter matched with the using scene information based on the using scene information, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fourth target output parameter and the initial output parameter;

and determining the quantity information and the relative position relation of the target objects based on the using scene information, determining a fifth target output parameter matched with the quantity information and the relative position relation, and determining the control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fifth target output parameter and the initial output parameter.

In an embodiment, the outputting the target multimedia data of the target object under the control parameter includes:

the auxiliary acquisition module of the electronic equipment is controlled to execute image acquisition auxiliary operation and/or sound acquisition auxiliary operation according to the control parameters, so that the electronic equipment obtains the target multimedia data under the action of the acquisition module and the auxiliary acquisition module;

and outputting the target multimedia data through a target output component, wherein the target output component belongs to or does not belong to the electronic equipment.

In an embodiment, the method further comprises:

and obtaining the use change information of the electronic equipment, and adjusting the control parameters of the auxiliary acquisition module of the electronic equipment based on the use change information.

According to a second aspect of the present disclosure, there is provided a control apparatus including:

the output parameter acquisition module is used for acquiring initial output parameters of multimedia data to be output, wherein the multimedia data to be output comprises multimedia data obtained by acquiring a target object through an acquisition module of the electronic equipment;

the control parameter determining module is used for determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment;

The data output module is used for outputting target multimedia data of a target object under the control parameters;

wherein the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output.

According to a third aspect of the present disclosure, there is provided an electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described in the present disclosure.

According to a fourth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of the present disclosure.

The control method, the device, the equipment and the storage medium are used for obtaining initial output parameters of multimedia data to be output, wherein the multimedia data to be output comprises multimedia data obtained by collecting a target object through an acquisition module of electronic equipment; determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment; outputting target multimedia data of a target object under the control parameters; the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output, the effect of optimizing the picture and the tone quality of the speaking object in real time can be achieved, and the user experience is improved.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which:

in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

Fig. 1A illustrates an implementation flow diagram of a control method provided by an embodiment of the present disclosure;

fig. 1B illustrates a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 1C is a schematic implementation flow diagram of step S110 in a control method according to an embodiment of the present disclosure;

fig. 1D is a schematic implementation flow diagram of step S130 in a control method according to an embodiment of the disclosure;

fig. 1E illustrates a hardware configuration diagram of a control method provided by an embodiment of the present disclosure;

FIG. 1F illustrates a flow diagram of a control method provided by an embodiment of the present disclosure;

FIG. 1G illustrates a bottom flow diagram of a control method provided by an embodiment of the present disclosure;

fig. 2 shows a schematic structural diagram of a control device according to an embodiment of the present disclosure;

fig. 3 shows a schematic diagram of a composition structure of an electronic device according to an embodiment of the disclosure.

Detailed Description

In order to make the objects, features and advantages of the present disclosure more comprehensible, the technical solutions in the embodiments of the present disclosure will be clearly described in conjunction with the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. Based on the embodiments in this disclosure, all other embodiments that a person skilled in the art would obtain without making any inventive effort are within the scope of protection of this disclosure.

Fig. 1A is a flowchart of a control method provided by an embodiment of the present disclosure, where the method may be performed by a control device provided by an embodiment of the present disclosure, and the device may be implemented in software and/or hardware. The method specifically comprises the following steps:

s110, obtaining initial output parameters of the multimedia data to be output.

The multimedia data to be output comprises multimedia data obtained by collecting a target object through a collecting module of the electronic equipment; the initial output parameters are display output parameters and sound output parameters comprising multimedia data; the collection module includes a sound collection module and an image collection module of the electronic device, and the target object may be a speaker, a lecturer, a live speaker, or the like, and in other embodiments may further include an item for display, such as an electronic product, a non-electronic product, or the like.

Specifically, in the present embodiment, initial output parameters of multimedia data to be output need to be obtained in focusing small-medium-sized conferences, live broadcasting, home office learning, and other scenes, so as to present a video picture of a target object. As shown in fig. 1B, the electronic device of the present embodiment may be a dedicated device for live broadcast and/or conference integrating a camera, a microphone, a lamp, a host, and the like. The embodiment may be that multimedia data obtained by directly collecting the target object through the collecting module of the electronic device, for example, collecting the multimedia data of the target object through a camera and a microphone; the system can also be multimedia data acquired through a non-acquisition module, such as video streams forwarded by third party equipment.

S120, determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment.

The usage information of the electronic device includes usage object information, usage scenario information, usage environment information, and the like. Wherein, the usage object information may include personal biological characteristics, personal habits, personal preference characteristics, and the like of the target object; the application scene of the electronic device can be characterized by using scene information, such as live broadcast, entertainment or conference; the usage environment information may be environment information of an environment in which the electronic device is located. The auxiliary acquisition module of the electronic device may be a module for improving the image quality or the audio quality of the acquisition target object, and may include, for example, a light supplementing module, a noise eliminating or reducing module, an auxiliary camera module, and the like. The control parameters may include dimming parameters, noise reduction or cancellation parameters, or image enhancement parameters of the auxiliary acquisition module. It should be noted that, the auxiliary camera module includes an image processing portion integrated in the camera module, where the improvement of the picture quality by the camera module may be performed by the image processing portion in the camera module, or may be performed by the auxiliary acquisition module by changing an environmental parameter or changing an image sampling parameter (such as the number of acquired images, an angle, an environmental parameter, etc.), and then by the image processing portion.

Because different users have different use requirements, different use scenes and different use environments, in order to present high-quality multimedia data, the embodiment can acquire initial output parameters of the multimedia data to be output and adjust control parameters of the auxiliary acquisition module by combining the use information. For example, the user A performs live broadcast, and the live broadcast scene can realize the effects of beautifying, whitening and face thinning through the image processing of the auxiliary camera module; for another example, the user B performs a conference, and the conference scene can achieve the effects of light beauty and other retaining the original image quality and authenticity through the image processing of the auxiliary camera module; for example, if the user C performs live broadcast, the light of the environment is darker, and the light supplementing effect can be achieved through the light supplementing module.

S130, outputting target multimedia data of a target object under the control parameters.

Wherein the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output. The target multimedia data refers to multimedia data which is finally output to an audio output component and/or is presented on a display screen after being adjusted to the multimedia data to be output.

According to the embodiment, the control parameters are adjusted, so that the target multimedia data containing the target object can be displayed on the display module connected with the electronic equipment, and/or the target multimedia data can be transmitted to the remote electronic equipment for display through the network, and the playing image quality and/or the sound quality of the target multimedia data of the target object are better than the quality of the multimedia data to be processed.

According to the embodiment, initial output parameters of the multimedia data to be output are obtained, wherein the multimedia data to be output comprises multimedia data obtained by collecting a target object through an acquisition module of electronic equipment; determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment; outputting target multimedia data of a target object under the control parameters; the data quality of the target object in the target multimedia data is superior to the data quality of the target object in the multimedia data to be output, so that the picture and the tone quality of the speaking object can be optimized in real time, and the user experience is improved.

In an alternative embodiment, step S110, obtaining initial output parameters of the multimedia data to be output, as shown in fig. 1C, specifically includes:

s110a, determining a target object, and controlling an acquisition module of the electronic equipment to acquire image data and/or sound data of the target object.

According to the embodiment, the sound information of the target object can be acquired in real time through the sound acquisition module, for example, the target object can be tracked in real time 360 degrees in an omnibearing manner on the basis of an independently developed annular MIC array (6-MIC) matching sound source localization tracking algorithm. The embodiment can also acquire the picture information of the target object in real time through the image acquisition module.

After the target object is determined, the embodiment can collect the image data of the target object first, and then collect the sound data according to the target object in the image data; or collecting the sound data of the target object, determining azimuth signals according to the sound data, and collecting the image data containing the target object through the azimuth signals; image data and sound data containing the target object may also be acquired simultaneously. By way of example, the embodiment can firstly utilize the sound collecting module to conduct sound source positioning, determine the sound information of at least one tracked target object, then automatically match azimuth signals according to the sound information of at least one target object, and accurately capture images through the azimuth signal auxiliary image collecting module, so as to achieve the effect of tracking and positioning a speaker in real time.

In an alternative embodiment, the determining the target object includes at least one of: determining an object in a designated area in a space environment where the electronic equipment is located as a target object; determining an object matched with the target voiceprint as a target object; determining an object with the motion parameter meeting a first condition as a target object; determining an object with the motion parameter meeting the second condition in the first time period as a target object; determining an object with a target identifier as a target object; an object that matches the requested content from the remote device is determined as a target object.

The appointed area can be a region marked and circled by a podium, a conference table head, a test bed, an object table or a user mark, and the object in the appointed area can comprise a speaker or an object; the target voiceprint can be a sound feature of the target object; the motion parameter may refer to limb motion, hand motion or mouth motion of the target object, and the first condition may be a condition for judging that the target object is moving according to the motion parameter, for example, an agent that will be moving all the time, or a motion track of the agent is always in a specific area; the first time length refers to a time critical value for judging whether an agent with the running parameters is a target object or not through time, and the second condition can be a condition for determining the target object through time and the motion parameters; the target identifier may be an identifier for distinguishing whether the target object is a target object, and may be a face identifier, a clothing identifier, a gesture identifier, a shape identifier, a nametag identifier, or the like.

Specifically, the present embodiment may determine the target object by one or a combination of the following ways: in this embodiment, the target object may not be directly defined, but all objects in a specified area in a spatial environment where the electronic device is located are determined as target objects; the target voiceprint of the target object can be acquired in advance, and the object which can be successfully matched with the target voiceprint is determined as the target object; the target object always speaks, so that the object with the mouth shape always moving can be used as the target object, and the object with the motion track of the hand motion and the limb motion always in a certain specific area can be used as the target object because the hand or the limb motion of the target object can occur; for eliminating non-main speakers, the mouth movement duration can be satisfied with the first duration, or for eliminating passers-by, an object with hands and limbs always in movement or movement track always in a specific area is determined as a target object; the target mark can be obtained by taking a picture on site or sending the picture through a network, and the object with the target mark is determined to be a target object through an image recognition method and the multimedia data collected by the collection module; the target object may also be determined by the remote device upon requesting to see and/or hear the target object by determining the target object image in the circled screen and/or recognizing the heard target object sound.

For example, when speaking for multiple persons, the embodiment may further monitor that the sound signal of the target voiceprint is greater than the object with the second duration as the target object, if there are multiple target objects, if the duration of sound signal continuous silence of one current target object exceeds the third duration, then delete the current target object, so as to avoid uncomfortable feeling of frequently switching and displaying the target objects. Wherein the second duration and the third duration are arbitrary values.

S110b obtains a display output parameter and/or an audio output parameter for outputting image data and/or sound data.

In order to present high-quality target object image quality information and/or sound information, the present embodiment may acquire display output parameters corresponding to image data after determining the image data and/or sound data, for outputting at a display output unit or a remote other electronic device connected to the electronic device, and/or acquire audio output parameters corresponding to sound data, for outputting at an audio output unit or a remote other electronic device of the electronic device.

In an optional embodiment, step S120 determines, based on the initial output parameter and the usage information of the electronic device, a control parameter of an auxiliary acquisition module of the electronic device, including at least one of: obtaining using object information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using object information; acquiring using environment information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using environment information; and obtaining the use scene information of the electronic equipment, and determining the control parameters of the auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use scene information.

Specifically, the camera module of the embodiment combines the Auto-scaling function, does not need manual adjustment, also supports the face recognition and automatic frame panorama function, and can automatically and electronically scale according to the position of the target object. Therefore, the present embodiment can obtain the user portrait information of the use object, and determine the control parameters of the camera module of the electronic device based on the initial output parameters and the user portrait information of the use object. Illustratively, when the camera module confirms as a target object, the camera module automatically follows and highlights the target object when the camera module confirms as the target object according to the user portrait information of the using object; when the camera module confirms a plurality of target objects, the camera module can determine the plurality of target objects according to the user portrait information of a plurality of using objects, and automatically follow-up and highlight the plurality of target objects.

Specifically, in this embodiment, the camera module may be intelligently adjusted according to the acquired number information of the usage objects or the usage object information such as the position distribution of the usage objects captured in the multimedia data, so as to output and display the usage object information in a reasonable manner. For example, the present embodiment may reasonably output a display screen according to the number of target objects included in the same screen, and determine a main target object according to the occlusion relationship in the screen, so as to capture and display the main target object.

Specifically, the embodiment can acquire the use environment information of the environment brightness/darkness of the electronic device through the photoresistor sensor in the light supplementing module, and then determine the control parameters of the light supplementing module by combining the initial output parameters, so that the target object collected by the image collecting module of the electronic device is always in an environment with sufficient light, and the image quality of the target object is improved. When a plurality of target objects are available and the number of the open microphone is relatively large, the embodiment can also determine the control parameters of the noise elimination or noise reduction module by acquiring the environmental noise of the electronic equipment and combining with the initial output parameters, so as to ensure that the sound of each target object is not affected by other objects.

Specifically, the embodiment can obtain the use scene information of the electronic equipment, and determine the control parameters of the auxiliary acquisition module according to the scene characteristics of different use scenes. For example, the embodiment can divide the usage scenario information into a conference usage scenario, a live broadcast usage scenario, a single person usage scenario, a multi-person usage scenario, an audio-visual entertainment scenario, and the like, and different scenarios can preset control parameters of corresponding auxiliary acquisition modules in advance, and when the electronic device is used, the usage scenario information can be determined according to the selection of the usage object, and can also be obtained by self-analysis according to the acquired multimedia data, so as to determine the control parameters of the corresponding auxiliary acquisition modules.

According to the embodiment, the target object can be identified through the image, and the automatic electronic zoom is realized by combining the number and/or the positions of the target objects so as to highlight the target object, so that the high cost of mechanically adjusting a zoom lens and the influence of mechanical noise on conversation are avoided, brand-new intelligent operation is brought, an intelligent light source control and adjustment system is provided for a user in an application scene, the problem of insufficient light in a conference and live broadcast is intelligently solved, and the problem of poor image quality is solved.

In one embodiment, determining the control parameters of the auxiliary acquisition module of the electronic device based on the initial output parameters and the usage object information includes one of: obtaining a first target output parameter of a target object based on the using object information, and determining a control parameter of an auxiliary acquisition module of the electronic device based on a difference between the first target output parameter and the initial output parameter; obtaining the quantity information of the target objects based on the using object information, determining a second target output parameter matched with the quantity information based on the quantity information, and determining the control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the second target output parameter and the initial output parameter; and obtaining the position information of the target object and the position relation between the target objects based on the object information, determining a third target output parameter matched with the position information and the position relation, and determining the control parameter of the auxiliary acquisition module of the electronic equipment based on the difference between the third target output parameter and the initial output parameter.

The historical output parameter may be the most habitual or preferred output parameter of the target object, and the expected output parameter is the expected output parameter of the target object, such as resolution, frame rate, exposure, volume, loudness, etc.; the first target output parameter is a historical output parameter or an expected output parameter corresponding to the target object; the second target output parameter is an output parameter determined according to the number of target objects; the third target output parameter is an output parameter determined according to a positional relationship between the target objects.

Specifically, the embodiment obtains the first target output parameter of the target object based on the object information, and determines the control parameter of the auxiliary acquisition module of the electronic device based on the difference between the first target output parameter and the initial output parameter. For example, if it is determined that the control parameter of the light supplementing module has exceeded the influence of the change in the light effect of the device itself based on the difference between the first target output parameter and the initial output parameter, it may be considered that the image brightness processing is performed by the image processing section of the camera module.

Specifically, the embodiment may preset, in advance, ideal output parameters corresponding to the number of different target objects as the second target output parameters. And determining a second target output parameter matched with the target object based on the quantity information of the target object, and determining the control parameter of an auxiliary acquisition module of the electronic equipment based on the difference between the second target output parameter and the initial output parameter. Illustratively, the number of target objects directly affects the person setting position of the display screen and the presentation ratio with the display screen, so this embodiment can display by setting different screen display templates according to different numbers of target objects.

Specifically, in this embodiment, the ideal output parameters corresponding to the position information and the position relation of different target objects may be preset in advance as a template, and this may be used as the third target output parameter, or the image standard and the sound standard in this template may be used as the reference to layout the third target output parameter in the current multimedia data. Taking two target objects as examples, the two target objects can be opposite to each other and stand in opposite directions, or can stand side by side towards the same direction, and dimming parameters, noise reduction or noise elimination parameters related to different position relations are different, so that the control parameters of the auxiliary acquisition module of the electronic equipment are determined by determining the difference between the third target output parameter and the initial output parameter.

According to the embodiment, a comprehensive mode which can be presented about the target object is considered, the effects of high-quality pictures and high-quality sound effects can be achieved by adjusting the control parameters of the auxiliary acquisition module in different situations, the requirements of different types of users are met, and the method has wide applicability.

In one embodiment, determining the control parameters of the auxiliary acquisition module of the electronic device based on the initial output parameters and the usage environment information includes at least one of: determining a compensation parameter based on the usage environment information and the initial output parameter, and determining a control parameter of an auxiliary acquisition module of the electronic device based on the compensation parameter; and determining the position relation among the acquisition module, the target object and the auxiliary acquisition module based on the using environment information, and determining the control parameters of the auxiliary acquisition module based on the position relation and the initial output parameters.

Specifically, in this embodiment, the output parameter in the standard environment is used as a reference to determine a compensation parameter with the current output parameter, for example, the compensation parameter such as the current environmental noise, the brightness and the like can be obtained, and the control parameter of the auxiliary acquisition module of the electronic device is determined based on the compensation parameter. The embodiment can also consider the consumption of light or sound in the propagation process, determine the position relationship among the acquisition module, the target object and the auxiliary acquisition module, and determine the control parameter of the auxiliary acquisition module according to the position relationship and the output parameter, so as to avoid the brightness loss of the light supplementing module in the dimming process and the loss of the volume and the definition of the noise eliminating or noise reducing module in the noise eliminating or noise reducing process.

According to the method, the control parameters of the auxiliary acquisition module of the electronic equipment are determined through the initial output parameters and the using environment information, so that the possibility of poor image quality and poor sound quality of multimedia data caused by poor environment factors is avoided, and the maximum contrast between target objects can be generated by adjusting the light source to keep sufficient brightness; and noise reduction or noise reduction operation of the noise reduction module also enables the tone quality of the target object to be clearer.

In one embodiment, determining the control parameters of the auxiliary acquisition module of the electronic device based on the initial output parameters and the usage scenario information includes at least one of: determining a fourth target output parameter matched with the scene information based on the scene information, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fourth target output parameter and the initial output parameter; and determining the quantity information and the relative position relation of the target objects based on the scene information, determining a fifth target output parameter matched with the quantity information and the relative position relation, and determining the control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fifth target output parameter and the initial output parameter.

The fourth target output parameter is a standard output parameter corresponding to different use scenes. The fifth target output parameter is a standard output parameter corresponding to the number of different target objects and different relative position relations.

Specifically, because different use scenes are preset and matched with the fourth target output parameters in advance, the embodiment can determine the fourth target output parameters according to the scenes, and then determine the control parameters of the auxiliary acquisition module of the electronic equipment based on the difference between the fourth target output parameters and the initial output parameters. In addition, the embodiment may further extract a preset fifth target output parameter according to a relative positional relationship between target objects in a single person scene and a multi-person scene, determine a fifth target output parameter matched with the electronic device according to the quantity information and the relative positional relationship when the electronic device is used, and determine a control parameter of an auxiliary acquisition module of the electronic device based on a difference between the fourth target output parameter and the initial output parameter.

According to the embodiment, the use scenes of the electronic equipment are classified, different scenes correspond to different standard output parameters, and the standard output parameters are acquired through the scene acquisition, so that the picture quality and the sound quality of the target object can be optimized.

In an embodiment, step S130, outputting the target multimedia data of the target object under the control parameter, as shown in fig. 1D, includes:

s130a, controlling an auxiliary acquisition module of the electronic equipment to execute image acquisition auxiliary operation and/or sound acquisition auxiliary operation according to the control parameters, so that the electronic equipment obtains target multimedia data under the action of the acquisition module and the auxiliary acquisition module.

Specifically, the embodiment can control the auxiliary acquisition module of the electronic device to execute image acquisition auxiliary operation according to the control parameters, specifically can perform light supplementing operation through the light supplementing module, and perform color temperature adjustment, image enhancement, image fusion and other operations through the image acquisition part in the camera module. The embodiment may further control the auxiliary acquisition module of the electronic device to perform an auxiliary sound acquisition operation according to the control parameter, for example, performing operations such as noise reduction, echo cancellation, and sound enhancement through noise reduction or noise cancellation parameters. And performing image acquisition auxiliary operation and/or sound acquisition auxiliary operation according to the control parameters, so that the electronic equipment obtains target multimedia data under the action of the acquisition module and the auxiliary acquisition module.

And S130b, outputting the target multimedia data through a target output component, wherein the target output component belongs to or does not belong to the electronic equipment.

The target output component may include a display output component and/or an audio output component, which may belong to an electronic device or may be an external component connected to the electronic device. The embodiment can locally output the target multimedia data through the target output component, and can also output the target multimedia data to the remote equipment through the application and the server thereof.

According to the embodiment, through image acquisition auxiliary operation and/or sound acquisition auxiliary operation, the picture quality and sound quality of target multimedia data obtained under the action of the acquisition module and the auxiliary acquisition module are superior to those of initial multimedia data.

In an embodiment, the method further comprises: and obtaining the use change information of the electronic equipment, and adjusting the control parameters of the auxiliary acquisition module of the electronic equipment based on the use change information.

The usage change information includes usage object change information, usage environment change information, usage scene change information, and the like. In order to obtain relatively stable high-quality target multimedia data, the embodiment obtains the usage change information of the electronic device in real time or at intervals, and when any usage change information is detected, the control parameters of the auxiliary acquisition module of the electronic device are timely adjusted according to the usage change information.

The control method provided by the embodiment can adapt to any condition change of the use object, the use environment or the use scene, and adjust the control parameters in time according to the change, so that stable high-quality images and sound effects can be maintained.

In an implementation manner, fig. 1E is a schematic hardware structure diagram of a control method according to an embodiment of the disclosure, including: the System comprises a System main Board, a Camera module, a light supplementing module, a main control chip SOC (System on chip) Board, a noise elimination or reduction module 4K sensor Board and an audio output component DMIC (digital multimedia integrated circuit) Board. The system main Board is used for supplying power, starting up the equipment and sending control instructions to a main control chip SOC Board of the electronic equipment so as to control each part of modules to realize the effect of outputting target multimedia data. The Camera module comprises an image acquisition part and an image processing part, and is used for acquiring image data of a target object and processing multimedia data. The light supplementing module light Board comprises a photoresistor sensor and a lamp, wherein the photoresistor sensor is used for collecting the ambient brightness of the current electronic equipment. The noise elimination or reduction module 4K sensor board is used for reducing environmental noise or eliminating echo, and preventing mutual interference when more than two speakers speak. The audio output means DMIC Board is for outputting the sound of the speaker speaking.

In an implementation manner, fig. 1F is a schematic flow chart of a control method according to an embodiment of the disclosure. As shown in fig. 1F, this embodiment is described by taking a case where mail links to a participant to perform a video conference, and starting the collection and output of multimedia data in different modes by selecting "conference start mode or live mode". By way of example, in this embodiment, when the MIC detects the feedback signal of the speaker, the azimuth signal of the sound source is determined by the feedback signal, and then the Camera Soc performs corresponding image processing according to the sound source by the azimuth signal of the sound source, and since the Camera Soc has the Auto-scanning function, the effect of displaying the face or the object in the central position of the picture in an enlarged manner can be achieved. In another embodiment, the number and name of the participants can be detected, the target object is determined according to the face recognition of the image, and the display mode finally displayed in the image is determined according to the number of the participants in the image. In addition, the embodiment can also perform the light supplementing operation according to the reference brightness information by detecting the feedback signal of the ambient light source of the speaker through the light source.

In an implementation manner, fig. 1G is a schematic bottom flow chart of a control method according to an embodiment of the disclosure. As shown in fig. 1G, in addition to the functions mentioned in fig. 1F, the target object can be determined by matching the input target object reference sound and the built-in algorithm with the sound source tracked by the MIC. And secondly, the audio output power amplifier can be also provided with a noise elimination or noise reduction module for ensuring that the voice of an output speaker is clear. The embodiment can output the processed multimedia data of the target object to the remote device through the network for output.

Fig. 2 is a schematic structural diagram of a control device according to an embodiment of the present disclosure, where the device specifically includes:

an output parameter obtaining module 210, configured to obtain an initial output parameter of multimedia data to be output, where the multimedia data to be output includes multimedia data obtained by collecting a target object through an collecting module of the electronic device;

a control parameter determining module 220, configured to determine a control parameter of the auxiliary acquisition module of the electronic device based on the initial output parameter and the usage information of the electronic device;

a data output module 230 for outputting target multimedia data of a target object under control parameters; wherein the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output.

In one embodiment, the output parameter obtaining module 210 is specifically configured to: determining a target object, and controlling an acquisition module of the electronic equipment to acquire image data and/or sound data of the target object; display output parameters and/or audio output parameters for outputting image data and/or sound data are obtained.

In one embodiment, the determining the target object in the output parameter obtaining module 210 includes at least one of: determining an object in a designated area in a space environment where the electronic equipment is located as a target object; determining an object matched with the target voiceprint as a target object; determining an object with the motion parameter meeting a first condition as a target object; determining an object with the motion parameter meeting the second condition in the first time period as a target object; determining an object with a target identifier as a target object; an object that matches the requested content from the remote device is determined as a target object.

In one embodiment, the control parameter determining module 220 is specifically configured to at least one of the following: obtaining using object information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using object information; acquiring using environment information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using environment information; and obtaining the use scene information of the electronic equipment, and determining the control parameters of the auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use scene information.

In one embodiment, the control parameter determining module 220 is specifically configured to one of the following: obtaining a first target output parameter of a target object based on the object information, and determining a control parameter of an auxiliary acquisition module of the electronic equipment based on a difference between the first target output parameter and an initial output parameter, wherein the first target output parameter is a historical output parameter or an expected output parameter corresponding to the target object; obtaining the quantity information of the target objects based on the using object information, determining a second target output parameter matched with the quantity information based on the quantity information, and determining the control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the second target output parameter and the initial output parameter; and obtaining the position information of the target object and the position relation between the target objects based on the object information, determining a third target output parameter matched with the position information and the position relation, and determining the control parameter of the auxiliary acquisition module of the electronic equipment based on the difference between the third target output parameter and the initial output parameter.

In one embodiment, the control parameter determining module 220 is specifically configured to at least one of the following: determining a compensation parameter based on the usage environment information and the initial output parameter, and determining a control parameter of an auxiliary acquisition module of the electronic device based on the compensation parameter; and determining the position relation among the acquisition module, the target object and the auxiliary acquisition module based on the using environment information, and determining the control parameters of the auxiliary acquisition module based on the position relation and the initial output parameters.

In one embodiment, the control parameter determining module 220 is specifically configured to at least one of the following: determining a fourth target output parameter matched with the scene information based on the scene information, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fourth target output parameter and the initial output parameter; and determining the quantity information and the relative position relation of the target objects based on the scene information, determining a fifth target output parameter matched with the quantity information and the relative position relation, and determining the control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fifth target output parameter and the initial output parameter.

In one embodiment, the data output module 230 is specifically configured to: the auxiliary acquisition module of the electronic equipment is controlled to execute image acquisition auxiliary operation and/or sound acquisition auxiliary operation according to the control parameters, so that the electronic equipment obtains target multimedia data under the action of the acquisition module and the auxiliary acquisition module; and outputting the target multimedia data through the target output component, wherein the target output component belongs to or does not belong to the electronic equipment.

In an embodiment, the method further comprises: the adjusting module is used for obtaining the use change information of the electronic equipment and adjusting the control parameters of the auxiliary acquisition module of the electronic equipment based on the use change information.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

Fig. 3 illustrates a schematic block diagram of an example electronic device 400 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 3, the apparatus 300 includes a computing unit 301 that may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM) 302 or a computer program loaded from a storage unit 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the device 300 may also be stored. The computing unit 301, the ROM 302, and the RAM 303 are connected to each other by a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.

Various components in device 300 are connected to I/O interface 305, including: an input unit 306 such as a keyboard, a mouse, etc.; an output unit 307 such as various types of displays, speakers, and the like; a storage unit 308 such as a magnetic disk, an optical disk, or the like; and a communication unit 309 such as a network card, modem, wireless communication transceiver, etc. The communication unit 309 allows the device 300 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The computing unit 301 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 301 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 301 performs the respective methods and processes described above, for example, control methods. For example, in some embodiments, the control method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 308. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 300 via the ROM 302 and/or the communication unit 309. When the computer program is loaded into the RAM 303 and executed by the computing unit 301, one or more steps of the control method described above may be performed. Alternatively, in other embodiments, the computing unit 301 may be configured to perform the control method by any other suitable means (e.g. by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems-on-a-chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.

Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.

The foregoing is merely specific embodiments of the disclosure, but the protection scope of the disclosure is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the disclosure, and it is intended to cover the scope of the disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims (10)

1. A control method, comprising:

obtaining initial output parameters of multimedia data to be output, wherein the multimedia data to be output comprises multimedia data obtained by collecting a target object through an acquisition module of electronic equipment;

determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment;

outputting target multimedia data of a target object under the control parameters;

wherein the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output.

2. The method of claim 1, the obtaining initial output parameters of multimedia data to be output, comprising:

determining a target object, and controlling an acquisition module of electronic equipment to acquire image data and/or sound data of the target object;

and obtaining display output parameters and/or audio output parameters for outputting the image data and/or sound data.

3. The method of claim 2, wherein determining the target object comprises at least one of:

determining an object in a designated area in a space environment where the electronic equipment is located as the target object;

Determining an object matched with a target voiceprint as the target object;

determining an object with the motion parameter meeting a first condition as the target object;

determining an object with the motion parameter meeting a second condition in the first time period as the target object;

determining an object with a target identifier as the target object;

an object that matches the requested content from the remote device is determined as the target object.

4. The method of claim 1, wherein determining the control parameters of the auxiliary acquisition module of the electronic device based on the initial output parameters and the usage information of the electronic device comprises at least one of:

acquiring using object information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using object information;

acquiring using environment information of the electronic equipment, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the using environment information;

and obtaining the use scene information of the electronic equipment, and determining the control parameters of the auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use scene information.

5. The method of claim 4, wherein determining control parameters of an auxiliary acquisition module of the electronic device based on the initial output parameters and the usage object information comprises one of:

obtaining a first target output parameter of the target object based on the using object information, and determining a control parameter of an auxiliary acquisition module of the electronic equipment based on a difference between the first target output parameter and the initial output parameter, wherein the first target output parameter is a historical output parameter or an expected output parameter corresponding to the target object;

obtaining the quantity information of the target objects based on the using object information, determining a second target output parameter matched with the quantity information based on the quantity information, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the second target output parameter and the initial output parameter;

and obtaining the position information of the target object and the position relation between the target objects based on the using object information, determining a third target output parameter matched with the position information and the position relation, and determining the control parameter of an auxiliary acquisition module of the electronic equipment based on the difference between the third target output parameter and the initial output parameter.

6. The method of claim 4, wherein determining control parameters of an auxiliary acquisition module of the electronic device based on the initial output parameters and the usage environment information comprises at least one of:

determining a compensation parameter based on the use environment information and the initial output parameter, and determining a control parameter of an auxiliary acquisition module of the electronic equipment based on the compensation parameter;

and determining the position relation among the acquisition module, the target object and the auxiliary acquisition module based on the using environment information, and determining the control parameters of the auxiliary acquisition module based on the position relation and the initial output parameters.

7. The method of claim 4, wherein determining control parameters of an auxiliary acquisition module of the electronic device based on the initial output parameters and the usage scenario information comprises at least one of:

determining a fourth target output parameter matched with the using scene information based on the using scene information, and determining control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fourth target output parameter and the initial output parameter;

and determining the quantity information and the relative position relation of the target objects based on the using scene information, determining a fifth target output parameter matched with the quantity information and the relative position relation, and determining the control parameters of an auxiliary acquisition module of the electronic equipment based on the difference between the fifth target output parameter and the initial output parameter.

8. The method of claim 1, the outputting target multimedia data of a target object under the control parameter, comprising:

the auxiliary acquisition module of the electronic equipment is controlled to execute image acquisition auxiliary operation and/or sound acquisition auxiliary operation according to the control parameters, so that the electronic equipment obtains the target multimedia data under the action of the acquisition module and the auxiliary acquisition module;

and outputting the target multimedia data through a target output component, wherein the target output component belongs to or does not belong to the electronic equipment.

9. The method of any one of claims 1 to 8, further comprising:

and obtaining the use change information of the electronic equipment, and adjusting the control parameters of the auxiliary acquisition module of the electronic equipment based on the use change information.

10. A control apparatus comprising:

the output parameter acquisition module is used for acquiring initial output parameters of multimedia data to be output, wherein the multimedia data to be output comprises multimedia data obtained by acquiring a target object through an acquisition module of the electronic equipment;

the control parameter determining module is used for determining control parameters of an auxiliary acquisition module of the electronic equipment based on the initial output parameters and the use information of the electronic equipment;

The data output module is used for outputting target multimedia data of a target object under the control parameters;

wherein the data quality of the target object in the target multimedia data is better than the data quality of the target object in the multimedia data to be output.

Images