CN112650650B

CN112650650B - Control method and device

Info

Publication number: CN112650650B
Application number: CN202011622250.0A
Authority: CN
Inventors: 张晶; 常家松
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2020-12-31
Filing date: 2020-12-31
Publication date: 2024-04-23
Anticipated expiration: 2040-12-31
Also published as: CN112650650A

Abstract

The application provides a control method and a control device, which are used for monitoring environment data of the current environment of electronic equipment if the electronic equipment is determined to run a target application process, outputting a corresponding prompt at least according to a use result of the target data if the environment data of the current environment of the electronic equipment is determined to obtain the target data related to the target application process from the environment data, and indicating whether a target part by means of the target application process has a problem in the running process of the target application process or not due to the setting of the target part by the output prompt, so that at least the target part is monitored according to the use result of the target data.

Description

Control method and device

Technical Field

The application belongs to the technical field of equipment control, and particularly relates to a control method and device.

Background

At present, the electronic device runs various application processes, such as a conference process, a video process, a document reading process and the like, and for at least one type of application process running by the electronic device, the execution of the application process may be assisted by a component in the electronic device during the running of the application process, for example, a radio component may be used for the conference process, and an image acquisition component may be used for the video process. However, during the process of running the application process by the electronic device, the components used by the application process may cause problems during the running process of the application process due to the setting of the components.

Disclosure of Invention

In one aspect, the present application provides a control method, including:

if the electronic equipment is determined to run the target application process, monitoring environment data of the current environment of the electronic equipment;

And outputting a corresponding prompt at least according to the use result of the target data if the target data associated with the target application process is obtained in the current environment from the environment data.

Optionally, determining that the electronic device runs the target application process includes:

acquiring a preset application list, and determining that the electronic equipment runs a target application process if the newly-built application process is in the preset application list; or alternatively, the first and second heat exchangers may be,

Acquiring a file access path when a new application process is established, and determining that the electronic equipment runs a target application process if the file access path is in a preset storage area; or alternatively, the first and second heat exchangers may be,

Acquiring historical operation data of a newly-built application process, and determining that the electronic equipment operates the target application process if the historical operation data indicates that the application process is associated with the target component; or alternatively, the first and second heat exchangers may be,

Acquiring behavior data acting on a newly built application process, and determining that the electronic equipment runs a target application process if the behavior data comprise audio/video input data or user interaction data; or alternatively, the first and second heat exchangers may be,

And obtaining the newly-built component on which the application process runs, and determining that the electronic equipment runs the target application process if the component contains the target component.

Optionally, if it is determined that the electronic device runs the target application process, monitoring the environmental data of the current environment of the electronic device includes:

if the electronic equipment is determined to run a first type of target application process, at least monitoring sound and/or image data of the current environment of the electronic equipment, wherein the first type of target application process is an application process which depends on a corresponding target component to realize functions; or alternatively, the first and second heat exchangers may be,

If the electronic equipment is determined to run a second type of target application process and run a target subprocess, at least monitoring sound and/or image data of the current environment of the electronic equipment, wherein the second type of target application process is an application process capable of realizing sound and/or image data interaction.

Optionally, monitoring environmental data of an environment in which the electronic device is currently located includes:

Monitoring the environmental data of the current environment acquired by the target component through a preset driver; or alternatively, the first and second heat exchangers may be,

Monitoring environmental data of the current environment of the electronic equipment through other components different from the target component; or alternatively, the first and second heat exchangers may be,

And monitoring the environment data through other equipment which is different from the electronic equipment in the current environment.

Optionally, if the electronic device runs a target application process of a first type, determining from the environment data that target data associated with the target application process is obtained in the current environment includes:

After the electronic equipment runs the target application process of the first type, determining each environment data obtained from the current environment as target data required by the target application process of the first type; or alternatively, the first and second heat exchangers may be,

Noise data of the current environment is obtained, and if first sound and/or image data different from the noise data is obtained from the environment data, the first sound and/or image data is determined to be target data required by the target application process of the first type.

Optionally, if the electronic device runs a target sub-process of the target application process of the second type, determining from the environment data that the target data associated with the target application process is obtained in the current environment, including at least one of the following:

Obtaining an interaction theme of the target subprocess interacting with a server or a client, and if second sound and/or image data associated with the interaction theme is obtained from the environment data, determining the second sound and/or image data as target data required by the target subprocess; or alternatively, the first and second heat exchangers may be,

Acquiring a sound acquisition instruction and/or an image acquisition instruction sent by a server or a client to a target subprocess, and if third sound and/or image data matched with the sound acquisition instruction and/or the image acquisition instruction are acquired from the environment data, determining the third sound and/or image data as target data required by the target subprocess; or alternatively, the first and second heat exchangers may be,

Obtaining an interactive object associated with an interactive operation executed by a target subprocess, and determining fourth sound and/or image data associated with the interactive object as target data required by the target subprocess if the fourth sound and/or image data is obtained from the environment data; or alternatively, the first and second heat exchangers may be,

And obtaining scene information of the running of the target subprocess, and if fifth sound and/or image data matched with the scene information are obtained from the environment data, determining the fifth sound and/or image data as target data required by the target subprocess.

Optionally, outputting a corresponding prompt at least according to the use result of the target data includes:

outputting a first prompt that a function of the electronic device corresponding to the target component is disabled if the target data is used by an application process associated with a preset driver; or alternatively, the first and second heat exchangers may be,

And if the target data cannot be used by the target application process, outputting a second prompt that the function of the target application process corresponding to the target component is disabled.

Optionally, the method further comprises:

Adjusting the corresponding functional state of the target component according to the prompt; and/or the number of the groups of groups,

And adjusting the working parameters of the target component according to the target data.

Optionally, adjusting the working parameter of the target component according to the target data includes:

Acquiring the target data by the target component and other components different from the target component if the target data is acquired by the target component and the first parameter condition is met; or alternatively, the first and second heat exchangers may be,

If the target data are obtained through a plurality of target components and the second parameter condition is met, acquiring the target data through the target component which is most matched with the target application process; or alternatively, the first and second heat exchangers may be,

And if the electronic equipment is detected to be switched from the operation of the first target application process to the operation of the second target application process, acquiring the target data through a target component corresponding to the second target application process.

In another aspect, the present application provides a control apparatus comprising:

the monitoring unit is used for monitoring the environmental data of the current environment of the electronic equipment if the electronic equipment is determined to run the target application process;

And the output unit is used for outputting a corresponding prompt at least according to the use result of the target data if the target data associated with the target application process is obtained in the current environment from the environment data.

In yet another aspect, the present application provides an electronic device comprising:

a memory for storing instructions;

and the processor is used for executing the instructions stored in the memory to realize the control method.

In yet another aspect, the present application provides a storage medium having stored therein computer program code which, when executed, implements the above-described control method.

According to the control method and the control device, if the electronic equipment is determined to run the target application process, the environmental data of the current environment of the electronic equipment is monitored, if the target data associated with the target application process is obtained in the current environment of the electronic equipment, which is determined from the environmental data, the corresponding prompt is output at least according to the use result of the target data, the output prompt can indicate whether the target application process has problems in the running process of the target application process due to the arrangement of the target component or not by means of the target component, and at least the target component is monitored according to the use result of the target data. If the problem of the running process of the target application process caused by the setting of the target component is detected, the target component can be adjusted to reduce the probability of the problem of the target application process caused by the target component.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a control method provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of a prompt output mode according to an embodiment of the present application;

FIG. 3 is a schematic diagram of another prompt output mode according to an embodiment of the present application;

FIG. 4 is a schematic diagram of another prompt output mode according to an embodiment of the present application;

FIG. 5 is a flow chart of another control method provided by an embodiment of the present application;

FIG. 6 is a flow chart of yet another control method provided by an embodiment of the present application;

Fig. 7 is a schematic structural diagram of a control device according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another control device according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

Referring to fig. 1, a flowchart of a control method provided by an embodiment of the present application may include the following steps:

101: and if the electronic equipment is determined to run the target application process, monitoring the environmental data of the current environment of the electronic equipment.

Wherein the target application process is an application process associated with a target component in the electronic device, the target application process associated with the target component may include, but is not limited to: at least one of a dependent target component implementation function and being capable of interacting with data of the same type as the data processed by the target component, the dependent target component implementation function comprising: at least one of sound data and/or image data acquisition depending on the target component, interaction between the electronic device and the user depending on the target component, and the like, the interaction being of the same type as the data processed by the target component including: interactive sound data and/or image data.

For example, the target component is a sound receiving component in the electronic device, and for meeting application processes, video application processes, chat application processes (such as WeChat) and the like running in the electronic device, the application processes can interact with sound data and/or can rely on the sound receiving component to collect sound data and the like in the running process of the application processes, so that the application processes can be used as the target application processes, and the sound receiving component can be regarded as the target component.

For another example, for the monitoring application process and the biological information verification application process, the monitoring application process and the biological information verification application process can interact with image data and/or can rely on the image acquisition component to acquire the image data, so that the monitoring application process and the biological information verification application process can be regarded as target application processes, and the dependent target component is the image acquisition component. If the biometric information authentication application process performs authentication through voice or fingerprint, the dependent target component is a sound receiving component or a fingerprint collecting component, respectively.

The conference application process, the video application process, the chat application process, the monitoring application process, the biological information verification application process, the radio component and the image acquisition component are described here as examples, and the target application process and the target component are not limited in this embodiment. In a default situation, when the electronic device runs the target application process, a preset driver related to the target component can be run, the target component is controlled to be in a data acquisition state through the preset driver, but the target component can only receive an acquisition instruction to passively acquire data, and cannot actively acquire data, for example, in a default situation, when the electronic device runs the target application process, the electronic device can run the preset driver related to the radio component (the preset driver related to the radio component can be simply referred to as a mic monitor app), the mic monitor app controls a sound card in the radio component to be always in a state of acquiring sound data, and the sound card can only receive the acquisition instruction to passively acquire sound data, and cannot actively acquire the sound data.

In this embodiment, the determining of the electronic device running target application process may be determined according to any one of a preset application list, a file access path, historical running data, behavior data and whether the dependent component includes the target component, and the determining of the electronic device running target application process may be, but is not limited to, determining whether the electronic device runs the target application process in a new application process of the electronic device, for example, at least one of a start setup time of the new application process, a setup time of the new application process, and an end setup time of the new application process. The method for determining the running target application process of the electronic device includes, but is not limited to, the following methods:

the method for determining the running target application process of the electronic equipment is that a preset application list is obtained, and if the newly-built application process is in the preset application list, the running target application process of the electronic equipment is determined.

The preset application list records the identification of the application process capable of triggering the electronic device to monitor the environmental data of the current environment, such as the names of the application processes capable of triggering the electronic device to monitor the environmental data of the current environment, wherein the application processes capable of triggering the electronic device to monitor the environmental data of the current environment are application processes related to target components in the electronic device, and the related target components can include but are not limited to: at least one of the function realization by the target component and the data with the same data type as the data processed by the target component can be interacted, such as the conference application process, the video application process and the like, and the identification of the application processes such as the conference application process, the video application process, the chat application process, the biological information verification application process and the like can be recorded in a preset application list.

If the electronic device establishes an application process, comparing the identifier of the established application process with the identifier of the application process in the preset application list to determine whether the established application process is one of the preset application processes, and if so, determining that the electronic device runs the target application process in the preset application list.

With the development of technology, various types of application processes running in electronic equipment are more and more, it is a complicated task to record all application processes capable of triggering the electronic equipment to monitor the environmental data of the current environment in the preset application processes, and the more the content recorded in the preset application list is, the larger the space occupied by the preset application list is, so this embodiment may adopt, but not limited to, a mode of recording function descriptions of the application processes, for example, recording description data of the application processes used to trigger the monitoring environmental data in the preset application list, where the description data are used to indicate the functions implemented by the application processes, and when the electronic equipment builds an application process, the description data of the new application process is matched with the description data of the application process in the preset application list, and it is determined whether there is an application process in the preset application list in which the description data is matched with the description data of the new application process, if there is a certain new application process in the preset application list. The matching of the description data of the new application process with the description data of the application process in the preset application list may be performed in a manner that, but is not limited to, determines that the description data of the new application process is similar to the description data of the application process in the preset application list.

For example, taking a conference application process as an example, the conference application process can realize a multiparty online conference by using conference software in the electronic device, the conference application process needs a radio component to collect sound data of participants in the conference process and outputs the sound data of the participants through a loudspeaker, then description data of the conference application process can be added into a preset application list, for example, description is completed by the radio component and the loudspeaker, in the process of creating an application process, similarity between the description data of the created application process and the description data of the conference application process is obtained, if the similarity is greater than the preset similarity, the created application process is determined to be a conference application process, so that the operation target application process of the electronic device is determined, the preset similarity is used for indicating whether the created application process is in the preset application list, and the value of the preset similarity is not limited in this embodiment.

Another way to determine the electronic device to run the target application process is to obtain a file access path when the application process is newly built, and if the file access path is in the preset storage area, determine that the electronic device runs the target application process.

The file access path is a path of a file accessed by the electronic device in the process of creating an application process, and contents such as files/data in the file access path can assist the electronic device in creating the application process. For example, for a video application process, the video application process needs the assistance of the image acquisition component, and then a driving process of the image acquisition component is started in the new video application process, so that the driving process of the image acquisition component is accessed in the new video application process, and a file access path of the driving process is obtained.

Because the electronic device can newly create different application processes, file access paths corresponding to the different application processes may also be different, for this embodiment, a preset storage area is preset, a file access path corresponding to a target application process is stored in the preset storage area, and if the file access path is in the preset storage area, it is determined that the electronic device runs the target application process. Taking the video application process as an example, a preset storage area corresponding to a file access path of a driving process of the image acquisition component is set, if the file access path of a newly built application process is in the preset storage area, it is indicated that the newly built application process accesses the driving process of the image acquisition component, and it can be determined that the newly built application process of the electronic device is the video application process, so that it is determined that the electronic device runs the target application process.

In another way of determining that the electronic device is running the target application process, historical running data of the newly-built application process is obtained, and if the historical running data indicates that the application process is associated with the target component, the electronic device is determined to run the target application process.

The historical operation data is the operation data of the application process existing before the application process is newly built by the electronic device, and the historical operation data can be at least one of operation data generated by newly building/operating the application process by other electronic devices and operation data generated by newly building/operating the application process by the electronic device. The historical operation data is used for indicating components involved in the process of creating/operating the application, for example, the historical operation data comprises historical sound data and/or historical image data, and the components such as a sound collecting component, a loudspeaker, an image collecting component and the like are involved in the process of creating/operating the application. Based on the embodiment, a target component associated with a target application process is preset, and if the historical running data indicates that the application process uses the target component, and the application process is associated with the target component, the electronic device is determined to run the target application process.

The associated target components of different types of target application processes are different, even though the associated target components are the same, the operation aiming at the target components may be different, so that the difference exists in the historical operation data of the different types of target application processes, for example, the game application process frequently controls a specific key, for example, the game application process frequently controls a direction key for controlling the position of a virtual object, and the data volume of the operation data of the direction key for controlling the position of the virtual object in the historical operation data of the game application process is larger than the data volume of other types of data; compared with the game application process, the number of the specific keys controlled by the document editing application process is increased but the specific keys are not frequently operated frequently, so that the number of the specific keys indicated by the historical operation data of the document editing application process is larger than the number of the specific keys indicated by the historical operation data of the game application process, and the specific keys are different; the video application processes frequently use the image acquisition components, and the historical operation data of the corresponding video application processes comprise a plurality of data related to the image acquisition components, so that the components related to the application processes can be determined according to the historical operation data of the application processes for different types of application processes.

In another way of determining that the electronic device runs the target application process, behavior data acting on the newly-built application process is obtained, and if the behavior data includes audio/video input data or user interaction data, the electronic device is determined to run the target application process.

The behavior data may be at least one of historical behavior data and/or current behavior data, the current behavior data being behavior data that is currently acting on the newly-built application process during the newly-built application process, and the behavior data may be behavior data that is acted on the newly-built application process by the electronic device and/or behavior data that is acted on the newly-built application process by other electronic devices.

The behavior data acting on the newly built application process is expressed in the form of: 1. some types of data such as audio input data, video input data, image input data, etc. which are input to or provided to the application process, and some data which are acted on the application process by user operations during the application process establishment process are called user interaction data. For example, the newly-built application process is a shopping application process, image input data is provided for the shopping application process in the process of establishing the shopping application process, and the image input data provided for the shopping application process is a product picture displayed in a shopping interface of the shopping application process, so that the product picture can be displayed in the shopping interface in the process of establishing the shopping application process.

The user interaction data characterizes operation data of a user operation in an application process establishing process, the user operation may be an operation on an input component in the application process establishing process, the corresponding user interaction data may be input data acting on the input component, the input component includes but is not limited to a keyboard, a mouse, an image acquisition component, a microphone, and the like, for example, the user interaction data may be input data acting on a key, and of course, the user interaction data may be interaction data generated in the application process establishing process for other components in the electronic device, such as an operation of a touch screen, which is not limited to this embodiment.

If the obtained behavior data includes audio/video input data or user interaction data, determining that the electronic device runs the target application process, wherein the audio/video input data may be, but is not limited to, at least one of audio input data (or sound input data), video input data and image input data, and the content represented by the audio/video input data is not limited in this embodiment.

In another way of determining that the electronic device runs the target application process, a newly built component on which the application process runs depends is obtained, and if the component contains the target component, the electronic device is determined to run the target application process.

The target component is a component relied on in the running process of the target application process, and the components relied on by different application processes may also be different, and in this embodiment, the dependent component is determined by, but not limited to, running data of a newly built application process, and if the dependent component is determined to include the target component, the electronic device is determined to run the target application process, and the process of determining the dependent component by the running data is described in detail herein, with reference to the above description of historical running data.

And triggering the monitoring of the environmental data of the current environment of the electronic equipment when the electronic equipment is determined to run the target application process, wherein the monitoring of the environmental data of the current environment of the electronic equipment is to monitor whether the target data associated with the target application process is obtained in the process of running the target application process of the electronic equipment, and the target data is related to the target component so as to monitor at least the target component according to the using result of the target data.

The target data comprises target sound data and/or target image data, the target component corresponding to the target sound data comprises at least one of a sound receiving component and a loudspeaker, the target component corresponding to the target image data comprises at least one of an image acquisition component and a fingerprint acquisition component, if the target sound data and/or the target image data are obtained, the target components can be monitored according to the target sound data and/or the target image data, and the environment data of the current environment of the corresponding monitoring electronic equipment are mainly sound data and/or image data of the current environment of the monitoring electronic equipment.

In this embodiment, the monitoring of the environmental data of the current environment of the electronic device includes, but is not limited to, the following ways:

The method for monitoring the environmental data is that environmental data of the current environment where the target component is located is monitored through a preset driver; under the default condition, when the electronic device runs the target application process, a preset driver related to the target component can be run, the target component is controlled to be in a data acquisition state by the preset driver, so that environmental data of the current environment of the electronic device is acquired by the target component, but the following is needed to be noted: the target component can only receive the acquisition instruction to passively acquire data, and cannot actively acquire data, such as passively acquiring environmental data when the target component receives the acquisition instruction sent by the target application process.

For example, the target component may be a sound receiving component, and the preset driver may be a sound card filter driver of the sound receiving component, where the sound data of the current environment collected by the sound receiving component is monitored by the sound card filter driver.

Under the condition that the electronic equipment is determined to run the target application process, the monitoring of the target component through the preset driver is directly triggered to acquire the environmental data of the current environment. In some cases, although the target application process is executed, the environmental data of the current environment is not required to be monitored, thus in the case that the electronic device is determined to execute the target application process, whether to trigger the monitoring of the environmental data of the current environment, which is collected by the target component, through the preset driver is also determined according to the operation parameters of the target application process and/or the device parameters related to the target component, and these combination modes are mainly used for determining whether the target application program is about to use the target component, and the following modes are shown in combination with the operation parameters of the target application process and/or the device parameters related to the target component:

In the first combination mode, when the electronic equipment is determined to run the target application process, the type of the target application process is determined, if the type of the target application process is the first type, the target application program is determined to use the target component, and the environment data of the current environment where the target component is located, which is collected by the preset driver program, is triggered. The first type of target application process is an application process which depends on a corresponding target component to realize a function, if the recording application process depends on the radio component to realize a recording function, the recording application process belongs to the first type of target application process, the image shooting application process depends on the image acquisition component to realize a shooting function, and the image shooting application process also belongs to the first type of target application process.

In the second combination mode, if the type of the target application process is the second type, the running state of the target application process is obtained to determine whether the target application process runs the target subprocess, and if the target subprocess runs, the environment data of the current environment where the target component is located, which is collected by the preset driver, is triggered. The second type of target application process is an application process capable of realizing voice and/or image data interaction, and the target subprocess is an application process which depends on a corresponding target component to realize functions in the second type of target application process. Taking a conference application process as an example, a conference application process is newly built in the process of running conference software by the electronic device, but the conference application process comprises a plurality of types of subprocesses, such as a login subprocess, a conference subprocess, a history conference viewing subprocess and the like, and at least one target component, namely a radio component, is used as the conference subprocess in the subprocesses, so that the conference subprocess can be determined as the target subprocess; and if the operation is performed to other subprocesses except the conference subprocess, the triggering of the monitoring of the environment data of the current environment acquired by the target component through the preset driver is forbidden.

The target sub-processes corresponding to different types of target application processes may be different, and in this embodiment, the target sub-processes may be preset for different types of target application processes, for example, the target sub-processes include, but are not limited to, a voice sub-process, a video sub-process, a conference sub-process, a biological information verification sub-process, and the like.

In a third combination mode, if the type of the target application process is the second type, acquiring the working parameters of an input component in the electronic equipment; if the operating parameters of the input component indicate that there is a possibility that the target component is used by the user, triggering the monitoring of the environmental data of the current environment in which the target component is located by the preset driver.

Input components include, but are not limited to: a keyboard, a mouse, an image acquisition part, a touch screen, a sound reception part and the like, wherein for different types of input parts, working parameters for indicating the possibility that a target part is used by a user are different; if the input component is at least one of a keyboard, a mouse and a touch screen, the working parameters of any component of the keyboard, the mouse and the touch screen are acquired, and the interaction event of the components is received. The user controls the target application process through at least one component of the keyboard, the mouse and the touch screen when the interaction event is conducted for the component, and the corresponding possibility that the target component is used by the user exists.

If the input component is a sound pickup component, the input signal (a representation of an operating parameter of the sound pickup component) of the sound pickup component is monitored, and if the signal strength of the input signal is continuously monitored to be greater than the preset strength for a preset period of time, it is determined that there is a possibility that the target component is used by the user.

If the input component is an image acquisition component, acquiring image data of the current environment of the electronic equipment through the image acquisition component; if it is determined that the user gazes at the display area of the electronic device based on the image data, it is determined that there is a possibility that the target component is used by the user. The display area of the user gazing at the electronic device may be determined by monitoring whether the eyes of the user are present in the image rendered based on the image data, and if the eyes of the user are present, determining that the user gazes at the display area of the electronic device. In this embodiment, the attention of the eyes may be detected based on the attention detection algorithm, so as to determine whether the eyes of the user focus on the display area, and if focus on the display area, determine that the user focuses on the display area of the electronic device.

If the input component is an image acquisition component, the image data acquired by the image acquisition component may also be used to determine whether there is a likelihood that the target component is used by the user by other means, such as monitoring whether there are other electronic devices in the image rendered based on the image data in addition to the electronic device, the other electronic devices being capable of assisting the user in communicating with the other user, and if not, determining that there is a likelihood that the target component is used by the user. For example, whether a mobile phone exists in an image rendered based on the image data is monitored, if the mobile phone exists, the mobile phone indicates that the user can communicate with other users in a long distance through the mobile phone, the possibility that the user currently uses the electronic device to which the target component belongs is low, and therefore the possibility that the target component is not used by the user is determined. In a scenario where other electronic devices than the electronic device are present and the other electronic devices assist the user in communicating with other users, it is also possible to monitor whether there is a picture in the image that the user communicates with the other electronic devices, determine that there is no possibility that the target component is used by the user if there is such a picture, and determine that there is a possibility that the target component is used by the user if there is no such a picture. Pictures that the user communicates with by means of other electronic devices, including but not limited to picture-determining target components that the user holds with the other electronic devices, headphones that the user wears, and even headphones that the user wears, are connected to the other electronic devices.

In this embodiment, the input unit further includes a unit that is externally connected to the interface of the electronic device, for example, an earphone that is externally connected to the earphone interface of the electronic device, and if sound data is received through the external earphone, it is determined that there is a possibility that the target unit is used by the user.

In a fourth combination, if the type of the target application process is the second type, the working state of the output component in the electronic device is obtained, and the output component may be, but is not limited to, a sound output component of the electronic device, such as a loudspeaker of the electronic device. If the operational state of the output component is an enabled state, it is determined that there is a likelihood that the target component is used by the user.

The four combination modes are exemplified to control the monitoring of the environmental data collected by the target component by the preset driver, and the present embodiment is not limited thereto.

Another way to monitor environmental data is to monitor environmental data of the current environment of the electronic device through other components different from the target component; i.e. by other components of the electronic device than the target component, which are capable of collecting environmental data, e.g. the target component is one of the image collecting component and the sound collecting component, and the other component may be the other of the image collecting component and the sound collecting component. For example, the target component is a sound receiving component, the other components are image collecting components, and the image collecting components monitor the image data of the current environment of the electronic device to determine whether the target data indicating the possibility of using the target component by the user exists, and the process is described in the manner of monitoring the environment data.

In this embodiment, other components for monitoring environmental data may be added to the electronic device, where the device resources consumed by the other components for monitoring environmental data are smaller than the device resources consumed by the target component, so as to reduce consumption. For example, an audio receiving component is additionally arranged in the electronic equipment, the additionally arranged audio receiving component is forbidden to be used as a target component, and environmental data is monitored through the additionally arranged audio receiving component. And in the same way, an image acquisition component for monitoring the image data can be additionally arranged in the electronic equipment, the image data acquired by the additionally arranged image acquisition component is taken as environment data, and the additionally arranged image acquisition component is forbidden to be used as a target component. For other components for monitoring environmental data, which are added to the electronic device, the present embodiment may be controlled by adopting the above four combination manners, and the specific process is not described in this embodiment.

Yet another way to monitor environmental data is by monitoring the environmental data by other devices within the current environment than the electronic device. Such as monitoring environmental data, such as monitoring sound data and/or image data, etc., by at least one of a camera, a sound reception device, other electronic devices, etc., that are different from the electronic device within the current environment.

After the other devices monitor the environment data, the other devices send the environment data to the electronic device through a communication link between the other devices and the electronic device, or after the other devices determine that the target data associated with the target application process is obtained in the current environment, prompt instructions are sent to the electronic device to indicate that the target data is determined.

102: And outputting a corresponding prompt at least according to the use result of the target data if the target data associated with the target application process is obtained in the current environment from the environment data.

The target data associated with the target application process indicates that the target data may be used by the target application process, but because some setting problems of the electronic device result in the target data not being used, the embodiment outputs a corresponding prompt at least according to the use result of the target data, so as to prompt that the target data cannot be used because of some setting problems of the electronic device. The target data comprises target sound data and/or target image data, and for the target data comprises content depending on the type of content required by the target application process, for example, the target application process is a conference application process, the type of content required by the conference application process comprises a sound type and an image type, and then the target data comprises target sound data and target image data; if the target application process is an image capturing application process, the required content type of which is an image type, the target data includes target image data. The result of using the target data includes two forms:

In one form, the target data is used by an application process associated with the preset driver, and if the target data is used by the application associated with the preset driver, a first prompt is output that a function of the electronic device corresponding to the target component is disabled.

The first prompt is used for indicating that the system setting of the electronic device sets the function corresponding to the target component to be in a disabled state, and the target component is set to be in the disabled state through the system setting even though the target component is started. For example, the target component is a sound receiving component, the working state of the sound receiving component comprises a mute state and a pickup state, the sound receiving component is still in a disabled state even if the sound receiving component is started in the mute state, sound data cannot be collected, and the sound receiving component is in an available state in the pickup state, and can collect the sound data. If the system setting of the electronic device sets the radio receiving component to a disabled state, outputting a first prompt that a function of the electronic device corresponding to the target component is disabled when the target data is used by an application associated with a preset driver.

Output modes of the first prompt include, but are not limited to: the interface displays at least one of prompts, voice prompts, light prompts, etc., such as OSD (On-SCREEN DISPLAY, on-screen menu mode of adjustment) and light prompts of keys. And the electronic device switches the output mode of the first prompt along with the use of the target application process, for example, the prompt degree of the first prompt is improved along with the use of the target application process so as to improve the prompt effect of the first prompt. For example, in the process of outputting the first prompt in the interface display prompt mode, along with the use of the target application process, the display of the first prompt is highlighted, for example, the interface display prompt mode outputs the first prompt in the form of shaking the icon, along with the increase of the shaking frequency of the use icon of the target application process or the increase of the icon, the function corresponding to the target component is still disabled even after the increase of the shaking frequency or the increase of the icon for a period of time, and then a dialog box may be output to prompt that the function corresponding to the target component is disabled.

In another form, the target data is to be used by the target application process but cannot be used by the target application process due to the setup problem, and if the target data cannot be used by the target application process, a second hint is output that a function of the target application process corresponding to the target component is disabled.

The second hint is used to indicate that the target application process sets the function corresponding to the target component to the disabled state although the system settings of the electronic device are not set to the disabled state, in which case the second hint is output for indicating that the function corresponding to the target component of the target application process is disabled to indicate that the application settings of the target application process set the function corresponding to the target component to the disabled state.

The output modes of the second prompt include, but are not limited to: interface display prompts, voice prompts, light prompts and the like, such as application window prompts of an interface display prompt, which can be in a target application process, desktop prompts of the electronic device and prompts through other devices, wherein the other devices can be devices for monitoring environment data of the current environment of the electronic device. In the process of outputting the second prompt, the prompt can be switched, namely, the output mode of the second prompt is switched, and the description of the first prompt can be seen specifically.

Whether the target data should be used by the target application process or not is judged by at least one judgment condition in the scene information operated by the target application process and the interaction theme corresponding to the target application process, and if the target data is related to the judgment condition, the target data is determined to be used by the target application process.

According to the control method, if the electronic equipment is determined to run the target application process, the environmental data of the current environment of the electronic equipment is monitored, if the target data associated with the target application process is obtained in the current environment of the electronic equipment, which is determined from the environmental data, the corresponding prompt is output at least according to the use result of the target data, the output prompt can indicate whether the target application process has problems in the running process of the target application process due to the fact that the target component is arranged, and at least the target component is monitored according to the use result of the target data. If the problem of the running process of the target application process caused by the setting of the target component is detected, the target component can be adjusted to reduce the probability of the problem of the target application process caused by the target component.

In the following, taking a meeting application process as a target application process and taking a radio receiving component as an example for explanation, if an electronic device builds an application process, determining that the built application process is the meeting application process by presetting any one of an application list, a file access path, historical operation data, behavior data and depending components including the target component, and triggering the electronic device to monitor the environmental data of the current environment.

The environment data can be collected through the sound collecting component, for example, the environment data collected by a sound card in the sound collecting component is monitored through a preset driver (such as a sound card filtering driver) of the sound collecting component, and if the sound data associated with the conference application process is obtained from the environment data in the current environment, a corresponding prompt is output at least according to the use result of the sound data. Outputting a first prompt for disabling a function of the electronic device corresponding to the target component, e.g., if the sound data is used by an application associated with the preset driver, e.g., the first prompt prompts a system setting of the electronic device to set the function corresponding to the target component to a disabled state, e.g., the system setting sets the radio component to a mute state; if the target data cannot be used by the target application process, outputting a second prompt for disabling the function corresponding to the target component of the target application process, wherein the second prompt is used for indicating that the application setting of the target application process sets the function corresponding to the target component to be in a disabled state, for example, the conference application process sets the radio component to be in a mute state.

Whether the first prompt and the second prompt are output, the output modes can be seen in, but are not limited to, the modes shown in fig. 2 to 4, and if the function corresponding to the radio part is determined to be police, a shaking icon (shown in the left side of fig. 2) is output for prompting; with the use of the conference application process, for example, when the continuous existence of sound data is detected, the output mode is switched from slight shaking shown in the left side of fig. 2 to the right side of fig. 2, so that the frequency of shaking the icon is quickened to highlight the display of the currently output prompt, and a text description (shown in fig. 3) can be added in the shaking icon in the process of outputting in the icon shaking mode so as to prompt a user to change the setting of the radio component and enable the function of the radio component to be in a usable state. If the function corresponding to the sound receiving component is disabled for a period of time (e.g., 5 seconds but not limited to 5 seconds) when the frequency of shaking the icon is increased, the box shown in fig. 4 is displayed to prompt the user to start the function corresponding to the sound receiving component, and the function corresponding to the cashier device is adjusted to be in an available state by operating the prompt information in the box.

When triggering and monitoring environment data of the current environment of the electronic device, the embodiment can also judge the following aiming at the meeting application process:

Judging, determining whether a conference application process runs a conference subprocess, and triggering a sound card filter driver to monitor environment data of the current environment collected by a sound receiving component if the conference subprocess runs;

The other judgment is that working parameters of at least one component of a keyboard, a mouse and a touch screen in the electronic equipment are obtained, and if interaction events aiming at the components are received, environmental data of the current environment where the radio component is located, which is collected by a sound card filter driver, is triggered;

the method comprises the steps of judging, acquiring the working state of a loudspeaker in electronic equipment, and triggering the monitoring of environmental data of the current environment acquired by a sound card filtering driver if the loudspeaker is in an enabled state;

The image data of the current environment of the electronic equipment is acquired through the image acquisition component; triggering the sound card filter driver to monitor the environmental data of the current environment collected by the sound receiving component if the user's eyes exist in the image rendered based on the image data or the user's eyes concentrate to watch the display area;

The method comprises the steps of judging whether an input signal of a sound receiving component is monitored, if the signal intensity of the input signal is continuously monitored to be larger than the preset intensity within a preset time period, triggering the monitoring of environmental data of the current environment, collected by the sound card filtering driver; the preset intensity is used for indicating the possibility that the sound receiving component is used by the user, that is, the user may speak through the sound receiving component in the process of running the conference application, and the value of the preset intensity is not limited in this embodiment. For example, the preset intensity can represent the sound size, and the corresponding preset intensity can be expressed by using but not limited to DB (decibel), for example, the preset intensity can be but not limited to 40DB, if the signal intensity of the input signal is continuously monitored to be greater than 40DB within the preset time period, the environment data of the current environment collected by the sound card filtering driver is triggered to be monitored;

The image data of the current environment of the electronic equipment is acquired through the image acquisition component; if other electronic equipment except the electronic equipment exists in the image rendered based on the image data, the other electronic equipment can assist the user to communicate with other users, and the sound card filtering driver is triggered to monitor the environmental data of the current environment where the sound receiving part is located, wherein the environmental data are collected by the sound card filtering driver; or the image is monitored to have a picture that the user communicates by other electronic equipment, and the environment data of the current environment collected by the radio part is triggered to be monitored by the sound card filter driver.

In addition, in addition to monitoring the environmental data collected by the sound card in the sound receiving component through the preset driver (such as the sound card filtering driver) of the sound receiving component, another sound receiving component can be additionally arranged in the electronic device, the additionally arranged sound receiving component is forbidden to be used as a target component, the environmental data is monitored through the additionally arranged sound receiving component, and when the environmental data is triggered to be monitored by the sound receiving component, please refer to the related description in the preset driver, and the description is not repeated here.

Referring to fig. 5, a flowchart of another control method provided by an embodiment of the present application may include the following steps:

201: and if the electronic equipment is determined to run the target application process, monitoring the environmental data of the current environment of the electronic equipment.

202: And outputting a corresponding prompt at least according to the use result of the target data if the target data associated with the target application process is obtained in the current environment from the environment data.

In this embodiment, step 201 and step 202 are the same as step 101 and step 102 described above, and will not be described here.

203: And adjusting the corresponding functional state of the target component according to the prompt.

In this embodiment, no matter the system setting of the electronic device or the application setting of the target application process sets the function corresponding to the target component to the disabled state, even if the target component can acquire the target data, the use of the target data is limited, so the present embodiment adjusts the function state corresponding to the target component according to the prompt so that the target data can be used by the target application process.

If the target component is used for collecting target sound data, the target component is in a disabled state when the target component is set in a mute state, and is in an available state when the target component is set in a pick-up state, the collected sound data can be used by a target application process, and a corresponding possible way of adjusting the corresponding functional state of the target component according to the prompt is to adjust the target component from the mute state to the pick-up state. If the system setting of the electronic equipment is the mute state, the system setting of the target component is adjusted, and the mute state is adjusted to the pick-up state; and if the application setting of the target application process is the mute state, adjusting the application setting of the target component, and adjusting the mute state of the application setting aiming at the target component to the pick-up state.

If the target component is used for acquiring target image data, the target component is in a disabled state when the target component is set in a closed state, and is in an available state when the target component is set in an open state, the acquired image data can be used by a target application process, and a corresponding possible way of adjusting the functional state corresponding to the target component according to the prompt is to adjust the target component from the closed state to the open state. If the system setting of the electronic equipment is the system setting of the electronic equipment, the system setting of the target component is adjusted, and the closing state is adjusted to the opening state; and if the application setting of the target application process is the closing state, adjusting the application setting of the target component, and adjusting the closing state of the application setting aiming at the target component to the opening state. If the target component for capturing target image data captures image data passively as well as by default, the functional state adjustment for the target component for capturing target image data is similar to the functional state of the target component for capturing target sound data described above and will not be described here.

According to the control method, if the target data associated with the target application process is obtained in the current environment from the environment data, the corresponding prompt is output at least according to the use result of the target data, and the functional state corresponding to the target component is adjusted according to the prompt, so that the target component can collect the target data and the collected target data can be used by the target application process, and the probability of occurrence of problems of the target application process due to the target component is reduced.

Referring to fig. 6, a flowchart of another control method provided by an embodiment of the present application may include the following steps:

301: and if the electronic equipment is determined to run the target application process, monitoring the environmental data of the current environment of the electronic equipment.

302: And outputting a corresponding prompt at least according to the use result of the target data if the target data associated with the target application process is obtained in the current environment from the environment data.

303: And adjusting the working parameters of the target component according to the target data. And adjusting the working parameters of the target component according to the target data relative to the functional state corresponding to the target component according to the prompt, wherein the working parameters of the target component are adjusted according to the target data under the condition that the target data can be used by the target application process, namely, the functional state corresponding to the target component is in an available state, so that the data quality of the target data is improved. Wherein, the adjusting the working parameters of the target component according to the target data comprises any one of the following modes:

An adjustment mode, if the target data is obtained through the target component and the first parameter condition is met, acquiring the target data through the target component and other components different from the target component; the first parameter condition is used for indicating that the target data obtained by the target component, although being usable by the target application process, does not satisfy the use condition of the target application process. Taking the target data as the target sound data as an example, if the volume corresponding to the target sound data is smaller than or equal to the preset volume, the definition of the sound is reduced due to the fact that the volume is too low in the process of outputting the target sound data, in this case, the working parameters of the target component need to be adjusted, the preset volume is a use condition corresponding to the target sound data set by the target application process, the volume is smaller than or equal to the preset volume, the preset volume is a representation form of the first parameter condition, and the value of the preset volume is not limited in this embodiment.

And if the first parameter condition is met, acquiring the target data through the target component and other components different from the target component so as to jointly acquire the target data through a plurality of components and improve the data quality of the target data. For example, for an electronic device including a plurality of target sound data collection devices, after adjusting the functional state corresponding to the target component from the mute state to the pick-up state, the target component corresponding to the target application process may be further adjusted to switch from the single-path pick-up state to the multi-path pick-up state, thereby switching from the single target component to the plurality of target components to collect sound data simultaneously, so as to increase the pick-up range and increase the volume corresponding to the target sound data by the plurality of target components, so as to improve the data quality of the target sound data. It is of course also possible to collect the sound data jointly by the target component in the electronic device and the component for collecting the sound data in the other device.

In another adjustment mode, if the target data are obtained through a plurality of target components and the second parameter condition is met, the target data are acquired through the target components which are most matched with the target application process; that is, in the process of obtaining target data by a plurality of target components, if the target data satisfies the second parameter condition, the obtaining of the target data from the plurality of target components is switched to the collection of the target data by a single target component, such as switching to the collection of the target data by the target component that is the closest match to the target application process.

The second parameter condition indicates that the data quality of the target data does not meet the use condition of the target application process, taking the target data as the target sound data as an example, if the corresponding volume of the target sound data is larger than a preset volume, the definition of sound is improved but the listening of a user is affected due to the fact that the volume is too high in the process of outputting the target sound data, in this case, the working parameter of the target component needs to be adjusted, the preset volume is the use condition set by the target application process and corresponding to the target sound data, and the volume is larger than the preset volume and is an expression form of the second parameter condition. For the target sound data, the determination may also be made by monitoring noise data in the target sound data, whereby the second parameter condition is used to define an amount of noise in the target sound data, by which it is determined whether the target data is collected by the target component that best matches the target application process. For example, if the noise is too much, the target data is collected by the target component that best matches the target application process.

The target component that best matches the target application process may collect target data as, but is not limited to: the data quality of the data collected by the plurality of target components is better than the data quality of the data collected by other target components, or the target data points to an interactive object, and the best matched target component is the target component closest to the interactive object.

In another adjustment mode, if the electronic equipment is detected to be switched from the first target application process to the second target application process, target data are collected through a target component corresponding to the second target application process.

In this embodiment, a corresponding target component is set for each target application process, and if a change in the target application process running by the electronic device is detected, the target component for collecting target data is also changed adaptively, and as to which target component is switched, it depends on the target application process to which the electronic device is currently switched. For example, the target application process 1 corresponds to the target component 1, the target application process 2 corresponds to the target component 2, and if the electronic device is detected to switch from the running target application process 1 to the target application process 2, the target component switches from the target component 1 to the target component 2, and the target data is collected through the target component 2. The types of target components corresponding to different target application processes may be the same or different, and are not limited herein.

In this embodiment, the adjustment of the target component may combine the adjustment of the functional state corresponding to the target component according to the target data with the adjustment of the working parameter of the target component according to the target data, which will not be described in detail in this embodiment.

According to the control method, if the target data related to the target application process is obtained in the current environment from the environment data, the corresponding prompt is output at least according to the use result of the target data, the working parameters of the target component are adjusted according to the target data, and the data quality of the collected target data is improved by adjusting the working parameters of the target component.

For the above control method, if it is determined that the electronic device runs the target application process, a process of monitoring the environmental data of the current environment of the electronic device may be different according to the type of the target application process, and the following description is made for the first type of the target application process and the second type of the target application process:

The target application process is a first type target application process, wherein the first type target application process is an application process depending on a corresponding target component to realize a function, and in the process of running the first type target application process by the electronic device, the function of the first type target application process needs to be realized depending on the corresponding target component, if the recording application process depends on the radio component to realize the recording function, the recording application process belongs to the first type target application process, the image shooting application process depends on the image acquisition component to realize a shooting function, and the image shooting application process also belongs to the first type target application process:

If it is determined that the electronic device is running a target application process of a first type, at least monitoring sound and/or image data of an environment in which the electronic device is currently located, and taking the sound and/or image data of the environment in which the electronic device is currently located as a representation of the environment data. If the electronic device runs a target application process of a first type, the method for determining that the target data associated with the target application process is obtained in the current environment is as follows:

after the electronic device runs the first type of target application process, each piece of environment data obtained from the current environment is determined to be the target data required by the first type of target application process, the environment data is taken as the target data, and the associated target data is directly determined to be obtained under the condition that the environment data is monitored, and even if noise data exists in the environment data, the environment data is directly determined to be the target data.

Or alternatively, the first and second heat exchangers may be,

And obtaining the noise data of the current environment, if the first sound and/or image data different from the noise data is obtained from the environment data, determining the first sound and/or image data as the target data required by the target application process of the first type, and detecting the noise data in the current environment of the electronic equipment by the mode so as to filter the influence of the noise data on the target data under the condition that the noise level of the current environment is higher, thereby improving the accuracy of the target data. The embodiment will not be described in detail as to how to separate the noise data from the environmental data to obtain the first sound and/or image data, where the noise data may include sound noise data and/or image noise data, and determine the first sound and/or image data related to the target application process in the environmental data as target data, so as to reduce the influence of the noise data.

The target application process is a second type of target application process, wherein the second type of target application process is an application process capable of realizing sound and/or image data interaction, in the second type of target application process, the function realization of a target subprocess depends on a corresponding target component, and taking a conference application process as an example, the conference application process comprises a plurality of subprocesses, such as a login subprocess, a conference subprocess, a history conference viewing subprocess and the like, wherein the conference subprocess at least uses the target component, and the possibility of using the target component by other subprocesses is low, so that the conference application process can be regarded as the second type of target application process. If it is determined that the electronic device is running a target application process of the second type and the target sub-process is running, at least sound and/or image data of the environment in which the electronic device is currently located is monitored.

If the electronic device runs a target subprocess of a target application process of a second type, determining from the environment data that the target data associated with the target application process is obtained in the current environment, wherein the target subprocess comprises at least one of the following steps:

obtaining an interaction theme of the target subprocess interacting with the server side or the client side, and if second sound and/or image data associated with the interaction theme are obtained from the environment data, determining the second sound and/or image data as target data required by the target subprocess;

The interaction theme is used for indicating the content corresponding to the data required by the target subprocess, for example, the conference subprocess corresponds to one interaction theme, and the interaction theme is used as the conference theme of the conference subprocess to limit the content required by the conference subprocess. For example, the conference theme of the conference subprocess is a tour discussion aiming at a certain area, the content corresponding to the required data is a content surrounding the tour discussion, and the corresponding second sound and/or image data surrounding the tour discussion is determined as target data, such as suggestion of the opinion of the tour, introduction of the area and the like; and second image data of a propaganda display picture and the like of the region.

Or alternatively, the first and second heat exchangers may be,

Acquiring a sound acquisition instruction and/or an image acquisition instruction sent by a server or a client to a target subprocess, and if third sound and/or image data matched with the sound acquisition instruction and/or the image acquisition instruction are acquired from environment data, determining the third sound and/or image data as target data required by the target subprocess; the sound capturing instruction and the image capturing instruction may be sent by the server or the client, and the embodiment is not limited to the form of when the server and the client send the instruction and the instruction.

But after receiving at least one of the sound acquisition instruction and the image acquisition instruction, analyzing the acquired environmental data to determine whether third sound and/or image data matched with the sound acquisition instruction and/or the image acquisition instruction is contained in the environmental data, and if so, determining the third sound and/or image data as target data required by a target subprocess.

Or alternatively, the first and second heat exchangers may be,

And obtaining the interactive object associated with the interactive operation of the target subprocess, and if fourth sound and/or image data associated with the interactive object is obtained from the environment data, determining the fourth sound and/or image data as target data required by the target subprocess.

The interactive object is an object main body involved in the process of executing the interactive operation for the target sub-process, so that the target object involved in the process of executing the interactive operation, namely the interactive object, such as the interactive object for executing the interactive operation or the interactive object pointed by the interactive operation, is determined from the objects by limiting the interactive object to which the target data belongs, such as a plurality of objects (such as a plurality of users) in the current environment.

The corresponding fourth sound and/or image data associated with the interactive object means that the voice obtained based on the sound data matches the voice of the interactive object and/or contains the interactive object picture, and if these types of data are acquired from the environment data, they are determined as target data required for the target subprocess.

Or alternatively, the first and second heat exchangers may be,

And obtaining scene information of the target subprocess operation, and if fifth sound and/or image data matched with the scene information are obtained from the environment data, determining the fifth sound and/or image data as target data required by the target subprocess.

The scene information is used for indicating an application scene to which the target subprocess belongs, and setting contents corresponding to data required by the target subprocess in the application scene, for example, in a dialogue scene, only collecting sound and/or image data of a target object and only recording dialogue records related to 'please notice'; in a release meeting scene, only the content (such as sound and/or image data) related to the release meeting is stored, so that the scene information of the operation of the target subprocess is determined, the application scene of the target subprocess is determined based on the scene information, the fifth sound and/or image data matched with the scene information is extracted from the environment data based on the content corresponding to the data required by the target subprocess set by the application scene, and if the fifth sound and/or image data is extracted, the fifth sound and/or image data is determined to be the target data required by the target subprocess.

In addition, for the first type of target application process, the present embodiment may also obtain target data associated with the first type of target application process according to the interaction theme, the sound acquisition instruction, and/or the image acquisition instruction, the interaction object, and the scene information, taking the first type of target application process as an image capturing application process as an example, the image capturing application process may correspond to an interaction object, the interaction object is a capturing subject of the image capturing application process, and if image data including a capturing subject picture is obtained from the environmental data, the image data including the capturing subject picture is determined as the target data.

According to the target application process of the first type and the target application process of the second type, the related target data are obtained through the method, data acquisition irrelevant to the target application process is reduced, and processing efficiency is improved.

For the foregoing method embodiments, for simplicity of explanation, the methodologies are shown as a series of acts, but one of ordinary skill in the art will appreciate that the present application is not limited by the order of acts, as some steps may, in accordance with the present application, occur in other orders or concurrently. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.

Referring to fig. 7, an optional structure of a control device provided by an embodiment of the present application may include: a monitoring unit 10 and an output unit 20.

And the monitoring unit 10 is used for monitoring the environmental data of the current environment of the electronic equipment if the electronic equipment is determined to run the target application process. The monitoring unit 10 determines that the electronic device runs the target application process in the following manner:

Acquiring behavior data acting on a newly built application process, and determining that the electronic equipment runs a target application process if the behavior data comprises audio/video input data or user interaction data; or alternatively, the first and second heat exchangers may be,

The monitoring unit 10 monitors environmental data of the current environment of the electronic device in the following manner:

monitoring environmental data of the current environment acquired by the target component through a preset driver; or alternatively, the first and second heat exchangers may be,

Environmental data is monitored by other devices within the current environment that are different from the electronic device.

If the monitoring unit 10 determines that the electronic device runs the target application process, the process of monitoring the environmental data of the current environment of the electronic device will be different according to the type of the target application process, and the following description will be given for the first type of the target application process and the second type of the target application process:

the target application process is a first type of target application process:

if the electronic equipment is determined to run a first type of target application process, at least monitoring sound and/or image data of the current environment of the electronic equipment, wherein the first type of target application process is an application process which depends on a corresponding target component to realize functions;

If the electronic device runs a target application process of a first type, determining from the environment data that the target data associated with the target application process is obtained in the current environment comprises:

After the electronic device runs the first type of target application process, determining each piece of environment data obtained from the current environment as target data required by the first type of target application process;

Or alternatively, the first and second heat exchangers may be,

Noise data of the current environment is obtained, and if first sound and/or image data different from the noise data is obtained from the environment data, the first sound and/or image data is determined as target data required by a target application process of a first type.

The target application process is a second type of target application process:

If the electronic equipment is determined to run a target application process of a second type and a target subprocess is run, at least monitoring sound and/or image data of the current environment of the electronic equipment, wherein the target application process of the second type is an application process capable of realizing sound and/or image data interaction.

Or alternatively, the first and second heat exchangers may be,

Acquiring a sound acquisition instruction and/or an image acquisition instruction sent by a server or a client to a target subprocess, and if third sound and/or image data matched with the sound acquisition instruction and/or the image acquisition instruction are acquired from environment data, determining the third sound and/or image data as target data required by the target subprocess;

Or alternatively, the first and second heat exchangers may be,

Obtaining an interactive object associated with the interactive operation of the target subprocess, and if fourth sound and/or image data associated with the interactive object are obtained from the environment data, determining the fourth sound and/or image data as target data required by the target subprocess;

Or alternatively, the first and second heat exchangers may be,

And an output unit 20 for outputting a corresponding hint at least according to the result of use of the target data if it is determined from the environment data that the target data associated with the target application process is obtained in the current environment. Wherein, the outputting unit 20 outputs the corresponding prompt at least according to the using result of the target data in the following manner:

outputting a first prompt that a function of the electronic device corresponding to the target component is disabled if the target data is used by an application process associated with the preset driver; or alternatively, the first and second heat exchangers may be,

According to the control device, if the electronic equipment is determined to run the target application process, the environment data of the current environment of the electronic equipment is monitored, if the environment data is determined to obtain the target data related to the target application process in the current environment, the corresponding prompt is output at least according to the use result of the target data, the output prompt can indicate whether the target application process has problems in the running process of the target application process or not due to the fact that the target component is arranged, and at least the target component is monitored according to the use result of the target data. If the problem of the running process of the target application process caused by the setting of the target component is detected, the target component can be adjusted to reduce the probability of the problem of the target application process caused by the target component.

Referring to fig. 8, an alternative structure of another control device provided in an embodiment of the present application may further include: an adjusting unit 30, configured to adjust a functional state corresponding to the target component according to the prompt; and/or adjusting the working parameters of the target component according to the target data. Optionally, adjusting the operating parameter of the target component according to the target data includes:

if the target data is obtained through the target component and the first parameter condition is met, acquiring the target data through the target component and other components different from the target component; or alternatively, the first and second heat exchangers may be,

If the target data are obtained through a plurality of target components and the second parameter condition is met, collecting the target data through the target components which are most matched with the target application process; or alternatively, the first and second heat exchangers may be,

And if the electronic equipment is detected to be switched from the first target application process to the second target application process, acquiring target data through a target component corresponding to the second target application process.

Referring to fig. 9, an electronic device provided by an embodiment of the present application may include: a processor 100 and a memory 200. Communication between processor 100 and memory 200 is by way of, but not limited to, bus 300. A memory 200 for storing instructions; the processor 100 is configured to execute instructions stored in the memory to implement the control method described above.

The embodiment of the application also provides a storage medium, wherein the storage medium stores computer program codes, and the computer program codes realize the control method when being run.

It should be noted that, each embodiment in the present specification may be described in a progressive manner, and features described in each embodiment in the present specification may be replaced or combined with each other, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.

Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.

Claims

1. A control method, comprising:

Outputting a corresponding prompt at least according to a use result of the target data if it is determined from the environment data that the target data associated with the target application process is obtained in the current environment;

outputting a corresponding prompt at least according to the using result of the target data, wherein the method comprises the following steps:

2. The method of claim 1, wherein determining that the electronic device is running the target application process comprises:

Obtaining behavior data acting on a newly built application process, and determining that the electronic equipment runs a target application process if the behavior data comprise sound or image input data or user interaction data; or alternatively, the first and second heat exchangers may be,

3. The method according to claim 1 or 2, wherein if it is determined that the electronic device is running the target application process, monitoring the environmental data of the environment in which the electronic device is currently located comprises:

4. The method of claim 1, monitoring environmental data of an environment in which the electronic device is currently located, comprising:

5. The method of claim 1 or 4, wherein determining from the environment data that target data associated with a target application process is obtained in the current environment if the electronic device is running the target application process of a first type comprises:

6. The method of claim 1 or 4, wherein, if the electronic device runs a target sub-process of a target application process of a second type, determining from the environment data that target data associated with the target application process is obtained in the current environment comprises at least one of:

7. The method of claim 1, further comprising:

8. The method of claim 7, wherein adjusting the operating parameters of the target component based on the target data comprises:

9. A control apparatus comprising:

The output unit is used for outputting a corresponding prompt at least according to the use result of the target data if the target data associated with the target application process is obtained in the current environment from the environment data;

The output unit is configured to output a corresponding hint at least according to a result of use of the target data, and includes: