WO2024078215A1 - Device control method and apparatus, and electronic device, computer-readable medium and product - Google Patents

Abstract

A device control method and apparatus (1500), and an electronic device (1600), a computer-readable medium (1700) and a computer program product (1800). When a multimedia file is played, different working states can be determined, and on the basis of different conditions, a volume value for playing the multimedia file can be adjusted or the multimedia file can be controlled to play or pause, without requiring intervention from a user, such that the operation burden for the user is reduced, and the usage convenience is improved.

Description

Device control method, device, electronic device, computer readable medium and product

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese application No. 202211236268.6, filed on October 10, 2022, the entire contents of which are hereby incorporated by reference for all purposes.

Technical Field

The present application relates to the field of control technology, and more specifically, to a device control method, apparatus, electronic device, computer-readable medium and product.

Background technique

At present, with the development of electronic information technology, electronic devices can play multimedia files such as audio content and picture content. When the electronic device plays the multimedia file content, the electronic device can be operated to adjust the relevant parameters of the multimedia file content. However, the current method of adjusting the relevant parameters of the multimedia file content played by the electronic device is less convenient.

Summary of the invention

The present application proposes a device control method, apparatus, electronic device, computer-readable medium and product to improve the convenience of device use.

In a first aspect, an embodiment of the present application provides a device control method, which is applied to an electronic device, and the method includes: playing a multimedia file; if the working mode of the electronic device is a first mode, adjusting the volume value of the electronic device playing the multimedia file based on a first condition; if the working mode of the electronic device is a second mode, controlling the playback or pause of the multimedia file based on a second condition.

In a second aspect, the embodiment of the present application further provides a device control apparatus, which is applied to an electronic device, and the apparatus comprises: a playback unit, a first control unit, and a second control unit. The playback unit is used to play a multimedia file; the first control unit is used to adjust the volume value of the multimedia file played by the electronic device based on a first condition if the working mode of the electronic device is the first mode; the second control unit is used to control the playback or pause of the multimedia file based on a second condition if the working mode of the electronic device is the second mode.

In a third aspect, an embodiment of the present application further provides an electronic device, comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory and configured to be executed by the one or more processors so that the electronic device executes the method described in the first aspect above.

In a fourth aspect, an embodiment of the present application further provides a computer-readable medium, wherein the readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method described in the first aspect.

In a fifth aspect, an embodiment of the present application further provides a computer program product, including a computer program/instruction, which implements the method described in the first aspect when executed by a processor.

Other features and advantages of the embodiments of the present application will be described in the following description, and partly become apparent from the description, or can be understood by practicing the embodiments of the present application. The invention can be realized and obtained by the structures particularly pointed out in the claims and the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

FIG1 shows an application scenario diagram of a device control method provided in an embodiment of the present application;

FIG2 is a schematic diagram showing the structure of an electronic device provided in an embodiment of the present application;

FIG3 shows a method flow chart of a device control method provided by an embodiment of the present application;

FIG4 shows a schematic diagram of a selection control provided in an embodiment of the present application;

FIG5 shows a method flow chart of a device control method provided by another embodiment of the present application;

FIG6 shows an implementation diagram of step S220;

FIG7 shows a method flow chart of a device control method provided by yet another embodiment of the present application;

FIG8 shows a method flow chart of a device control method provided by another embodiment of the present application;

FIG9 is a schematic diagram showing a designated interface provided by an embodiment of the present application;

FIG10 shows a method flow chart of a device control method provided by another embodiment of the present application;

FIG11 is a schematic diagram showing a designated interface provided by another embodiment of the present application;

FIG12 is a flowchart of a device control method provided by another embodiment of the present application;

FIG13 shows an implementation diagram of step S620;

FIG14 is a schematic diagram showing a graph provided in an embodiment of the present application;

FIG15 shows a structural block diagram of a device control device provided in an embodiment of the present application;

FIG16 shows a structural block diagram of an electronic device provided in an embodiment of the present application;

FIG17 shows a block diagram of a computer-readable storage medium provided in an embodiment of the present application;

FIG18 shows a structural block diagram of a computer program product provided in an embodiment of the present application.

Detailed ways

In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiment of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

At present, with the development of electronic information technology, electronic devices can play audio content and picture content. When an electronic device plays multimedia file content, the electronic device can be operated to adjust the relevant parameters of playing the multimedia file content. However, the current method of adjusting the relevant parameters of the electronic device playing the multimedia file content is less convenient. How to reasonably adjust the relevant parameters of the electronic device playing the audio content and the picture content and improve the convenience is a problem to be solved urgently.

Currently, when a user is using an electronic device, for example, playing a video on the electronic device, the screen of the electronic device can play the picture content. If the user needs to complete other things at this time, the electronic device can be manually controlled to pause the picture. For another example, when a user is using an electronic device to play audio content and wants to adjust the volume of the audio content played by the electronic device, the electronic device can be manually controlled to adjust the volume of the audio content.

However, the inventors found in their research that the above method of controlling electronic devices requires user intervention, and the user needs to perform cumbersome operations, which is less convenient. Therefore, in order to overcome the above defects, the present application provides a device control method, apparatus, electronic device, computer-readable medium and product.

An embodiment of the present application provides a device control method, which is applied to an electronic device, and the method includes:

Play a multimedia file; if the working mode of the electronic device is the first mode, then based on the first condition, adjust the volume value of the electronic device playing the multimedia file; if the working mode of the electronic device is the second mode, then based on the second condition, control the playing or pausing of the multimedia file.

According to an implementation of the present application, if the working mode of the electronic device is the first mode, then based on the first condition, adjusting the volume value of the electronic device playing the multimedia file includes: if the working mode of the electronic device is the first mode, adjusting the volume value according to the distance between the electronic device and the user.

According to an implementation manner of the present application, if the working mode of the electronic device is the first mode, the volume value is adjusted according to the distance between the electronic device and the user, including: if the working mode of the electronic device is the first mode and the distance is less than a distance threshold, the volume value is adjusted according to the distance, and the distance is positively correlated with the volume value; if the distance is greater than or equal to the distance threshold, the playback of the multimedia file is paused.

According to an implementation manner of the present application, if the distance is greater than or equal to the distance threshold, pausing the playing of the multimedia file includes: if the distance is greater than or equal to the distance threshold, outputting a first voice prompt message and pausing the playing of the multimedia file.

According to an implementation of the present application, if the working mode of the electronic device is the first mode, the volume value of the electronic device playing the multimedia file is adjusted based on the first condition: if the working mode is the first mode and the distance between the electronic device and the user changes, the volume value is adjusted, wherein the change amplitude of the distance between the electronic device and the user is positively correlated with the adjustment amplitude of the volume value.

According to an implementation of the present application, the method further includes: if a specified operation of the user is obtained, canceling the adjustment of the volume value.

According to an implementation of the present application, if the working mode of the electronic device is the first mode, the volume value of the electronic device playing the multimedia file is adjusted based on a first condition, including: if the working mode is the first mode, the volume value is adjusted according to the volume of the ambient sound around the electronic device.

According to an implementation manner of the present application, the amplitude of the volume change of the ambient sound is positively correlated with the amplitude of the volume value of the multimedia file played by the electronic device.

According to an implementation manner of the present application, if the working mode of the electronic device is the second mode, the playback or pause of the multimedia file is controlled based on the second condition, including: if the working mode is the second mode and a user's portrait is detected, keeping the multimedia file in a playback state; if the working mode is the second mode and no user's portrait is detected, pausing the playback of the multimedia file.

According to an implementation manner of the present application, it also includes: if the working mode is the second mode and a user's portrait is detected, based on a control operation of the electronic device when the multimedia file is in a playing state, generating corresponding first text information and displaying the first text information.

According to an implementation manner of the present application, if the working mode is the second mode and no user portrait is detected, pausing the playback of the multimedia file, including: if the working mode is the second mode and no user portrait is detected, outputting a second voice prompt message, wherein the second voice prompt message is used to prompt that the multimedia file will be paused; if no specified voice information is detected, pausing the playback of the multimedia file, wherein the specified voice information is used to indicate to cancel the pause of the playback of the multimedia file.

According to an implementation manner of the present application, if the working mode is the second mode and no user's portrait is detected, after pausing the playback of the multimedia file, it also includes: acquiring an image to be detected in the front area of the screen of the electronic device; if the image to be detected includes a portrait, controlling the multimedia file to continue playing.

According to an implementation manner of the present application, the electronic device includes a screen and a camera, and the camera and the screen are arranged on the same side. The playing of multimedia files includes: playing multimedia files; if the angle feature information corresponding to the screen of the electronic device meets the target conditions, waking up the voice assistant and displaying the selection control; obtaining the first mode or the second mode selected by the user based on the selection control as the working mode of the electronic device.

According to an implementation manner of the present application, if the angle feature information corresponding to the screen of the electronic device meets the target condition, waking up the voice assistant and displaying the selection control includes: if the angle feature information corresponding to the screen of the electronic device meets the target condition, waking up the voice assistant and displaying the selection control; displaying a second text message and playing a third voice prompt message, wherein the second text message is used to indicate that the voice assistant is awakened, and the third voice prompt message is used to prompt that the voice assistant is awakened.

According to an implementation of the present application, the method further includes: if the angle feature information corresponding to the screen of the electronic device no longer meets the target condition, turning off the voice assistant.

According to an embodiment of the present application, the method further includes: if the camera is turned on, displaying a graphic in a specified manner at a specified position, the graphic displayed in the specified manner is used to represent that the camera is turned on, and the specified position is determined based on the position of the camera.

The following describes an application environment in which the device control method provided in the embodiments of the present application can be used.

Please refer to FIG. 1 , which shows an application scenario diagram of a device control method provided by an embodiment of the present application, namely, a device control scenario 100. In FIG. 1 , a user 101 is playing a multimedia file through an electronic device 102, specifically, watching a video through a video playback application running on the electronic device 102, watching the picture corresponding to the video through the screen of the electronic device 102, and listening to the audio content corresponding to the video. At this time, if the user 101 needs to leave temporarily, the electronic device 102 can control the multimedia file to pause. Optionally, when the user 101 returns to the electronic device 102 and prepares to continue watching the picture, the electronic device 102 can also replay the multimedia file.

Please refer to FIG. 2 , the electronic device 200 shown in FIG. 2 is a smart phone, and the electronic device 200 may include a rotation axis 201, and a first part 202 and a second part 203 that can be relatively folded or unfolded along the rotation axis 201. For some embodiments, the electronic device 200 may also include an image acquisition module, such as a camera 204, and the camera 204 may be disposed on the first part 202. The first part may include a first screen 2021, and the second part may include a second screen 2031. The first screen 2021 and the second screen 2031 may be used to display images and text information.

Please refer to Figure 3, which shows a device control method provided by an embodiment of the present application, which can be applied to the electronic device 200 in the above embodiment, and specifically, the processor in the electronic device can be used as the execution subject. Specifically, the method includes steps S110 to S130.

Step S110: Play the multimedia file.

Electronic devices can be used to run different applications to achieve different functions and meet different needs of users. In some embodiments, the electronic device can play multimedia files, for example, it can run some video playback related applications, such as the electronic device plays a video through a video playback application. Since playing a video generally displays the picture content on the screen at the same time, and plays the audio content corresponding to the video, the electronic device can also play audio and play the picture through the screen. Therefore, a multimedia file can include audio content, can also include picture content, and can also include audio content and picture content at the same time.

For some users, the focus at this time may be on the screen content displayed when the electronic device plays multimedia files; other users may also focus on the audio content played by the electronic device when playing multimedia files. Therefore, for different user attention levels, the electronic device can enter different working modes to adjust the parameters related to the multimedia files. For example, you can pause or play the multimedia file, such as pausing or playing the picture on the screen, or adjust the volume value of the multimedia file, so that the user experience can be improved without the user's active intervention, and it is convenient.

Therefore, when the electronic device plays a multimedia file, the working mode of the electronic device can be first obtained, wherein the working mode can include a first mode and a second mode, so it can be first determined whether the electronic device works in the first mode or the second mode. In the first mode, the user's attention to the displayed content of the screen is lower than the user's attention to the displayed content of the screen in the second mode. For example, the first mode can correspond to the user's attention focus on the audio content in the multimedia file, and the second mode can correspond to the user's attention focus on the screen content displayed on the electronic device multimedia file.

Specifically, when the electronic device plays a multimedia file, a selection control can be displayed on the screen of the electronic device; the user can select the working mode of the electronic device based on the selection control. The electronic device can obtain the first mode or the second mode selected by the user based on the selection control as the working mode of the electronic device. For an exemplary example, please refer to Figure 4, which shows a schematic diagram of a selection control displayed by the electronic device 200. Among them, the electronic device 200 can display the screen corresponding to the played video through the first screen 2021 set in the first part 202, and display the selection control 2032 on the second screen 2031 set in the second part 203 to prompt the user to select the working mode. Among them, the selection control 2032 can include text prompt information, and a check box corresponding to the text prompt information, and the user can select the corresponding working mode by touching the corresponding check box. Please continue to refer to Figure 4. The selection control shown in Figure 4 includes text prompt information of "first mode" and "second mode", as well as a check box corresponding to the "first mode" and a check box corresponding to the "second mode". Exemplarily, the user can touch the check box corresponding to the first mode to select the first mode.

Optionally, the user can also select the first mode or the second mode by voice. After displaying the selection control, the electronic device can also continue to obtain the user's voice command. At this time, the user can issue a voice command of "first mode" or "second mode" to control the electronic device to work in the corresponding working mode.

Optionally, when playing multimedia files, the electronic device can also monitor the screen playing picture and determine whether the screen playing picture has an association with the audio content. If the screen playing picture has no association with the audio content, it can be considered that the user's attention is focused on the audio content played by the electronic device, and the working mode can be directly determined to be the first mode. In an exemplary manner, if the electronic device plays audio content through a music application and displays the system desktop picture through the screen, the displayed picture will not change with the playback of the audio content, so it can be determined that the screen playing picture has no association with the audio content, and the working mode can be directly determined to be the first mode.

Step S120: If the working mode of the electronic device is the first mode, then based on a first condition, adjusting the volume value of the electronic device playing the multimedia file.

Furthermore, if the working mode of the electronic device is the first mode, it indicates that the user's focus is on the audio content played when the electronic device plays a multimedia file. For example, the user can listen to the audio content played when the electronic device plays a video while cooking, so it can be seen that the user is not very concerned about the screen content displayed by the electronic device at this time. Furthermore, when the working mode of the electronic device is the first mode, based on the first condition, the volume value of the multimedia file played by the electronic device can be adjusted, thereby providing the user with a better audio content experience, reducing the user's operating burden, and having a certain convenience.

Among them, for some implementations, the first condition can be set by the distance between the electronic device and the user, and then the volume value is adjusted based on the first condition. For other implementations, the first condition can also be set based on the volume of the ambient sound around the electronic device, and then the volume value is adjusted based on the first condition. For a specific description, please refer to the subsequent embodiments.

Step S130: If the working mode of the electronic device is the second mode, the multimedia file is controlled to be played or paused based on a second condition.

Furthermore, if the working mode of the electronic device is the second mode, it indicates that the user's focus is on the screen content displayed when the electronic device plays a multimedia file. For example, the user can watch the screen content of the video played by the electronic device while eating. At this time, the electronic device can control the playback or pause of the picture based on the second condition. This provides the user with a better picture content experience, reduces the user's operation burden, and has a certain convenience.

In some implementations, the second condition can be set by determining whether the image to be detected includes a human portrait, and then the playing or pausing of the image is controlled based on the second condition.

The device control method, apparatus, electronic device, computer-readable medium and product provided by the present application play a multimedia file. If the working mode of the electronic device is the first mode, the volume value of the multimedia file played by the electronic device is adjusted based on the first condition; if the working mode of the electronic device is the second mode, the multimedia file is controlled to be played or paused based on the second condition. Therefore, when playing a multimedia file, the embodiment of the present application can determine different working states, and can adjust the volume value of the multimedia file played or control the multimedia file to be played and paused based on different conditions without user intervention, thereby reducing the user's operating burden and increasing the convenience of use.

Please refer to Figure 5, which shows a device control method provided by an embodiment of the present application, which can be applied to the electronic device 200 in the above embodiment, and specifically, the processor in the electronic device can be used as the execution subject. Specifically, the method includes steps S210 to S240.

Step S210: Play the multimedia file.

Among them, step S210 has been introduced in detail in the above embodiment and will not be repeated here.

Step S220: If the working mode of the electronic device is the first mode, adjusting the volume value according to the distance between the electronic device and the user.

For some embodiments, when the electronic device is working in the first mode, it can be known from the above analysis that the user's focus is on the audio content played when the electronic device plays multimedia files, and the distance between the electronic device and the user will affect the quality of the audio content heard by the user, thereby affecting the user's experience. Therefore, the first condition can be constructed by the distance between the electronic device and the user, so that the volume value of the electronic device playing audio can be adjusted based on the distance between the electronic device and the user. The volume value of the electronic device can be adjusted based on the distance between the electronic device and the user without the need for user intervention, thereby improving the user's experience.

Therefore, the distance between the electronic device and the user can be obtained first. In an exemplary embodiment, the first position of the user and the second position of the electronic device can be obtained, and the distance between the electronic device and the user can be determined based on the first position and the second position. In another exemplary embodiment, the distance between the user and the electronic device can also be directly determined.

Specifically, the first position of the user can be obtained through a wearable device worn by the user. The wearable device can establish a communication connection with the electronic device in advance, for example, a connection can be established through Bluetooth or wireless communication technology Wi-Fi. For example, the wearable device can be provided with a global positioning system (Global Positioning System, GPS), and the first position of the user can be obtained through the global positioning system GPS. Furthermore, the electronic device can also be provided with a global positioning system GPS, so that the second position of the electronic device can be obtained. Furthermore, after obtaining the first position and the second position, the distance between the electronic device and the user can be determined based on the first displacement and the second position.

It should be noted that after the first position is obtained by the wearable device worn by the user, the first position can be sent to the electronic device through a pre-established communication connection, and the electronic device obtains the second position. After receiving the first position sent from the wearable device, the first position and the second position can be calculated to determine the position of the user and the electronic device.

For some other embodiments, the distance between the electronic device and the user can also be determined directly, without separately obtaining the first position of the user and the second position of the electronic device to determine the distance between the electronic device and the user. In an exemplary embodiment, the electronic device or the wearable device worn by the user can also be provided with an ultrasonic transceiver module, which can transmit ultrasonic signals and receive reflected ultrasonic signals, and determine the distance between the electronic device and the user based on the time difference between transmission and reception. For example, The ultrasonic transceiver module can be set in a wearable device. If the wearable device transmits an ultrasonic signal at time t1, the ultrasonic signal is transmitted to the electronic device, and the time when it is re-received by the wearable device after reflection is t2, then the distance d between the electronic device and the user can be calculated by the speed-time formula as approximately v*(t2-t1)/2, where v is the propagation speed of the ultrasonic signal. For another example, the ultrasonic transceiver module can be set in an electronic device. If the electronic device transmits an ultrasonic signal at time t1, the ultrasonic signal is transmitted to the user, and the time when it is re-received by the electronic device after reflection by the user is t2, then the distance between the electronic device and the user can be calculated by the speed-time formula. An exemplary wearable device can be a smart watch, a smart bracelet, smart glasses, etc.

Further, after obtaining the distance between the electronic device and the user, the volume value may be adjusted based on the distance. Specifically, please refer to FIG. 6 , which shows an implementation diagram of step S220 , including step S221 and step S222 .

Step S221: If the working mode of the electronic device is the first mode and the distance is less than a distance threshold, adjusting the volume value according to the distance, and the distance is positively correlated with the volume value.

Step S222: If the distance is greater than or equal to the distance threshold, pausing the playing of the multimedia file.

For some implementations, the distance between the electronic device and the user should be within a distance threshold. If the distance threshold is exceeded, there is a high probability that the user does not need to use the electronic device at this time, and the electronic device does not need to continue playing the audio of the multimedia file. Therefore, a distance threshold can be set in advance, and the acquired distance between the electronic device and the user is compared with the distance threshold. Therefore, the first condition can be determined based on the relationship between the distance and the distance threshold. If the distance is less than the distance threshold, the volume value is adjusted based on the distance; if the distance is greater than the distance threshold, the electronic device can be controlled to pause playing the video, thereby achieving control of the electronic device without the user's active intervention.

For some implementations, the farther the distance between the electronic device and the user is, the greater the volume value of the audio that the user needs to obtain, and the greater the volume value of the audio played by the electronic device, so the distance is positively correlated with the volume value. For example, when the distance is less than the distance threshold, the greater the distance, the greater the volume value can be set, so as to ensure that the volume value of the audio heard by the user is as similar as possible.

Further, if the distance is greater than or equal to the distance threshold, the multimedia file can be paused. Optionally, before pausing the multimedia file, a first voice prompt message can be output to prompt the user that the multimedia file is paused. In an exemplary embodiment, the first voice prompt message can be "the distance is too large, the playback has been paused".

Optionally, before outputting the first voice prompt information, an inquiry message may be issued, and feedback information from the user based on the inquiry message may be obtained. Exemplarily, since it is detected that the distance is greater than the distance threshold, the user is generally not able to directly input instructions through the touch screen or buttons at this time, so the electronic device may issue an audio inquiry message, such as asking the user "The distance is detected to be too large, do you want to pause?" At this time, the user may issue feedback information based on the audio inquiry information of the electronic device. Similarly, the feedback information may also be a voice signal. For example, the user may issue a "pause" voice signal, and the electronic device may pause the playback of the multimedia file after receiving the "pause" voice signal issued by the user. For another example, the user may also issue a "no pause" voice signal, and the electronic device may continue to play the multimedia file after receiving the "no pause" voice signal issued by the user.

Furthermore, after the electronic device sends the audio query information, if the user is away from the electronic device at this time, it is impossible to respond to the audio query information sent by the electronic device in time and send feedback information. Therefore, the electronic device can also set a first time threshold, and when the electronic device sends the audio query information and passes the first time threshold, if the feedback information sent by the user is not obtained, the multimedia file can be directly paused.

Step S30: If the working mode of the electronic device is the second mode, then based on the second condition, the multimedia file screen is controlled to be played or paused.

Among them, step S230 has been described in detail in the above embodiment and will not be repeated here.

Step S240: If a specified operation of the user is obtained, the adjustment of the volume value is canceled.

In some embodiments, after adjusting the volume value of the audio when playing a multimedia file on an electronic device, if a user's specified operation is obtained, the adjustment of the volume value can be canceled. The specified operation can be a pre-set operation input through the touch screen of the electronic device. For example, the specified operation can be sliding the touch screen of the electronic device to the right, and the adjustment of the volume value can be canceled. In another exemplary embodiment, the specified operation can also be sliding the touch screen of the electronic device to the left, or sliding downward, etc.

Optionally, the designated operation may be sliding from left to right, or from right to left, etc. at a preset position on the screen of the electronic device, which is not limited in the embodiments of the present application.

For another example, after the volume value is adjusted, a text box may be displayed on the screen, and the text in the text box is used to prompt that the volume value has been adjusted (increased or decreased). If the user wants to cancel the adjustment made by the electronic device to the volume value, the user can slide the text box, for example, slide the text box to the right or left, thereby instructing the electronic device to cancel the previously made volume value adjustment operation.

The device control method, apparatus, electronic device, computer-readable medium and product provided in the present application play multimedia files. Furthermore, in an embodiment of the present application, the distance between the electronic device and the user is obtained, and if the working mode of the electronic device is the first mode, the volume value is adjusted according to the distance between the electronic device and the user; and based on the second condition, the playing and pausing of the multimedia file are controlled, so that when the user changes the distance from the electronic device, the volume value played by the electronic device can be flexibly adjusted, thereby improving the user's usage experience and giving the user a more constant sense of media accompaniment.

Please refer to Figure 7, which shows a device control method provided by an embodiment of the present application, which can be applied to the electronic device 200 in the above embodiment, and specifically, the processor in the electronic device can be used as the execution subject. Specifically, the method includes steps S310 to S340.

Step S310: Play the multimedia file.

Step S320: If the working mode is the first mode and the distance between the electronic device and the user changes, the volume value is adjusted, wherein the change amplitude of the distance between the electronic device and the user is positively correlated with the adjustment amplitude of the volume value.

Step S330: If the working mode of the electronic device is the second mode, the multimedia file is controlled to be played or paused based on a second condition.

Among them, step S310 and step S330 have been introduced in the above-mentioned embodiment and will not be repeated here.

For some embodiments, when the electronic device is working in the first mode, it can be known from the above analysis that the user's focus is on the audio content played when the electronic device plays multimedia files, and the distance between the electronic device and the user will affect the quality of the audio content heard by the user, thereby affecting the user's experience. Therefore, the first condition can be constructed by the distance between the electronic device and the user, so that the volume value of the electronic device playing audio can be adjusted based on the distance between the electronic device and the user. The volume value of the electronic device can be adjusted based on the distance between the electronic device and the user without the need for user intervention, thereby improving the user's experience.

In an exemplary embodiment, when an electronic device plays the audio of a multimedia file, it may be played at a volume value. At this time, if it is detected that the distance between the electronic device and the user has changed, the volume value may be adjusted. Among them, if the distance becomes smaller, the adjustment of the volume value may be reduced, and if the distance becomes larger, the adjustment of the volume value may be increased. It is not difficult to understand that the change amplitude of the distance between the electronic device and the user is positively correlated with the adjustment amplitude of the volume value. For example, if the distance becomes smaller, the change amplitude of the distance is 1 meter, the volume value may be reduced by 10 units, and if the distance becomes larger, the change amplitude of the distance is 3 meters, the volume value may be increased by 30 units.

Step S340: If a specified operation of the user is obtained, the adjustment of the volume value is canceled.

Among them, step S340 has been introduced in detail in the above embodiment and will not be repeated here.

The device control method, apparatus, electronic device, computer-readable medium and product provided by the present application play multimedia files. Further, if the working mode is the first mode and the distance between the electronic device and the user changes, the volume value is adjusted, wherein the change amplitude of the distance between the electronic device and the user is positively correlated with the adjustment amplitude of the volume value; and based on the second condition, the playback and pause of the multimedia file are controlled, so that when the user changes the distance from the electronic device, the volume value can be adjusted based on the change amplitude of the distance, thereby improving the user's usage experience and giving the user a relatively constant sense of media accompaniment.

Please refer to Figure 8, which shows a device control method provided by an embodiment of the present application, which can be applied to the electronic device 200 in the above embodiment, and specifically, the processor in the electronic device can be used as the execution subject. Specifically, the method includes steps S410 to S430.

Step S410: Play the multimedia file.

Among them, step S410 has been described in detail in the above embodiment and will not be repeated here.

Step S420: If the working mode is the first mode, adjusting the volume value according to the volume of the ambient sound around the electronic device.

For some embodiments, when an electronic device plays a multimedia file, such as playing audio and playing pictures through the screen, there are generally other sounds in the environment where the electronic device is located, such as the noise when large engineering equipment is working, or the sound emitted by other electronic devices. In the environment where the electronic device is located, the sum of the sounds that can be detected can be used as the ambient sound around the electronic device. It is not difficult to understand that when the working mode of the electronic device is the first mode, the user's attention is focused on the audio content played by the electronic device. If the ambient sound is large, it will affect the user's normal listening to the audio content played by the electronic device. Therefore, in order to obtain better audio content played by the electronic device, the user can manually adjust the volume value of the electronic device playing the multimedia file. However, manually controlling the volume value of the electronic device playing the multimedia file requires the user to actively intervene, and increases the user's operating burden, which is not convenient.

Therefore, the electronic device can also obtain the volume of the surrounding ambient sound, and then adjust the volume value of the multimedia file played by the electronic device based on the volume of the surrounding ambient sound, thereby improving the user's experience and reducing the user's operating burden without the need for active user intervention, which has a certain degree of convenience.

It should be noted that, since the user uses an electronic device to play multimedia files, for example, through a video player running in the electronic device The application plays the corresponding audio content in the video, so that the user is generally in the same environment as the electronic device, such as in the same room. Therefore, the ambient sound heard by the user and the ambient sound that can be collected by the electronic device can be approximately equal.

Specifically, the ambient sound around the electronic device may be collected by a microphone or a microphone array provided on the electronic device, and the volume of the ambient sound may be obtained by analyzing the processor in the electronic device.

Optionally, similar to the aforementioned embodiment, the user may also wear a wearable device, which may be provided with a microphone or a microphone array, etc., so that the ambient sound may also be collected through the wearable device worn by the user. Furthermore, the collected ambient sound may be analyzed by the processor in the wearable device to obtain the volume of the ambient sound, and then the volume of the ambient sound may be sent to the electronic device through a pre-established communication connection. In another exemplary embodiment, the collected ambient sound may also be directly sent to the electronic device through a pre-established communication connection, and then the processor in the electronic device may analyze the ambient sound to determine the volume of the ambient sound.

It is easy to understand that the sound signal heard by the user is actually the superposition of the surrounding sound and the audio content output by the electronic device. Therefore, when the volume of the surrounding sound is low, the volume value of the audio content output by the electronic device only needs to be low, and the user can get a better user experience; when the volume of the surrounding sound is high, the volume value of the audio content output by the electronic device needs to be increased accordingly, and the user can get a better user experience.

Therefore, an intensity threshold can be set in advance. After the electronic device obtains the volume of the ambient sound, the volume of the ambient sound is compared with the pre-set intensity threshold. If the volume of the ambient sound is less than the intensity threshold, it means that the volume of the ambient sound is relatively small at this time. At this time, the electronic device can be controlled to output the audio signal with a smaller volume value. Therefore, the first condition can be determined based on the size relationship between the volume value of the ambient sound and the intensity threshold. If the volume of the ambient sound is greater than the intensity threshold, it means that the volume of the ambient sound is relatively large at this time. At this time, the electronic device can be controlled to output the audio signal with a larger volume value.

Optionally, there may be multiple pre-set intensity thresholds, each of which corresponds to a volume value of a multimedia file played by an electronic device, wherein the intensity threshold is positively correlated with the volume value. In an exemplary embodiment, if the intensity threshold includes a first intensity threshold, a second intensity threshold and a third intensity threshold, the first intensity threshold corresponds to a first volume value, the second intensity threshold corresponds to a second volume value, and the third intensity threshold corresponds to a third volume value, wherein the first intensity threshold, the second intensity threshold and the third intensity threshold increase in sequence. If the volume of the ambient sound is less than or equal to the first intensity threshold, the electronic device is controlled to play the audio signal at the first volume value; if the volume value of the ambient sound is less than or equal to the second intensity threshold and greater than the first intensity threshold, the electronic device is controlled to play the audio signal at the second volume value; if the volume value of the ambient sound is less than or equal to the third intensity threshold and greater than the second intensity threshold, the electronic device is controlled to output the audio signal at the third volume value.

It is easy to understand that in order to prevent the sound of the multimedia file heard by the user from being disturbed by the ambient sound, the volume change amplitude of the surrounding ambient sound can be positively correlated with the volume value change amplitude of the multimedia file played by the electronic device. That is, the greater the volume change of the ambient sound, the greater the volume value change amplitude of the multimedia file played by the electronic device. As an exemplary example, if it is detected that the volume of the ambient sound changes from 40dB to 60dB, the change amplitude is 20dB, then the volume value of the multimedia file can be controlled to increase by 10 volume units. If the volume of the ambient sound changes from 40dB to 70dB, the change amplitude is 30dB, then the volume value of the multimedia file can be controlled to increase by 20 volume units.

Optionally, after the electronic device adjusts the volume value of the electronic device based on the volume of the surrounding ambient sound, it can also prompt the user in the form of text display on the designated interface. For example, please refer to Figure 9, which shows a schematic diagram of a designated interface of the electronic device 200, wherein the electronic device 200 can display the screen corresponding to the played video through the first screen 2021 set in the first part 202, and display the designated interface 2033 on the second screen 2031 set in the second part 203, so as to prompt the user that the volume value of the electronic device has been adjusted based on the volume of the surrounding ambient sound through the text information displayed on the designated interface 2033. For example, the designated interface 2033 in Figure 9 may display "the volume value has been adjusted based on the surrounding ambient sound".

Furthermore, after the text message is displayed through the designated interface to prompt the user that the volume value has been adjusted, the user can also actively intervene to cancel the electronic device's adjustment of the volume value. For example, the user can control the electronic device to cancel the adjustment of the volume value through voice commands; for another example, the user can also input a cancellation command on the electronic device to control the electronic device to cancel the adjustment of the volume value. Exemplarily, the cancellation command can be sliding in a designated area. For example, please continue to refer to Figure 9, which also includes a designated area 2034. The user can slide in the designated area 2034 to cancel the adjustment of the volume value, such as sliding from one side of the designated area 2034 to the other side.

Step S430: If the working mode of the electronic device is the second mode, the multimedia file is controlled to be played or paused based on a second condition.

Among them, step S430 has been described in detail in the above embodiment and will not be repeated here.

The device control method, apparatus, electronic device, computer-readable medium and product provided in the present application, the method obtains the working mode of the electronic device when the electronic device plays audio and plays pictures through the screen, wherein the working mode includes a first mode and a second mode, and in the first mode, the user's attention to the displayed content of the screen is lower than that in the second mode. The user's attention to the displayed content on the screen. Therefore, the embodiment of the present application provides a method for determining different working modes by the user's attention to the displayed content on the screen. Furthermore, the embodiment of the present application can also obtain the volume of the ambient sound around the electronic device; adjust the volume value based on the volume of the ambient sound; and control the play and pause of the picture based on the second condition, thereby adjusting the volume value of the electronic device playback in combination with the ambient sound, thereby improving the user experience.

Referring to Fig. 10, Fig. 10 shows a device control method provided by an embodiment of the present application, which can be applied to the electronic device 200 in the aforementioned embodiment, and specifically, the processor in the electronic device can be used as the execution subject. Specifically, the method includes steps S510 to S560.

Step S510: Play the multimedia file.

Step S520: If the working mode of the electronic device is the first mode, then based on the first condition, adjusting the volume value of the electronic device playing the multimedia file.

Among them, step S510 and step S520 have been described in detail in the above embodiments and will not be repeated here.

Optionally, if the working mode of the electronic device is the first mode, it means that the user's attention is not focused on the picture displayed on the screen of the electronic device. Therefore, for some implementations, the screen of the electronic device can be directly turned off and the audio content can continue to be played, thereby greatly reducing the power consumption of the electronic device without affecting the user experience.

Step S530: If the working mode is the second mode and the user's portrait is not detected, pausing the playing of the multimedia file.

For some embodiments, if the working mode of the electronic device is the second mode, it can be known that the user's focus is on the screen content displayed when the electronic device plays a multimedia file. Since the user needs to watch the screen content played by the electronic device through the screen set on the electronic device, the second condition can be set based on whether the front area of the screen of the electronic device includes a portrait. It can be detected whether the front area of the screen of the electronic device includes a portrait. If the image to be detected does not include the user's portrait, the multimedia file is controlled to pause playing.

In an exemplary embodiment, an electronic device may be provided with an image acquisition module. For example, please continue to refer to FIG. 2 , the electronic device 200 shown in FIG. 2 may include a camera 204, wherein the camera 204 may be provided in a portion for displaying screen content, i.e., the first portion 202. Thus, the electronic device 200 may acquire the image to be detected in the area in front of the screen through the camera 204.

Furthermore, after acquiring the image to be detected, it is possible to analyze and determine whether the image to be detected includes the user's portrait. If the image to be detected does not include the user's portrait, it means that the user is not in the front area of the screen used by the electronic device to display the screen content at this time, so the user has a high probability of not needing to watch the screen content at this time, so the electronic device can be controlled to pause the playback of the multimedia file. If the image to be detected includes the user's portrait, it means that the user has a high probability of being in the front area of the screen used by the electronic device to display the screen content at this time, so the user needs to watch the screen content at this time, so the electronic device can be controlled to keep the multimedia file in the playback state.

Optionally, if the working mode is the second mode and the user's portrait is not detected, before controlling the electronic device to pause the playing of the multimedia file, a second voice prompt message may be output to ask the user whether the playing needs to be paused, wherein the second voice prompt message is used to prompt that the playing of the multimedia file will be paused. For example, the second voice prompt message may be "Do you need to control the screen to pause the playing?"

Furthermore, after the second voice prompt information is output, it is also possible to detect whether the specified voice information is obtained. The specified voice information may be a voice information to which the user replies based on the second voice prompt information, such as "pause" or "no pause". When the specified voice information is detected, the electronic device may be controlled based on the user's specified voice information. For example, if the specified voice information is "pause", the screen may be controlled to pause playback; if the specified voice information is "no pause", the multimedia file may be controlled not to be paused and continue to play.

Further, if the designated voice information matching the second voice prompt information is not detected, the picture can be controlled to pause playing. For some implementations, a second time threshold can be set, and after the second voice prompt information is output, if the designated voice information matching the second voice prompt information is not detected after the second time threshold, the multimedia file can be controlled to pause playing.

Step S540: If the working mode is the second mode and a user's portrait is detected, based on a control operation on the electronic device when the multimedia file is in a playing state, corresponding first text information is generated and displayed.

For some embodiments, when the user is watching the screen content displayed on the electronic device, the user can also control the electronic device through a voice assistant. Among them, the user can first wake up the voice assistant through a wake-up operation. In an exemplary embodiment, the user can wake up the voice assistant by tapping the screen of the electronic device for a specified number of times, such as tapping three times in a row. The user can also wake up the voice assistant through a preset voice command. For example, the voice command may include "Hello mobile phone", then the user only needs to say "Hello mobile phone", and the electronic device can wake up the voice assistant after detecting the voice command.

Furthermore, if the working mode is the second mode and the user's portrait is detected, the user can issue a voice control command to control the electronic device. For example, the user can issue a "reduce volume" control command to reduce the volume of the electronic device; the user can also issue a "fast forward 30 seconds" control command to make the screen content played by the electronic device Fast forward 30 seconds.

It is easy to understand that the user's focus at this time is on the screen content displayed when the electronic device plays a multimedia file. If the voice assistant issues a voice prompt message after responding to the user's control command, the screen content displayed on the screen will be temporarily interrupted, which will have a negative impact on the user's experience. Therefore, at this time, the first text information corresponding to the control operation can be generated based on the control operation of the multimedia file in the playback state, and the first text information can be displayed, for example, on the screen of the electronic device. Please refer to Figure 11, which shows a schematic diagram of a designated interface of an electronic device 200, wherein the electronic device 200 can display the screen corresponding to the played video through the first screen 2021 set in the first part 202, and the second screen 2031 set in the second part 203 displays the designated interface 2033, so as to prompt the user through the first text information displayed on the designated interface 2033. Among them, the first text information displayed in the designated interface 2033 may include the voice information generated by the voice assistant converted into the first text information. For example, after the user issues a control operation of "fast forward 30 seconds", the electronic device responds to the control operation to fast forward the played screen content by 30 seconds. At this time, the voice assistant can generate a first text message corresponding to the control operation to prompt the user that the played screen content has been fast forwarded by 30 seconds and display it. For example, the designated interface 2033 of the second screen 2031 can display "the screen content has been fast forwarded by 30 seconds".

Step S550: Acquire the image to be detected in the area in front of the screen of the electronic device.

Step S560: If the image to be detected includes a portrait, control the multimedia file to continue playing.

For some implementations, if the working mode is the second mode and the user's portrait is not detected and the image to be detected does not include a portrait, then the multimedia file of the screen is paused. After the user returns to the area in front of the electronic device screen after a period of time, the electronic device can be controlled to replay the screen. Therefore, the image to be detected in the area in front of the screen can also be obtained through the camera of the electronic device. If the image to be detected includes a portrait, the multimedia file is controlled to be replayed.

The device control method, apparatus, electronic device, computer-readable medium and product provided by the present application, the method plays multimedia files, and further, the embodiment of the present application obtains the distance between the electronic device and the user, if the working mode of the electronic device is the first mode, the volume value is adjusted according to the distance between the electronic device and the user; and if the working mode is the second mode and the user's portrait is detected, the multimedia file is kept in the playing state; if the working mode is the second mode and the user's portrait is not detected, the playing of the multimedia file is paused. Thus, the multimedia file played by the electronic device can be adjusted without the user's active intervention, which reduces the user's operating burden and improves convenience. It is also possible to obtain the image to be detected in the area in front of the screen through the camera of the electronic device again after controlling the multimedia file to pause playing. If the image to be detected includes a portrait, the multimedia file is controlled to be played again, so as to further improve the user's experience.

Please refer to Figure 12, which shows a device control method provided by an embodiment of the present application, which can be applied to the electronic device 200 in the above embodiment, and specifically, the processor in the electronic device can be used as the execution subject. Specifically, the method includes steps S610 to S670.

Step S610: Play the multimedia file.

Step S620: If the angle feature information corresponding to the screen of the electronic device meets the target condition, the voice assistant is woken up and the selection control is displayed.

For some embodiments, the electronic device may include a screen and a camera, and the camera and the screen are arranged on the same side. For an exemplary embodiment, please continue to refer to FIG. 2 , in which the electronic device 200 shown in FIG. 2 includes a first screen 2021 and a camera 204, and the camera 204 and the first screen 2021 are arranged on the same side.

It can be seen from the introduction in the aforementioned embodiments that in some cases, the voice assistant can obtain the image to be detected in the front area of the screen of the electronic device through the camera, and then play or pause the multimedia file according to whether the image to be detected includes a portrait. Therefore, it is possible to determine whether to wake up the voice assistant by judging whether the angle feature information of the screen on the same side as the camera meets the target conditions. Among them, the voice assistant can be used to output the first voice information, the second voice information or the first text information described in the aforementioned embodiments.

In some embodiments, the angle characteristic information corresponding to the screen may be the angle between the direction in which the screen is facing and the direction of the horizon. It is not difficult to understand that the angle generally ranges from 0 to 90 degrees. In an exemplary embodiment, the target condition may be 0 to 60 degrees. For example, if the angle characteristic information corresponding to the screen of the electronic device is 45 degrees, the target condition is met, and the voice assistant may be awakened and the selection control may be displayed. Among them, the selection control may be displayed on the screen of the electronic device, and the user may select the working mode of the electronic device based on the selection control. For details, please refer to the relevant description of FIG. 4 in the aforementioned embodiment, which will not be repeated here.

For some other implementations, the angle characteristic information corresponding to the screen may also be in a direction perpendicular to the screen orientation direction, so that target conditions may be set based on the angle characteristic information, which is similar to the aforementioned target conditions and will not be described in detail here.

For some implementations, please refer to FIG. 13 , which shows an implementation diagram of step S620 , specifically including step S621 and step S622 .

Step S621: If the angle feature information corresponding to the screen of the electronic device meets the target condition, the voice assistant is woken up and the selection control is displayed.

Step S622: Display a second text message and play a third voice prompt message, wherein the second text message is used to indicate that the voice assistant is awakened, and the third voice prompt message is used to prompt that the voice assistant is awakened.

Furthermore, after the electronic device wakes up the voice assistant, the electronic device may also display a second text message, for example, the second text message may be displayed on the screen of the electronic device. The second text message may be used to indicate that the voice assistant is awakened. For example, the second text message may be "the voice assistant has been awakened".

Optionally, after the electronic device wakes up the voice assistant, a third voice prompt message may also be played, wherein the third voice prompt message is used to prompt that the voice assistant is woken up.

It is easy to understand that after the electronic device wakes up the voice assistant, the second text message can be displayed and the third voice prompt message can be played at the same time. It is also possible to only display the second text message and only play the third voice prompt message.

Step S630: Acquire the first mode or the second mode selected by the user based on the selection control as the working mode of the electronic device.

Furthermore, the user can select the first working mode or the second working mode based on the selection control, so that the working mode selected by the user can be used as the working mode of the electronic device.

Step S640: If the angle feature information corresponding to the screen of the electronic device no longer meets the target condition, the voice assistant is turned off.

For some implementations, if the angle feature information corresponding to the screen of the electronic device no longer meets the target condition, the voice assistant can be turned off.

For example, if the target condition is 0 degrees to 60 degrees, if the angle characteristic information corresponding to the screen of the electronic device changes from 45 degrees to 90 degrees, then the angle characteristic information corresponding to the screen of the electronic device no longer meets the target condition, and the voice assistant can be turned off at this time.

Step S650: If the working mode of the electronic device is the first mode, then based on the first condition, adjusting the volume value of the electronic device playing the multimedia file.

Step S660: If the working mode of the electronic device is the second mode, the playing or pausing of the multimedia file is controlled based on the second condition.

Among them, step S650 and step S660 have been introduced in detail in the above embodiments and will not be repeated here.

Step S670: If the camera is turned on, a graphic is displayed at a specified position in a specified manner, and the graphic displayed in the specified manner is used to represent that the camera is turned on. The specified position is determined based on the position of the camera.

In some embodiments, if the camera of the electronic device is turned on, a graphic can be displayed in a specified manner on the screen of the electronic device to prompt the user. Optionally, the camera of the electronic device can be turned on when the voice assistant is awakened, when it is used to obtain an image to be detected, or at any other time as needed, which is not limited in the embodiments of the present application.

The graphic displayed in a specified manner is used to indicate that the camera is turned on. Specifically, the graphic can be displayed at a specified position on the screen of the electronic device. Optionally, the specified position can be determined based on the position of the camera. For example, the specified position can be a position on the screen close to the camera; the specified position can also be a position on the screen at a certain distance from the camera.

Furthermore, the graphic may be a circular ring similar to the shape of the camera, or a rectangular shape, etc.

For example, please refer to FIG. 14, which shows a graphic 205, which is located on the first screen 2021 of the electronic device 200. The electronic device 200 also includes a camera 204, which is disposed on the first screen 2021. The graphic 205 is a ring. When the camera 204 is turned on, the first screen 2021 can display the graphic 205, thereby prompting the user that the camera 204 is turned on.

Furthermore, the graphics may be displayed in a specified manner, and the specified manner may include displaying the graphics in different colors. For example, the graphics may be pink, red, purple, yellow, etc. The specified manner may also include flashing the graphics at a certain interval, for example, the graphics may be flashed at intervals of 1 second. The specified manner may also include displaying the graphics in a dynamic manner, for example, the graphics may be rotated while being displayed.

Optionally, for some embodiments, the specified method may also include a progress bar. In this case, a graphic may be displayed in the form of a progress bar, and the state of the camera may be represented by the graphic in the form of a progress bar. For example, when the electronic device controls the camera to turn on, the progress bar graphic is displayed on the screen, and the progress bar may be in a starting state; when the camera is already turned on, the progress bar may be in a terminated state. Among them, the progress bar in the revelation state may represent that the camera is ready to turn on, and the progress bar in the terminated state may represent that the camera is already turned on.

The device control method, apparatus, electronic device, computer-readable medium and product provided by the present application play a multimedia file, and when the angle feature information corresponding to the screen of the electronic device meets the target condition, the voice assistant is awakened and the selection control is displayed, so as to obtain the first mode or the second mode selected by the user based on the selection control as the working mode of the electronic device; When the angle characteristic information corresponding to the screen of the electronic device no longer meets the target condition, the voice assistant is turned off; if the working mode of the electronic device is the first mode, based on the first condition, the volume value of the multimedia file played by the electronic device is adjusted; if the working mode of the electronic device is the second mode, based on the second condition, the playback or pause of the multimedia file is controlled; if the camera is turned on, a graphic is displayed in a specified manner at a specified position. Therefore, when playing multimedia files, the embodiment of the present application can determine whether to wake up the voice assistant by the angle characteristic information corresponding to the screen of the electronic device. When the voice assistant is awakened, the volume value of the multimedia file played can be adjusted or the multimedia file playback and pause can be controlled based on different conditions without user intervention, which reduces the user's operating burden and increases the convenience of use. Furthermore, the embodiment of the present application can also prompt the user that the camera is turned on by displaying a graphic on the screen in a specified manner when the camera is turned on.

Please refer to FIG. 15 , which shows a structural block diagram of a device control apparatus 1500 provided in an embodiment of the present application, including: a playback unit 1510 , a first control unit 1520 , and a second control unit 1530 .

The playing unit 1510 is used to play multimedia files.

Furthermore, the playback unit 1510 can also be used to play multimedia files; if the angle feature information corresponding to the screen of the electronic device meets the target conditions, the voice assistant is woken up and the selection control is displayed; and the first mode or the second mode selected by the user based on the selection control is obtained as the working mode of the electronic device.

Furthermore, the playback unit 1510 can also be used to wake up the voice assistant and display the selection control if the angle feature information corresponding to the screen of the electronic device meets the target conditions; display the second text information and play the third voice prompt information, wherein the second text information is used to indicate that the voice assistant is awakened, and the third voice prompt information is used to prompt that the voice assistant is awakened.

Furthermore, the playback unit 1510 can also be used to turn off the voice assistant if the angle feature information corresponding to the screen of the electronic device no longer meets the target condition.

Furthermore, the playback unit 1510 may also be configured to display a third text message if the camera is awakened, wherein the third text message is used to indicate that the camera is awakened.

The first control unit 1520 is configured to adjust the volume value of the electronic device playing the multimedia file based on a first condition if the working mode of the electronic device is the first mode.

Furthermore, the first control unit 1520 may also be configured to adjust the volume value according to the distance between the electronic device and the user if the working mode of the electronic device is the first mode.

Furthermore, the first control unit 1520 can also be used to adjust the volume value according to the distance if the working mode of the electronic device is the first mode and the distance is less than a distance threshold, and the distance is positively correlated with the volume value; if the distance is greater than or equal to the distance threshold, pause playing the multimedia file.

Furthermore, the first control unit 1520 can also be used to output a first voice prompt message and pause playing the multimedia file if the distance is greater than or equal to the distance threshold, wherein the first voice prompt message is used to prompt that the multimedia file is paused.

Furthermore, the first control unit 1520 can also be used to adjust the volume value if the working mode is the first mode and the distance between the electronic device and the user changes, wherein the change amplitude of the distance between the electronic device and the user is positively correlated with the adjustment amplitude of the volume value.

Furthermore, the first control unit 1520 may also be configured to cancel the adjustment of the volume value if a specified operation of the user is obtained.

Furthermore, the first control unit 1520 can also be used to adjust the volume value according to the volume of the ambient sound of the electronic device if the working mode is the first mode, wherein the volume change amplitude of the ambient sound is positively correlated with the volume value change amplitude of the multimedia file played by the electronic device.

The second control unit 1530 is configured to control the playing or pausing of the multimedia file based on a second condition if the working mode of the electronic device is the second mode.

Further, the second control unit 1530 may also be used to keep the multimedia file in the playing state if the working mode is the second mode and the user's portrait is detected; if the working mode is the second mode and the user's portrait is not detected, pause the playing of the multimedia file. Further, the second control unit 1530 may also be used to generate corresponding first text information based on the control operation of the electronic device when the multimedia file is in the playing state, and display the first text information if the working mode is the second mode and the user's portrait is detected.

Furthermore, the second control unit 1530 can also be used to output a second voice prompt message if the working mode is the second mode and the user's portrait is not detected, wherein the second voice prompt message is used to prompt that the multimedia file will be paused; if the specified voice information is not detected, the playback of the multimedia file is paused, wherein the specified voice information is used to indicate the cancellation of the pause of the playback of the multimedia file.

Furthermore, the second control unit 1530 can also be used to obtain the image to be detected in the area in front of the screen of the electronic device; The image to be detected includes a portrait, and the multimedia file is controlled to continue playing.

Furthermore, the second control unit 1530 can also be used to display a selection control on the screen when the electronic device plays audio and plays pictures through the screen; and obtain the first mode or the second mode selected by the user based on the selection control as the working mode of the electronic device.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and units can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

In several embodiments provided in the present application, the coupling between the units may be electrical, mechanical or other forms of coupling.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

Please refer to Figure 16, which shows a block diagram of an electronic device provided in an embodiment of the present application. The electronic device 1600 can be an electronic device such as a smart phone, a tablet computer, etc. that can run a computer program. The electronic device 1600 in the present application may include one or more of the following components: a processor 1610 and a memory 1620, and one or more application programs, wherein the processor 1610 is electrically connected to the memory 1620, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

The processor 1610 may include one or more processing cores. The processor 1610 uses various interfaces and lines to connect various parts of the entire electronic device 1600, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1620, and calling data stored in the memory 1620. Optionally, the processor 1610 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 160 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and computer programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor 1610, but may be implemented separately through a communication chip. Specifically, the method described in the above embodiments may be executed by one or more processors 1610 .

For some embodiments, the memory 1620 may include a random access memory (RAM) or a read-only memory (ROM). The memory 1620 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1620 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the following various method embodiments, etc. The data storage area may also store data created by the electronic device 1600 during use, etc.

Please refer to Figure 17, which shows a block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 1700 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

The computer-readable storage medium 1700 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 1700 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 1700 has storage space for program code 1710 for executing any method steps in the above method. These program codes may be read from or written to one or more computer program products. The program code 1710 may be compressed, for example, in a suitable form.

Please refer to Fig. 18, which shows a structural block diagram 1800 of a computer program product provided by an embodiment of the present application. The computer program product 1800 includes a computer program/instruction 1810, and the computer program/instruction 1810 implements the steps of the above method when executed by a processor.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (20)

1. A device control method, wherein the method is applied to an electronic device, the method comprising:

   Play multimedia files;

   If the working mode of the electronic device is the first mode, adjusting the volume value of the electronic device playing the multimedia file based on the first condition;

   If the working mode of the electronic device is the second mode, the playing or pausing of the multimedia file is controlled based on the second condition.
2. The method according to claim 1, wherein if the working mode of the electronic device is the first mode, adjusting the volume value of the electronic device playing the multimedia file based on the first condition comprises:

   If the working mode of the electronic device is the first mode, the volume value is adjusted according to the distance between the electronic device and the user.
3. The method according to claim 2, wherein if the working mode of the electronic device is the first mode, adjusting the volume value according to the distance between the electronic device and the user comprises:

   If the working mode of the electronic device is the first mode and the distance is less than a distance threshold, adjusting the volume value according to the distance, and the distance is positively correlated with the volume value;

   If the distance is greater than or equal to the distance threshold, the playing of the multimedia file is paused.
4. The method according to claim 3, wherein if the distance is greater than or equal to the distance threshold, pausing the playing of the multimedia file comprises:

   If the distance is greater than or equal to the distance threshold, a first voice prompt message is output and the playing of the multimedia file is paused, wherein the first voice prompt message is used to prompt that the playing of the multimedia file is paused.
5. The method according to claim 1, wherein if the working mode of the electronic device is the first mode, adjusting the volume value of the electronic device playing the multimedia file based on the first condition:

   If the working mode is the first mode and the distance between the electronic device and the user changes, the volume value is adjusted, wherein the change amplitude of the distance between the electronic device and the user is positively correlated with the adjustment amplitude of the volume value.
6. The method according to claim 2, 3 or 5, wherein the method further comprises:

   If the user's designated operation is obtained, the adjustment of the volume value is canceled.
7. The method according to claim 1, wherein if the working mode of the electronic device is the first mode, adjusting the volume value of the electronic device playing the multimedia file based on the first condition comprises:

   If the working mode is the first mode, the volume value is adjusted according to the volume of the ambient sound around the electronic device.
8. The method according to claim 7, wherein the amplitude of the volume change of the ambient sound is positively correlated with the amplitude of the volume value of the multimedia file played by the electronic device.
9. The method according to claim 1, wherein if the working mode of the electronic device is the second mode, controlling the playing or pausing of the multimedia file based on the second condition comprises:

   If the working mode is the second mode and a user's portrait is detected, keeping the multimedia file in a playing state;

   If the working mode is the second mode and the user's portrait is not detected, the playing of the multimedia file is paused.
10. The method according to claim 9, further comprising:

    If the working mode is the second mode and a user's portrait is detected, corresponding first text information is generated based on a control operation on the electronic device when the multimedia file is in a playing state, and the first text information is displayed.
11. The method according to claim 9, wherein if the working mode is the second mode and the user's portrait is not detected, pausing the playing of the multimedia file comprises:

    If the working mode is the second mode and the user's portrait is not detected, outputting a second voice prompt message, wherein the second voice prompt message is used to prompt that the multimedia file will be paused;

    If the designated voice information is not detected, the playing of the multimedia file is paused, wherein the designated voice information is used to instruct to cancel the pause of the playing of the multimedia file.
12. The method according to claim 9, wherein if the working mode is the second mode and the user's portrait is not detected, after pausing the playing of the multimedia file, the method further comprises:

    Acquire an image to be detected in the area in front of the screen of the electronic device;

    If the image to be detected includes a portrait, the multimedia file is controlled to continue playing.
13. The method according to any one of claims 1 to 12, wherein the electronic device comprises a screen and a camera, the camera and the screen are arranged on the same side, and the playing of the multimedia file comprises:

    Play multimedia files;

    If the angle feature information corresponding to the screen of the electronic device meets the target condition, waking up the voice assistant and displaying the selection control;

    The first mode or the second mode selected by the user based on the selection control is obtained as the working mode of the electronic device.
14. The method according to claim 13, wherein if the angle feature information corresponding to the screen of the electronic device meets the target condition, waking up the voice assistant and displaying the selection control comprises:

    If the angle feature information corresponding to the screen of the electronic device meets the target condition, waking up the voice assistant and displaying the selection control;

    A second text message is displayed, and a third voice prompt message is played, wherein the second text message is used to indicate that the voice assistant is awakened, and the third voice prompt message is used to prompt that the voice assistant is awakened.
15. The method according to claim 13, wherein the method further comprises:

    If the angle feature information corresponding to the screen of the electronic device no longer meets the target condition, the voice assistant is turned off.
16. The method according to claim 13, wherein the method further comprises:

    If the camera is turned on, a graphic is displayed at a specified position in a specified manner, and the graphic displayed in the specified manner is used to indicate that the camera is turned on. The specified position is determined based on the position of the camera.
17. A device control device, wherein the device is applied to an electronic device, and the device comprises:

    A playback unit, used for playing multimedia files;

    A first control unit, configured to adjust a volume value of the electronic device playing the multimedia file based on a first condition if the working mode of the electronic device is the first mode;

    The second control unit is used to control the playing or pausing of the multimedia file based on a second condition if the working mode of the electronic device is the second mode.
18. An electronic device, comprising: one or more processors;

    Memory;

    One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1-16.
19. A computer-readable storage medium, wherein the computer-readable storage medium stores a program code, and the program code can be called by a processor to execute the method according to any one of claims 1 to 16.
20. A computer program product, comprising a computer program/instruction, wherein the computer program/instruction, when executed by a processor, implements the method according to any one of claims 1 to 16.