CN118069020A - Equipment control method and device and electronic equipment - Google Patents

Abstract

The embodiment of the application discloses a device control method and device and electronic equipment. The method comprises the following steps: in a screen-extinguishing display state, responding to touch operation acted on a screen, and acquiring a touch response mode of the electronic equipment; determining a processing mode corresponding to the touch operation based on the touch response mode, wherein the processing mode comprises responding or not responding, and the touch operation supported by different touch response modes for responding is different; the processing method is executed. Therefore, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, how to feed back the detected touch operation can be determined according to the current touch response mode, so that the touch interaction flexibility in screen-extinguishing display is improved.

Description

Equipment control method and device and electronic equipment

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a device control method and apparatus, and an electronic device.

Background

With the increasing functionality of electronic devices, electronic devices are beginning to support a screen-rest display. The screen-extinguishing display (always on display, AOD) refers to that after the electronic equipment is on the screen, the contents such as the normally-bright display time, the incoming call information, the push message and the like are kept in the partial area of the screen, so that the user can quickly acquire the information. However, the related screen-extinguishing display mode also has the problem that the touch interaction flexibility is to be improved.

Disclosure of Invention

In view of the above, the present application provides a device control method, a device, and an electronic device, so as to improve the above problem.

In a first aspect, the present application provides a device control method, applied to an electronic device, where the electronic device includes a screen, the method includes: in a screen-extinguishing display state, responding to touch operation acted on the screen, and acquiring a touch response mode of the electronic equipment; determining a processing mode corresponding to the touch operation based on the touch response modes, wherein the processing mode comprises responding or not responding, and the touch operation supported by different touch response modes for responding is different; and executing the processing mode.

In a second aspect, the present application provides a device control apparatus, which operates on an electronic device, the electronic device including a screen, the apparatus including: the mode acquisition unit is used for responding to the touch operation acted on the screen in the screen-extinguishing display state and acquiring a touch response mode of the electronic equipment; the device control unit is used for determining a processing mode corresponding to the touch operation based on the touch response modes, wherein the processing mode comprises responding or not responding, and the touch operation supported by different touch response modes for responding is different; and the control execution unit is used for executing the processing mode.

In a third aspect, the present application provides an earphone comprising a plurality of microphones, one or more processors, and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods described above.

In a fourth aspect, the present application provides a computer readable storage medium storing program code executable by a processor, the computer readable storage medium comprising stored program code, wherein the method described above is performed when the program code is run.

According to the device control method and device and the electronic device, in the screen-off display state, the touch control operation acted on the screen is responded, the touch control response mode of the electronic device is obtained, and the processing mode corresponding to the touch control operation is determined based on the touch control response mode. The processing mode includes responding or not responding, and the touch operation supported by different touch response modes for responding is different, and then the determined processing mode is executed. Therefore, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, how to feed back the detected touch operation can be determined according to the current touch response mode, so that the touch interaction flexibility in screen-extinguishing display is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 shows a flowchart of a device control method according to an embodiment of the present application;

FIG. 2 is a schematic diagram showing a status of a screen display according to an embodiment of the present application;

FIG. 3 illustrates a schematic diagram of a mode selection interface in an embodiment of the application;

fig. 4 shows a flowchart of a device control method according to another embodiment of the present application;

FIG. 5 is a schematic diagram of a touch event processing system according to an embodiment of the present application;

FIG. 6 is a schematic diagram showing content switching in a screen-off display state according to an embodiment of the present application;

fig. 7 is a flowchart showing a device control method according to still another embodiment of the present application;

FIG. 8 shows a schematic view of an electronic device being gazed at by a user in an embodiment of the application;

FIG. 9 is a schematic diagram of an electronic device not being gazed by a user in an embodiment of the application;

Fig. 10 is a flowchart showing a device control method according to another embodiment of the present application;

FIG. 11 is a schematic diagram of an electronic device in a designated attitude in accordance with the present application;

fig. 12 is a flowchart showing a device control method according to still another embodiment of the present application;

FIG. 13 is a schematic diagram of an electronic device displaying associated content in accordance with the present application;

FIG. 14 is a schematic diagram of a mode switch of an electronic device according to the present application;

Fig. 15 is a block diagram showing a configuration of an apparatus control device according to an embodiment of the present application;

fig. 16 shows a block diagram of the structure of an electronic device for performing the device control method according to the embodiment of the present application;

Fig. 17 is a storage unit for storing or carrying program code for implementing the device control method according to the embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The screen-extinguishing display (always on display, AOD) refers to that after the electronic equipment is on the screen, the contents such as the normally-bright display time, the incoming call information, the push message and the like are kept in the partial area of the screen, so that the user can quickly acquire the information. However, the inventor finds that the related screen display mode has the problem that the touch interaction flexibility is to be improved in the research of the related screen display.

Therefore, the inventor proposes a device control method, a device and an electronic device, in which in a screen-off display state, a touch response mode of the electronic device is obtained in response to a touch operation acting on a screen, so as to determine a processing mode corresponding to the touch operation based on the touch response mode. The processing mode includes responding or not responding, and the touch operation supported by different touch response modes for responding is different, and then the determined processing mode is executed. Therefore, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, how to feed back the detected touch operation can be determined according to the current touch response mode, so that the touch interaction flexibility in screen-extinguishing display is improved.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Referring to fig. 1, the method for controlling an apparatus provided by the present application is applied to an electronic apparatus, and includes:

S110: and in the screen-extinguishing display state, responding to the touch operation acted on the screen, and acquiring a touch response mode of the electronic equipment.

In the embodiment of the application, the screen-off display can be understood as that the control screen is partially lightened to display some information under the condition that the whole screen is not lightened. The information may include some notification information, time information, incoming call information, push information, etc. In the embodiment of the application, the information displayed during screen-off is not particularly limited.

The electronic device can enter the screen-extinguishing display state in various modes.

As one approach, the electronic device may be triggered to enter a rest screen display state by a specified gesture acting on the screen. For example, a specified gesture for triggering the electronic device to enter a rest display state may include a double-click operation, a multi-finger swipe operation, a swipe operation of a specified trajectory, and the like. For example, as shown in fig. 2, if the electronic device is in a bright screen display state (e.g., displaying the desktop shown in fig. 2) as shown in the left image in fig. 2, the electronic device may switch to a rest screen display state shown in the right image in fig. 2 if there is a double click operation on the screen. In the off-screen display state shown in the right image of fig. 2, the electronic device may display time information and weather information in the screen.

The specified gesture for triggering the electronic device to enter the screen-extinguishing display state can be configured by default or by a user of the electronic device according to own operation habits.

Alternatively, the electronic device may start to count after entering the screen locking state, and automatically enter the screen-in display state if the electronic device does not detect a touch operation acting on the screen within the first specified duration. Moreover, the electronic device may also automatically enter the screen-extinguishing display state when detecting that no touch operation is performed on the screen within the second specified duration in the screen-brightening state.

In the embodiment of the application, after the electronic device is in the screen-off display state, if any operation on the electronic device is not detected, the electronic device can be kept in the screen-off display state all the time, or after the electronic device enters the screen-off display state, timing can be started, and if the operation on the electronic device is not detected within the third specified duration, the screen-off display state is switched to the screen-off state. When the electronic equipment is in the screen-off state, the screen of the electronic equipment can not display any content.

In the embodiment of the application, the electronic equipment is in a screen-off display state or a screen-off state, and the screen of the electronic equipment still supports touch control. And if the touch operation on the screen is detected, the current touch response mode can be acquired first.

In the embodiment of the application, a plurality of modes for acquiring the touch response mode can be provided.

As an acquisition mode, the electronic device may read a preset specific identifier, and determine the current touch response mode by judging the value of the specific identifier. Optionally, the value of the specified identifier may be 0, 1, or 2, where the touch response mode corresponding to 0 is the first response mode, the touch response mode corresponding to 1 is the second response mode, and the touch response mode corresponding to 2 is the third response mode. In this case, if the electronic device performs the exclusive right of the specified flag and determines that the index flag is 0, it may be determined that it is currently in the first response mode. Wherein the electronic device can determine how the value of the specified identity should be configured in a number of ways.

As a way of determination, the value of the specified identifier may be configured according to the selection of the user. In this determination manner, a mode selection interface may be configured in the electronic device, and further, a user may perform selection of a response mode through the mode selection interface, so that the user may control how the electronic device feeds back the touch operation in the screen-off display state according to his habit or demand. Illustratively, as shown in fig. 3, a plurality of options are included in the mode selection interface 10, each option corresponding to a response mode, and the user may select the response mode according to habits or requirements.

Alternatively, the electronic device may determine the current touch response mode based on whether or not the user gazes at the electronic device. Alternatively, the electronic device may be configured in one touch response mode if it is detected that the user is looking at the electronic device, and in another touch response mode if it is detected that the user is not looking at the electronic device. For example, when it is detected that the user is looking at the electronic device, the electronic device is configured in a first touch response mode, and then the value of the specified identifier is configured as 0, and when it is detected that the user is not looking at the electronic device, the electronic device is configured in a second touch response mode, and then the value of the specified identifier is configured as 1.

As still another determination manner, the electronic device may determine a touch response mode according to a gesture or a motion state in which the electronic device is located, and may configure a value of the specified identifier after determining the touch response mode.

In addition, as another acquisition mode, when the electronic device detects that there is a touch operation, the electronic device may determine the touch response mode in real time according to whether there is a user gazing at the electronic device, or determine the touch response mode in real time according to the gesture or the motion state of the electronic device.

S120: based on the touch response modes, determining processing modes corresponding to the touch operation, wherein the processing modes comprise responding or not responding, and the touch operation supported by different touch response modes for responding is different.

In the embodiment of the application, under the condition that a plurality of touch response modes exist, the touch operation supported by the different touch response modes for responding is different. The touch response mode supports responding to a touch operation, which can be understood as controlling the electronic device through the touch operation. The control may include controlling switching of a display style of the content displayed in the screen, or controlling switching of a display detail level of the content displayed in the screen, or may further control the electronic device to close or start an application program, or the like.

For example, the touch operations may include a first touch operation, a second touch operation, a third touch operation, and a fourth touch operation. In this case, one touch response mode may support responding to all of the first, second, third, and fourth touch operations, and the other touch response mode may support responding to only a part of the first, second, third, and fourth touch operations. In another case, the touch operations supported by the different touch response modes for response are completely different, where the touch operations supported by the different touch response modes for response are completely different, which can be understood that the touch operations supported by the different touch response modes for response do not have the same portion. The plurality of touch response modes include a first response mode and a second response mode, wherein the touch operation supported by the first response mode for responding may include a first touch operation, a second touch operation, and a third touch operation, and the touch operation supported by the second response mode for responding may include a fourth touch operation and a fifth touch operation.

S130: the processing method is executed.

After determining the processing mode corresponding to the touch operation, the detected touch operation can be processed based on the processing mode. For example, if the determined processing manner is to respond, the detected touch operation may be executed for controlling the electronic device through the touch operation. For another example, if the determined processing manner is not responsive, the electronic device ignores the detected touch operation and does not respond to the touch operation.

In the device control method provided by the embodiment, in a screen-off display state, a touch control response mode of the electronic device is obtained in response to a touch control operation acting on a screen, so that a processing mode corresponding to the touch control operation is determined based on the touch control response mode. The processing mode includes responding or not responding, and the touch operation supported by different touch response modes for responding is different, and then the determined processing mode is executed. Therefore, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, how to feed back the detected touch operation can be determined according to the current touch response mode, so that the touch interaction flexibility in screen-extinguishing display is improved.

Referring to fig. 4, the method for controlling an apparatus provided by the present application is applied to an electronic apparatus, and includes:

S210: and in the screen-extinguishing display state, responding to the touch operation acted on the screen, and acquiring a touch response mode of the electronic equipment.

S220: if the touch response mode is the first response mode, the processing mode corresponding to the touch operation is to respond.

In this embodiment, the first response mode may be understood as a screen-off interaction mode, and in the screen-off interaction mode, the electronic device may be a mode that responds to all touch operations. In this case, if the current touch response mode is detected as the first response mode, it may be directly determined that the feedback mode corresponding to the touch operation is to be a response.

S230: if the touch response mode is the second response mode, detecting whether the touch operation is a touch operation of a specified type.

In this embodiment, the second response mode is a mode that responds to only a part of the touch operation. And the touch operation which can be responded in the second response mode is the touch operation of the appointed type. Therefore, in the case that the current touch response mode is determined to be the second response mode, it may be further determined whether the touch operation is a specified type of touch operation.

The designated type of touch operation is a touch operation that can enable the electronic device to respond in the second response mode. In the embodiment of the application, the designated type of touch operation can be configured in various ways. As one way, the default configuration may be performed by the electronic device, in which way a developer of the electronic device may configure a specified type of touch operation before the electronic device leaves the factory set. Alternatively, the configuration may be performed by the user according to his or her own operation habits or demands. Optionally, a touch operation configuration interface may be provided in the electronic device, through which a user may configure a specified type of touch operation.

As a configuration manner, a touch operation to be selected may be displayed in the touch operation configuration interface. In this way, the user can select a desired touch operation from the touch operations to be selected as a specified type of touch operation. For example, the touch operation to be selected may include a double click operation, a slide operation in a left direction, a slide operation in a right direction, an upward slide operation, a downward slide operation, a slide operation with a track of "M", a slide operation with a track of "W", and a slide operation with a track of "O". In this case, the user can select a double click operation among them, a slide operation in the left direction, a slide operation in the right direction, an upward slide operation, a downward slide operation, a slide operation with a trajectory of "M", a slide operation with a trajectory of "W", and a slide operation with a trajectory of "O" as the specified type of slide operation.

As another configuration mode, in the touch operation configuration interface, a user can configure a touch operation of a specified type in an actual demonstration mode. Optionally, a presentation area may be configured in the touch operation configuration interface, where a user may actually demonstrate a desired touch operation through a touch object. For example, if it is detected that a touch object acts on a double-click operation in the presentation area, the double-click operation may be regarded as a designated type of touch operation. For another example, if it is detected that a touch object has acted on the demonstration area by a sliding operation with a track of "M", the sliding operation with the track of "M" may be used as the touch operation of the designated type.

S240: if the touch operation is of the designated type, the corresponding processing mode of the touch operation is to respond.

S250: if the touch operation is not the designated type, the processing mode corresponding to the touch operation is not responsive.

S260: the processing method is executed.

In the case that the detected touch operation is determined to be a specified type of touch operation, the touch operation may be responded to, so that the electronic device may be controlled according to the touch operation. For example, if the touch operation applied to the screen is detected as a double-click operation, and the double-click operation is a touch operation of a specified type, the determined corresponding feedback manner is response. When the control mode corresponding to the double-click operation is to switch the electronic device to the bright screen display state, the electronic device may be switched from the off-screen display state to the bright screen display state. If the touch operation acted on the screen is detected to be a clicking operation, and the clicking operation is not the touch operation of the designated type, the determined corresponding feedback mode is not response, and the electronic device can ignore the clicking operation.

It should be noted that, in the operation process, the devices included in the electronic apparatus generally need to consume electric power, and thus power consumption may occur. The power consumption of the electronic device may include processor power consumption, TP (TouchPanel) power consumption, display power consumption, camera power consumption, sensor power consumption, and the like.

Among them, processor power consumption is the most dominant source of power consumption of electronic devices. It should be noted that, the processor of the electronic device may include two states, namely a wake state and a sleep state, where the processor is in the wake state, there is a higher power consumption than when the processor is in the sleep state. However, when the processor is in the wake-up state, the processor can adjust the state and frequency of each core according to the task load, so as to achieve the purpose of saving power consumption. It should be noted that an operating system (for example, an Android system) of an electronic device may be divided into a main system and a plurality of subsystems according to functions. The subsystem can run on the coprocessor (mainly processing the underlying data and the underlying events), so that the processor is not required to be awakened when processing simple matters, and the framework and the application of the main system run in the main system.

Among them, TP power consumption is also one of the main sources of power consumption of electronic devices. TP is a touch panel of the electronic device. It should be noted that there are three modes of TP. Bright screen mode, high refresh rate but maximum power consumption. A low power mode, operating but with a low refresh rate. In the screen-off mode, TP does not work and has no power consumption and loss. Among them, display power consumption is also one of the main sources of power consumption of electronic devices. In the embodiment of the application, the screen can have three modes. Bright screen mode, high refresh rate but maximum power consumption. A low power consumption mode where the screen is active but the refresh rate is low. The screen-off mode is that the screen does not work and has no power consumption and loss.

As can be seen from the foregoing power consumption of the electronic device, various hardware of the electronic device may generate power consumption, so that the touch response mode of the electronic device may be advantageously used to avoid ineffective power consumption of the electronic device. For example, the plurality of touch response modes of the electronic device may include the aforementioned first response mode and second response mode, wherein the first response mode may indicate that the user is currently using the electronic device or is currently comparing content displayed by the electronic device of interest, and the second response mode may indicate that the content displayed by the electronic device is not currently of interest. In this case, if the first response mode is detected after the touch operation, the touch operation may be directly responded to, so as to meet the control requirement of the user on the electronic device. If the second response mode is detected after the touch operation, only part of the touch operations (the touch operations of the designated type) can be responded, so that the invalid increase of the power consumption of the electronic device caused by the fact that the user mistakenly touches the electronic device is avoided.

In one way, in the embodiment of the present application, in order to further reduce power consumption, the device control method provided in the embodiment of the present application may be executed by a coprocessor and a processor of an electronic device in common. Optionally, in the embodiment of the present application, whether a touch operation is detected and a processing manner corresponding to the touch operation is determined may be executed by the coprocessor, and a subsequent execution processing manner (for example, the processing manner is responding) may be executed by the processor, so that the processor is woken up again to reduce power consumption when the touch operation needs to be responded. Optionally, the device control method may include: in the screen-extinguishing display state, the touch operation on the screen is responded through the coprocessor, and the touch response mode of the electronic equipment is acquired through the coprocessor. And then waking up a processor of the electronic device, and responding to the touch operation through the processor.

The device control method according to the embodiment is described below by means of a touch event.

As shown in fig. 5, if there is a touch TP, the coprocessor will first report a TP event to report that the current touch panel has a touch. Then, in response to the TP event report, it may be detected whether the first response mode is currently in. If the first response mode is the first response mode, the processor can be awakened, and the TP gesture event is reported to the processor, so that the processor processes the TP gesture receipt. The processor processes the TP gesture event, which may be understood as a response to the touch operation by the processor. If not in the first response mode (e.g., in the second response mode), the co-processor may perform a black screen gesture recognition. The black screen gesture may be understood as a specific type of touch operation. If the touch operation reported by the TP time is a black screen gesture, the processor can be awakened to process the TP gesture event. If the touch gesture is not a black screen gesture, the touch operation is not responded, the reported TP gesture event is abandoned, and the processor is not awakened.

As one aspect, the execution processing includes: and if the content is displayed at the position which is in the first response mode and is acted by the touch operation, executing the touch operation based on the displayed content. It should be noted that, in the state of the screen-off display, some touch-controllable contents can still be displayed in the screen. The touch-controllable content corresponds to a control manner, in this case, a position of the touch operation on the screen is obtained, and in the case that the detected position of the touch operation is the touch-controllable content, executing the touch operation based on the displayed content may be understood as controlling the electronic device to execute the control manner corresponding to the touched content.

As shown in fig. 6, in the screen display state shown in the left image of fig. 6, a music playing control is further displayed in the screen, where the music playing control includes a pause control 20, and the control mode corresponding to the pause control 20 is to control the electronic device to pause playing audio. If the content displayed at the action position of the touch operation is the pause control 20, when the touch operation is performed based on the pause control 20, the electronic device stops playing the audio, and the displayed pause control 20 is switched to the display playing control 21 shown in the right image of fig. 6.

According to the equipment control method, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, feedback of the detected touch operation can be determined according to the current touch response mode, so that touch interaction flexibility in screen-extinguishing display is improved. In addition, in this embodiment, when the touch response mode is the first response mode, the touch operation may be directly responded, and when the touch response mode is the second response mode, whether the touch operation is a specific type of touch operation may be further determined to determine whether to respond to the touch operation.

Referring to fig. 7, the method for controlling an apparatus provided by the present application is applied to an electronic apparatus, and includes:

S310: and in the screen-extinguishing display state, responding to touch operation acted on the screen, and determining whether a user gazes at the electronic equipment or not through the camera.

The method comprises the steps of collecting images through a camera, detecting whether a face exists in the collected images, and if the face exists, determining that a user is looking at the electronic equipment currently, and further determining that a touch response mode of the electronic equipment is a first response mode.

As one way, the camera of the electronic device may collect an image with a resolution lower than the specified resolution as a reference image, then detect whether there is a face contour in the reference image, and if so, determine that there is a user looking at the electronic device. It should be noted that, the data processing capability of the coprocessor may be worse than that of the processor, and by collecting an image with a resolution lower than the specified resolution as the reference image, it is possible to detect whether the user is looking at the electronic device, and not to increase too much power consumption. If the electronic device is a smart watch worn by the user and the smart watch is provided with a camera, as shown in fig. 8, the scenario shown in fig. 8 may determine that the user is looking at the smart watch. And as in the state shown in fig. 9, it is determined that the user is not looking at the electronic device.

S320: and determining a touch response mode of the electronic device based on whether the user gazes at the electronic device.

S330: based on the touch response modes, determining processing modes corresponding to the touch operation, wherein the processing modes comprise responding or not responding, and the touch operation supported by different touch response modes for responding is different.

S340: the processing method is executed.

According to the equipment control method, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, feedback of the detected touch operation can be determined according to the current touch response mode, so that touch interaction flexibility in screen-extinguishing display is improved. In addition, in the embodiment, the image acquisition can be performed through the camera, whether a user looks at the electronic equipment or not is determined, and whether the user looks at the electronic equipment or not is further determined, so that the intelligent degree of determining the touch response mode of the electronic equipment is improved.

Referring to fig. 10, the method for controlling an apparatus provided by the present application is applied to an electronic apparatus, and includes:

S410: in the screen-extinguishing display state, whether the electronic equipment is in a specified motion state and/or a specified gesture is detected in response to touch operation on the screen.

S420: a touch response mode of the electronic device is determined based on whether the electronic device is in a specified motion state and/or a specified gesture.

It should be noted that, when the electronic device is used by a user, the electronic device may be in a certain posture or a moving state. For example, when a user uses a smartphone, the smartphone is typically held by the user, and the held smartphone is in an inclined posture. As shown in fig. 11, when the user uses the smartphone 100 (is looking at the smartphone 100), the smartphone 100 is inclined to a certain degree from the numerical direction. And, the current acceleration of the smart phone 100 is 0. For another example, when the user walks with the electronic device, the electronic device may be placed in a purse of a piece of clothing, in which case the direction of the acceleration of the electronic device may change regularly. Therefore, by detecting the motion state and/or gesture of the electronic device, it can be determined whether the user is focusing on the content of the electronic device, and further determine the touch response mode of the electronic device. For example, for the case shown in fig. 11, in the case where it is determined that the user is looking at the electronic device according to the specified motion state and/or the specified gesture, then the touch response mode may be determined to be the first response mode.

S430: based on the touch response modes, determining processing modes corresponding to the touch operation, wherein the processing modes comprise responding or not responding, and the touch operation supported by different touch response modes for responding is different.

S440: the processing method is executed.

According to the equipment control method, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, feedback of the detected touch operation can be determined according to the current touch response mode, so that touch interaction flexibility in screen-extinguishing display is improved. In addition, in the embodiment, the touch response mode of the electronic device can be determined according to whether the electronic device is in the specified motion state and/or the specified gesture, so that the degree of intellectualization of determining the touch response mode of the electronic device is improved.

Referring to fig. 12, the method for controlling an apparatus provided by the present application is applied to an electronic apparatus, and includes:

s510: and in the screen-extinguishing display state, responding to the condition of meeting the entering, and switching the touch control response mode of the electronic equipment into a first response mode.

Wherein the entry condition is a condition for determining whether the electronic device can switch to the first response mode. The entry condition may include at least one of the user currently looking at the cell phone, the electronic device being in a specified motion state, and the electronic device being in a specified pose. Furthermore, the electronic device also supports the user clicking on a specified UI element to trigger satisfaction of the entry condition.

S520: and in the screen-extinguishing display state, responding to the touch operation acted on the screen, and acquiring a touch response mode of the electronic equipment.

It should be noted that, although it is described in S510 that the electronic device is triggered to switch the touch response mode to the first response mode in response to the entry condition, it may also be triggered to exit the first response mode (for example, to switch to the second response mode) because the entry condition is not satisfied. After the touch operation is detected, the current touch response mode is further acquired, so that the electronic equipment can be guaranteed to accurately process the detected touch operation according to the current actual touch response mode.

S530: determining a processing mode corresponding to the touch operation based on the touch response mode, wherein the processing mode comprises responding or not responding, and the touch operation supported by different touch response modes for responding is different;

S540: the processing method is executed.

In one manner, in response to an entry condition being satisfied, a target content of currently displayed contents in a screen is acquired, the target content corresponding to associated content, and the associated content is displayed. In the off-screen display state, in order to further reduce power consumption, only a part of the content may be displayed first, and then, if it is detected that the user is currently using the electronic device (for example, looking at the screen of the electronic device), the content associated with the already displayed content may be displayed for the user to operate. For example, as shown in fig. 13, in the case of a mode other than the first response mode (e.g., the second touch response mode), the audio play control 23 displayed in the screen by the electronic device may be as shown on the left side of fig. 13. If the entering condition is detected to be met and the touch response mode is switched to the first response mode, the associated content (for example, singer, lyrics, etc.) corresponding to the audio playing control 23 may be displayed, and then the displayed content of the audio playing control may be shown as the right image in fig. 13.

It should be noted that, regarding the scenario for performing the detail content presentation, the embodiment of the present application is not specifically limited. For example, the method can also be applied to scenes such as take-away information display, flight information display, taxi taking information display and the like. For example, when the electronic device is not in the first response mode, brief information of take-out information display, flight information display or taxi taking information may be displayed, and when the touch response mode is switched to the first response mode, detailed information of take-out information display, flight information display or taxi taking information may be displayed, and a control that may be operated by a user may be configured in the detailed information.

It should be noted that, after the first response mode is entered because the entry condition is satisfied, whether the entry condition is satisfied may still be detected, and if the entry condition is not satisfied, the first response mode may be exited again. Illustratively, as shown in FIG. 14, after the user is on standby, the electronic device first enters a second response mode. In the second response mode, the electronic device may respond to only a portion of the touch operations (e.g., the black screen gestures in the foregoing embodiments). Then, if the entering condition is detected to be met, the electronic device may enter a first response mode, in which more touch operations can be performed by the electronic device, for example, in the first response mode, the electronic device supports the user to perform touch interaction on the displayed content. Further, in the first response mode, if no operation of the user is detected within a specified time, the first response mode may be exited and the second response mode may be returned.

According to the equipment control method, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, feedback of the detected touch operation can be determined according to the current touch response mode, so that touch interaction flexibility in screen-extinguishing display is improved. In addition, in the embodiment, the current touch response mode can be determined by directly reading the designated identifier, so that the efficiency of determining the touch response mode is improved.

Referring to fig. 15, an apparatus control device 600 provided by the present application is operated in an electronic apparatus, the electronic apparatus includes a screen, and the apparatus 600 includes:

The mode obtaining unit 610 is configured to obtain a touch response mode of the electronic device in response to a touch operation applied to the screen in the screen-off display state.

The device control unit 620 is configured to determine, based on the touch response modes, a processing manner corresponding to the touch operation, where the processing manner includes responding or not responding, and the touch operations supported by different touch response modes for responding are different.

The control execution unit 630 is configured to execute a processing mode.

As one manner, the device control unit 620 is specifically configured to respond to the touch operation in a processing manner corresponding to the touch response mode being the first response mode. Optionally, the control execution unit 630 is specifically configured to wake up a processor of the electronic device; the processor is responsive to the touch operation. Optionally, the control execution unit 630 is specifically configured to display content if the position acted by the touch operation; and executing touch operation based on the displayed content.

As one way, the device control unit 620 is further configured to detect whether the touch operation is a touch operation of a specified type if the touch response mode is the second response mode; if the touch operation is of the designated type, responding to the corresponding processing mode of the touch operation; if the touch operation is not the designated type, the processing mode corresponding to the touch operation is not responsive.

As one way, the mode obtaining unit 610 is specifically configured to determine, through the camera, whether the user gazes at the electronic device; and determining a touch response mode of the electronic device based on whether the user gazes at the electronic device. As another way, the mode obtaining unit 610 is specifically configured to detect whether the electronic device is in a specified motion state and/or a specified gesture; a touch response mode of the electronic device is determined based on whether the electronic device is in a specified motion state and/or a specified gesture.

As one way, the device control unit 620 is configured to detect whether there is a touch operation acting on the screen within a specified period of time if the touch response mode is the first response mode; if not, the first response mode is exited. The mode obtaining unit 610 is further configured to switch, in response to the entering condition being met, a touch response mode of the electronic device to the first response mode in a screen-off display state. The mode obtaining unit 610 is further configured to obtain, in response to satisfaction of an entry condition, a target content in contents currently displayed in a screen, the target content corresponding to the associated content; and displaying the associated content.

According to the device control device provided by the embodiment, the device control device can divide the touch response modes in the screen-extinguishing display state, and further determine how to feed back the detected touch operation according to the current touch response mode when the touch operation is detected, so that the touch interaction flexibility in screen-extinguishing display is improved.

It should be noted that, in the embodiment of the present application, the apparatus embodiment and the foregoing method embodiment correspond to each other, and the specific implementation principle of each unit in the embodiment of the apparatus is similar to that in the foregoing method embodiment, and specific content in the embodiment of the apparatus may refer to the method embodiment, which is not repeated in the embodiment of the apparatus.

An electronic device according to the present application will be described with reference to fig. 16.

Referring to fig. 16, based on the above-mentioned device control method and apparatus, an embodiment of the present application further provides an electronic device 1000 capable of executing the above-mentioned device control method. The electronic device 1000 comprises one or more (only one is shown in the figure) processors 105, a memory 104, a camera 106 and an audio acquisition means 108 coupled to each other. The memory 104 stores therein a program capable of executing the contents of the foregoing embodiments, and the processor 105 can execute the program stored in the memory 104.

Wherein the processor 105 may include one or more processing cores. The processor 105 utilizes various interfaces and lines to connect various portions of the overall electronic device 1000, perform various functions of the electronic device 1000, and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 104, and invoking data stored in the memory 104. Alternatively, the processor 105 may be implemented in at least one hardware form of digital signal Processing (DIGITAL SIGNAL Processing, DSP), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 105 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for being responsible for rendering and drawing of display content; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 105 and may be implemented solely by a single communication chip.

The Memory 104 may include random access Memory (Random Access Memory, RAM) or Read-Only Memory (ROM). Memory 104 may be used to store instructions, programs, code sets, or instruction sets. The memory 104 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (e.g., a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described below, etc.

Further, the electronic device 1000 may include a network module 110 and a sensor module 112 in addition to the devices shown above.

The network module 110 is configured to implement information interaction between the electronic device 1000 and other devices, for example, transmit a device control command, a manipulation request command, and a status information acquisition command. While the electronic device 200 may be embodied as a different device, its corresponding network module 110 may be different.

The sensor module 112 may include at least one sensor. Specifically, the sensor module 112 may include, but is not limited to: light sensors, motion sensors, acceleration sensors, barometers, and other sensors.

Wherein the pressure sensor may detect a pressure generated by pressing against the electronic device 1000. That is, the pressure sensor detects a pressure generated by contact or pressing between the user and the electronic device, for example, a pressure generated by contact or pressing between the user's ear and the mobile terminal. Thus, the pressure sensor may be used to determine whether contact or pressure has occurred between the user and the electronic device 1000, as well as the magnitude of the pressure.

The acceleration sensor may detect the acceleration in each direction (typically, three axes), and may detect the gravity and direction when stationary, and may be used for applications for recognizing the gesture of the electronic device 1000 (such as landscape/portrait screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer, and knocking), and so on. In addition, the electronic device 1000 may further be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, etc., which will not be described herein.

The audio acquisition device 110 is used for acquiring audio signals. Optionally, the audio capturing device 110 includes a plurality of audio capturing devices, which may be microphones.

As one way, the network module of the electronic device 1000 is a radio frequency module, and the radio frequency module is configured to receive and transmit electromagnetic waves, and implement mutual conversion between the electromagnetic waves and the electrical signals, so as to communicate with a communication network or other devices. The radio frequency module may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and the like. For example, the radio frequency module may interact with external devices through transmitted or received electromagnetic waves. For example, the radio frequency module may send instructions to the target device.

Referring to fig. 17, a block diagram of a computer readable storage medium according to an embodiment of the present application is shown. The computer readable medium 1100 has stored therein program code that can be invoked by a processor to perform the methods described in the method embodiments above.

The computer readable storage medium 1100 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Optionally, computer readable storage medium 1100 includes non-volatile computer readable media (non-transitory computer-readable storage medium). The computer readable storage medium 1100 has storage space for program code 1110 that performs any of the method steps described above. The program code can be read from or written to one or more computer program products. Program code 1110 may be compressed, for example, in a suitable form.

In summary, in the device control method, the device and the electronic device provided by the application, in response to a touch operation on a screen in a screen-off display state, a touch response mode of the electronic device is obtained, so that a processing mode corresponding to the touch operation is determined based on the touch response mode. The processing mode includes responding or not responding, and the touch operation supported by different touch response modes for responding is different, and then the determined processing mode is executed. Therefore, the touch response modes can be divided in the screen-extinguishing display state, and further, when the touch operation is detected, how to feed back the detected touch operation can be determined according to the current touch response mode, so that the touch interaction flexibility in screen-extinguishing display is improved.

In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.

Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present application, the meaning of "plurality" means at least two, for example, two, three, etc., unless specifically defined otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.

It is to be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be appreciated by those of ordinary skill in the art that: the technical schemes described in the foregoing embodiments can be modified or part of the technical feature diagrams can be replaced equivalently; such modifications and substitutions do not drive the essence of the corresponding technical solutions to depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (13)

1. A device control method, characterized by being applied to an electronic device including a screen, comprising:

In a screen-extinguishing display state, responding to touch operation acted on the screen, and acquiring a touch response mode of the electronic equipment;

Determining a processing mode corresponding to the touch operation based on the touch response modes, wherein the processing mode comprises responding or not responding, and the touch operation supported by different touch response modes for responding is different;

And executing the processing mode.

2. The method of claim 1, wherein the determining, based on the touch response mode, a processing manner corresponding to the touch operation includes:

And if the touch response mode is the first response mode, responding the processing mode corresponding to the touch operation.

3. The method of claim 2, wherein the performing the processing means comprises:

Waking up a processor of the electronic device;

And responding to the touch operation through the processor.

4. The method of claim 2, wherein said performing said processing means,

If the content is displayed at the position of the action of the touch operation;

and executing the touch operation based on the displayed content.

5. The method according to claim 2, wherein the method further comprises:

If the touch response mode is a second response mode, detecting whether the touch operation is a touch operation of a designated type;

if the touch operation is of the appointed type, responding to the corresponding processing mode of the touch operation;

If the touch operation is not the specified type, the processing mode corresponding to the touch operation is not response.

6. The method of claim 1, wherein the obtaining the touch response mode of the electronic device comprises:

determining, by the camera, whether a user gazes at the electronic device;

and determining a touch response mode of the electronic equipment based on whether a user gazes at the electronic equipment.

7. The method of claim 1, wherein the obtaining the touch response mode of the electronic device comprises:

detecting whether the electronic equipment is in a specified motion state and/or a specified gesture;

and determining a touch response mode of the electronic equipment based on whether the electronic equipment is in a specified motion state and/or a specified gesture.

8. The method according to claim 1, wherein the method further comprises:

if the touch response mode is a first response mode, detecting whether a touch operation acting on the screen exists in a specified time period;

and if not, exiting the first response mode.

9. The method of claim 1, wherein in response to a touch operation on the screen in the off-screen display state, prior to obtaining a touch response mode of the electronic device further comprises:

and in the screen-extinguishing display state, responding to the condition of meeting the entering, and switching the touch control response mode of the electronic equipment into a first response mode.

10. The method according to claim 9, wherein the method further comprises:

responding to the condition of entering, and acquiring target content in the currently displayed content in the screen, wherein the target content corresponds to the associated content;

and displaying the associated content.

11. A device control apparatus operable with an electronic device, the electronic device including a screen, the apparatus comprising:

The mode acquisition unit is used for responding to the touch operation acted on the screen in the screen-extinguishing display state and acquiring a touch response mode of the electronic equipment;

The device control unit is used for determining a processing mode corresponding to the touch operation based on the touch response modes, wherein the processing mode comprises responding or not responding, and the touch operation supported by different touch response modes for responding is different;

And the control execution unit is used for executing the processing mode.

12. An electronic device comprising a plurality of microphones, one or more processors, and a memory; one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-10.

13. A computer readable storage medium storing program code executable by a processor, characterized in that the computer readable storage medium comprises stored program code, wherein the method of any of claims 1-10 is performed when the program code is run.