CN117041476A

CN117041476A - Control method and device of intelligent equipment, storage medium and electronic device

Info

Publication number: CN117041476A
Application number: CN202210467359.4A
Authority: CN
Inventors: 潘威滔
Original assignee: Qingdao Haier Technology Co Ltd; Haier Smart Home Co Ltd
Current assignee: Qingdao Haier Technology Co Ltd; Haier Smart Home Co Ltd
Priority date: 2022-04-29
Filing date: 2022-04-29
Publication date: 2023-11-10

Abstract

The application discloses a control method and device of intelligent equipment, a storage medium and an electronic device, and relates to the field of intelligent home, wherein the method comprises the following steps: responding to a wake-up signal of target equipment, and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state; acquiring an image of a target area through the image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of a screen of the equipment; and under the condition that a target part of a target object is identified from the group of acquired images, waking up the equipment screen from the off-screen state, wherein the equipment screen after waking up is in a bright-screen state. The technical problem of large resource consumption in the control method of the intelligent equipment in the related technology is solved.

Description

Control method and device of intelligent equipment, storage medium and electronic device

Technical Field

The present application relates to the field of device control, and in particular, to a method and apparatus for controlling an intelligent device, a storage medium, and an electronic apparatus.

Background

At present, a user can wake up the intelligent device (for example, an intelligent refrigerator) through voice, after receiving the wake-up voice of the user, the intelligent device can wake up a display screen configured on the intelligent device, so that the display screen is bright, and the user can conveniently use the screen.

Therefore, the control method of the intelligent equipment in the related technology has the technical problem of high resource consumption.

Disclosure of Invention

The embodiment of the application provides a control method and device of intelligent equipment, a storage medium and an electronic device, which at least solve the technical problem of high resource consumption in the control method of the intelligent equipment in the related technology.

According to an aspect of an embodiment of the present application, there is provided a control method of an intelligent device, including: responding to a wake-up signal of target equipment, and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state; acquiring an image of a target area through the image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of a screen of the equipment; and under the condition that a target part of a target object is identified from the group of acquired images, waking up the equipment screen from the off-screen state, wherein the equipment screen after waking up is in a bright-screen state.

In an exemplary embodiment, before the activating the image capturing device corresponding to the target device in response to the wake-up signal of the target device, the method further includes: acquiring voice through voice acquisition equipment corresponding to the target equipment to obtain first voice data; generating a wake-up signal under the condition that a wake-up word of the target device is identified from the first voice data; or acquiring an infrared image through target infrared equipment corresponding to the target equipment to obtain a first infrared image; the wake-up signal is generated in case a target infrared feature is identified from the first infrared image.

In an exemplary embodiment, before the activating the image capturing device corresponding to the target device in response to the wake-up signal of the target device, the method further includes: acquiring second voice data through voice acquisition equipment corresponding to the target equipment, wherein target infrared equipment corresponding to the target equipment is in a closed state in the voice acquisition process of the voice acquisition equipment; under the condition that part of words in wake-up words of the target equipment are identified from the second voice data, starting the target infrared equipment to acquire an infrared image, and obtaining a second infrared image; the wake-up signal is generated if a target infrared feature is identified from the second infrared image.

In an exemplary embodiment, the generating the wake-up signal in case a target infrared feature is identified from the second infrared image comprises: carrying out temperature identification on the second infrared image, and determining the temperature value of each position point in the second infrared image; and generating the wake-up signal under the condition that a position point with a temperature value larger than or equal to a target temperature value exists in the second infrared image.

In an exemplary embodiment, after said waking up said device screen from said off-screen state, said method further comprises: acquiring an infrared image through target infrared equipment corresponding to the target equipment to obtain a third infrared image; and switching the equipment screen from the bright screen state to the off screen state under the condition that the target infrared characteristic is not recognized in the third infrared image.

In an exemplary embodiment, the controlling the device screen to transition from the off-screen state to the on-screen state in a case where a target portion of a target object is identified from the set of acquired images includes: the device screen is awakened from the off-screen state upon identifying a target face of the target object from the set of captured images.

In an exemplary embodiment, the waking up the device screen from the off-screen state in a case where a target portion of a target object is identified from the set of acquired images includes: under the condition that the target part is identified from N continuous acquired images of the group of acquired images, waking up the equipment screen from the screen off state, wherein N is a positive integer greater than or equal to 2; or when the target part is identified from the continuous N acquired images of the group of acquired images and the size of the target part gradually becomes larger, waking up the equipment screen from the screen off state.

According to another aspect of the embodiment of the present application, there is also provided a control device for an intelligent device, including: the first starting unit is used for responding to a wake-up signal of target equipment and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state; the first acquisition unit is used for acquiring images of a target area through the image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of a screen of the equipment; and the awakening unit is used for awakening the equipment screen from the screen-off state under the condition that the target part of the target object is identified from the group of acquired images, wherein the awakened equipment screen is in the screen-on state.

In an exemplary embodiment, the apparatus further comprises: the second acquisition unit is used for acquiring voice through the voice acquisition equipment corresponding to the target equipment before the image acquisition equipment corresponding to the target equipment is started in response to the wake-up signal of the target equipment, so as to obtain first voice data; a first generating unit, configured to generate a wake-up signal when a wake-up word of the target device is identified from the first voice data; or the third acquisition unit is used for acquiring an infrared image through target infrared equipment corresponding to the target equipment to obtain a first infrared image; and the second generation unit is used for generating the wake-up signal under the condition that the target infrared characteristic is identified from the first infrared image.

In an exemplary embodiment, the apparatus further comprises: a fourth acquisition unit, configured to perform voice acquisition through a voice acquisition device corresponding to a target device before the image acquisition device corresponding to the target device is started in response to a wake-up signal of the target device, to obtain second voice data, where in a process of performing voice acquisition by the voice acquisition device, a target infrared device corresponding to the target device is in a closed state; the second starting unit is used for starting the target infrared device to acquire an infrared image under the condition that part of words in the wake-up words of the target device are identified from the second voice data, so as to obtain a second infrared image; and a third generating unit, configured to generate the wake-up signal when the target infrared feature is identified from the second infrared image.

In an exemplary embodiment, the third generating unit includes: the determining module is used for carrying out temperature identification on the second infrared image and determining the temperature value of each position point in the second infrared image; and the generating module is used for generating the wake-up signal under the condition that a position point with the temperature value being greater than or equal to a target temperature value exists in the second infrared image.

In an exemplary embodiment, the apparatus further comprises: the fifth acquisition unit is used for acquiring an infrared image through target infrared equipment corresponding to the target equipment after the equipment screen is awakened from the screen-off state, so as to obtain a third infrared image; and the switching unit is used for switching the equipment screen from the bright screen state to the off screen state under the condition that the target infrared characteristic is not recognized in the third infrared image.

In an exemplary embodiment, the wake-up unit includes: and the first awakening module is used for awakening the equipment screen from the screen-off state under the condition that the target face of the target object is identified from the group of acquired images.

In an exemplary embodiment, the wake-up unit includes: the second awakening module is used for awakening the equipment screen from the screen-off state under the condition that the target part is identified from N continuous acquired images of the group of acquired images, wherein N is a positive integer greater than or equal to 2; or a third awakening module, configured to awaken the device screen from the off-screen state when the target location is identified from all the N continuous acquired images in the set of acquired images and the size of the target location becomes gradually larger.

According to still another aspect of the embodiments of the present application, there is also provided a computer-readable storage medium having a computer program stored therein, wherein the computer program is configured to execute the control method of the smart device described above when running.

According to still another aspect of the embodiment of the present application, there is further provided an electronic apparatus including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the control method of the smart device through the computer program.

In the embodiment of the application, a mode of setting a screen in a screen-off state after equipment is awakened and controlling equipment to lighten the screen after a specific part of a target object is identified is adopted, and an image acquisition equipment corresponding to the target equipment is started by responding to an awakening signal of the target equipment, wherein the target equipment is intelligent household equipment, and when the image acquisition equipment is started, the equipment screen of the target equipment is in the screen-off state; image acquisition is carried out on a target area through image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of an equipment screen; under the condition that the target part of the target object is identified from a group of acquired images, the equipment screen is awakened from a screen-off state, wherein the equipment screen after awakening is in a screen-on state, and because the equipment is not necessarily positioned near the equipment when in awakening, the consumption of resources by the screen-on state can be saved through controlling the screen to be in the screen-off state, and when the target part of the target object is identified, the screen-on state of the equipment is controlled, so that information viewing by the user can be facilitated, the aim of reducing the screen-on time of the screen after the equipment awakens can be realized, the technical effect of reducing the resource waste of the equipment screen is achieved, and the technical problem of large resource consumption in the control method of the intelligent equipment in the related art is solved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a schematic diagram of a hardware environment of an alternative method of controlling a smart device according to an embodiment of the present application;

FIG. 2 is a flow chart of an alternative method of controlling a smart device according to an embodiment of the present application;

FIG. 3 is a schematic illustration of an alternative device inspection scope in accordance with an embodiment of the application;

FIG. 4 is a schematic diagram of an alternative remote device scenario in accordance with an embodiment of the present application;

FIG. 5 is a schematic diagram of an alternative near device scenario in accordance with an embodiment of the application;

FIG. 6 is a schematic diagram of an alternative smart device control method in accordance with an embodiment of the present application;

FIG. 7 is a flow chart of another alternative method of controlling a smart device according to an embodiment of the present application;

FIG. 8 is a block diagram of an alternative smart device control apparatus in accordance with an embodiment of the present application;

fig. 9 is a block diagram of an alternative electronic device according to an embodiment of the application.

Detailed Description

In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

According to one aspect of the embodiment of the application, a control method of an intelligent device is provided. The control method of the intelligent equipment is widely applied to full-house intelligent digital control application scenes such as intelligent Home (Smart Home), intelligent Home equipment ecology, intelligent Home (Intelligence House) ecology and the like. Alternatively, in the present embodiment, the control method of the above-described smart device may be applied to a hardware environment constituted by the terminal device 102 and the server 104 as shown in fig. 1. As shown in fig. 1, the server 104 is connected to the terminal device 102 through a network, and may be used to provide services (such as application services and the like) for a terminal or a client installed on the terminal, a database may be set on the server or independent of the server, for providing data storage services for the server 104, and cloud computing and/or edge computing services may be configured on the server or independent of the server, for providing data computing services for the server 104.

The network may include, but is not limited to, at least one of: wired network, wireless network. The wired network may include, but is not limited to, at least one of: a wide area network, a metropolitan area network, a local area network, and the wireless network may include, but is not limited to, at least one of: WIFI (Wireless Fidelity ), bluetooth. The terminal device 102 may not be limited to a PC, a mobile phone, a tablet computer, an intelligent air conditioner, an intelligent smoke machine, an intelligent refrigerator, an intelligent oven, an intelligent cooking range, an intelligent washing machine, an intelligent water heater, an intelligent washing device, an intelligent dish washer, an intelligent projection device, an intelligent television, an intelligent clothes hanger, an intelligent curtain, an intelligent video, an intelligent socket, an intelligent sound box, an intelligent fresh air device, an intelligent kitchen and toilet device, an intelligent bathroom device, an intelligent sweeping robot, an intelligent window cleaning robot, an intelligent mopping robot, an intelligent air purifying device, an intelligent steam box, an intelligent microwave oven, an intelligent kitchen appliance, an intelligent purifier, an intelligent water dispenser, an intelligent door lock, and the like.

The control method of the intelligent device according to the embodiment of the present application may be executed by the server 104, may be executed by the terminal device 102, or may be executed by both the server 104 and the terminal device 102. The control method of the terminal device 102 for executing the intelligent device according to the embodiment of the present application may also be executed by a client installed thereon.

Taking the example that the terminal device 102 executes the control method of the smart device in this embodiment as an example, fig. 2 is a schematic flow chart of an alternative control method of the smart device according to an embodiment of the present application, as shown in fig. 2, the flow of the method may include the following steps:

step S202, responding to a wake-up signal of target equipment, and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state.

The control method of the intelligent device in the embodiment can be applied to a scene of controlling the intelligent device, wherein the intelligent device can be an intelligent home device in a user family and can be an electronic device provided with an intelligent chip, such as an intelligent television, an intelligent refrigerator and the like. The type of the intelligent device is not limited in this embodiment.

In the related art, when an intelligent home device with a device screen is awakened, the intelligent home device immediately controls the device screen to turn on a bright screen. However, when the smart home device is awakened, the user may be far away from the screen, the state of the screen cannot be controlled, and the resource waste is caused by instant opening of the bright screen. In this embodiment, after the device is awakened, the device screen is in a screen-off state, and after a specific part (e.g., a face) is detected, the screen is turned on, so that resources can be reasonably utilized, and resource waste is reduced.

For the target device (i.e., the terminal device 102 described above), which is an intelligent home device, after receiving the wake-up signal, the target device may respond to the wake-up signal to activate an image capturing device corresponding to the target device. When the image acquisition device is started, the device screen of the target device is in a screen-off state, and the target device can be an intelligent household device, such as an intelligent refrigerator, or other intelligent devices with screens.

The image capturing device may be an image capturing device mounted on the target device, for example, a camera mounted on the intelligent refrigerator, or an image capturing device not mounted on the target device but establishing a connection relationship with the target device. Alternatively, the image capturing device may be an image capturing device located in the same location area as the target device, for example, a camera located in the same room as the intelligent refrigerator, which is not limited in this embodiment.

In this embodiment, after receiving the wake-up signal, the target device may start up other components in addition to the image capturing device corresponding to the target device, optionally, a control component in the target device that controls the image capturing device to capture an image may be started up, and a processing component that analyzes an image captured by the image capturing device may also be started up, which is not limited in this embodiment.

When the image capturing device corresponding to the target device is not set on the target device, the process of starting the image capturing device corresponding to the target device may be that the target device sends a start message to the image capturing device, where the start message is used to instruct to start the image capturing device corresponding to the target device to capture an image. After receiving the start message sent by the target device, the image acquisition device may start image acquisition. Optionally, the manner in which the target device sends the start message to the image capturing device may be: the start message is sent through a communication connection with the image acquisition device or is broadcast in a broadcast form to the location area of the target device, and the image acquisition device is located in the broadcast range of the target device.

For example, a camera may be provided on the intelligent refrigerator, and the camera may be located at the front side of the intelligent refrigerator. After receiving the wake-up signal, the intelligent refrigerator can start the set camera.

In step S204, image acquisition is performed on a target area by the image acquisition device, so as to obtain a set of acquired images, wherein the target area is an area located in front of a screen of the device.

In this embodiment, after the image capturing device corresponding to the target device is started, the image capturing device may perform image capturing on the target area to obtain a set of captured images, or may perform video image capturing on the target area by the image capturing device to obtain a section of video, and then determine a set of captured images from a video frame sequence corresponding to the captured video, where the target area may be an area located in front of a screen of the device.

Since the image capturing apparatus consumes a lot of resources in capturing the image. Alternatively, the image capturing device may be controlled to capture an image of the target area for a period of time after the target device wakes up, and if the target portion of the target object is not identified from the captured image for a period of time (e.g., 30s, 1min, etc.) after the target device wakes up, the target device is controlled to enter a sleep state, and the image capturing device is controlled to stop capturing the image of the target area. Alternatively, the image capturing device may be controlled to periodically perform image capturing on the target area, and the time interval between the two capturing periods may be preset, for example, 1s, 5s, 1min, or the like, or may be other time intervals, and a predetermined number of images (for example, 1 sheet, 2 sheets, or the like) may be captured in each time interval, which is not limited in this embodiment.

It should be noted that the number of the image capturing devices may be plural. When the number of the image capturing devices is multiple, part or all of the image capturing devices can be selected from the multiple image capturing devices to capture the image of the target area, so as to obtain one or more groups of captured images, wherein each group of captured images in the multiple groups of captured images corresponds to one image capturing device, and the method is not limited in this embodiment.

For example, as shown in fig. 3, a camera on the intelligent refrigerator may perform image acquisition on an area in front of a screen to obtain a set of acquired images.

Step S206, waking up the device screen from the off-screen state when the target part of the target object is identified from a group of acquired images, wherein the device screen after waking up is in the on-screen state.

In this embodiment, after obtaining a set of acquired images, the target device may perform image recognition on the acquired set of acquired images. Alternatively, the process of image recognition of a set of acquired images may be: according to the acquisition time sequence of each acquisition image in a group of acquisition images, image identification is sequentially performed on each acquisition image, or the group of acquisition images can be divided into a plurality of parts, each part in the plurality of parts can comprise at least one acquisition image in the group of acquisition images, and the image identification is performed on the acquisition images contained in each part in parallel, which is not limited in the embodiment.

In an embodiment, each acquired image in the acquired set of acquired images may be preprocessed before image recognition is performed on the acquired set of acquired images, and optionally, noise in each acquired image may be removed, or other preprocessing operations may be performed, which is not limited in this embodiment.

If the target part of the target object is identified from a group of acquired images, it can be determined that the target object is within the viewing range of the target device, the device screen of the target device can be controlled, and at the moment, the device screen can be awakened, namely, the device screen is awakened from the off-screen state, and the awakened device screen is in the bright-screen state. The target portion of the target object may be a face of the target object or a portion located in the face, for example, a pupil, a mouth, or the like of the target object. In addition, other body parts of the target object may be used, and this is not a limitation in the present embodiment.

For example, after the user wakes up the intelligent refrigerator, the face can be detected through the camera at the front end of the intelligent refrigerator, if the face is found to exist, the user is indicated to be in the range of the sight distance of the refrigerator, the screen of the refrigerator can be controlled, and at the moment, the screen is lightened, the intelligent level of the intelligent refrigerator can be improved, and the waste of resources is reduced.

Through the steps S202 to S206, in response to the wake-up signal of the target device, the image acquisition device corresponding to the target device is started, where the target device is an intelligent home device, and when the image acquisition device is started, the device screen of the target device is in a screen-off state; image acquisition is carried out on a target area through image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of an equipment screen; under the condition that the target part of the target object is identified from a group of acquired images, the equipment screen is awakened from the screen-off state, wherein the awakened equipment screen is in the screen-on state, the technical problem of high resource consumption in the control method of the intelligent equipment in the related technology is solved, and the resource waste of the equipment screen is reduced.

In an exemplary embodiment, before the image capturing device corresponding to the target device is started in response to the wake-up signal of the target device, the method further includes:

s11, performing voice acquisition through voice acquisition equipment corresponding to target equipment to obtain first voice data; generating a wake-up signal under the condition that a wake-up word of the target device is identified from the first voice data; or,

S12, acquiring an infrared image through target infrared equipment corresponding to target equipment to obtain a first infrared image; in case the target infrared feature is identified from the first infrared image, a wake-up signal is generated.

In this embodiment, the wake-up manner of the target device may be various, and may include, but not limited to, at least one of the following: and (5) voice awakening and infrared awakening.

As an alternative embodiment, the target device may be awakened by a voice signal. The voice signal is a signal obtained by picking up sound by a voice acquisition device (for example, a microphone array) on the target device, and the sound emitted by the person can be identified by the voice signal.

The target equipment can acquire voice through voice acquisition equipment corresponding to the target equipment to obtain first voice data, and voice recognition is carried out on the first voice data; if the wake-up word of the target device is identified from the first voice data, a wake-up signal may be generated, where the wake-up word of the target device may be a wake-up keyword set by a user, or may be a specific wake-up word.

For example, after a person around the intelligent refrigerator has a voice signal, a microphone of the intelligent refrigerator picks up the voice signal and performs wake-up recognition at the intelligent refrigerator end, and if the voice wake-up is successful (e.g., a wake-up word is recognized), the intelligent refrigerator (or a voice assistant on the intelligent refrigerator) may perform TTS (Text To Speech) broadcasting (e.g., "in woolen").

As another alternative, the target device may be awakened by infrared signals. An external device (e.g., a thermal infrared imager) may detect the presence of a person by detecting ambient infrared signals to collect a thermodynamic diagram over a range.

The target equipment can acquire an infrared image through target infrared equipment corresponding to the target equipment, obtain a first infrared image, and identify the first infrared image; if a target infrared signature is identified from the first infrared image, a wake-up signal may be generated, which may be a signature (e.g., thermodynamic value) displayed in the acquired thermodynamic diagram, or may be another signature.

For example, a thermal infrared imager on a smart refrigerator may detect ambient infrared signals at all times and generate a thermodynamic diagram based on the infrared signals, and if any point in the thermodynamic diagram exceeds a set threshold, it may be considered that an ambient living being is present, the wake-up may be successful, and the smart refrigerator (or a voice assistant on the smart refrigerator) may perform TTS broadcasting (e.g., "on the wool").

It should be noted that, the above-mentioned voice acquisition device (target infrared device) may be disposed on the target device, or may be not mounted on the target device, but may establish a connection relationship with the target device. Alternatively, a microphone (thermal infrared imager) may be located in the same location area as the target device, for example, in the same room as the intelligent refrigerator. In addition, the above-mentioned voice acquisition device (target infrared device) may be one or more, which is not limited in this embodiment.

In the related art, the voice wake-up is a precondition of a bright screen, and has strong correlation, which means that the voice wake-up must have very good recognition rate to be feasible, but in complex situations (such as strong noise, multi-person voice interference, dialect, hoarseness, etc.), the wake-up success rate is low, so that the bright screen cannot be performed, the control of a person on the screen is not facilitated, and the control of a user on equipment is very affected. The problem of narrow application range of voice awakening bright screen can be solved by awakening the equipment through infrared signals or infrared signals combined with voice signals, and the bright screen response range can be enlarged by processing various input signals simultaneously, so that intelligent perception of the equipment by a user is improved, and man-machine interaction is promoted.

Through the embodiment, the wake-up signals are triggered and generated in different modes, so that the diversity of the wake-up modes of the equipment can be improved, and the use experience of the user is improved.

s21, performing voice acquisition through voice acquisition equipment corresponding to target equipment to obtain second voice data, wherein in the process of voice acquisition through the voice acquisition equipment, target infrared equipment corresponding to the target equipment is in a closed state;

S22, under the condition that part of words in wake-up words of the target equipment are identified from the second voice data, starting the target infrared equipment to acquire an infrared image, and obtaining a second infrared image;

s23, generating a wake-up signal when the target infrared characteristic is identified from the second infrared image.

In this embodiment, the target device may perform voice acquisition through a voice acquisition device corresponding to the target device to obtain second voice data, where in the process of voice acquisition by the voice acquisition device, the target infrared device corresponding to the target device is in a closed state. The voice acquisition device and the target infrared device are similar to those in the previous embodiments, and will not be described here.

After obtaining the second voice data, the target device may perform voice recognition on the second voice data. If a partial word of the wake-up word of the target device is recognized from the second voice data, it is considered that the user may want to wake up by voice, but cannot pick up sound accurately due to influence of objective conditions (e.g., strong noise, multi-person voice interference, dialect, hoarseness of throat, etc.). In this case, the target infrared device may be activated to perform infrared image acquisition, resulting in a second infrared image.

For example, the intelligent refrigerator can acquire voice data through the set microphone, when a large amount of noise exists in the voice data acquired in the acquisition process, the intelligent refrigerator can only recognize part of wake-up words from the acquired voice data, for example, the wake-up words of the intelligent refrigerator are AABB, and AA is recognized from the acquired voice data. In this case, the intelligent refrigerator may start the thermal infrared imager of the intelligent refrigerator to perform infrared image acquisition.

Optionally, after the second infrared image is acquired, the target device may perform image recognition on the acquired second infrared image. If the target infrared characteristic is identified from the second infrared image, the target device can be determined to need to wake up, and a wake-up signal is generated. Otherwise, it may be determined that the target device does not need to wake up and does not generate a wake-up signal.

For example, if it is determined from a thermodynamic diagram acquired by a thermal infrared imager that any one point exceeds a set threshold, it can be considered that surrounding organisms are present, and the wake-up is successful.

It should be noted that, voice awakening has a coverage area farther than infrared induction (within 3 m), and can solve infrared abnormal induction conditions of pets and the like in the home. Compared with voice awakening, the infrared induction has more stable induction to the human body, and the condition of low awakening success rate under the complex condition is avoided. By combining voice wakeup with infrared wakeup, for example, parallel detection or voice detection is performed first and then infrared detection is performed when necessary, the advantages of the two can be combined, and the success rate of equipment wakeup can be improved.

According to the embodiment, under the condition that the acquired voice data cannot identify the complete wake-up word, the infrared device is started to acquire the infrared image, the infrared device can be restarted to acquire the image when needed, and the equipment wake-up success rate can be improved and the equipment wake-up resource waste can be reduced.

In one exemplary embodiment, generating the wake-up signal in the event that the target infrared feature is identified from the second infrared image comprises:

s31, carrying out temperature identification on the second infrared image, and determining the temperature value of each position point in the second infrared image;

s32, generating a wake-up signal when a position point with a temperature value larger than or equal to a target temperature value exists in the second infrared image.

Since the temperature of the human body is generally higher than the room temperature, it is possible to determine whether the infrared image has the target infrared feature according to the temperature value displayed in the infrared image. Optionally, the target device may perform temperature identification on the second infrared image, determine a temperature value of each location point in the second infrared image, and determine that the infrared image has the target infrared feature when there is a location point with a temperature value greater than or equal to the target temperature value.

For example, different temperatures in the infrared image will show different colors, an object with a high temperature will show a red color in the infrared image, and the higher the temperature, the brighter the red color in the image; the color of the object with low temperature is blue in the infrared image, and the lower the temperature is, the darker the blue in the image is, therefore, the temperature value of each position point in the infrared image can be determined through the color of the position point, and when the color of the position point exceeds the set color range, the target infrared characteristic is determined in the infrared image.

After determining the temperature values for the respective location points in the second infrared image, the temperature values for the respective location points may be compared to the target temperature values. And generating a wake-up signal when a position point with a temperature value greater than or equal to a target temperature value is detected to exist in the second infrared image.

For example, a thermal infrared imager on a smart refrigerator may detect ambient infrared signals and generate a thermodynamic diagram from the infrared signals, and if any point in the thermodynamic diagram exceeds a set threshold, generate a wake-up signal.

According to the embodiment, the temperature value of each position point in the infrared image is identified, and equipment awakening is performed based on the identified temperature value of each position point, so that the convenience of infrared feature identification can be improved, and the equipment awakening efficiency is improved.

In an exemplary embodiment, after waking up the device screen from the off-screen state, the method further includes:

s41, acquiring an infrared image through target infrared equipment corresponding to target equipment to obtain a third infrared image;

s42, switching the device screen from a bright screen state to a dead screen state under the condition that the target infrared characteristic is not recognized from the third infrared image.

In this embodiment, in order to reduce resource waste caused by that there is no target object before the device screen of the target device, but the device screen still keeps the bright screen state, after waking up the device screen from the bright screen state, the target device may acquire a third infrared image through the target infrared device corresponding to the target device periodically, and perform image recognition on the acquired third infrared image, determine whether there is a target infrared feature in the acquired third infrared image, and switch the device screen from the bright screen state to the bright screen state in the case that the target infrared feature is not identified in the third infrared image, and control the device screen to keep the bright screen state in the case that the target infrared feature is identified in the third infrared image.

Optionally, after the device screen is switched from the bright screen state to the off screen state, the target device may keep the image capturing device in the on state for a period of time, and if the target portion of the target object is identified in the image captured by the image capturing device at this time, the device screen may be directly awakened from the off screen state.

For example, after the screen of the intelligent refrigerator is lighted, the intelligent refrigerator may detect surrounding infrared signals through the infrared thermal imager and generate a thermodynamic diagram according to the infrared signals, and if the temperature of any one point in the thermodynamic diagram does not exceed a set threshold, the screen of the intelligent refrigerator may be extinguished.

According to the embodiment, after the equipment is on the screen, the state of the equipment screen is controlled based on whether the specific infrared characteristic is identified in the infrared image acquired by the infrared equipment, so that the resource waste caused by the fact that the equipment screen is kept on the screen can be reduced.

In one exemplary embodiment, in the event that a target site of a target object is identified from a set of acquired images, the control device screen transitions from an off-screen state to an on-screen state, comprising:

s51, waking up the device screen from a screen off state in the case that a target face of a target object is identified from a set of acquired images.

In this embodiment, the target portion recognized by the control device on the screen is the target face. In the case where a target face of a target object is identified from a set of acquired images, the target device may wake up the device screen from an off-screen state, which may be part or all of the target face, such as a pupil in the face or various organs in the face, etc.

By the embodiment, the device is controlled to lighten the screen based on whether the object face is detected, so that the rationality and timeliness of the device lightening screen control can be improved.

In one exemplary embodiment, waking up a device screen from an off-screen state in the event that a target site of a target object is identified from a set of acquired images includes:

s61, waking up a device screen from a screen off state under the condition that a target part is identified from N continuous acquired images of a group of acquired images, wherein N is a positive integer greater than or equal to 2; or,

s62, when the target part is identified from the continuous N acquired images of the group of acquired images and the size of the target part gradually becomes larger, waking up the equipment screen from the screen off state.

In this embodiment, the target device may wake up the device screen from the off-screen state when the target portion is identified from all of N consecutive acquired images in a set of acquired images, where N is a positive integer greater than or equal to 2. For example, N is 4, the intelligent refrigerator recognizes the face of the human body in 4 continuously acquired images, and wakes up the screen of the intelligent refrigerator from a screen-off state to a screen-on state.

Since the user is most likely not required to use the screen of the target device when the target object passes in the manner shown in fig. 4, the target site is identified in each of the N consecutive acquired images of the set of acquired images acquired by the image acquisition device, so that the screen of the device is awakened from the off-screen state. However, waking up the device screen from the off-screen state to the on-screen state consumes a lot of unnecessary resources. When the target object passes through in the manner shown in fig. 5, the user may need to use the screen of the target device, and at this time, not only the target portion is identified in the continuous N acquired images of the set of acquired images acquired by the image acquisition device, but also the size of the target portion gradually increases. Therefore, in order to more accurately control the intelligent refrigerator screen to wake up from the off-screen state to the on-screen state, the size change of the target part can be considered in the process of controlling the intelligent refrigerator screen to wake up from the off-screen state to the on-screen state.

Alternatively, the target device may wake up the device screen from the off-screen state in a case where the target portion is recognized from all of the N continuous acquired images of the set of acquired images and the size of the target portion becomes gradually larger, which means that the size of the target portion becomes larger in the acquired images due to the decrease in the distance of the target object from the image acquisition device, instead of actually changing the size.

According to the embodiment, the equipment screen is controlled according to the occurrence condition of the target part in the continuous multiple acquired images, so that the accuracy of equipment screen-lighting control can be improved.

The following explains the control method of the intelligent device in the embodiment of the present application with reference to an alternative example. In this optional example, the smart home device is a smart refrigerator, the image capturing device is a camera, the target infrared device is a thermal infrared imager, the target portion of the target object is a face of a human body, and the voice capturing device is a microphone array.

At present, intelligent refrigerators have only one bright screen mode: that is, the intelligent refrigerator is awakened by the wake-up word, so that the intelligent refrigerator is on screen, for example, the wake-up word is spoken to the intelligent refrigerator, a voice assistant on the intelligent refrigerator can speak "on the floor", and at the same time, the intelligent refrigerator screen is on, so that a user can control a screen interface (for example, open music, open a menu, etc.).

However, for environments with strong noise or in some cases (e.g., voice hoarseness after illness, etc. is not suitable for sounding), the recognition rate of voice wake-up is so low that the manner of lighting the screen by using voice wake-up intelligent refrigerator cannot be realized. Therefore, only one mode of voice awakening is not suitable for all scenes, and the awakening success rate of voice awakening is low, so that the bright screen cannot be performed, the control of a person on the screen is not facilitated, and the control of a user on the intelligent refrigerator is affected.

In order to solve the above-mentioned problem of the way of waking up the bright screen by voice, the present alternative example provides a bright screen scheme of multiple signal processing, and the bright screen of the intelligent refrigerator is controlled by using the way of inputting multiple signals, namely voice signals, infrared signals and image signals: the intelligent refrigerator is enabled to be on through voice awakening and image face detection, and is enabled to be on through infrared induction and image face detection, wherein image signals are captured through a camera and used for judging whether faces exist or not.

Here, the advantage of infrared induction combined with image face detection to control the bright screen compared with pure infrared induction control bright screen is that: when the non-human organism enters the area, the operation of lighting the screen is not triggered by mistake; in addition, when a person is not in the range of the sight distance of the camera, for example, the person is cooking, the intelligent refrigerator and the cooking range are close, the screen is always bright only based on infrared induction, and the bright screen cannot be controlled by combining infrared induction with image face detection. In addition, if the child is close to the intelligent refrigerator, but when the child is short, even if the child is on, the child cannot control the screen, the resource waste can be caused when the child is on, and the infrared induction is combined with the image face detection to control the bright screen, so that the bright screen cannot be controlled.

As shown in connection with fig. 6 and 7, the control method of the smart device in this alternative example may include the following steps:

in step S702, a voice signal is acquired through a microphone array and/or a thermodynamic diagram is acquired through a thermal infrared imager.

When the microphone array and the infrared thermal imager on the intelligent refrigerator can detect voice signals and infrared signals at the same time. If someone around the refrigerator sends out a voice signal, the voice signal is picked up by the microphone, and wake-up recognition is carried out in the intelligent refrigerator. And detecting surrounding infrared signals through an infrared thermal imager of the intelligent refrigerator to obtain a thermodynamic diagram.

Step S704, analyzing the acquired voice signal and/or thermodynamic diagram.

And analyzing the acquired voice signal, and if the wake-up word is identified from the voice signal, waking up the intelligent refrigerator. If any point in the thermodynamic diagram exceeds a set threshold, the intelligent refrigerator is awakened.

Step S706, the camera is started to detect the face, and the screen is lightened when the face is detected.

And starting the camera in a black screen state, carrying out face recognition according to the captured video frame sequence, and if the face is continuously detected to exceed N frames, considering that a person is in front of the screen, thereby lightening the screen.

Through the optional example, the problems of low wake-up success rate and the like of a single mode of waking up a bright screen by voice of the intelligent refrigerator can be solved, and more coverage areas are provided for indoor scenes.

It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present application is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.

From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM (Read-Only Memory)/RAM (Random Access Memory), magnetic disk, optical disk), comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.

According to another aspect of the embodiment of the application, a control device of an intelligent device for implementing the control method of the intelligent device is also provided. Fig. 8 is a block diagram of a control apparatus of an alternative smart device according to an embodiment of the present application, and as shown in fig. 8, the apparatus may include:

a first starting unit 802, configured to start an image acquisition device corresponding to a target device in response to a wake-up signal of the target device, where the target device is an intelligent home device, and when the image acquisition device is started, a device screen of the target device is in a screen-off state;

the first acquisition unit 804 is connected to the first starting unit 802, and is configured to acquire an image of a target area through the image acquisition device, so as to obtain a set of acquired images, where the target area is an area located in front of a screen of the device;

and the awakening unit 806 is connected with the first acquisition unit 804 and is used for awakening the equipment screen from the off-screen state when the target part of the target object is identified from a group of acquired images, wherein the awakened equipment screen is in the on-screen state.

It should be noted that, the first starting unit 802 in this embodiment may be used to perform the step S802, the first collecting unit 804 in this embodiment may be used to perform the step S204, and the wake-up unit 806 in this embodiment may be used to perform the step S206.

By the module, the image acquisition equipment corresponding to the target equipment is started in response to the wake-up signal of the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, the equipment screen of the target equipment is in a screen-off state; image acquisition is carried out on a target area through image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of an equipment screen; under the condition that the target part of the target object is identified from a group of acquired images, the equipment screen is awakened from the screen-off state, wherein the awakened equipment screen is in the screen-on state, the technical problem of high resource consumption in the control method of the intelligent equipment in the related technology is solved, and the resource waste of the equipment screen is reduced.

In an exemplary embodiment, the above apparatus further includes:

the second acquisition unit is used for carrying out voice acquisition through the voice acquisition equipment corresponding to the target equipment before the image acquisition equipment corresponding to the target equipment is started in response to the wake-up signal of the target equipment, so as to obtain first voice data;

the first generation unit is used for generating a wake-up signal under the condition that a wake-up word of the target equipment is identified from the first voice data; or,

The third acquisition unit is used for acquiring an infrared image through target infrared equipment corresponding to the target equipment to obtain a first infrared image;

and the second generation unit is used for generating a wake-up signal under the condition that the target infrared characteristic is identified from the first infrared image.

In an exemplary embodiment, the above apparatus further includes:

the fourth acquisition unit is used for acquiring voice through the voice acquisition equipment corresponding to the target equipment before the image acquisition equipment corresponding to the target equipment is started in response to the wake-up signal of the target equipment to obtain second voice data, wherein in the process of voice acquisition through the voice acquisition equipment, the target infrared equipment corresponding to the target equipment is in a closed state;

the second starting unit is used for starting the target infrared equipment to acquire an infrared image under the condition that part of words in the wake-up words of the target equipment are identified from the second voice data, so as to obtain a second infrared image;

and a third generating unit for generating a wake-up signal in case the target infrared feature is identified from the second infrared image.

In one exemplary embodiment, the third generating unit includes:

The determining module is used for carrying out temperature identification on the second infrared image and determining the temperature value of each position point in the second infrared image;

and the generating module is used for generating a wake-up signal under the condition that a position point with a temperature value larger than or equal to a target temperature value exists in the second infrared image.

In an exemplary embodiment, the above apparatus further includes:

the fifth acquisition unit is used for acquiring an infrared image through target infrared equipment corresponding to target equipment after the equipment screen is awakened from the screen-off state, so as to obtain a third infrared image;

and the switching unit is used for switching the equipment screen from the bright screen state to the off screen state under the condition that the target infrared characteristic is not recognized in the third infrared image.

In one exemplary embodiment, the wake-up unit includes:

and the first awakening module is used for awakening the device screen from the off-screen state under the condition that the target face of the target object is identified from a group of acquired images.

In one exemplary embodiment, the wake-up unit includes:

the second awakening module is used for awakening the equipment screen from a screen-off state under the condition that a target part is identified from N continuous acquired images of a group of acquired images, wherein N is a positive integer greater than or equal to 2; or,

And the third awakening module is used for awakening the equipment screen from the screen-off state under the condition that the target part is identified from the continuous N acquired images of the group of acquired images and the size of the target part is gradually increased.

It should be noted that the above modules are the same as examples and application scenarios implemented by the corresponding steps, but are not limited to what is disclosed in the above embodiments. It should be noted that the above modules may be implemented in software or in hardware as part of the apparatus shown in fig. 1, where the hardware environment includes a network environment.

According to yet another aspect of an embodiment of the present application, there is also provided a storage medium. Alternatively, in this embodiment, the storage medium may be used to execute the program code of the control method of any one of the smart devices described above in the embodiment of the present application.

Alternatively, in this embodiment, the storage medium may be located on at least one network device of the plurality of network devices in the network shown in the above embodiment.

Alternatively, in the present embodiment, the storage medium is configured to store program code for performing the steps of:

S1, responding to a wake-up signal of target equipment, and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state;

s2, image acquisition is carried out on a target area through image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of an equipment screen;

s3, waking up the equipment screen from a screen-off state under the condition that a target part of a target object is identified from a group of acquired images, wherein the wakened equipment screen is in a screen-on state.

Alternatively, specific examples in the present embodiment may refer to examples described in the above embodiments, which are not described in detail in the present embodiment.

Alternatively, in the present embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a U disk, ROM, RAM, a mobile hard disk, a magnetic disk or an optical disk.

According to still another aspect of the embodiment of the present application, there is also provided an electronic device for implementing the control method of the above-mentioned intelligent device, where the electronic device may be a server, a terminal, or a combination thereof.

Fig. 9 is a block diagram of an alternative electronic device, according to an embodiment of the present application, as shown in fig. 9, including a processor 902, a communication interface 904, a memory 906, and a communication bus 908, wherein the processor 902, the communication interface 904, and the memory 906 communicate with each other via the communication bus 908, wherein,

a memory 906 for storing a computer program;

the processor 902 is configured to execute the computer program stored in the memory 906, and implement the following steps:

Alternatively, the communication bus may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or an EISA (Extended Industry Standard Architecture ) bus, or the like. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, only one thick line is shown in fig. 9, but not only one bus or one type of bus. The communication interface is used for communication between the electronic device and other equipment.

The memory may include RAM or may include non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

As an example, the memory 906 may include, but is not limited to, a first starting unit 802, a first collecting unit 804, and a wake-up unit 806 in a control device including the smart device. In addition, other module units in the control device of the intelligent device may be included, but are not limited to, and are not described in detail in this example.

The processor may be a general purpose processor and may include, but is not limited to: CPU (Central Processing Unit ), NP (Network Processor, network processor), etc.; but also DSP (Digital Signal Processing, digital signal processor), ASIC (Application Specific Integrated Circuit ), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.

Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments, and this embodiment is not described herein.

It will be understood by those skilled in the art that the structure shown in fig. 9 is only schematic, and the device implementing the control method of the smart device may be a terminal device, and the terminal device may be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palm computer, a mobile internet device (Mobile Internet Devices, MID), a PAD, etc. Fig. 9 is not limited to the structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in fig. 9, or have a different configuration than shown in fig. 9.

Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be implemented by a program for instructing a terminal device to execute in association with hardware, the program may be stored in a computer readable storage medium, and the storage medium may include: flash disk, ROM, RAM, magnetic or optical disk, etc.

The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.

The integrated units in the above embodiments may be stored in the above-described computer-readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing one or more computer devices (which may be personal computers, servers or network devices, etc.) to perform all or part of the steps of the method described in the embodiments of the present application.

In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.

In several embodiments provided by the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution provided in the present embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or at least two units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.

Claims

1. The control method of the intelligent device is characterized by comprising the following steps:

responding to a wake-up signal of target equipment, and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state;

acquiring an image of a target area through the image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of a screen of the equipment;

And under the condition that a target part of a target object is identified from the group of acquired images, waking up the equipment screen from the off-screen state, wherein the equipment screen after waking up is in a bright-screen state.

2. The method of claim 1, wherein prior to the activating an image capture device corresponding to a target device in response to a wake-up signal of the target device, the method further comprises:

acquiring voice through voice acquisition equipment corresponding to the target equipment to obtain first voice data; generating a wake-up signal under the condition that a wake-up word of the target device is identified from the first voice data; or,

acquiring an infrared image through target infrared equipment corresponding to the target equipment to obtain a first infrared image; the wake-up signal is generated in case a target infrared feature is identified from the first infrared image.

3. The method of claim 1, wherein prior to the activating an image capture device corresponding to a target device in response to a wake-up signal of the target device, the method further comprises:

acquiring second voice data through voice acquisition equipment corresponding to the target equipment, wherein target infrared equipment corresponding to the target equipment is in a closed state in the voice acquisition process of the voice acquisition equipment;

Under the condition that part of words in wake-up words of the target equipment are identified from the second voice data, starting the target infrared equipment to acquire an infrared image, and obtaining a second infrared image;

the wake-up signal is generated if a target infrared feature is identified from the second infrared image.

4. A method according to claim 3, wherein said generating said wake-up signal in case a target infrared feature is identified from said second infrared image comprises:

carrying out temperature identification on the second infrared image, and determining the temperature value of each position point in the second infrared image;

and generating the wake-up signal under the condition that a position point with a temperature value larger than or equal to a target temperature value exists in the second infrared image.

5. The method of claim 1, wherein after the waking up the device screen from the off-screen state, the method further comprises:

acquiring an infrared image through target infrared equipment corresponding to the target equipment to obtain a third infrared image;

and switching the equipment screen from the bright screen state to the off screen state under the condition that the target infrared characteristic is not recognized in the third infrared image.

6. The method of claim 1, wherein the controlling the device screen from the off-screen state to the on-screen state if the target portion of the target object is identified from the set of acquired images comprises:

the device screen is awakened from the off-screen state upon identifying a target face of the target object from the set of captured images.

7. The method according to any one of claims 1 to 6, wherein waking up the device screen from the off-screen state in the case that a target site of a target object is identified from the set of acquired images comprises:

under the condition that the target part is identified from N continuous acquired images of the group of acquired images, waking up the equipment screen from the screen off state, wherein N is a positive integer greater than or equal to 2; or,

and waking up the equipment screen from the screen-off state under the condition that the target part is identified from the continuous N acquired images of the group of acquired images and the size of the target part gradually becomes larger.

8. The utility model provides a controlling means of smart machine which characterized in that includes:

The first starting unit is used for responding to a wake-up signal of target equipment and starting image acquisition equipment corresponding to the target equipment, wherein the target equipment is intelligent home equipment, and when the image acquisition equipment is started, an equipment screen of the target equipment is in a screen-off state;

the first acquisition unit is used for acquiring images of a target area through the image acquisition equipment to obtain a group of acquired images, wherein the target area is an area positioned in front of a screen of the equipment;

and the awakening unit is used for awakening the equipment screen from the screen-off state under the condition that the target part of the target object is identified from the group of acquired images, wherein the awakened equipment screen is in the screen-on state.

9. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program when run performs the method of any one of claims 1 to 7.

10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method according to any of claims 1 to 7 by means of the computer program.