CN115665546A

CN115665546A - Display apparatus and power saving control method

Info

Publication number: CN115665546A
Application number: CN202211177428.4A
Authority: CN
Inventors: 邵肖明; 张继栋
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-09-26
Filing date: 2022-09-26
Publication date: 2023-01-31

Abstract

The disclosure relates to a display device and an energy-saving control method, which are applied to the field of terminal control and solve the problem that in the prior art, people forget to turn off the display device after turning on the display device, so that electric energy is wasted. The display device includes: a built-in image capture device configured to: acquiring images in a first shooting range in real time; a controller configured to: acquiring a target image from an image acquired by built-in image acquisition equipment at intervals of a first preset time length, performing image recognition on the target image, updating the numerical value of a first counter when the target image does not comprise a target object, and determining that the display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold value; and controlling the display to perform countdown reminding based on the unviewed state, and controlling the display equipment to enter an energy-saving state after countdown is finished under the condition that user operation is not received.

Description

Display apparatus and power saving control method

Technical Field

The disclosure relates to the field of terminal control, and in particular, to a display device and an energy-saving control method.

Background

With the improvement of the life quality of people, the requirements on viewing experience are higher and higher, and therefore, the visual effect enhancement brought by the large-screen display equipment draws wide attention. Correspondingly, the power consumption of the screen accounts for a large proportion of the power consumption of the display device, so that the larger the screen is, the power consumption is naturally increased greatly. Therefore, an energy saving control method is required.

Disclosure of Invention

In order to solve the technical problem or at least partially solve the technical problem, the present disclosure provides a display device and an energy saving control method, which may determine that the display device is in an unviewed state when detecting that a target object is not included in a target image for multiple times, and control the display device to enter an energy saving state after countdown is finished without receiving a user operation, thereby avoiding waste of electric energy, avoiding a user's operation, and improving user experience.

In a first aspect, the present disclosure provides a display apparatus comprising:

a built-in image capture device configured to: acquiring images in a first shooting range in real time;

a controller configured to: acquiring a target image from an image acquired by the built-in image acquisition equipment at intervals of a first preset time length, performing image recognition on the target image, updating the numerical value of a first counter when the target image does not comprise a target object, and determining that the display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold value;

and controlling a display to perform countdown reminding based on the unviewed state, and controlling the display equipment to enter an energy-saving state after countdown is finished under the condition that user operation is not received.

In a second aspect, the present disclosure provides an energy saving control method, including:

acquiring a target image from an image acquired by built-in image acquisition equipment at a first preset time interval, performing image recognition on the target image, updating the numerical value of a first counter when determining that the target image does not comprise a target object, and determining that display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold value;

and controlling a display of the display equipment to perform countdown reminding based on the unviewed state, and controlling the display equipment to enter an energy-saving state after countdown is finished under the condition that user operation is not received.

In a third aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium stores thereon a computer program which, when executed by a processor, implements the energy saving control method as shown in the second aspect.

In a fourth aspect, the present disclosure provides a computer program product comprising: when the computer program product runs on a computer, the computer is caused to implement the energy saving control method as shown in the second aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: firstly, acquiring a target image at a first preset time interval from an image acquired by built-in image acquisition equipment, carrying out image recognition on the target image, updating the numerical value of a first counter when the target image does not comprise a target object, determining that display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold, then controlling a display to carry out countdown reminding based on the unviewed state, and controlling the display equipment to enter an energy-saving state after countdown is finished under the condition that user operation is not received. When the display equipment is determined to be in the non-watched state and the user operation is not received, the display equipment is controlled to enter the energy-saving state after the countdown is finished, so that the electric energy can be saved, the resource waste is avoided, the user operation is not needed, and the user experience can be improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the embodiments or technical solutions in the prior art description will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

Fig. 1 is a schematic view of an operation scenario of energy saving control according to an embodiment of the present disclosure;

fig. 2 is a block diagram of a hardware configuration of a control apparatus according to one or more embodiments of the present disclosure;

fig. 3A is a block diagram of a hardware configuration of a display device according to one or more embodiments of the present disclosure;

FIG. 3B is a diagram illustrating a software configuration in a display device according to one or more embodiments of the present disclosure;

FIG. 3C is a schematic illustration of an icon control interface display of an application in a display device according to one or more embodiments of the present disclosure;

FIG. 4 is a system framework diagram for energy-saving control in accordance with one or more embodiments of the present disclosure;

fig. 5A is a schematic flowchart of an energy saving control method according to an embodiment of the disclosure;

fig. 5B is an interaction diagram of an energy saving control process according to an embodiment of the present disclosure;

FIG. 5C is an interactive schematic diagram of another energy saving control process provided by the embodiments of the present disclosure;

fig. 5D is an interaction diagram of another energy saving control process provided by the embodiment of the disclosure;

fig. 5E is a general flowchart of an energy saving control process provided by the embodiment of the disclosure;

fig. 6A is an interface schematic diagram of an energy-saving control countdown reminding page provided in an embodiment of the present disclosure;

fig. 6B is a schematic diagram of a control process when different operations are executed for the countdown reminding page according to the embodiment of the present disclosure;

fig. 6C is a schematic diagram illustrating a principle of controlling a built-in image capturing device to capture an image in real time according to an embodiment of the present disclosure;

fig. 6D is a schematic flowchart of a process of starting the energy saving control service and performing image recognition according to an embodiment of the present disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

It should be noted that the brief descriptions of terms in the present disclosure are only for convenience of understanding of the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

It is noted that, in the present disclosure, relational terms such as "first" and "second", and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element. For example, an article or device that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not explicitly listed or inherent to such article or device.

Among display devices, smart televisions are household appliances with high popularity and utilization rate, and along with the development of science and technology, televisions with large-screen liquid crystal size of 65 inches or more gradually become mainstream. The most important power consuming component in the lcd is the backlight source, and the lcd currently uses a Light-Emitting Diode (LED) backlight source, so that the power consumption increases with the increase of the size of the lcd.

For example, the power consumption of an LCD TV of 46-52 inches is generally 256-307W, but the average power consumption of an LCD TV of 65 inches is 550-559W. Meanwhile, the brightness of the television screen is also a main influence factor influencing the power consumption of the television, and the energy consumption of the television at the brightest is nearly doubled compared with that of the television at the darkest.

In some embodiments, the volume of the television also affects the power consumption of the television.

In summary, in the case where the screen size of the display device is fixed, the power consumption can be reduced by reducing the screen brightness and sound of the display device.

Fig. 1 is a schematic view of an operation scenario of energy saving control according to an embodiment of the present disclosure. As shown in fig. 1, fig. 1 includes a control device 100, a display device 200, and an image capture device 300, and a user can control the display device 200 through the control device 100. The image capturing device 300 may include an internal image capturing device and an external image capturing device. The built-in image acquisition device is an image acquisition device configured for the display device itself, such as a built-in camera or a radar. The external image acquisition equipment is the image acquisition equipment that can external to display device, for example, external camera or external radar etc..

In fig. 1, in a (television watching) scene a, a user sits in a photographable range of the image capturing apparatus 300 to watch television, the image capturing apparatus 300 may capture images in real time at a fixed number of frames per second (e.g., 60 frames/s), and the controller of the display apparatus 200 performs image recognition on the images captured by the image capturing apparatus 300 to determine whether a target object is included in the images. In order to reduce the pressure of a Central Processing Unit (CPU), image recognition is not performed on each frame of image acquired by the image acquisition device 300, but a target image is acquired at intervals of a first preset duration (for example, at intervals of 50 ms) from the image acquired by the image acquisition device 300, and image recognition is performed on the target image. The first preset time interval may be a self-defined value, or may be determined according to a specific situation, and this embodiment is not limited.

In scene B, when the user leaves the range in which the image capturing apparatus 300 can capture, the controller determines that the display apparatus 200 is in the non-watched state, controls the display to perform countdown reminding based on the non-watched state, and controls the display apparatus 200 to enter the energy saving state after countdown is finished if the user operation is not received.

In order to reduce the CPU stress of the display apparatus 200, it is possible to acquire target images at second preset-duration intervals (e.g., 200ms intervals) from the images acquired by the image acquisition apparatus 300 after the display apparatus 200 enters the power-saving state, perform image recognition, and acquire target images at third preset-duration intervals (e.g., 1 minute intervals) from the images acquired by the image acquisition apparatus 300 and perform image recognition on the target images after the display apparatus 200 exits the power-saving state.

The second preset duration interval and the third preset duration interval may be self-defined values, or may be determined according to specific situations, but this embodiment is not limited thereto, but it needs to be satisfied that the third preset duration interval is greater than the second preset duration interval, and the second preset duration interval is greater than the first preset duration interval.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device 200 may include infrared protocol communication, bluetooth protocol communication, wireless or other wired methods, and the like, by which the display device 200 can be controlled. The user may input a user command through a key on a remote controller, a voice input, a control panel input, and the like to control the display apparatus 200.

In some embodiments, the display device 200 may also be controlled using mobile terminals, tablets, computers, laptops, and other smart devices.

In some embodiments, the mobile terminal may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. And the audio and video content displayed on the mobile terminal can be transmitted to the display device 200, so that the synchronous display function is realized. The display apparatus 200 may also be in data communication with a server through various communication means, which may allow the display apparatus 200 to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server may be a cluster or a plurality of clusters, and may include one or more types of servers. The server may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, or a projection display device, etc. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

Fig. 2 is a block diagram of a hardware configuration of a control apparatus according to one or more embodiments of the present disclosure. As shown in fig. 2, the control apparatus includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply source. The control apparatus may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display apparatus 200, serving as an interaction intermediary between the user and the display apparatus 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 3A is a block diagram of a hardware configuration of a display device according to one or more embodiments of the present disclosure. As shown in fig. 3A, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through wired or wireless reception and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. Communicator 220 is a component for communicating with servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the server through the communicator 220. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for controlling devices, such as infrared remote controls, etc.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.

Fig. 3B is a schematic diagram of a Software configuration in a display device according to one or more embodiments of the present disclosure, and as shown in fig. 3B, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), a Software Development Kit (SDK) layer, an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.

In this embodiment, the application layer is mainly used for image acquisition device management, image acquisition, resource management, television control, task queue, algorithm frequency control, and the like. The image acquisition equipment management can comprise camera opening, camera closing, camera idle state monitoring and the like. And the image acquisition is used for acquiring an image which accords with the specified format of the image recognition algorithm in the camera and transmitting the image to the SDK layer. And resource management, which is used for monitoring the television CPU memory, monitoring the idle state of the camera and the like. And the television control is used for calling a system interface according to the condition that the display equipment is in the unviewed state or the watched state, and controlling the television to enter the energy-saving state or exit the energy-saving state. And the task queue encapsulates the called image recognition algorithm SDK into tasks and puts the tasks into the task queue to manage the tasks. And the algorithm frequency control is used for adjusting the preset time interval (such as a first preset time interval, a second preset time interval, a third preset time interval and the like) according to the busy condition of the CPU memory of the television, so as to adjust the identification frequency of the image identification algorithm.

In some embodiments, the SDK layer may encapsulate an image processing algorithm, an image recognition model, and a recognition result, is mainly used for image processing, image recognition, result processing, and the like, and may further extend a service access interface to the outside. The application layer can call an image recognition algorithm through an interface and return a recognition result.

In some embodiments, the framework layer may include a Convolutional structure for Fast Feature Embedding (Caffe), tensorFlow, and the like.

In some embodiments, the kernel layer is a layer between hardware and software, and may include: an embedded Neural-Network Processing Unit (NPU), a CPU, a Graphics Processing Unit (GPU), and the like, and further includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Fig. 3C is a schematic diagram of an icon control interface display of an application program in a display device according to one or more embodiments of the present disclosure, as shown in fig. 3C, an application layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video-on-demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. The media center application program can provide various applications for playing multimedia contents. The application program center can provide and store various application programs.

In some embodiments, the display device is a terminal device with a display function, such as a television, a mobile phone, a computer, a learning machine, and the like. The display device includes:

a communicator 220 for communicating with a server;

a controller configured to: acquiring a target image from an image acquired by the built-in image acquisition equipment at a first preset time interval, performing image recognition on the target image, updating the numerical value of a first counter when the target image does not comprise a target object, and determining that the display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold value;

In some embodiments, the controller 250 is further configured to:

after the display device enters an energy-saving state, acquiring a target image at a second preset time interval from an image acquired by the built-in image acquisition device, performing image recognition on the target image, updating the value of a second counter until the target image comprises the target object, continuously acquiring the target image at a first preset time interval, updating the value of the second counter until the value of the second counter is greater than a second threshold value when the target image comprises the target object, and determining that the display device is in a watched state, wherein the second preset time interval is greater than the first preset time interval;

controlling the display device to exit the power saving state based on the viewed state.

In some embodiments, the controller 250 is further configured to:

after the display device exits the energy-saving state, performing zero clearing on the first counter, acquiring a target image from an image acquired by the built-in image acquisition device at a third preset time interval, performing image recognition on the target image, updating the value of the first counter until the target image does not include the target object, continuously acquiring the target image at the first preset time interval, updating the value of the first counter when the target image does not include the target object, and determining that the display device is in an unviewed state until the value of the first counter is greater than the first threshold, wherein the third preset time interval is greater than the second preset time interval;

and controlling a display to perform countdown reminding based on the unviewed state, and controlling the display equipment to enter the energy-saving state after countdown is finished under the condition that user operation is not received.

In some embodiments, the controller 250 is further configured to:

and after the display equipment enters the energy-saving state, carrying out zero clearing treatment on the second counter.

In some embodiments, the controller 250 is specifically configured to:

performing image recognition on the target image to obtain the similarity between each object in the target image and the target object;

determining that the target object is not included in the target image based on the similarity.

In some embodiments, the user operation includes canceling a target operation of entering the power saving state;

a controller 250 further configured to:

and receiving the target operation before the countdown is finished, and controlling the display equipment to keep the current state.

In some embodiments, the controller 250 is further configured to:

when an external image acquisition device is inserted into the display device, if a mounting broadcast sent by the external image acquisition device is received, acquiring a device list, wherein the external image acquisition device is configured on the display;

and according to the equipment nodes in the equipment list, when the external image acquisition equipment exists, acquiring images in a second shooting range in real time through the external image acquisition equipment.

In some embodiments, the controller 250 is specifically configured to:

calling a target function in a system of the display equipment to acquire the use state of the built-in image acquisition equipment;

and controlling the built-in image acquisition equipment to acquire the image in the first shooting range in real time when the built-in image acquisition equipment is determined to be in an idle state according to the using state of the built-in image acquisition equipment.

To sum up, the present disclosure performs the above energy saving control method on a display device, and first obtains a target image at a first preset time interval from an image collected by a built-in image collection device, performs image recognition on the target image, and when it is determined that the target image does not include a target object, updates a numerical value of a first counter until the numerical value of the first counter is greater than a first threshold, determines that the display device is in an unviewed state, and then controls a display to perform countdown reminding based on the unviewed state, and controls the display device to enter an energy saving state after countdown is finished without receiving a user operation, in which, in the above method, energy saving control on the display device can be automatically implemented by the built-in image collection device and the controller, which is specifically: when the display equipment is determined to be in the non-watched state and the user operation is not received, the display equipment is controlled to enter the energy-saving state after the countdown is finished, so that the electric energy can be saved, the resource waste is avoided, the user operation is not needed, and the user experience can be improved.

Fig. 4 is a system framework diagram for performing energy-saving control according to one or more embodiments of the present disclosure, and as shown in fig. 4, the system may include an image acquisition module 401, a state determination module 402, a reminder module 403, and a control module 404. The image obtaining module 401 is configured to obtain a target image at a first preset time interval from an image collected by an image collecting device (which may include an internal image collecting device and an external image collecting device), the state determining module 402 is configured to perform image recognition on the target image, update a numerical value of a first counter when it is determined that the target image does not include a target object, determine that the display device is in an unviewed state when the numerical value of the first counter is greater than a first threshold, control the display device to perform countdown reminding based on the unviewed state, and control the display device to enter an energy saving state after countdown is finished when a user operation is not received by the control module 404. Among the above-mentioned technical scheme, can realize the energy-conserving control to display device automatically through built-in image acquisition equipment and controller, specifically do: when the target object is not included in the target image, the display equipment is determined to be in the non-watched state, and under the condition that the user operation is not received, the display equipment is controlled to enter the energy-saving state after the countdown is finished, so that the waste of electric energy is avoided, the user operation is not needed, and the use experience of the user can be improved.

For more detailed description of the energy saving control scheme in the present disclosure, the following description is made in an exemplary manner with reference to fig. 5A, and it is understood that the steps involved in fig. 5A may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so as to enable the energy saving control method provided in the embodiment of the present disclosure, and the embodiment of the present disclosure is not limited.

Fig. 5A is a schematic flowchart of an energy saving control method according to an embodiment of the present disclosure. The present embodiment is applicable to the description of the process of controlling the display device to enter the power saving state when the display device is detected to be in the unviewed state. As shown in fig. 5A, the energy-saving control method specifically includes the following steps:

s510, acquiring a target image at a first preset time interval from an image acquired by built-in image acquisition equipment, performing image recognition on the target image, updating the numerical value of a first counter when the target image does not comprise a target object, and determining that the display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold value.

The built-in image acquisition device is an image acquisition device configured for the display device itself, such as a built-in camera or a radar. The first preset duration interval may be a self-defined value, for example, an interval of 50ms, or may be determined according to a specific situation, and this embodiment is not limited thereto. The target image may be understood as an image extracted by the controller of the display device from the image captured by the built-in image capturing device each time according to a certain condition. The first photographing range may be understood as a maximum range that the built-in image capture device can photograph. The target object may be understood as an object having a human body feature such as a human body, a human face, or the like. The first counter is used for counting the times of not including the target object. The first threshold may be a preset value, and generally the value is an integer greater than 1, for example, 5, and the present embodiment is not limited as the case may be.

Illustratively, if the first preset duration interval is an interval of 50ms, the controller of the display device is equivalent to acquiring a target image from an image acquired by the built-in image acquisition device every 50 ms.

Because the built-in image acquisition equipment acquires images in the first shooting range in real time, the acquired images are more, and if each acquired frame of image is subjected to subsequent image identification, the pressure of a CPU is increased, so that the resource waste is caused. Therefore, in this embodiment, the controller of the display device acquires the target image from the image acquired by the built-in image acquisition device at the first preset time interval, and performs image recognition on the target image, and specifically, the controller may detect an object included in the target image by using an image recognition algorithm, a human body detection algorithm, and other methods, so as to determine whether the target image includes the target object. When the target object is not included in the target image, it may be understood that the current target image does not include an object having a human body feature, and at this time, the controller of the display device updates the value of the first counter, specifically, the value of the first counter is increased by 1 until the value of the first counter is greater than the first threshold, which indicates that the target object is not included in the target image for multiple times, and it can be determined that the display device is in an unviewed state, that is: at present, no person watches the display device, so that the problem that a user leaves the first shooting range of the built-in image acquisition device for a short time (with extremely short time) or the image identification result is inaccurate is avoided.

It can be understood that the target images are acquired from the images acquired by the built-in image acquisition device at intervals of the first preset time length, and the target images are subjected to image recognition, so that whether the display device is in an unviewed state or not can be judged at high speed, and the efficiency and the accuracy are improved.

And S520, controlling the display to perform countdown reminding based on the unviewed state, and controlling the display equipment to enter an energy-saving state after countdown is finished under the condition that user operation is not received.

The duration of the countdown reminding may be a preset value, for example, 5 minutes, or may be determined according to a specific situation, and this embodiment is not limited. The energy-saving state can be understood as a standby state, under the state, the screen brightness and the volume of the display device are the lowest, electric energy can be saved, and meanwhile, when the display device is detected to be in a watched state in the follow-up process, the display device can exit from the energy-saving state quickly, so that a user can watch the display device conveniently.

After the controller of the display equipment determines that the display equipment is in the non-watched state, based on the non-watched state, the controller controls the display to perform countdown reminding, the countdown reminding can remind a user that the display equipment can enter the energy-saving state after countdown is finished, and in the countdown reminding stage, if the user operation is not received, the controller directly controls the display equipment to enter the energy-saving state after countdown is finished, so that the waste of electric energy is avoided when no one watches the display equipment.

In this embodiment, the energy-saving control of the display device can be automatically realized through the built-in image acquisition device and the controller, specifically: when the target object is not included in the target image, the display equipment is determined to be in the non-watched state, and under the condition that the user operation is not received, the display equipment is controlled to enter the energy-saving state after the countdown is finished, so that the waste of electric energy is avoided, the user operation is not needed, and the use experience of the user can be improved.

Fig. 5B is an interaction diagram of an energy saving control process according to an embodiment of the present disclosure. The process of controlling the display device to enter the energy saving state through the interaction between the built-in image capturing device and the controller shown in fig. 5B has been described in detail in the foregoing embodiments, and is not repeated herein to avoid repetition.

In some embodiments, after the controlling the display device enters the energy saving state after the countdown is finished, the controlling the display device may further include:

acquiring a target image at a second preset time interval from an image acquired by the built-in image acquisition equipment, performing image recognition on the target image until the target image comprises the target object, updating the value of a second counter, continuously acquiring the target image at a first preset time interval, updating the value of the second counter when the target image comprises the target object, and determining that the display equipment is in a watched state until the value of the second counter is greater than a second threshold value, wherein the second preset time interval is greater than the first preset time interval;

The second preset duration interval may be a self-defined value, for example, an interval of 200ms, or may be determined according to specific situations, which is not limited in this embodiment, but it needs to be satisfied that the second preset duration interval is greater than the first preset duration interval. The second counter is used for counting the number of times the target object is included. The second threshold may be a preset value, generally, the value is an integer greater than 1, for example, 6, and may also be determined according to the specific situation, and the second threshold and the first threshold may be equal or may not be equal, which is not limited in this embodiment.

Specifically, after the display device enters the energy saving state, in order to reduce the pressure of the CPU, the controller of the display device acquires the target image at a second preset time interval greater than the first preset time interval, and performs image recognition on the target image until it is determined that the target image includes the target object, which indicates that the current target image includes an object having human body features, and at this time, updates the value of the second counter, specifically, may be to add 1 to the value of the second counter. Meanwhile, in order to accelerate the judgment of whether the display device is in the watched state, the controller of the display device continues to acquire the target image at a first preset time interval, and when it is determined that the target image includes the target object, the value of the second counter is updated, specifically, the value of the second counter is incremented by 1 until the value of the second counter is greater than a second threshold, which indicates that the target object is detected in the target image for multiple times, and it can be determined that the display device is in the watched state, that is: currently someone is watching the display device. Accordingly, the controller of the display device controls the display device to exit the energy-saving state based on the watched state, thereby avoiding the user from manually exiting the energy-saving state when the user wants to watch the display device.

In the embodiment, through the scheme, when the display device is determined to be switched from the watched state to the watched state, the energy-saving state can be automatically exited without the operation of a user, and the use experience of the user is further improved.

Fig. 5C is an interaction diagram of another energy saving control process provided by the embodiment of the present disclosure. The process shown in fig. 5C for controlling the display device to automatically exit the energy-saving state when it is determined that the display device is switched from the unviewed state to the watched state through the interaction between the built-in image capture device and the controller is described in detail in the foregoing embodiments, and therefore, in order to avoid repetition, details are not repeated here.

In some embodiments, optionally, after the controlling the display device to exit the energy saving state, the method may further include:

performing zero clearing on the first counter, acquiring a target image at a third preset time interval from an image acquired by the built-in image acquisition device, performing image recognition on the target image, updating the value of the first counter until the target image does not include the target object, continuously acquiring the target image at the first preset time interval, updating the value of the first counter when the target image does not include the target object, determining that the display device is in an unviewed state until the value of the first counter is greater than the first threshold, wherein the third preset time interval is greater than the second preset time interval;

The third preset time interval may be a self-defined value, for example, an interval of 1 minute, or may be determined according to specific situations, which is not limited in this embodiment, but it needs to be satisfied that the third preset time interval is greater than the second preset time interval.

Specifically, after the display device exits the energy-saving state (i.e., the normal viewing state), the first counter is cleared, so that the influence on updating the value of the first counter when the target object is determined not to be included in the target image is avoided, and the accuracy of the value of the first counter can be ensured. In order to reduce the pressure of the CPU and not affect normal viewing of the user, the controller of the display device acquires the target image at a third preset time interval that is greater than the second preset time interval, performs image recognition on the target image until it is determined that the target image does not include the target object, which indicates that the current target image does not include an object with human features, and updates the value of the first counter at this time, which may be specifically a value obtained by adding 1 to the value of the first counter. Meanwhile, in order to accelerate the determination of whether the display device is in the unviewed state, the controller of the display device continues to acquire the target image at a first preset time interval, and when it is determined that the target image does not include the target object, the value of the first counter is updated, specifically, the value of the first counter is incremented by 1 until the value of the first counter is greater than the first threshold, which indicates that the target object is detected to be not included in the target image for multiple times, and then it can be determined that the display device is in the unviewed state, that is: no one is currently watching the display device. Correspondingly, the controller of the display equipment controls the display to perform countdown reminding based on the unviewed state, and in the countdown reminding stage, if the user operation is not received, the display equipment is directly controlled to enter the energy-saving state after countdown is finished.

In this embodiment, according to the above scheme, when it is determined that the display device is switched from the watched state to the unviewed state, the display device can automatically enter the energy-saving state, so that electric energy is saved, operation by a user is not required, and use experience of the user is improved.

For example, fig. 5D is an interaction diagram of another energy saving control process provided in the embodiment of the present disclosure. The process of controlling the display device to automatically enter the energy saving state when determining that the display device is switched from the watched state to the unviewed state through the interaction between the built-in image capture device and the controller shown in fig. 5D has already been described in detail in the foregoing embodiments, and is not repeated here to avoid repetition.

In some embodiments, optionally, the method may further specifically include:

and after the display equipment enters the energy-saving state, carrying out zero clearing processing on the second counter.

In this embodiment, after the display device enters the energy saving state, the second counter needs to be cleared, so as to avoid affecting subsequent updating of the value of the second counter when the target object is included in the determined target image, thereby ensuring the accuracy of the value of the second counter and ensuring that the viewed state of the display device is accurate.

For example, fig. 5E is a general flowchart of an energy saving control process provided by the embodiment of the disclosure. As shown in fig. 5E, after controlling the display device to enter the energy saving state after the countdown is finished, the method further includes: determining whether the numerical value of the second counter is 0, if the numerical value of the second counter is 0, acquiring a target image at a second preset time interval, performing image recognition on the target image, updating the numerical value of the second counter until the target image is determined to comprise a target object, and returning to execute the acquisition of the target image at the first preset time interval; and if the numerical value of the second counter is not 0, carrying out zero clearing treatment on the second counter, then executing acquisition of the target image at a second preset time interval, carrying out image recognition on the target image, updating the numerical value of the second counter until the target image is determined to comprise the target object, and returning to execute acquisition of the target image at the first preset time interval.

Correspondingly, the controller of the display device acquires the target image at a first preset time interval, performs image recognition on the target image, and updates the numerical value of the second counter when the target image comprises the target object, until the numerical value of the second counter is greater than the second threshold value, and the display device is determined to be in the watched state. Then determining whether the essence of the first counter is 0, if the value of the first counter is 0 (or if the value of the first counter is not 0, performing zero clearing processing on the first counter), then acquiring a mark of an energy-saving state, determining whether the display device is in the energy-saving state currently according to the mark, if the display device is in the energy-saving state, exiting the energy-saving state, acquiring a target image at a third preset time interval, performing image recognition on the target image, updating the value of the first counter until the target image is determined not to include a target object, and returning to execute the acquisition of the target image at the first preset time interval; and if the target image is not in the energy-saving state, acquiring the target image at a third preset time interval, performing image recognition on the target image until the target image does not comprise the target object, updating the numerical value of the first counter, and returning to execute the acquisition of the target image at the first preset time interval.

It should be noted that: the rest of the processes have already been described in detail in the above embodiments, and are not repeated here to avoid repetition.

In some embodiments, optionally, the performing image recognition on the target image, and determining that the target image does not include the target object, may specifically include:

The preset threshold may be a preset value, for example, 60%, or may be determined according to a specific situation, and this embodiment is not limited.

Specifically, image recognition is performed on a target image through an image recognition algorithm or a human body detection algorithm and the like, so that the similarity between each object in the target image and a target object can be obtained, and according to the numerical value of each similarity, for each similarity, if the similarity is greater than a preset threshold value, it is indicated that the object corresponding to the similarity is the target object; if the similarity is smaller than or equal to a preset threshold value, it is indicated that the object corresponding to the similarity is not the target object. Therefore, based on the similarity, it can be determined that the target object is not included in the target image.

In this embodiment, the target image can be subjected to image recognition by the above method, and it is further determined that the target image does not include the target object, so that the subsequent step of updating the value of the first counter is performed conveniently until the value of the first counter is greater than the first threshold, and the step of determining that the display device is in the unviewed state is performed, and meanwhile, whether the target image recognition is accurate or not further affects the subsequent step of determining whether the display device is in the unviewed state or not.

For example, fig. 6A is an interface schematic diagram of an energy saving control countdown reminding page provided in an embodiment of the present disclosure. The controller of the display device can control the display to perform countdown reminding based on the unviewed state, specifically, the countdown for 5 minutes is started by the controller of the display device, and a reminding page as shown in fig. 6A pops up when the countdown is finished by 15s, where the reminding page includes cancellation and unavailability within a fourth preset time. The cancellation is used for canceling entering the energy-saving state, and the cancellation is unavailable within a fourth preset time length and is used for stopping obtaining the target image within the fourth preset time length and carrying out image recognition. The fourth preset time period may be a self-defined value, for example, 1 hour, or may be determined according to specific situations, and this embodiment is not limited. The 15s at the upper right corner is a time reminder, and the value of the time reminder is continuously reduced along with the change of time until the value is 0.

Through the reminding page shown in fig. 6A, whether the user enters the energy-saving state or not can be reminded, and the error of the image recognition result and the misjudgment caused when the user watches the television outside the first shooting range of the built-in image acquisition device are avoided. And if the user operation is not received, the controller of the display equipment automatically closes the reminding page after 15s, and controls the display equipment to automatically enter the energy-saving state.

It can be understood that: both 5 minutes and 15s are custom values and are not intended to be limiting.

In some embodiments, optionally, the user operation includes canceling a target operation of entering the energy saving state;

the method may further specifically include:

The target operation may be understood as an operation triggered by a user to cancel entering the energy saving state.

In this embodiment, the controller of the display device receives an operation triggered by the user to cancel entering the energy saving state before the countdown is finished, and then controls the display device to keep the current state, so that the user experience can be further improved, and errors in the image recognition result and misjudgments caused when the user watches the television outside the first shooting range of the built-in image acquisition device are avoided.

Fig. 6B is a schematic diagram of a control process when different operations are executed for a countdown reminding page according to an embodiment of the present disclosure. Specifically, after the controller of the display device starts countdown, the display pops up a countdown reminding page, if the controller of the display device does not receive user operation, the page is closed after the countdown is finished, and the display device enters an energy-saving state; if the controller of the display equipment receives the target operation, closing the page, and keeping the current state of the display equipment; and if the controller of the display equipment receives the operation that the fourth preset time length is unavailable, stopping acquiring the target image, starting countdown of the fourth preset time length, continuing to acquire the target image at the first preset time length interval after the countdown of the fourth preset time length is finished, and performing image recognition on the target image.

In some embodiments, optionally, the method may further specifically include:

Wherein, external image acquisition equipment is the image acquisition equipment that can external to display device, for example, external camera or external radar etc.. The second shooting range can be understood as the maximum range that the external image capturing device can shoot. The device list records devices included in the display device itself and external devices.

Specifically, the external image acquisition device may be connected to the display device, and the external image acquisition device may be configured on the display device to acquire images in real time. When the external image acquisition equipment is inserted into the display equipment, the external image acquisition equipment can send a mounting broadcast to the display equipment generally, if the mounting broadcast sent by the external image acquisition equipment is received by a controller of the display equipment, an equipment list is obtained, whether a video recorder node is included in the equipment list or not is determined according to equipment nodes in the equipment list, if the video node is included, the external image acquisition equipment is determined to exist, and at the moment, the image in a second shooting range can be acquired in real time through the external image acquisition equipment.

In some embodiments, the device list may be maintained under a system/dev directory.

In some embodiments, when the controller of the display device determines that an external image capture device is present, a broadcast inserted by the external image capture device may be registered, the broadcast acting to: when the external image acquisition equipment is mounted on a system of the display equipment, image acquisition can be started. There are two situations for triggering the broadcast of the external image acquisition device mounting: 1. when the display equipment is started, the application layer receives a starting broadcast, the external image acquisition equipment is not mounted to the system, and the mounting broadcast of the external image acquisition equipment is received after the energy-saving control service is started; 2. after the display equipment is started, when a user actively inserts the external image acquisition equipment into the display equipment, the application layer receives the mounting broadcast of the external image acquisition equipment.

In the embodiment, the image acquisition can be carried out through the external image acquisition equipment, so that the subsequent image identification process is facilitated.

In some embodiments, optionally, the method may further specifically include:

The target function can be a pre-programmed ondviceStatusChanged function which can record the use state of the image acquisition device. The target function is a function in a pre-written program for determining the use state of the image acquisition device.

Specifically, the image acquisition device is a shared resource of the display device system, other applications in the system can also use the resource, the mechanism for allocating the image acquisition device resource by the operating system is a preemption mechanism, the applications can preempt each other, and when the image acquisition device is used by other applications, the image acquisition device cannot be preempted any more, so that the use of the image acquisition device by other applications is prevented from being interrupted. Therefore, the controller of the display device needs to call an objective function in the system of the display device so as to acquire the use state of the built-in image capture device, and then, according to the use state of the built-in image capture device, the built-in image capture device is controlled to capture the image in the first shooting range in real time when the built-in image capture device is determined to be in the idle state.

Correspondingly, after the controller of the display device calls the target function in the system of the display device, the use state of the external image acquisition device can be acquired, and then the external image acquisition device is controlled to acquire the image in the second shooting range in real time when the external image acquisition device is determined to be in the idle state according to the use state of the external image acquisition device.

In this embodiment, the use state of the image acquisition device is first obtained by the method, and then the internal image acquisition device or the external image acquisition device is controlled to acquire images in real time when the internal image acquisition device or the external image acquisition device is in an idle state, so that the target images can be acquired subsequently, image recognition can be performed, and interruption of use of the image acquisition device by other applications can be avoided.

Fig. 6C is a schematic diagram illustrating a principle of controlling a built-in image capturing device to capture an image in real time according to an embodiment of the present disclosure. The process of controlling the built-in image capturing device to capture images in real time shown in fig. 6C has been described in detail in the above embodiments, and is not repeated here to avoid repetition.

For example, fig. 6D is a schematic flowchart of a process of starting the energy saving control service and performing image recognition according to an embodiment of the present disclosure. As shown in fig. 6D, after the display device is powered on, the display device sends a power-on broadcast to the application layer, and after the application layer receives the power-on broadcast, the application layer determines whether to start the energy-saving control switch, where the energy-saving control switch may be a switch provided in the display device, and after the switch is turned on, the subsequent energy-saving control operation may be performed, and when the switch is turned off, the subsequent energy-saving control operation may not be performed. Therefore, after the energy-saving control switch is started, the display device starts the energy-saving control service, and acquires the device list to determine whether there is an image capturing device, and in the case that there is an image capturing device, determines whether the image capturing device is in an idle state, if the image capturing device is not in the idle state, the display device continues to determine whether the image capturing device is in the idle state after delaying the first time period until the image capturing device is in the idle state, and opens the image capturing device in the idle state to enable the image capturing device to capture an image in real time, and then acquires a target image, performs image recognition to obtain a recognition result, where the recognition result includes two cases, that the target image does not include a target object and the target image includes the target object, and subsequent processes have been described in detail in the above embodiments, and are not repeated here.

It should be noted that: the first duration may be a preset value, for example, 5s, or may be determined according to specific situations, and this embodiment is not limited.

It can be understood that: the image acquisition devices can be multiple, so that when multiple image acquisition devices are in an idle state, images can be acquired in real time through any one image acquisition device.

The disclosed embodiment provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements each process executed by the above energy saving control method, and can achieve the same technical effect, and is not described herein again to avoid repetition.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product comprising: when the computer program product runs on a computer, the computer is caused to implement the energy saving control method described above.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

2. The display device of claim 1, wherein the controller is further configured to:

3. The display device of claim 2, wherein the controller is further configured to:

4. The display device of claim 3, wherein the controller is further configured to:

5. The display device according to claim 1, wherein the controller is configured to:

6. The display device according to claim 1, wherein the user operation includes a target operation of canceling entry into the power saving state;

the controller further configured to:

7. The display device according to claim 1, wherein the controller is further configured to:

8. The display device according to claim 1, wherein the controller is configured to:

and controlling the built-in image acquisition equipment to acquire the image in the first shooting range in real time when the built-in image acquisition equipment is determined to be in an idle state according to the use state of the built-in image acquisition equipment.

9. An energy saving control method, comprising:

acquiring a target image from an image acquired by built-in image acquisition equipment at intervals of a first preset time length, performing image recognition on the target image, updating the numerical value of a first counter when determining that the target image does not comprise a target object, and determining that display equipment is in an unviewed state until the numerical value of the first counter is greater than a first threshold value;

10. The method of claim 9, wherein after controlling the display device to enter the power saving state after the countdown is over, further comprising: