CN112825560B - Display device and video image display method - Google Patents
Display device and video image display method Download PDFInfo
- Publication number
- CN112825560B CN112825560B CN201911144104.9A CN201911144104A CN112825560B CN 112825560 B CN112825560 B CN 112825560B CN 201911144104 A CN201911144104 A CN 201911144104A CN 112825560 B CN112825560 B CN 112825560B
- Authority
- CN
- China
- Prior art keywords
- user
- display
- video image
- pause
- watching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Abstract
The embodiment of the invention provides a display device and a video image display method, wherein the device comprises: the display is used for displaying and playing the video image; the camera device is used for collecting user image information of a watching area, and the watching area is positioned in front of the display; a controller configured to: when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user; if yes, controlling the display to pause playing the first video image. The user controls the display to display or pause playing of the first video image through the preset gesture, viewing and control experience of the user is improved, and electric energy waste in the remote controller caused by the fact that the display is controlled to pause through the remote controller is avoided.
Description
Technical Field
The embodiment of the invention relates to the field of displays, in particular to a display device and a video image display method.
Background
With the development of displays, the functions of the displays are more and more abundant, and the dependence of home users on the displays is increasing day by day.
Currently, a home user can control the display to turn on, play, pause, or turn off through a remote controller. In practical applications, when a plurality of people watch a current television program played by the display, only a user with the remote controller can control the display, and in the process, the display is controlled by the remote controller, so that the electric energy in the remote controller is wasted. Further, when a plurality of people watch the current television program played by the display, if some users leave (do not watch the television), the display can continue to play the current television program, and the current television program cannot be paused or continuously played according to the playing node when the users leave, so that the user experience is poor.
Disclosure of Invention
The embodiment of the invention provides display equipment and a video image display method, which are used for improving the efficiency and convenience of controlling a display by a special user.
In a first aspect, an embodiment of the present invention provides a display device, including:
the display is used for displaying and playing the video image;
the camera device is used for collecting user image information of a watching area, and the watching area is positioned in front of the display;
a controller configured to:
when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
if yes, controlling the display to pause playing the first video image.
In one possible design, comprising: the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of watching video images by a user, the historical pause information comprises user watching pause nodes, and the user watching pause nodes comprise user identifications, video image identifications and video image pause moments, wherein the user identifications, the video image identifications and the video image pause moments correspond to one another in pairs;
the controller is further configured to: when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
if not, after the first user is determined to be the preset user, recording the user watching pause node of the first user as a first identifier comprising a first video image and a first video image pause moment, wherein the first video image pause moment is the moment when the first user leaves.
In one possible design, comprising:
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of watching video images by a user, the historical pause information comprises user watching pause nodes, and the user watching pause nodes comprise user identifications, video image identifications and video image pause moments, wherein the user identifications, the video image identifications and the video image pause moments correspond to one another in pairs;
the controller is further configured to:
when the display displays and plays the first video image, after detecting that the first user in the watching area leaves the watching area according to the user image information, if determining that no other user exists in the watching area,
recording a user viewing pause node of the first user as a first identifier comprising a first video image and a first video image pause time, and controlling the display to be closed, wherein the first video image pause time is the time when the first user leaves.
In one possible design, the controller is further configured to:
after the leaving time length of the first user is determined to be smaller than the preset time length, if it is determined that a second user enters the watching area within the preset time length, whether the second user is the same as the first user is judged;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, after the viewing pause node of the second user exists in the historical pause information, the display is controlled to display the second video image at the pause moment of the second video image included in the viewing pause node of the second user, and after the viewing pause node of the second user does not exist in the historical pause information, the display is controlled to display the favorite video image of the second user.
In one possible design, after controlling the display to pause playing the first video image, the controller is further configured to:
judging whether the first user enters the watching area or whether the gesture which is the same as the second preset gesture is made by the user exists in other members;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, the display is controlled to pause playing the first video image.
In one possible design, the controller is further configured to:
when the display displays the first video image, after a third user in the watching area is detected to enter the watching area according to the user image information, if the third user is detected to be the highest priority user in the watching area, whether the third user makes a gesture which is the same as a third preset gesture is judged;
if yes, after the fact that the watching pause node of the third user exists in the historical pause information is determined, the display is controlled to display the third video image at the pause moment of the third video image included in the watching pause node of the third user, and after the fact that the watching pause node of the third user does not exist in the historical pause information is determined, the display is controlled to display the favorite video image of the third user.
In one possible design, before the display displays the first video image, the controller is further configured to:
when the display is closed, judging whether the watching area comprises X users or not according to the user image information;
if yes, after the X users are determined to comprise Y preset users, when the fact that one preset user has the watching behavior is detected in the Y preset users, the display is controlled to be opened, and when the fact that the Y preset users do not have the watching behavior is detected, the display continues to be closed;
if not, the display is continuously closed;
wherein X, Y is an integer of 0 or more, and X is Y or more.
In one possible design, before controlling the display to turn on, the controller is further configured to:
if the Y preset users comprise Z special users, judging whether the current watching time is located in a preset watching time period corresponding to at least one special user in the Z special users; the current watching moment is the moment when one preset user with watching behaviors exists in Y preset users;
if yes, controlling the display to be opened;
if so, the display continues to be turned off.
In one possible design, after controlling the display to turn on, the controller is further configured to:
after determining that the historical pause information comprises the watching pause node of the highest priority preset user in the Y preset users, controlling the display to display a fourth video image at a pause moment of the fourth video image included in the watching pause node of the highest priority preset user;
and after determining that the watching pause node of the highest priority preset user does not exist in the historical pause information, controlling the display to display the favorite video image of the highest priority preset user.
In a second aspect, an embodiment of the present invention provides a video image display method, which is applied to a controller in the display apparatus in any one of the first aspects, where the display apparatus further includes a display and an image pickup device, and the controller is connected to the display and the image pickup apparatus, respectively, and the method includes:
acquiring user image information of a watching area in front of a display, which is acquired by camera equipment;
when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
if yes, controlling the display to pause playing the first video image
In one possible design, a display device includes:
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of watching video images by a user, the historical pause information comprises user watching pause nodes, and the user watching pause nodes comprise user identifications, video image identifications and video image pause moments, wherein the user identifications, the video image identifications and the video image pause moments correspond to one another in pairs;
the method further comprises the following steps:
when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
if not, after the first user is determined to be the preset user, recording the user watching pause node of the first user as a first identifier comprising a first video image and a first video image pause moment, wherein the first video image pause moment is the moment when the first user leaves.
In one possible design, a display device includes:
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of watching video images by a user, the historical pause information comprises user watching pause nodes, and the user watching pause nodes comprise user identifications, video image identifications and video image pause moments, wherein the user identifications, the video image identifications and the video image pause moments correspond to one another in pairs;
the method further comprises the following steps: when the display displays and plays the first video image, after detecting that the first user in the watching area leaves the watching area according to the user image information, if determining that no other user exists in the watching area,
recording a user viewing pause node of the first user as a first identifier comprising a first video image and a first video image pause time, and controlling the display to be closed, wherein the first video image pause time is the time when the first user leaves.
In one possible design, the method further includes:
after the leaving time length of the first user is determined to be smaller than the preset time length, if it is determined that a second user enters the watching area within the preset time length, whether the second user is the same as the first user is judged;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, after the viewing pause node of the second user exists in the historical pause information, the display is controlled to display the second video image at the pause moment of the second video image included in the viewing pause node of the second user, and after the viewing pause node of the second user does not exist in the historical pause information, the display is controlled to display the favorite video image of the second user.
In one possible design, after controlling the display to pause playing the first video image, the method further includes:
judging whether the first user enters the watching area or whether the gesture which is the same as the second preset gesture is made by the user exists in other members;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, the display is controlled to pause playing the first video image.
In one possible design, the method further includes:
when the display displays the first video image, after a third user in the watching area is detected to enter the watching area according to the user image information, if the third user is detected to be the highest priority user in the watching area, whether the third user makes a gesture which is the same as a third preset gesture is judged;
if yes, after the fact that the watching pause node of the third user exists in the historical pause information is determined, the display is controlled to display the third video image at the pause moment of the third video image included in the watching pause node of the third user, and after the fact that the watching pause node of the third user does not exist in the historical pause information is determined, the display is controlled to display the favorite video image of the third user.
In one possible design, before the display displays the first video image, the method further includes:
when the display is closed, judging whether the watching area comprises X users or not according to the user image information;
if yes, after the X users are determined to comprise Y preset users, when the fact that one preset user has the watching behavior is detected in the Y preset users, the display is controlled to be opened, and when the fact that the Y preset users do not have the watching behavior is detected, the display continues to be closed;
if not, the display is continuously closed;
wherein X, Y is an integer of 0 or more, and X is Y or more.
In one possible design, before controlling the display to be turned on, the method further includes:
if the Y preset users comprise Z special users, judging whether the current watching time is located in a preset watching time period corresponding to at least one special user in the Z special users; the current watching moment is the moment when one preset user with watching behaviors exists in Y preset users;
if yes, controlling the display to be opened;
if so, the display continues to be turned off.
In one possible design, after controlling the display to be turned on, the method further includes:
after determining that the historical pause information comprises the watching pause node of the highest priority preset user in the Y preset users, controlling the display to display a fourth video image at a pause moment of the fourth video image included in the watching pause node of the highest priority preset user;
and after determining that the watching pause node of the highest priority preset user does not exist in the historical pause information, controlling the display to display the favorite video image of the highest priority preset user.
In a third aspect, an embodiment of the present invention provides a computer-readable storage medium, where computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the display control method according to any one of the above first aspects is implemented.
The display device and the video image display method provided by the embodiment of the invention comprise the following steps: the display is used for displaying and playing the video image; the camera device is used for collecting user image information of a watching area, and the watching area is positioned in front of the display; a controller configured to: when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user; if yes, controlling the display to pause playing the first video image. The user controls the display to display or pause playing of the first video image through the preset gesture, viewing and control experience of the user is improved, and electric energy waste in the remote controller caused by the fact that the display is controlled to pause through the remote controller is avoided.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a first schematic structural diagram of a display device according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a display device according to an embodiment of the present invention;
fig. 3 is a first flowchart illustrating a video image display method executed by the controller according to the present application;
fig. 4 is a second flowchart illustrating a video image display method executed by the controller according to the present application;
fig. 5 is a third schematic flowchart of a video image display method executed by the controller according to the present application;
fig. 6 is a fourth schematic flowchart of a video image display method executed by the controller according to the present application;
fig. 7 is a fifth flowchart illustrating a video image display method executed by the controller according to the present application;
fig. 8 is a sixth schematic flowchart of a video image display method executed by the controller according to the present application;
fig. 9 is a schematic structural diagram of a display device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a first schematic structural diagram of a display device according to an embodiment of the present invention. As shown in fig. 1, the display device includes: a display 101, a camera 102, a controller 103, wherein,
a display 101 for displaying a playing video image;
the camera device 102 is used for collecting user image information of a watching area, and the watching area is positioned in front of the display 101;
a controller 103 configured to:
when the display 101 displays and plays the first video image, after detecting that the first user in the watching area leaves the watching area according to the user image information, if determining that other users exist in the watching area, judging whether the other users have a gesture which is the same as the first preset gesture of the user;
if yes, controlling the display to pause playing the first video image.
In the display device in fig. 1, after detecting that a first user in the viewing area leaves the viewing area according to the user image information, the controller determines that other users still exist in the viewing area, and if it is determined that other users still exist in the viewing area, determines whether the other users have a gesture which is the same as a first preset gesture of the user; if yes, controlling the display to pause playing the first video image. In the process, the first video image is paused to be played according to the first preset gesture, watching and control experience of a user is improved, and the problems that the electric energy in the remote controller is wasted due to the fact that the display is paused through the remote controller are avoided.
Fig. 2 is a schematic structural diagram of a display device according to an embodiment of the present invention. On the basis of fig. 1, as shown in fig. 2, the display apparatus further includes: a memory, wherein,
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of watching video images by a user, the historical pause information comprises user watching pause nodes, and the user watching pause nodes comprise user identifications, video image identifications and video image pause moments, wherein the user identifications, the video image identifications and the video image pause moments correspond to one another in pairs;
the controller is further configured to: when the display displays and plays the first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
if not, after the first user is determined to be the preset user, recording the user watching pause node of the first user as a first identifier comprising a first video image and a first video image pause moment, wherein the first video image pause moment is the moment when the first user leaves.
In this embodiment, after determining that the first user is the preset user, the controller records the user viewing pause node of the first user as including the first identifier of the first video image and the first video image pause time, so that the viewing experience of the first user is improved.
In one possible design of the system, the system may be,
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of watching video images by a user, the historical pause information comprises user watching pause nodes, and the user watching pause nodes comprise user identifications, video image identifications and video image pause moments, wherein the user identifications, the video image identifications and the video image pause moments correspond to one another in pairs;
the controller is further configured to:
when the display displays and plays the first video image, after detecting that the first user in the watching area leaves the watching area according to the user image information, if determining that no other user exists in the watching area,
recording a user viewing pause node of the first user as a first identifier comprising a first video image and a first video image pause time, and controlling the display to be closed, wherein the first video image pause time is the time when the first user leaves.
In one possible design, the controller is further configured to:
after the leaving time length of the first user is determined to be smaller than the preset time length, if it is determined that a second user enters the watching area within the preset time length, whether the second user is the same as the first user is judged;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, after the viewing pause node of the second user exists in the historical pause information, the display is controlled to display the second video image at the pause moment of the second video image included in the viewing pause node of the second user, and after the viewing pause node of the second user does not exist in the historical pause information, the display is controlled to display the favorite video image of the second user.
In one possible design, after controlling the display to pause playing the first video image, the controller is further configured to:
judging whether the first user enters the watching area or whether the gesture which is the same as the second preset gesture is made by the user exists in other members;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, the display is controlled to pause playing the first video image.
In one possible design, the controller is further configured to:
when the display displays the first video image, after a third user in the watching area is detected to enter the watching area according to the user image information, if the third user is detected to be the highest priority user in the watching area, whether the third user makes a gesture which is the same as a third preset gesture is judged;
if yes, after the fact that the watching pause node of the third user exists in the historical pause information is determined, the display is controlled to display the third video image at the pause moment of the third video image included in the watching pause node of the third user, and after the fact that the watching pause node of the third user does not exist in the historical pause information is determined, the display is controlled to display the favorite video image of the third user.
In one possible design, before the display displays the first video image, the controller is further configured to:
when the display is closed, judging whether X users are included in the watching area according to the user image information;
if yes, after the X users are determined to comprise Y preset users, when the fact that one preset user has the watching behavior is detected in the Y preset users, the display is controlled to be opened, and when the fact that the Y preset users do not have the watching behavior is detected, the display continues to be closed;
if not, the display is continuously closed;
wherein X, Y is an integer of 0 or more, and X is Y or more.
In one possible design, before controlling the display to turn on, the controller is further configured to:
if the Y preset users comprise Z special users, judging whether the current watching time is located in a preset watching time period corresponding to at least one special user in the Z special users; the current watching moment is the moment when one preset user with watching behaviors exists in Y preset users;
if yes, controlling the display to be opened;
if so, the display continues to be turned off.
In one possible design, after controlling the display to turn on, the controller is further configured to:
after determining that the historical pause information comprises the watching pause node of the highest priority preset user in the Y preset users, controlling the display to display a fourth video image at a pause moment of the fourth video image included in the watching pause node of the highest priority preset user;
and after determining that the watching pause node of the highest priority preset user does not exist in the historical pause information, controlling the display to display the favorite video image of the highest priority preset user.
A video image display method executed by the controller is described below with reference to fig. 3, and specifically, refer to the embodiment in fig. 3.
Fig. 3 is a first flowchart illustrating a video image display method executed by the controller according to the present application. As shown in fig. 3, the video image display method performed by the controller includes:
s301: user image information of a viewing area in front of a display, which is acquired by a camera device, is acquired.
The viewing area is an area that can be captured by the imaging device.
S302: when the display displays and plays the first video image, whether a first user leaves the watching area in the watching area is detected according to the user image information.
If not, go to S303.
If yes, go to step S304.
Optionally, the controller may perform human body detection processing on the user image information in the first period by presetting a human body detection model, and determine that the viewing area includes M users. And carrying out human body detection processing on the user image information in the second time period, and judging whether the watching area further comprises M users. If the viewing zone is determined to include M-1 users, it is determined to store the first user departure. Wherein M is an integer of 1 or more.
Specifically, the preset human body detection model may be a YOLOV3 detection algorithm model, or may be another detection algorithm model capable of performing detection processing on user image information and determining that the viewing area includes M users.
S303: the display displays and plays the first video image.
S304: and judging whether other users exist in the watching area.
If yes, S305-S308 are executed.
If not, go to S309.
S305: and judging whether the other users have the gesture which is the same as the first preset gesture made by the user.
If yes, go to S306.
If not, go to step S307.
Optionally, the first preset gesture may be a preset pause gesture, a preset switch gesture, a preset acceleration gesture, a preset display turn-on gesture, a preset display turn-off gesture, or the like.
It should be noted that the first preset gesture is a gesture stored in the memory in advance.
S306: and controlling the display to pause playing the first video image.
Specifically, when the first preset gesture is a preset pause gesture, the controller may control the display to pause playing the first video image.
For example, when the first preset gesture is a preset display closing gesture, the controller may control the display to be closed.
S307: and judging whether the first user is a preset user.
If yes, go to step S308.
If not, go to S303.
Alternatively, it may be determined whether the first user is a preset user based on the face information of the first user and face information of at least one preset user previously stored in the memory.
Specifically, the user image information may be processed by presetting a face detection model, so as to obtain the face information of the first user.
Optionally, the preset face detection model may be a FaceBbox detection algorithm model, and may also be another detection model capable of processing user image information.
Alternatively, the face information may include size profiles of both eyes, mouth and nose, and information of a distance between both eyes, a distance between mouth and nose, and the like, a distance between mouth and nose and eyes, and the like.
S308: recording a user viewing pause node of the first user as a first identifier comprising a first video image and a first video image pause time, wherein the first video image pause time is a time when the first user leaves.
Specifically, when it is determined that the similarity between the face information of the first user and the face information of a certain preset user in the at least one preset user is greater than or equal to a first preset threshold, it may be determined that the first user is a preset user, and the user viewing pause node of the first user is recorded as a first identifier including the first video image and a first video image pause time.
Alternatively, the first preset threshold may be 70%, 80%, etc. Specifically, the specific size of the first preset threshold is not limited in the application.
S309: recording the leaving time length of the first user.
According to the video image display method provided by the embodiment of the application, whether the first user leaves the watching area or not can be judged according to the user image information, after the first user leaves the watching area, whether other users exist in the watching area or not is judged, when the other users exist in the watching area, whether the gestures of the users stored in the other users are the same as the first preset gesture or not is judged, if yes, the display is controlled to pause playing of the first video image, and the watching experience of the other users is improved. Furthermore, the problems of electric energy waste and the like in the remote controller caused by the fact that the display is controlled to pause through the remote controller can be avoided, and electric energy is saved.
On the basis of the embodiment of fig. 3, the controller may further perform the following video image display method. Please refer to fig. 4.
Fig. 4 is a second flowchart illustrating a video image display method executed by the controller according to the present application. As shown in fig. 4, the video image display method performed by the controller further includes:
s401: and acquiring the leaving time length of the first user.
S402: and judging whether the leaving time length is greater than or equal to a preset time length.
If yes, go to S403.
If not, go to S404.
The preset time period may be 5 minutes, 10 minutes, etc. Specifically, the specific value of the preset duration is not limited in the present application.
S403: recording a user viewing pause node of the first user as a first identifier comprising a first video image and a first video image pause time, and controlling the display to be closed, wherein the first video image pause time is the time when the first user leaves.
S404: after determining that a second user enters the watching area within the preset time length, judging whether the second user is the same as the first user.
If yes, go to S405.
If not, go to step S406.
Alternatively, the face information of the second user may be acquired from the user image information, and it may be determined whether the second user and the first user are the same based on the face information of the second user and the face information of the first user.
Specifically, if the face information of the second user is the same as the face information of the first user, it is determined that the second user is the same as the first user.
Optionally, whether the second user is the same as the first user may also be determined according to the similarity between the face information of the second user and the face information of the first user and a second preset threshold.
Specifically, if the similarity between the face information of the second user and the face information of the first user is greater than or equal to a second preset threshold, it is determined that the second user is the same as the first user.
S405: and controlling the display to continue playing the first video image from the pause moment of the first video image.
S406: and judging whether the watching pause node of the second user exists in the historical pause information.
If yes, go to S407.
If not, go to step S408.
Optionally, it may be looked up in the memory whether to store the viewing pause node of the second user according to the user identification of the second user. Wherein the user identification of the second user may be facial information of the second user. The ID may correspond to the face information of the second user.
S407: the display is controlled to display the second video image from a second video image pause time included in the view pause node of the second user.
Specifically, in S407, the display may be further controlled to display a favorite video image of the second user.
S408: the display is controlled to display the favorite video images of the second user.
On the basis of the embodiment of fig. 3, the controller may further perform the following video image display method. Please refer to fig. 5.
Fig. 5 is a third schematic flowchart of a video image display method executed by the controller according to the present application. As shown in fig. 5, after the controller controls the display to pause playing the first video image, the video image display method executed by the controller further includes:
s501: it is determined that the display paused the first video image.
S502: and judging whether the first user enters the watching area or whether the gesture which is the same as the second preset gesture is performed by the user in other members.
If yes, go to S503.
If not, go to S504.
It should be noted that the second preset gesture is a preset pause gesture, and is used for causing the display to pause playing the first video image.
S503: and controlling the display to continue playing the first video image from the pause moment of the first video image.
S504: the display is controlled to pause playing the first video image.
On the basis of any of the above embodiments, the following describes the video image display method provided by the present application with reference to the embodiment of fig. 6, specifically, please refer to fig. 6.
Fig. 6 is a fourth schematic flowchart of a video image display method executed by the controller according to the present application. As shown in fig. 6, the video image display method performed by the controller further includes:
s601: user image information of a viewing area is acquired.
S602: when the display displays the first video image, whether a third user enters the watching area or not is detected according to the user image information.
If not, go to S603.
If yes, go to S604.
S603: the display continues to display the first video image.
S604: and acquiring the priority of the third user.
S605: it is determined whether the priority of the third user is the highest priority user in the viewing area.
If yes, go to S606.
If not, go to S603.
S606: and judging whether the third user makes the gesture which is the same as the third preset gesture.
If yes, S607 is executed.
If not, go to S603.
S607: and judging whether a watching pause node of a third user exists in the historical playing record.
If yes, go to S608.
If not, go to S609.
S608: the display is controlled to display the third video image from a third video image pause time included in the view pause node of the third user.
S609: the display is controlled to display the favorite video images of the third user.
On the basis of any of the above embodiments, the following describes the video image display method provided by the present application with reference to the embodiment of fig. 7, specifically, please refer to fig. 7.
Fig. 7 is a flowchart illustrating a video image display method executed by the controller according to a fifth embodiment of the present disclosure. As shown in fig. 7, the video image display method performed by the controller further includes:
s701: user image information of a viewing area of a display is acquired, wherein the user image information comprises image information of X users.
S702: when the display is turned off, it is determined whether X users are included in the viewing area based on the user image information.
If not, S707 is executed.
If yes, S703 is performed.
Optionally, the X users include strange users and/or preset users, and the preset users are home users, for example, the preset users include general users and/or special users. Wherein, the common user is a user who needs help from others in the watching process. The special user is a user who does not need help from others in the watching process, for example: old people and children.
S703: and judging whether the X users comprise Y preset users or not.
If yes, go to step S704.
If not, S707 is executed.
Wherein X is not less than Y, and Y is an integer not less than 0.
Specifically, facial feature information corresponding to X users may be determined according to a preset face detection model and user image information, and then whether Y preset users are included in the X users is determined according to the facial feature information corresponding to the X users and facial feature information corresponding to Y preset users that are stored in advance.
S704: whether a preset user has a watching behavior is detected from Y preset users.
If yes, go to S705.
If not, go to S708.
Optionally, the user image information including Y preset users may be detected according to a preset motion detection model, and it is determined whether there is a preset user having a viewing behavior among the Y preset users.
For example, after detecting the user image information including Y preset users, if it is determined that one preset user has a sitting posture and faces the display, it may be determined that one preset user among the Y preset users has a viewing behavior.
S705: whether Z special users are included in the Y preset users is detected.
If not, go to S706.
If yes, go to S708.
Wherein Y is not less than Z, and Z is an integer not less than 0.
Specifically, facial feature information corresponding to Y preset users may be determined according to the preset face detection model and the user image information, and then whether Z special users are included in the Y preset users is determined according to the facial feature information corresponding to the Y preset users and facial feature information corresponding to Z special users stored in advance.
S706: and judging whether the current watching moment is positioned in a preset watching time period corresponding to at least one special user in the Z special users.
If not, S707 is executed.
If yes, go to S708.
S707: the display continues to be off.
S708: and controlling the display to be turned on.
The current watching moment is the moment when one preset user with watching behaviors is detected to exist in the Y preset users.
In the present application, the preset watching periods corresponding to different special users are usually different. For example, the preset watching time period for "old people" may be 00:00-23:59, and the preset watching time period for "young children" may be 10:00-20: 00.
In the process, the display is controlled to be turned on when the current watching moment is located in the preset watching time period corresponding to at least one special user in the Z special users. When the current watching moment is not located in the preset watching time period corresponding to at least one special user in the Z special users, the display is continuously closed, and the special users can be helped to form a good watching habit.
Based on the embodiment of fig. 7, the following describes a video image display method in further detail with reference to fig. 8, specifically, please refer to fig. 8.
Fig. 8 is a sixth schematic flowchart of a video image display method executed by the controller according to the present application. As shown in fig. 8, the video image display method performed by the controller further includes:
s801: and after Y preset users are determined to be included in the X users according to the user image information, the priorities of the Y preset users are obtained.
S802: and determining the high-priority preset users according to the priorities of the Y preset users.
Alternatively, the priority of the Y preset users may be a number of 0, 1, … …, Y-1, where the larger the number the higher the priority, or the smaller the number the lower the priority.
S803: and judging whether the historical pause information comprises the watching pause node of the preset user with the highest priority.
If yes, go to S804.
If not, go to S805.
S804: and controlling the display to display the fourth video image from a fourth video image pause time included in the viewing pause node of the highest priority preset user.
S805: and controlling the display to display the favorite video image of the preset user with the highest priority.
In the method, the controller can control the display to display the fourth video image at the pause moment of the fourth video image included in the watching pause node of the highest priority preset user or control the display to display the favorite video image of the highest priority preset user according to the watching pause node of the highest priority preset user, so that the problems of control confusion and the like caused by the fact that a single preset user controls the display at the same time in the prior art are avoided, and the control and watching experience of the user is improved.
Fig. 9 is a schematic structural diagram of a display device according to an embodiment of the present invention. As shown in fig. 9, includes: a server 901, a light cat (or router) 902, a controller 903, a camera 904 and a display 05.
The server 901 is connected to the optical modem (or router) 902 through an optical fiber, the optical modem (or router) 902 is connected to the controller 903 through a network cable, and the controller 903 may be connected to the camera 904 and the display 905 through a wired network and a wireless network, respectively.
Alternatively, the wired network may be coaxial cable, twisted pair, fiber optics, and the like.
Optionally, the Wireless network may be a 2G network, a 3G network, a 4G network, a 5G network, bluetooth, or a Wireless Fidelity (WIFI) network.
Alternatively, the camera 904 may be mounted (e.g., mechanically fixed) in a central location on the top, bottom, or sides (left or right) of the display 905, or in other locations in the spatial environment of the display 905.
In practical application, the server 901 transmits original video image data to the optical modem (or router) 902 through an optical fiber, the optical modem (or router) 902 analyzes the original video image data to obtain a network video image, and transmits the network video image to the controller 903 through a network cable, and the controller 903 analyzes the network video image to obtain video image information to be played.
Further, the controller 903 may acquire, from the camera 904, user image information of the viewing area acquired by the camera 904, and determine whether at least one user exists in the viewing area according to the user image information, and after it is determined that a preset user exists in the viewing area, may control the display 905 to push a favorite video image of the preset user with the highest priority, or display a certain video image at a time when the video image included in the viewing pause node of the preset user with the highest priority is paused, according to the priority of the preset user. Therefore, the problems that the control is disordered and the like caused by the fact that Y preset users control the display at the same time in the prior art are avoided, and the watching experience of the users is improved.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer executes instructions, and when a processor executes the computer to execute the instructions, the method for controlling a display in any of the above method embodiments is implemented.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A display device, comprising:
the display is used for displaying and playing the video image;
the camera device is used for collecting user image information of a watching area, and the watching area is positioned in front of the display;
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of a user watching a video image, the historical pause information comprises a user watching pause node, and the user watching pause node comprises a user identifier, a video image identifier and a video image pause moment, wherein the user identifier, the video image identifier and the video image pause moment correspond to each other in pairs;
a controller configured to:
when the display displays and plays a first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
if yes, controlling the display to pause playing the first video image;
if not, after the first user is determined to be a preset user, recording a user watching pause node of the first user as a first identifier comprising the first video image and a first video image pause moment, wherein the first video image pause moment is a moment when the first user leaves.
2. The display device according to claim 1, comprising:
the device comprises a memory, a storage and a processing unit, wherein the memory is used for storing historical pause information of a user watching a video image, the historical pause information comprises a user watching pause node, and the user watching pause node comprises a user identifier, a video image identifier and a video image pause moment, wherein the user identifier, the video image identifier and the video image pause moment correspond to each other in pairs;
the controller is further configured to:
when the display displays and plays the first video image, after detecting that the first user in the watching area leaves the watching area according to the user image information, if determining that no other user exists in the watching area,
recording a user viewing pause node of the first user as a first identifier comprising the first video image and a first video image pause time, and controlling the display to be closed, wherein the first video image pause time is the time when the first user leaves.
3. The display device of claim 2, wherein the controller is further configured to:
after the leaving time length of the first user is determined to be smaller than a preset time length, if a second user enters the watching area within the preset time length is determined, whether the second user is the same as the first user is judged;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, after the viewing pause node of the second user exists in the historical pause information, controlling the display to display a second video image at a second video image pause moment included in the viewing pause node of the second user, and after the viewing pause node of the second user does not exist in the historical pause information, controlling the display to display a favorite video image of the second user.
4. The display device of claim 1, wherein after the controlling the display to pause playing the first video image, the controller is further configured to:
judging whether the first user enters the watching area or whether the other users have a gesture which is the same as a second preset gesture of the user;
if so, controlling the display to continue playing the first video image from the pause moment of the first video image;
if not, controlling the display to pause playing the first video image.
5. The display device of claim 1, wherein the controller is further configured to:
when the display displays the first video image, after a third user in the watching area is detected to enter the watching area according to the user image information, if the third user is detected to be the highest priority user in the watching area, whether the third user makes a gesture which is the same as a third preset gesture is judged;
if yes, after the fact that the watching pause node of the third user exists in the historical pause information is determined, the display is controlled to display a third video image at a pause moment of the third video image included in the watching pause node of the third user, and after the fact that the watching pause node of the third user does not exist in the historical pause information is determined, the display is controlled to display a favorite video image of the third user.
6. The display device according to any one of claims 1 to 5, wherein before the display displays the first video image, the controller is further configured to:
when the display is closed, judging whether the watching area comprises X users or not according to the user image information;
if yes, after the X users are determined to comprise Y preset users, when the fact that one preset user has the watching behavior is detected in the Y preset users, the display is controlled to be opened, and when the fact that the Y preset users do not have the watching behavior is detected, the display continues to be closed;
if not, the display is continuously closed;
wherein X, Y is an integer of 0 or more, and X is Y or more.
7. The display device of claim 6, wherein prior to controlling the display to turn on, the controller is further configured to:
if the Y preset users comprise Z special users, judging whether the current watching time is located in a preset watching time period corresponding to at least one special user in the Z special users; wherein Z is an integer greater than or equal to 0, Y is greater than or equal to Z, and the current viewing time is the time when a preset user with a viewing behavior is detected to exist in the Y preset users;
if yes, controlling the display to be turned on;
if not, the display continues to be closed.
8. The display device of claim 6, wherein after the controlling the display to turn on, the controller is further configured to:
after determining that the historical pause information comprises the watching pause node of the highest priority preset user in the Y preset users, controlling the display to display a fourth video image from the pause moment of the fourth video image included in the watching pause node of the highest priority preset user;
and after determining that the watching pause node of the highest priority preset user does not exist in the historical pause information, controlling the display to display the favorite video image of the highest priority preset user.
9. A video image display method applied to a controller in the display apparatus according to any one of claims 1 to 8, the display apparatus further including a display and an image pickup device, the controller being connected to the display and the image pickup device, respectively, the method comprising:
acquiring user image information of a watching area in front of the display, which is acquired by the camera device;
when the display displays and plays a first video image, after detecting that a first user in the watching area leaves the watching area according to the user image information, if other users are determined to exist in the watching area, judging whether the other users have a gesture which is the same as a first preset gesture of the user;
and if so, controlling the display to pause playing the first video image.
10. A computer-readable storage medium having computer-executable instructions stored thereon which, when executed by a processor, implement the video image display method as recited in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144104.9A CN112825560B (en) | 2019-11-20 | 2019-11-20 | Display device and video image display method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144104.9A CN112825560B (en) | 2019-11-20 | 2019-11-20 | Display device and video image display method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112825560A CN112825560A (en) | 2021-05-21 |
| CN112825560B true CN112825560B (en) | 2021-12-24 |
Family
ID=75907071
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911144104.9A Active CN112825560B (en) | 2019-11-20 | 2019-11-20 | Display device and video image display method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112825560B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203015051U (en) * | 2012-12-26 | 2013-06-19 | Tcl集团股份有限公司 | Television set capable of controlling play modes through image identification |
| CN103237248A (en) * | 2012-04-04 | 2013-08-07 | 微软公司 | Media program based on media reaction |
| WO2016088906A1 (en) * | 2014-12-01 | 2016-06-09 | 김시복 | Method and system for sharing multimedia file |
| CN105867610A (en) * | 2015-12-29 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Play control method based on face identification and terminal |
| CN107223337A (en) * | 2017-04-01 | 2017-09-29 | 深圳市智晟达科技有限公司 | The method and DTV of a kind of automatic pause video playback |
| CN110087131A (en) * | 2019-05-28 | 2019-08-02 | 海信集团有限公司 | TV control method and main control terminal in television system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105142021B (en) * | 2015-08-11 | 2019-02-22 | 京东方科技集团股份有限公司 | Display control program, display control method and display device |
| CN107566898A (en) * | 2017-09-18 | 2018-01-09 | 广东小天才科技有限公司 | Control method, control device and the terminal device of video playback |
| CN107613368A (en) * | 2017-09-26 | 2018-01-19 | 珠海市魅族科技有限公司 | Video pause method and apparatus, computer installation and computer-readable recording medium |
-
2019
- 2019-11-20 CN CN201911144104.9A patent/CN112825560B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103237248A (en) * | 2012-04-04 | 2013-08-07 | 微软公司 | Media program based on media reaction |
| EP2834987A1 (en) * | 2012-04-04 | 2015-02-11 | Microsoft Corporation | Controlling the presentation of a media program based on passively sensed audience reaction |
| CN203015051U (en) * | 2012-12-26 | 2013-06-19 | Tcl集团股份有限公司 | Television set capable of controlling play modes through image identification |
| WO2016088906A1 (en) * | 2014-12-01 | 2016-06-09 | 김시복 | Method and system for sharing multimedia file |
| CN105867610A (en) * | 2015-12-29 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Play control method based on face identification and terminal |
| CN107223337A (en) * | 2017-04-01 | 2017-09-29 | 深圳市智晟达科技有限公司 | The method and DTV of a kind of automatic pause video playback |
| CN110087131A (en) * | 2019-05-28 | 2019-08-02 | 海信集团有限公司 | TV control method and main control terminal in television system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112825560A (en) | 2021-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1905629B (en) | Image capturing apparatus and image capturing method | |
| EP2031545A2 (en) | Information processing apparatus, information processing method, and computer program | |
| JP5088507B2 (en) | Identity determining apparatus, identity determining method, and identity determining program | |
| JP2010503006A (en) | Method and apparatus for adaptive video presentation | |
| JP2010503006A5 (en) | ||
| CN116051115A (en) | Face-brushing payment prompting method, device and equipment | |
| CN101998058A (en) | Image sensing apparatus and image processing apparatus | |
| CN106911962A (en) | Mobile video based on scene intelligently plays interaction control method | |
| CN115599219B (en) | Eye protection control method, system and equipment for display screen and storage medium | |
| US9591210B2 (en) | Image processing face detection apparatus, method for controlling the same, and program | |
| EP3422316A1 (en) | Monitored-person monitoring device, method and system | |
| CN110087131A (en) | TV control method and main control terminal in television system | |
| JP2007249595A (en) | Display, projector, display system, display method, display program, and recording medium | |
| JP2019208103A (en) | Image recording device, image recording method, and program | |
| CN109949392A (en) | Movie distribution method and system | |
| CN110825220B (en) | Eyeball tracking control method, device, intelligent projector and storage medium | |
| CN112825560B (en) | Display device and video image display method | |
| CN111382599A (en) | Image processing method and device and electronic equipment | |
| US9386292B2 (en) | Stereoscopic video processing apparatus and stereoscopic video processing method | |
| JP5755483B2 (en) | Video display device having automatic recording function, recording device, and automatic recording method | |
| CN108345844B (en) | Method and device for controlling unmanned aerial vehicle to shoot, virtual reality equipment and system | |
| CN112148113A (en) | Method and device for playing eye movement multimedia information and display terminal | |
| CN114257757B (en) | Automatic video clipping and switching method and system, video player and storage medium | |
| CN116301322A (en) | Output method and electronic equipment | |
| CN115525188A (en) | Shooting method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |