CN113709564B - Early warning method based on 5G television, 5G television and readable storage medium - Google Patents
Early warning method based on 5G television, 5G television and readable storage medium Download PDFInfo
- Publication number
- CN113709564B CN113709564B CN202010437568.5A CN202010437568A CN113709564B CN 113709564 B CN113709564 B CN 113709564B CN 202010437568 A CN202010437568 A CN 202010437568A CN 113709564 B CN113709564 B CN 113709564B
- Authority
- CN
- China
- Prior art keywords
- television
- target user
- user
- preset
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000001815 facial effect Effects 0.000 claims description 43
- 238000004590 computer program Methods 0.000 claims description 14
- 238000012549 training Methods 0.000 claims description 2
- 238000001514 detection method Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000036544 posture Effects 0.000 description 6
- 210000000689 upper leg Anatomy 0.000 description 6
- 238000004891 communication Methods 0.000 description 3
- 210000001503 joint Anatomy 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 210000000323 shoulder joint Anatomy 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004134 energy conservation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The application provides a 5G television-based early warning method, a 5G television and a computer-readable storage medium, wherein the method comprises the following steps: determining the mode information of the current 5G television, and detecting a corresponding preset range through a preset camera; when detecting that the user appears in the preset range, determining whether the user is a target user or not; if the user is determined to be a target user, acquiring an image of the current target user; determining state information of the target user according to the image; and sending early warning information according to the state information of the target user and the current mode information of the 5G television, so that the state information of the target user in the detection range of the 5G television is sent through the state information of the user and the mode information of the 5G television, and the security and protection efficiency of the 5G television is improved.
Description
Technical Field
The application relates to the technical field of intelligent televisions, in particular to an early warning method based on a 5G television, the 5G television and a computer readable storage medium.
Background
At present, as the 5G technology in China enters a rapid development stage, 5G televisions also appear in the field of view of the masses, and the 5G televisions have multiple advantages of high transmission rate, large capacity, low delay, energy conservation, low cost, large-scale equipment connection and the like, and people have satisfied entertainment such as watching television programs and the like. Along with the importance of people on safety, the use of security equipment in families or enterprises is more common, the requirements of people on the security equipment are higher, and although the existing intelligent television can be used as the security equipment, the intelligent television can only early warn strangers in a range, and the security efficiency is low.
Disclosure of Invention
The application mainly aims to provide a 5G television-based early warning method, a 5G television and a computer-readable storage medium, and aims to solve the problems that the existing intelligent television only can early warn strangers in a range and the security and protection efficiency is low.
In a first aspect, the present application provides a 5G television-based early warning method, where the 5G television-based early warning method includes the following steps:
determining the mode information of the current 5G television, and detecting a corresponding preset range through a preset camera;
when detecting that the user appears in the preset range, determining whether the user is a target user or not;
if the user is determined to be a target user, acquiring an image of the current target user;
determining state information of the target user according to the image;
and sending early warning information according to the state information of the target user and the current mode information of the 5G television.
In a second aspect, the present application further provides a 5G television, where the 5G television includes a preset camera, a display, a processor, a memory, and a computer program stored on the memory and executable by the processor, where the computer program when executed by the processor implements the steps of the 5G television-based early warning method as described above.
In a third aspect, the present application also provides a computer readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the 5G television-based early warning method as described above.
The application provides a 5G television-based early warning method, a 5G television and a computer-readable storage medium, wherein the method detects a corresponding preset range through a preset camera by determining the mode information of the current 5G television; when detecting that the user appears in the preset range, determining whether the user is a target user or not; if the user is determined to be a target user, acquiring an image of the current target user; determining state information of the target user according to the image; and sending early warning information according to the state information of the target user and the current mode information of the 5G television, so that the state information of the target user in the detection range of the 5G television is sent through the state information of the user and the mode information of the 5G television, and the security and protection efficiency of the 5G television is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of steps of a 5G television-based early warning method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of an emulation mode of a 5G television in an embodiment of the present application;
fig. 3 is a schematic diagram of a sleep mode of a 5G television according to an embodiment of the present application;
FIG. 4 is a flow chart illustrating sub-steps of the 5G television-based early warning method of FIG. 1;
fig. 5 is a schematic block diagram of a 5G television according to an embodiment of the present application.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The flow diagrams depicted in the figures are merely illustrative and not necessarily all of the elements and operations/steps are included or performed in the order described. For example, some operations/steps may be further divided, combined, or partially combined, so that the order of actual execution may be changed according to actual situations.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a flow chart of an early warning method based on a 5G television according to an embodiment of the application.
As shown in fig. 1, the early warning method based on the 5G television includes steps S101 to S105.
Step S101, determining the mode information of the current 5G television, and detecting a corresponding preset range through a preset camera.
The mode information of the 5G television includes a play mode and a sleep mode, as shown in fig. 2, where the play mode is that the user is watching a television program or performing other entertainment items using the 5G television, and as shown in fig. 3, the sleep mode refers to that the interface of the 5G television is in a black screen state. For example, determining the mode information of the current 5G television may be obtaining the interface information of the current 5G television, if the interface of the current 5G television is in the black screen state as shown in fig. 3, determining that the current 5G television is in the sleep mode, and if the interface of the current 5G television is in the play interface as shown in fig. 2, determining that the current 5G television is in the play mode.
Specifically, whether the 5G television is in an operating state is detected; if the 5G television is in the running state, determining that the current 5G television is in a playing mode; and if the 5G television is not in the running state, determining that the current 5G television is in the dormant mode.
In one embodiment, detecting whether the 5G television is in an operational state includes detecting power usage of the current 5G television, and determining whether the current 5G television is in an operational state from the power usage. The example is that the power consumption of the 5G television in the running state is obtained in advance, when the power consumption of the current 5G television is detected, the power consumption of the current 5G television is compared with the power consumption of the 5G television in the running state, and if the power consumption of the current 5G television is greater than or equal to the power consumption of the 5G television in the running state, the 5G television is determined to be in the running state. If the 5G television is in the running state, the current 5G television is determined to be in the playing mode shown in fig. 2, and if the 5G television is not in the running state, the current 5G television is determined to be in the dormant mode shown in fig. 3.
The 5G television includes a preset camera, which is located directly above the 5G television, although other positions may be set, and the corresponding preset range is detected by the preset camera, where the detection includes real-time detection or timing detection.
Specifically, when the current 5G television is determined to be in a playing mode, receiving an operation instruction, starting a preset camera based on the operation instruction, and detecting a corresponding preset range in real time through the preset camera; and when the current 5G television is determined to be in a dormant mode, starting a preset camera, and detecting a corresponding preset range in real time through the preset camera.
In an embodiment, when it is determined that the current 5G television is in a play mode, the preset camera of the 5G television is in a closed state, and the 5G television receives an operation instruction of a user. For example, a voice instruction of a user, a key operation instruction of the user through a remote controller, or a touch failure on a display screen is received. And starting the preset camera through an operation instruction of a user. The preset camera detects the corresponding preset range in real time after being started.
When the current 5G television is determined to be in the dormant mode, the preset camera is in a starting state. For example, when a user turns off a 5G television, the user turns off the 5G television and simultaneously starts a preset camera, and the corresponding preset range is detected in real time through the preset camera, wherein the preset range is determined based on the position of the 5G television. For example, when the 5G tv is located in a home living room, a corresponding living room range is detected by a preset camera, and when the 5G tv is located in a conference room, a corresponding conference room area is detected by a preset camera.
Step S102, when the user in the preset range is detected, determining whether the user is a target user or not.
And when the user appearing in the preset range is detected through the preset camera, analyzing the user to determine whether the user is a target user. The examples are: the body contour of the target user is acquired in advance, and the acquired body contour is stored. When the user appears in the preset range, acquiring the body contour of the user, wherein the body contour of the user is matched with the pre-stored body contour, if the body contour of the user is matched with the pre-stored body contour, determining that the user is a target user, and if the body contour of the user is not matched with the pre-stored body contour, determining that the user is not the target user.
Specifically, when detecting that a user appears in the preset range, carrying out facial recognition on the user to acquire facial features of the user; matching the facial features with a preset facial feature library, and determining whether the facial features are matched with preset facial features in the preset facial feature library; and if the facial features are matched with the preset facial features, determining the user as a target user.
In an embodiment, a user is detected to appear in a preset range through a preset camera, the face position of the user is determined, face recognition is carried out on the face position of the user, and the face characteristics of the user are obtained. In an exemplary embodiment, a preset camera detects that a user appears in a preset range, a preset face recognition model determines the face position of the user, and the face position is recognized and facial features of the user are extracted. And matching the extracted facial features with preset facial features in a preset facial feature library, and if the facial features of the user are matched with the preset facial features in the preset facial feature library, determining that the user is a target user. If the facial features of the user do not match the preset facial features in the preset facial feature library, then it is determined that the user is not the target user.
The determining whether the user is a target user further comprises: if the user is determined not to be the target user, continuously shooting the image of the user through the preset camera, and sending early warning information to the mobile terminal associated with the 5G television or displaying the image of the user on a display interface of the 5G television and playing a preset alarm bell.
In an embodiment, if it is determined that the user is not a target user, continuously capturing images of the user through a preset camera of the 5G television, and sending early warning information to a mobile terminal associated with the 5G television, where the early warning information includes information such as prompt voice or text, or sending the images of the user as early warning information to the mobile terminal, and the mobile terminal includes electronic devices such as a mobile phone and a tablet computer. Or, the image of the user is directly displayed on the display interface of the 5G television, and the preset alarm bell is played so as to prompt the user to fall into the monitoring range.
Step S103, if the user is determined to be the target user, acquiring the current image of the target user.
If the user is determined to be the target user, acquiring an image of the current target user through a preset camera, wherein the image can be a whole body image or a facial image of the user. In an exemplary case, when the user is determined to be the target user, determining whether the body of the target user is within a preset range of the preset camera, and if the whole body of the target user is determined to be within the preset range of the preset camera, shooting the whole body image of the target user through the preset camera. Or when the user is determined to be the target user, determining whether the face of the target user is in a preset range right in front of the preset camera, and if the face of the target user is determined to be in the preset range right in front of the preset camera, shooting the face image of the target user through the preset camera.
Step S104, determining the state information of the target user according to the image.
And if the face image of the target user is acquired, analyzing the face image of the target user, and determining the state information of the current user. The method comprises the steps of analyzing a facial image of a target user through a preset micro-expression model, extracting micro-expression features of the target user, matching the extracted micro-expression features with the preset micro-expression features, obtaining state information of a preset micro-expression feature identifier corresponding to the micro-expression features, determining the state information of the current target user, wherein the state information of the user comprises a safety state and a dangerous state, and the preset micro-expression model is generated in advance through micro-expression training corresponding to different facial images and facial images of the target user.
In one embodiment, as shown in fig. 4, step S104 includes substeps S1041 to S1043.
And step S1041, determining the positions of all the nodes of the target user according to the image based on a preset model.
When the image of the user is acquired, the preset model is a preset target detection model, the target user in the image is identified through the preset target detection model, and the positions of the head joint point, the shoulder joint point, the arm joint point, the palm joint point, the thigh joint point, the shank joint point and the sole joint point of the target user are determined.
Substep S1042, determining gesture information of the target user according to the positions of the nodes.
When the positions of the head joint, the shoulder joint, the arm joint, the palm joint, the thigh joint, the shank joint and the sole joint of the target user are obtained, the head position, the shoulder position, the arm position, the palm position, the shoulder position, the thigh position, the shank position and the sole position are sequentially connected according to the sequence of the joints of the head, the shoulder, the arm, the thigh, the shank, the sole and the like, the body contour of the target user is obtained, and the posture information of the target user is determined according to the body contour of the target user.
The determining of the gesture information of the target user specifically includes: establishing a coordinate system for the image, and determining the corresponding coordinates of the positions of the joint points in the coordinate system; connecting the coordinates of all the joint points according to a preset joint point connection sequence to acquire the body contour of the target user; and determining posture information corresponding to the body contour according to the body contour.
In an embodiment, a coordinate system is established for a target user in an image to determine coordinates of each joint position in the coordinate system, head coordinates, shoulder coordinates, arm coordinates, palm coordinates, shoulder coordinates, thigh coordinates, shank coordinates, sole coordinates and the like are sequentially connected according to the sequence of joints of the head, the shoulder, the arm, the palm, the shank, the sole, the body contour of the target user is acquired by a preset body feature table of the target user, the width and the height of the head, the width and the height of the shoulder, the width and the height of the arm, the width and the height of the palm, the width and the height of the thigh, the width and the height of the shank, the width and the height of the sole, the body contour of the target user is acquired, the acquired body contour is matched with a preset body contour in a preset body contour library, the preset body contour matched with the body contour is determined, and posture information corresponding to the preset body contour is acquired. The preset body contour library comprises different body contours of the target user and gesture information corresponding to the body contours, such as sitting postures, lying postures and the like.
Substep S1043, determining state information of the target user according to the gesture information.
When the gesture information of the target user is obtained, the gesture information of the target user is matched with preset gestures in a preset gesture library, the identification of the preset gestures matched with the gesture information of the target user is obtained, the state information of the current target user is determined through the identification of the preset gestures, if the gesture of the target user is a standing gesture and a sitting gesture, the target user is determined to be in a safe state, and if the gesture of the target user is a lying gesture, the target user is determined to be in a dangerous state.
Step 105, sending early warning information according to the state information of the target user and the current mode information of the 5G television.
When the state information of the target user is determined to be a dangerous state, based on the mode information of the current 5G television, early warning information is sent, specifically, if the state information of the target user is determined to be a dangerous state and the current 5G television is in a playing mode shown in fig. 2, early warning information is displayed on a playing interface of the 5G television; and if the state information of the target user is determined to be in a dangerous state and the current 5G television is in a dormant mode as shown in fig. 3, sending early warning information to a mobile terminal associated with the 5G television.
In a real-time example, when the information of the target user is in a dangerous state, if the current 5G television is determined to be in a playing mode, early warning information is displayed on a playing interface of the 5G television, wherein the early warning information comprises displaying an image of the current target user on the playing interface or displaying preset characters or alarm bells on the playing interface. And if the current 5G television is determined to be in the dormant mode, sending early warning information to the mobile terminal associated with the 5G television, wherein the early warning information comprises characters, images and the like. The mobile terminal comprises electronic equipment such as a mobile phone, a tablet personal computer and the like.
In the application, the mode information of the current 5G television is determined, and if the user is not a target user, early warning information is sent through the user in the detection range of the preset camera of the 5G television. If the user is a target user, acquiring an image of the current target user, acquiring state information of the current target user according to the image, and transmitting early warning information based on the state information of the current target user and the mode information of the current 5G television, wherein the purposes that early warning information can be transmitted through the 5G television when the target user is in a dangerous state by acquiring the state information of the target user are achieved, and the security effect of the intelligent television is improved.
Referring to fig. 5, fig. 5 is a schematic block diagram of a 5G television according to an embodiment of the present application.
As shown in fig. 5, the 5G television 300 includes a processor 302, a memory 303, and a communication interface 304, a camera 305, and a display screen 306, which are connected through a system bus 301, wherein the memory may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store a computer program. The computer program comprises program instructions which, when executed, cause the processor to perform any of a variety of 5G television-based pre-warning methods.
The processor is used to provide computing and control capabilities to support the operation of the entire 5G television.
The memory provides an environment for the execution of a computer program in a non-volatile storage medium that, when executed by the processor, causes the processor to perform any of a variety of 5G television-based pre-warning methods.
The communication interface 304 is used for communication. It will be appreciated by those skilled in the art that the structure shown in fig. 5 is merely a block diagram of a portion of the structure associated with the inventive arrangements and is not limiting of the 5G television to which the inventive arrangements are applied, and that a particular 5G television may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
It should be appreciated that the bus 301 may be, for example, an I2C (Inter-integrated Circuit) bus, the Memory 303 may be a Flash chip, a Read-Only Memory (ROM) disk, an optical disk, a U-disk, a removable hard disk, etc., the processor 302 may be a central processing unit (Central Processing Unit, CPU), the processor may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., and the camera 305 may be a gun camera, an integral camera, a dome camera, a ball-type holder camera, a blind camera, etc. Wherein the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein in one embodiment the processor is configured to run a computer program stored in the memory to implement the steps of:
determining the mode information of the current 5G television, and detecting a corresponding preset range through a preset camera;
when detecting that the user appears in the preset range, determining whether the user is a target user or not;
if the user is determined to be a target user, acquiring an image of the current target user;
determining state information of the target user according to the image;
and sending early warning information according to the state information of the target user and the current mode information of the 5G television.
In one embodiment, the processor, when implementing determining mode information for a current 5G television, is configured to implement:
detecting whether the 5G television is in an operating state;
if the 5G television is in the running state, determining that the current 5G television is in a playing mode;
and if the 5G television is not in the running state, determining that the current 5G television is in the dormant mode.
In one embodiment, the processor, when implementing detection of the corresponding preset range by the preset camera, is configured to implement:
when the current 5G television is determined to be in a playing mode, receiving an operation instruction, starting a preset camera based on the operation instruction, and detecting a corresponding preset range in real time through the preset camera;
and when the current 5G television is determined to be in a dormant mode, starting a preset camera, and detecting a corresponding preset range in real time through the preset camera.
In one embodiment, the processor is configured to, when detecting that the preset range is a user, determine whether the user is a target user, implement:
when detecting that a user appears in the preset range, carrying out facial recognition on the user to acquire facial features of the user;
matching the facial features with a preset facial feature library, and determining whether the facial features are matched with preset facial features in the preset facial feature library;
and if the facial features are matched with the preset facial features, determining the user as a target user.
In one embodiment, the processor, when implementing determining the status information of the target user from the image, is configured to implement:
determining the positions of all the nodes of the target user according to the image based on a preset model;
determining gesture information of the target user according to the positions of the joint points;
and determining state information of the target user according to the gesture information, wherein the state information comprises a safety state and a dangerous state.
In one embodiment, the processor, when implementing determining the gesture information of the target user according to the location of each of the nodes, is configured to implement:
establishing a coordinate system for the image, and determining the corresponding coordinates of the positions of the joint points in the coordinate system;
connecting the coordinates of all the joint points according to a preset joint point connection sequence to acquire the body contour of the target user;
and determining posture information corresponding to the body contour according to the body contour.
In one embodiment, the processor is configured to, when implementing sending the early warning information according to the state information of the target user and the current mode information of the 5G television, implement:
if the state information of the target user is determined to be a dangerous state and the current 5G television is in a playing mode, early warning information is displayed on a playing interface of the 5G television;
and if the state information of the target user is determined to be a dangerous state and the current 5G television is in a dormant mode, sending early warning information to a mobile terminal associated with the 5G television.
In one embodiment, the processor, when implementing the determination of whether the user is a target user, is configured to implement:
if the user is determined not to be the target user, continuously shooting the image of the user through the preset camera, and sending early warning information to the mobile terminal associated with the 5G television or displaying the image of the user on a display interface of the 5G television and playing a preset alarm bell.
It should be noted that, for convenience and brevity of description, a person skilled in the art may clearly understand that, in the specific working process of the 5G television described above, reference may be made to a corresponding process in the foregoing 5G television-based early warning method embodiment of the 5G television, which is not described herein again.
The embodiment of the application also provides a computer readable storage medium, wherein the computer readable storage medium is stored with a computer program, the computer program comprises program instructions, and the method realized by the program instructions when being executed can refer to various embodiments of the 5G television-based early warning method.
The computer readable storage medium may be an internal storage unit of the 5G television set according to the foregoing embodiment, for example, a hard disk or a memory of the 5G television set. The computer readable storage medium may also be an external storage device of the 5G television, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the 5G television.
It is to be understood that the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments. While the application has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the application. Therefore, the protection scope of the application is subject to the protection scope of the claims.
Claims (8)
1. The early warning method based on the 5G television is characterized in that the 5G television comprises a preset camera; the method comprises the following steps:
determining the mode information of the current 5G television, and detecting a corresponding preset range through a preset camera;
when detecting that the user appears in the preset range, determining whether the user is a target user or not;
if the user is determined to be a target user, acquiring an image of the current target user;
determining state information of the target user according to the image; analyzing a facial image of the target user through a preset micro-expression model, extracting micro-expression features of the target user, and obtaining state information of a preset micro-expression feature identifier corresponding to the micro-expression features through matching the extracted micro-expression features with the preset micro-expression features to determine the state information of the current target user; the state information includes a safe state and a dangerous state; the preset microexpressive model is generated in advance through microexpressive training corresponding to different facial images of the target user;
sending early warning information according to the state information of the target user and the current mode information of the 5G television;
the determining the mode information of the current 5G television comprises the following steps:
detecting whether the 5G television is in an operating state;
if the 5G television is in the running state, determining that the current 5G television is in a playing mode;
if the 5G television is not in the running state, determining that the current 5G television is in a dormant mode;
the detecting the corresponding preset range through the preset camera comprises the following steps:
when the current 5G television is determined to be in a playing mode, receiving an operation instruction, starting a preset camera based on the operation instruction, and detecting a corresponding preset range in real time through the preset camera;
and when the current 5G television is determined to be in a dormant mode, starting a preset camera, and detecting a corresponding preset range in real time through the preset camera.
2. The method according to claim 1, wherein when detecting that the user is present in the preset range, determining whether the user is a target user includes:
when detecting that a user appears in the preset range, carrying out facial recognition on the user to acquire facial features of the user;
matching the facial features with a preset facial feature library, and determining whether the facial features are matched with preset facial features in the preset facial feature library;
and if the facial features are matched with the preset facial features, determining the user as a target user.
3. The method of claim 1, wherein the determining the status information of the target user from the image comprises:
determining the positions of all the nodes of the target user according to the image based on a preset model;
determining gesture information of the target user according to the positions of the joint points;
and determining state information of the target user according to the gesture information, wherein the state information comprises a safety state and a dangerous state.
4. The method according to claim 3, wherein determining the gesture information of the target user according to the positions of the respective nodes comprises:
establishing a coordinate system for the image, and determining the corresponding coordinates of the positions of the joint points in the coordinate system;
connecting the coordinates of all the joint points according to a preset joint point connection sequence to acquire the body contour of the target user;
and determining posture information corresponding to the body contour according to the body contour.
5. The method of claim 3, wherein the sending the pre-warning information according to the state information of the target user and the current mode information of the 5G television includes:
if the state information of the target user is determined to be a dangerous state and the current 5G television is in a playing mode, early warning information is displayed on a playing interface of the 5G television;
and if the state information of the target user is determined to be a dangerous state and the current 5G television is in a dormant mode, sending early warning information to a mobile terminal associated with the 5G television.
6. The method according to any one of claims 1 to 5, wherein after determining whether the user is a target user, further comprising:
if the user is determined not to be the target user, continuously shooting the image of the user through the preset camera, and sending early warning information to the mobile terminal associated with the 5G television or displaying the image of the user on a display interface of the 5G television and playing a preset alarm bell.
7. A 5G television, characterized in that the 5G television comprises a preset camera, a display, a processor, a memory and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, realizes the steps of the 5G television based early warning method according to any one of claims 1 to 5.
8. A computer-readable storage medium, wherein the computer-readable storage medium has stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the 5G television-based early warning method as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010437568.5A CN113709564B (en) | 2020-05-21 | 2020-05-21 | Early warning method based on 5G television, 5G television and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010437568.5A CN113709564B (en) | 2020-05-21 | 2020-05-21 | Early warning method based on 5G television, 5G television and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113709564A CN113709564A (en) | 2021-11-26 |
| CN113709564B true CN113709564B (en) | 2023-12-12 |
Family
ID=78645901
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010437568.5A Active CN113709564B (en) | 2020-05-21 | 2020-05-21 | Early warning method based on 5G television, 5G television and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113709564B (en) |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012248100A (en) * | 2011-05-30 | 2012-12-13 | Toshiba Corp | Intruder detection level variable television receiver |
| CN104135642A (en) * | 2014-07-31 | 2014-11-05 | 青岛歌尔声学科技有限公司 | Intelligent monitoring method and relevant equipment |
| CN104850771A (en) * | 2015-04-30 | 2015-08-19 | 广东欧珀移动通信有限公司 | Identity verification method and related equipment |
| CN104994335A (en) * | 2015-06-11 | 2015-10-21 | 广东欧珀移动通信有限公司 | Alarm method and terminal |
| JP2015226294A (en) * | 2014-05-30 | 2015-12-14 | シャープ株式会社 | Device with security function |
| CN105307017A (en) * | 2015-11-03 | 2016-02-03 | Tcl集团股份有限公司 | Method and device for correcting posture of smart television user |
| CN205508057U (en) * | 2016-03-16 | 2016-08-24 | 泽川力合（天津）科技发展有限公司 | Home -used security monitoring system |
| WO2017000218A1 (en) * | 2015-06-30 | 2017-01-05 | 北京旷视科技有限公司 | Living-body detection method and device and computer program product |
| CN107256375A (en) * | 2017-01-11 | 2017-10-17 | 西南科技大学 | Human body sitting posture monitoring method before a kind of computer |
| WO2017206433A1 (en) * | 2016-05-30 | 2017-12-07 | 乐视控股（北京）有限公司 | Television control method and system |
| CN107657687A (en) * | 2017-08-25 | 2018-02-02 | 深圳市盛路物联通讯技术有限公司 | A kind of access control management method and entrance guard management server based on image processing techniques |
| WO2018133874A1 (en) * | 2017-01-23 | 2018-07-26 | 杭州海康威视数字技术股份有限公司 | Method and device for sending warning message |
| CN208754453U (en) * | 2018-11-02 | 2019-04-16 | 北京市电信工程局有限公司 | A kind of safety monitoring video wall |
| CN109743541A (en) * | 2018-12-15 | 2019-05-10 | 深圳壹账通智能科技有限公司 | Intelligent control method, device, computer equipment and storage medium |
| CN110582014A (en) * | 2019-10-17 | 2019-12-17 | 深圳创维－Rgb电子有限公司 | Television and television control method, control device and readable storage medium thereof |
-
2020
- 2020-05-21 CN CN202010437568.5A patent/CN113709564B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012248100A (en) * | 2011-05-30 | 2012-12-13 | Toshiba Corp | Intruder detection level variable television receiver |
| JP2015226294A (en) * | 2014-05-30 | 2015-12-14 | シャープ株式会社 | Device with security function |
| CN104135642A (en) * | 2014-07-31 | 2014-11-05 | 青岛歌尔声学科技有限公司 | Intelligent monitoring method and relevant equipment |
| CN104850771A (en) * | 2015-04-30 | 2015-08-19 | 广东欧珀移动通信有限公司 | Identity verification method and related equipment |
| CN104994335A (en) * | 2015-06-11 | 2015-10-21 | 广东欧珀移动通信有限公司 | Alarm method and terminal |
| WO2017000218A1 (en) * | 2015-06-30 | 2017-01-05 | 北京旷视科技有限公司 | Living-body detection method and device and computer program product |
| CN105307017A (en) * | 2015-11-03 | 2016-02-03 | Tcl集团股份有限公司 | Method and device for correcting posture of smart television user |
| CN205508057U (en) * | 2016-03-16 | 2016-08-24 | 泽川力合（天津）科技发展有限公司 | Home -used security monitoring system |
| WO2017206433A1 (en) * | 2016-05-30 | 2017-12-07 | 乐视控股（北京）有限公司 | Television control method and system |
| CN107256375A (en) * | 2017-01-11 | 2017-10-17 | 西南科技大学 | Human body sitting posture monitoring method before a kind of computer |
| WO2018133874A1 (en) * | 2017-01-23 | 2018-07-26 | 杭州海康威视数字技术股份有限公司 | Method and device for sending warning message |
| CN107657687A (en) * | 2017-08-25 | 2018-02-02 | 深圳市盛路物联通讯技术有限公司 | A kind of access control management method and entrance guard management server based on image processing techniques |
| CN208754453U (en) * | 2018-11-02 | 2019-04-16 | 北京市电信工程局有限公司 | A kind of safety monitoring video wall |
| CN109743541A (en) * | 2018-12-15 | 2019-05-10 | 深圳壹账通智能科技有限公司 | Intelligent control method, device, computer equipment and storage medium |
| CN110582014A (en) * | 2019-10-17 | 2019-12-17 | 深圳创维－Rgb电子有限公司 | Television and television control method, control device and readable storage medium thereof |
Non-Patent Citations (3)
| Title |
|---|
| 家庭安防系统中的多摄像头视频采集与网络传送;王会清;程勇;;武汉工程大学学报(2012年第07期);第66-70页 * |
| 面向智能电视的隐式手势交互建模与算法;徐治鹏;冯志全;刘慧;梁丽伟;;计算机辅助设计与图形学学报(第02期);第344-353页 * |
| 高清互动电视家庭融合安防方案研究与设计;林勉等;;有线电视技术(2017年第01期);第48-50页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113709564A (en) | 2021-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110535732B (en) | Equipment control method and device, electronic equipment and storage medium | |
| US20180048482A1 (en) | Control system and control processing method and apparatus | |
| CN107742072B (en) | Face recognition method and mobile terminal | |
| CN109381165B (en) | Skin detection method and mobile terminal | |
| CN109005336B (en) | Image shooting method and terminal equipment | |
| CN108712603B (en) | Image processing method and mobile terminal | |
| CN108881544B (en) | Photographing method and mobile terminal | |
| CN110334629B (en) | Method and device capable of detecting distance in multiple directions and readable storage medium | |
| US20200057882A1 (en) | Method and system for unlocking electronic cigarette | |
| CN106814838B (en) | Method and device for terminal automatic dormancy | |
| CN112130918A (en) | Intelligent device awakening method, device and system and intelligent device | |
| CN109525837B (en) | Image generation method and mobile terminal | |
| CN109618218B (en) | Video processing method and mobile terminal | |
| CN106774889B (en) | Gesture recognition method and device of wearable device | |
| TW201426405A (en) | Smart switching device and smart switching method and system thereof | |
| CN112634895A (en) | Voice interaction wake-up-free method and device | |
| JP2010239499A (en) | Communication terminal unit, communication control unit, method of controlling communication of communication terminal unit, and communication control program | |
| WO2016124146A1 (en) | Display device camouflage/recovery system and control method | |
| CN108345780B (en) | Unlocking control method and mobile terminal | |
| US20220284738A1 (en) | Target user locking method and electronic device | |
| CN105979154A (en) | AR shooting method and device as well as intelligent terminal | |
| CN113709564B (en) | Early warning method based on 5G television, 5G television and readable storage medium | |
| CN114022896A (en) | Target detection method and device, electronic equipment and readable storage medium | |
| CN111353414A (en) | Identity recognition method, system, machine readable medium and equipment | |
| CN112929491B (en) | Application program starting method and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |