CN113542832A - Display control method, display device, and computer-readable storage medium - Google Patents
Display control method, display device, and computer-readable storage medium Download PDFInfo
- Publication number
- CN113542832A CN113542832A CN202110754541.3A CN202110754541A CN113542832A CN 113542832 A CN113542832 A CN 113542832A CN 202110754541 A CN202110754541 A CN 202110754541A CN 113542832 A CN113542832 A CN 113542832A
- Authority
- CN
- China
- Prior art keywords
- human body
- preset
- information
- gesture
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Biophysics (AREA)
- Analytical Chemistry (AREA)
- Biomedical Technology (AREA)
- Chemical & Material Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a display control method, a display device and a storage medium, wherein the method comprises the following steps: acquiring human body information within a preset field angle range in real time, and processing according to the human body information to obtain key point positions corresponding to the human body information; processing to obtain real-time human body posture information according to the key point positions; and adjusting the camera according to the real-time human body posture information so as to enable the human body to be in a preset position in the camera. The invention enables the display picture of the terminal to change along with the movement of the human body, thereby improving the experience of a user in the using process.
Description
Technical Field
The invention relates to the technical field of smart televisions, in particular to a display control method, a display device and a computer readable storage medium.
Background
With the rapid development of science and technology, the functions of televisions are no longer limited to watching programs and playing video, and smart televisions with user interfaces or operating systems are available. When the existing smart television realizes live-action display and man-machine action interaction, a display picture often cannot be accurately changed along with movement of a character or action of the character, so that the range of motion of a user is limited when man-machine interaction is carried out, and the use experience of the user is influenced.
Disclosure of Invention
The invention mainly aims to provide a display control method, a display device and a computer readable storage medium, and aims to solve the problem that the existing television picture cannot be changed along with the movement of a person.
In order to achieve the above object, the present invention provides a display control method, comprising the steps of:
acquiring human body information within a preset field angle range in real time, and processing according to the human body information to obtain key point positions corresponding to the human body information;
processing to obtain real-time human body posture information according to the key point positions;
and adjusting the camera according to the real-time human body posture information so as to enable the human body to be in a preset position in the camera.
Optionally, the human body posture information includes gesture information; the key point positions comprise hand key points and human body key points; the step of adjusting the camera according to the real-time human body posture information so as to enable the human body to be positioned at a preset position in the camera comprises the following steps:
determining whether the gesture information is a preset control gesture according to the hand key points;
when the gesture information is detected to be a preset control gesture, determining the position of a preset point in the human body key point positions according to the human body key point positions;
and adjusting the camera according to the position of the preset point so as to enable the human body to be in the preset position in the camera.
Optionally, after the step of adjusting the camera according to the position of the preset point to make the human body located at the preset position in the camera, the method further includes:
determining whether other preset control gestures except the judged preset control gesture exist according to the human body information within the preset field angle range acquired in real time;
if so, determining the position of a preset point in the human body key point positions of the human body corresponding to the next preset control gesture according to the priority sequence of the other preset control gestures;
and adjusting the camera according to the position of a preset point in the human body key point position corresponding to the next preset control gesture so that the human body corresponding to the next preset control gesture is in the preset position in the camera.
Optionally, the step of determining, according to the priority order of the other preset control gestures, a position of a preset point in the human body key point positions of the human body corresponding to the next preset control gesture includes:
acquiring picture information within the preset field angle range, and acquiring user information of the human body corresponding to the other preset control gestures according to the picture information;
processing to obtain the user priority of the human body corresponding to the other preset control gestures according to the user information;
and determining the priority of other preset control gestures according to the user priority, and determining the position of a preset point in the human body key point position of the human body corresponding to the next preset control gesture according to the priority.
Optionally, the step of determining whether the gesture information is a preset control gesture according to the hand key point includes:
determining whether the gesture information is consistent with a preset control gesture according to the position of the key point of the hand;
if the gesture information is in accordance with a preset control gesture, acquiring the time of the preset control gesture;
and if the time of the preset control gesture is longer than the preset time, judging that the gesture information is the preset control gesture.
Optionally, the step of acquiring human body information in a preset field angle range in real time, and processing the human body information to obtain the position of a key point corresponding to the human body information includes:
acquiring picture information in a preset field angle range, and judging whether a human body exists in the preset field angle range;
and if a human body exists, processing according to the picture information and a preset learning algorithm to obtain a first preset number of human body key points and a second preset number of hand key points corresponding to the human body.
Optionally, if there is a human body, the step of obtaining a first preset number of human body key points and a second preset number of hand key points corresponding to the human body according to the picture information and a preset learning algorithm includes:
if the human body exists, determining the number of the human body according to the picture information;
if the number of people is less than the preset number of people, processing according to the picture information and a preset learning algorithm to obtain a first preset number of human key points and a second preset number of hand key points corresponding to the human body;
if the number of people is larger than or equal to the preset number of people, acquiring the priority sequence of the preset control gesture corresponding to the human body in the preset field angle range, and processing according to the picture information and a preset learning algorithm in sequence to obtain a first preset number of human key points and a second preset number of hand key points corresponding to the human body.
Optionally, after the step of adjusting the camera according to the real-time human body posture information to enable the human body to be located at a preset position in the camera, the method further includes:
and identifying the operation intention of the user according to the real-time human body posture information, converting the operation intention into a control instruction corresponding to the human body posture information and executing the control instruction.
To achieve the above object, the present invention also provides a display device including a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program implementing the steps of the display control method as described above when executed by the processor.
To achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the display control method as described above.
According to the display control method, the display device and the computer readable storage medium, the human body information in the preset field angle range is acquired in real time, the key point position corresponding to the human body information is obtained according to the human body information processing, the real-time human body posture information is obtained through the key point position processing, the key point position of a user can be detected in real time, the real-time posture information of the user is detected, and the accuracy of the human body posture information is ensured; the camera is adjusted according to the real-time human body posture information, so that a human body is located at a preset position in the camera, interaction between a user and a television is achieved, the user is always located at the preset position in the camera, and therefore the television can be guaranteed to be always kept in interaction with the user in real time along with movement of the user.
Drawings
FIG. 1 is a schematic diagram of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a display control method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a display control method according to a second embodiment of the present invention;
FIG. 4 is a flowchart illustrating a display control method according to a third embodiment of the present invention;
FIG. 5 is a flowchart illustrating a detailed process of step S35 in the third embodiment of the display control method according to the present invention;
FIG. 6 is a flowchart illustrating a display control method according to a fourth embodiment of the present invention;
FIG. 7 is a flowchart illustrating a fifth embodiment of a display control method according to the present invention;
FIG. 8 is a diagram illustrating the positions of key points of a human body according to the control method of the present invention;
FIG. 9 is a diagram illustrating the positions of the key points of the hand according to the control method of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic diagram of a hardware structure of a display device provided in each embodiment of the present invention. The display device includes a communication module 01, a memory 02, a processor 03, and the like. Those skilled in the art will appreciate that the display device shown in fig. 1 may also include more or fewer components than shown, or combine certain components, or a different arrangement of components. The processor 03 is connected to the memory 02 and the communication module 01, respectively, and the memory 02 stores a computer program, which is executed by the processor 03 at the same time.
The communication module 01 may be connected to an external device through a network. The communication module 01 may receive data sent by an external device, and may also send data, instructions, and information to the external device, where the external device may be an electronic device such as a mobile phone, a tablet computer, a notebook computer, and a desktop computer.
The memory 02 may be used to store software programs and various data. The memory 02 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data or information created according to the use of the display device, or the like. Further, the memory 02 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 03, which is a control center of the display device, connects various parts of the entire display device using various interfaces and lines, and performs various functions of the display device and processes data by operating or executing software programs and/or modules stored in the memory 02 and calling data stored in the memory 02, thereby performing overall monitoring of the display device. Processor 03 may include one or more processing units; preferably, the processor 03 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 03.
Those skilled in the art will appreciate that the display device configuration shown in fig. 1 does not constitute a limitation of the display device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
Various embodiments of the method of the present invention are presented in terms of the above-described hardware architecture.
Referring to fig. 2, in a first embodiment of the display control method of the present invention, the display control method includes the steps of:
step S10, acquiring human body information within a preset field angle range in real time, and processing according to the human body information to obtain key point positions corresponding to the human body information;
in this embodiment, the field angle is an included angle formed by taking a lens of the camera as a vertex angle and two edges of a maximum range through which an object image of the detected human body can pass through the lens, where the maximum range is a field angle range, and the preset field angle range may be a range covered by a field angle of 30 degrees or a range covered by a field angle of 45 degrees and a range covered by a field angle of 60 degrees, and those skilled in the art may set field angle ranges of different sizes according to actual needs to satisfy acquisition of human body information. The keypoint locations include human keypoints representing skeletal locations and hand keypoints representing the hand, which may be identified through AI (artificial intelligence ARTIFICIAL INTELLIGENCE) deep learning.
Step S20, processing to obtain real-time human body posture information according to the key point position;
the human body posture information represented by each combination can be judged according to the combination of the key point positions, and the human body posture information comprises gesture information. For example, when the positions of the key points of the hand are all in the open state, it can be determined that the hand of the user is in the open state of the five fingers.
Step S30, adjusting the camera according to the real-time human body posture information to enable the human body to be at a preset position in the camera;
in this embodiment, the camera is a pan-tilt camera installed on the television, and can set the rotation direction and the field angle range by itself, and when the change of the human body posture information is detected, the camera can change the working angle and the direction according to the change of the human body posture information, so that the human body is always in the preset position in the camera, the picture of the human body is always displayed on the television, and the preset position is the central position of the camera.
According to the display control method, the human body information in the preset field angle range is acquired in real time, the key point position corresponding to the human body information is obtained according to the human body information processing, the real-time human body posture information is obtained through the key point position processing, the key point position of a user can be detected in real time, the real-time posture information of the user is detected, and the accuracy of the human body posture information is ensured; the camera is adjusted according to the real-time human body posture information, so that a human body is located at a preset position in the camera, interaction between a user and a television is achieved, the user is always located at the preset position in the camera, and therefore the television can be guaranteed to be always kept interacting with the user along with movement of the user.
Further, referring to fig. 3, in the display control method according to the present invention proposed based on the first embodiment of the present invention, the present invention proposes a second embodiment, and the step S30 includes:
step S31, determining whether the gesture information is a preset control gesture according to the position of the key point of the hand;
in this embodiment, the gesture information may be recognized through an AI (artificial intelligence ARTIFICIAL INTELLIGENCE) recognition technique, and the recognized gesture information is compared with a preset gesture, so as to screen out a preset control gesture; the preset control gesture is a gesture in which five fingers are opened, and of course, a person skilled in the art can set different preset control gestures as required to realize recognition of the preset control gesture.
Step S32, when the gesture information is detected to be a preset control gesture, determining the position of a preset point in the human body key point positions according to the human body key point positions;
step S33, adjusting the camera according to the position of the preset point to make the human body in the preset position in the camera;
in this embodiment, the positions of the human body key points may be divided into 16 key points, and the key points may be specifically divided according to the positions of human bones; referring to fig. 8, a schematic diagram of positions of key points of a human body is shown, where the preset point is a key point located at a midpoint of a connection line between two shoulders of the human body, i.e., point 1 in fig. 8; and when the position of the preset point is identified, controlling the camera to adjust up, down, left and right so that the preset point is always positioned at the central position in the camera, and thus, the human body is always positioned in a television display picture which is connected with the camera.
In the invention, the judgment of the gesture information is more accurate by determining whether the gesture information is a preset control gesture according to the position of the key point of the hand; when the gesture information is detected to be the preset control gesture, the position of a preset point in the human body key point positions is determined according to the human body key point positions, so that the joint judgment of the gesture information and the human body key point positions is realized, and the association of the gesture and the human body skeleton is completed; the camera is adjusted according to the position of the preset point, so that the human body is located at the preset position in the camera, the interaction between the user and the television can be better guaranteed according to the action and the movement of the user, and the practical experience of the user is improved.
Further, referring to fig. 4, based on the display control method of the present invention proposed by the first embodiment of the present invention, the present invention proposes a third embodiment, and after step S33, the method further includes:
step S34, determining whether other preset control gestures except the judged preset control gesture exist according to the human body information within the preset field angle range acquired in real time;
the determined preset control gesture is a control gesture of a human body corresponding to the current camera, for example, when it is determined that the current gesture is the preset control gesture, the camera is adjusted along with the human body corresponding to the current control gesture, and when a second control gesture appears within the field angle range, it is determined whether the second control gesture is the preset control gesture.
Step S35, if yes, determining the position of a preset point in the human body key point position of the human body corresponding to the next preset control gesture according to the priority of the other preset control gestures;
referring to fig. 5, in an embodiment, the step S35 further includes:
step S351, obtaining picture information within the preset field angle range, and obtaining user information of the human body corresponding to the other preset control gestures according to the picture information;
in this embodiment, the face information of the human body in the preset field angle range may be acquired according to the picture information, and the user information of the human body corresponding to the other preset control gestures is acquired according to the face information, where the user information may be account information generated according to the face information and stored in a television, and includes the number of times that the user uses the television.
Step S352, processing to obtain user priorities of human bodies corresponding to the other preset control gestures according to the user information;
and S353, determining the priority of other preset control gestures according to the user priority, and determining the position of a preset point in the human body key point position of the human body corresponding to the next preset control gesture according to the priority.
The user priority may be determined according to the number of times the user uses the television stored in the user information. The more the use times are, the higher the priority of the user is, and whether the gesture information of the user with the higher priority is a preset control gesture is judged preferentially; in addition, the user priority can be judged according to the sequence corresponding to the human body entering the preset field angle range, namely the priority of the user corresponding to the human body entering the preset field angle range is higher; the priority can also be set by the user himself.
And step S36, executed after step S35, of adjusting the camera according to the position of the preset point in the human body key point position corresponding to the next preset control gesture, so that the human body corresponding to the next preset control gesture is located at the preset position in the camera.
And the human body corresponding to the next preset control gesture is the next user determined according to the user priority order, meanwhile, the preset point position in the human body key point position of the human body corresponding to the next user is obtained, and the camera is adjusted to rotate up, down, left and right, so that the preset position in the camera is switched to the human body corresponding to the next user. For example, when the television display picture is following the first person, the second person only needs to make a preset control gesture action of opening five fingers, and then the camera can detect the control gesture, so that the position of a key point of the human body of the second person is identified, the camera is further adjusted, the second person is always located at the center of the camera, and the picture of the second person is always kept in the television display picture.
In the invention, whether other preset control gestures except the judged preset control gesture exist is determined according to the human body information in the preset field angle range acquired in real time, so that the judgment of other users except the judged user is realized, the camera is prevented from detecting only one user, and the other users can be conveniently switched to carry out picture following; the position of a preset point in the human body key point position of the human body corresponding to the next preset control gesture is determined according to the priority sequence of the other preset control gestures, so that the problem that other preset control gestures cannot be determined when the same preset control gesture is detected by a camera at the same time is avoided, the judgment accuracy is improved, and the use experience of a user is improved; the camera is adjusted according to the position of the preset point, so that the human body corresponding to the next preset control gesture is located at the preset position in the camera, the effect that different users follow the corresponding users through gesture switching of the television display pictures is achieved, the users can make specific gestures, the television display pictures can be switched to the users in human-computer interaction, manual switching of the users through a remote controller and the like is avoided, the user experience is improved, and meanwhile the application scene of the television is wider.
Further, referring to fig. 6, in the display control method according to the present invention proposed based on the first embodiment of the present invention, the present invention proposes a fourth embodiment, and the step S31 includes:
step S311, determining whether the gesture information is consistent with a preset control gesture according to the position of the key point of the hand;
in this embodiment, the gesture information includes 22 gesture actions, the positions of the key points of the hand are identified by an AI (artificial intelligence ARTIFICIAL INTELLIGENCE) identification technique and a deep learning algorithm, and it is determined whether the gesture actions included in the gesture information are preset control gestures;
step S312, if the gesture information is in accordance with a preset control gesture, acquiring the time of existence of the preset control gesture;
step 313, if the time of the preset control gesture is longer than the preset time, determining that the gesture information is the preset control gesture;
the preset time is 1 second, and of course, a person skilled in the art can set different preset times as needed, for example, 1.2 seconds, 1.4 seconds, 1.6 seconds, and the like, so as to realize the judgment of the preset control gesture;
in the invention, whether the preset control gesture is adopted or not is judged by judging the existence time of the preset control gesture, so that the problem of mistaken touch in the human-computer interaction process is avoided, and the judgment accuracy of the preset control gesture and the use experience of a user are improved.
Further, referring to fig. 7, in the display control method according to the present invention proposed based on the first embodiment of the present invention, the present invention proposes a fifth embodiment, and the step S10 includes:
step S11, acquiring picture information in a preset field angle range, and judging whether a human body exists in the preset field angle range;
step S12, if a human body exists, processing according to the picture information and a preset learning algorithm to obtain a first preset number of human body key points and a second preset number of hand key points corresponding to the human body;
the field angle is an included angle formed by taking a lens of the camera as a vertex angle and two edges of a maximum range through which an object image of a detected human body can pass through the lens, wherein the maximum range is a field angle range, the preset field angle range can be a range covered by a field angle of 30 degrees or a range covered by a field angle of 45 degrees and a range covered by a field angle of 60 degrees, and technicians in the field can set field angle ranges with different sizes according to actual needs so as to meet the requirement for acquiring human body information. The keypoint locations include 16 human keypoints representing skeletal locations and 22 hand keypoints representing hands, which may be identified through AI (artificial intelligence ARTIFICIAL INTELLIGENCE) deep learning.
Wherein, the step S12 further includes:
if the human body exists, determining the number of the human body according to the picture information;
if the number of people is less than the preset number of people, processing according to the picture information and a preset learning algorithm to obtain a first preset number of human key points and a second preset number of hand key points corresponding to the human body;
if the number of people is larger than or equal to the preset number of people, acquiring the priority sequence of preset control gestures corresponding to the human body in a preset field angle range, and processing according to the picture information and a preset learning algorithm in sequence to obtain a first preset number of human key points and a second preset number of hand key points corresponding to the human body;
referring to fig. 8 and 9, the schematic diagram of the positions of the human body key points and the schematic diagram of the positions of the hand key points are respectively shown, in this embodiment, the preset number of people is 1, and the number of the human body corresponds to the number of people. Whether a person exists in the preset field angle range is judged by acquiring picture information in the preset field angle range, if yes, a first preset number of human key points and a second preset number of hand key points corresponding to the human body are obtained according to the picture information and a preset learning algorithm, the camera is prevented from detecting the preset field angle range for a long time, electric power is saved, and equipment loss is prevented.
Further, based on the display control method of the present invention proposed by the first embodiment of the present invention, the present invention proposes a sixth embodiment, and after the step S30, the method further includes:
according to the real-time human body posture information, identifying a user operation intention, converting the user operation intention into a control instruction corresponding to the human body posture information and executing the control instruction;
in this embodiment, positions of the key points of the human body and the key points of the hand are identified, human posture information formed by combining the key points of the human body and the key points of the hand is obtained through a preset algorithm, and then a user operation intention corresponding to a preset action instruction is identified and obtained through matching the human posture information with the preset action instruction, and is converted into a control instruction and executed, so that the television is controlled to perform corresponding operation. For example, if a hand-lifting action of the user is recognized, the hand-lifting action is matched with a preset action instruction, the hand-lifting action is recognized as a television channel switching action, the television channel switching is controlled, and a person skilled in the art can set human body posture information corresponding to the control instruction according to actual needs so as to improve the use experience of the user.
In the invention, the operation intention of the user is recognized according to the real-time human body posture information, and the operation intention is converted into the corresponding control instruction and executed, so that the user can directly control the content displayed by the television through the posture change of the body in the human-computer interaction process without observing the complex key on the traditional remote controller for operation, the convenience of television control is improved, and the interaction between the user and the television is favorably realized.
The invention also proposes a computer-readable storage medium on which a computer program is stored. The computer-readable storage medium may be the Memory 02 in the display device of fig. 1, and may also be at least one of a ROM (Read-Only Memory)/RAM (Random Access Memory), a magnetic disk, and an optical disk, and the computer-readable storage medium includes several pieces of information for enabling the display device to perform the method according to the embodiments of the present invention.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A display control method, characterized by comprising the steps of:
acquiring human body information within a preset field angle range in real time, and processing according to the human body information to obtain key point positions corresponding to the human body information;
processing to obtain real-time human body posture information according to the key point positions;
and adjusting the camera according to the real-time human body posture information so as to enable the human body to be in a preset position in the camera.
2. The display control method according to claim 1, wherein the human body posture information includes gesture information; the key point positions comprise hand key points and human body key points; the step of adjusting the camera according to the real-time human body posture information so as to enable the human body to be positioned at a preset position in the camera comprises the following steps:
determining whether the gesture information is a preset control gesture according to the hand key points;
when the gesture information is detected to be a preset control gesture, determining the position of a preset point in the human body key point positions according to the human body key point positions;
and adjusting the camera according to the position of the preset point so as to enable the human body to be in the preset position in the camera.
3. The display control method according to claim 2, wherein after the step of adjusting the camera according to the position of the preset point so that the human body is at the preset position in the camera, the method further comprises:
determining whether other preset control gestures except the judged preset control gesture exist according to the human body information within the preset field angle range acquired in real time;
if so, determining the position of a preset point in the human body key point positions of the human body corresponding to the next preset control gesture according to the priority sequence of the other preset control gestures;
and adjusting the camera according to the position of a preset point in the human body key point position corresponding to the next preset control gesture so that the human body corresponding to the next preset control gesture is in the preset position in the camera.
4. The display control method according to claim 3, wherein the step of determining the position of the preset point in the human body key point positions of the human body corresponding to the next preset control gesture according to the priority of the other preset control gestures comprises:
acquiring picture information within the preset field angle range, and acquiring user information of the human body corresponding to the other preset control gestures according to the picture information;
processing to obtain the user priority of the human body corresponding to the other preset control gestures according to the user information;
and determining the priority of other preset control gestures according to the user priority, and determining the position of a preset point in the human body key point position of the human body corresponding to the next preset control gesture according to the priority.
5. The display control method according to claim 2, wherein the step of determining whether the gesture information is a preset control gesture according to the hand key point comprises:
determining whether the gesture information is consistent with a preset control gesture according to the position of the key point of the hand;
if the gesture information is in accordance with a preset control gesture, acquiring the time of the preset control gesture;
and if the time of the preset control gesture is longer than the preset time, judging that the gesture information is the preset control gesture.
6. The display control method according to claim 1, wherein the step of acquiring the human body information in a preset field angle range in real time and processing the human body information to obtain the positions of the key points corresponding to the human body information comprises:
acquiring picture information in a preset field angle range, and judging whether a human body exists in the preset field angle range;
and if a human body exists, processing according to the picture information and a preset learning algorithm to obtain a first preset number of human body key points and a second preset number of hand key points corresponding to the human body.
7. The display control method according to claim 6, wherein the step of obtaining a first preset number of key points of the human body and a second preset number of key points of the hand corresponding to the human body according to the picture information and a preset learning algorithm if the human body exists comprises:
if the human body exists, determining the number of the human body according to the picture information;
if the number of people is less than the preset number of people, processing according to the picture information and a preset learning algorithm to obtain a first preset number of human key points and a second preset number of hand key points corresponding to the human body;
if the number of people is larger than or equal to the preset number of people, acquiring the priority sequence of the preset control gesture corresponding to the human body in the preset field angle range, and processing according to the picture information and a preset learning algorithm in sequence to obtain a first preset number of human key points and a second preset number of hand key points corresponding to the human body.
8. The display control method according to claim 1, wherein after the step of adjusting the camera according to the real-time human body posture information to make the human body be at a preset position in the camera, further comprising:
and identifying the operation intention of the user according to the real-time human body posture information, converting the operation intention into a control instruction corresponding to the human body posture information and executing the control instruction.
9. A display device, characterized in that the display device comprises a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the display control method according to any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the display control method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110754541.3A CN113542832B (en) | 2021-07-01 | 2021-07-01 | Display control method, display device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110754541.3A CN113542832B (en) | 2021-07-01 | 2021-07-01 | Display control method, display device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113542832A true CN113542832A (en) | 2021-10-22 |
| CN113542832B CN113542832B (en) | 2023-07-04 |
Family
ID=78097679
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110754541.3A Active CN113542832B (en) | 2021-07-01 | 2021-07-01 | Display control method, display device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113542832B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130283162A1 (en) * | 2012-04-23 | 2013-10-24 | Sony Mobile Communications Ab | System and method for dynamic content modification based on user reactions |
| CN106851094A (en) * | 2016-12-30 | 2017-06-13 | 纳恩博（北京）科技有限公司 | A kind of information processing method and device |
| CN107357427A (en) * | 2017-07-03 | 2017-11-17 | 南京江南博睿高新技术研究院有限公司 | A kind of gesture identification control method for virtual reality device |
| CN111897430A (en) * | 2020-07-30 | 2020-11-06 | 深圳创维－Rgb电子有限公司 | Application control method, display terminal and computer readable storage medium |
| CN111953907A (en) * | 2020-08-28 | 2020-11-17 | 维沃移动通信有限公司 | Composition method, composition device and electronic equipment |
| CN112506342A (en) * | 2020-12-04 | 2021-03-16 | 郑州中业科技股份有限公司 | Man-machine interaction method and system based on dynamic gesture recognition |
| CN112639689A (en) * | 2020-04-30 | 2021-04-09 | 华为技术有限公司 | Control method, device and system based on air-separating gesture |
| CN112672062A (en) * | 2020-08-21 | 2021-04-16 | 海信视像科技股份有限公司 | Display device and portrait positioning method |
| CN112987933A (en) * | 2021-03-25 | 2021-06-18 | 北京市商汤科技开发有限公司 | Device control method, device, electronic device and storage medium |
-
2021
- 2021-07-01 CN CN202110754541.3A patent/CN113542832B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130283162A1 (en) * | 2012-04-23 | 2013-10-24 | Sony Mobile Communications Ab | System and method for dynamic content modification based on user reactions |
| CN106851094A (en) * | 2016-12-30 | 2017-06-13 | 纳恩博（北京）科技有限公司 | A kind of information processing method and device |
| CN107357427A (en) * | 2017-07-03 | 2017-11-17 | 南京江南博睿高新技术研究院有限公司 | A kind of gesture identification control method for virtual reality device |
| CN112639689A (en) * | 2020-04-30 | 2021-04-09 | 华为技术有限公司 | Control method, device and system based on air-separating gesture |
| CN111897430A (en) * | 2020-07-30 | 2020-11-06 | 深圳创维－Rgb电子有限公司 | Application control method, display terminal and computer readable storage medium |
| CN112672062A (en) * | 2020-08-21 | 2021-04-16 | 海信视像科技股份有限公司 | Display device and portrait positioning method |
| CN111953907A (en) * | 2020-08-28 | 2020-11-17 | 维沃移动通信有限公司 | Composition method, composition device and electronic equipment |
| CN112506342A (en) * | 2020-12-04 | 2021-03-16 | 郑州中业科技股份有限公司 | Man-machine interaction method and system based on dynamic gesture recognition |
| CN112987933A (en) * | 2021-03-25 | 2021-06-18 | 北京市商汤科技开发有限公司 | Device control method, device, electronic device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 郑潇;彭晓东;王嘉璇;: "基于姿态时空特征的人体行为识别方法", 计算机辅助设计与图形学学报, no. 09 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113542832B (en) | 2023-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021135601A1 (en) | Auxiliary photographing method and apparatus, terminal device, and storage medium | |
| CN111556278B (en) | Video processing method, video display device and storage medium | |
| CN111182205B (en) | Photographing method, electronic device, and medium | |
| US20090153366A1 (en) | User interface apparatus and method using head gesture | |
| CN109074819A (en) | Preferred control method based on operation-sound multi-mode command and the electronic equipment using it | |
| CN108712603B (en) | Image processing method and mobile terminal | |
| CN106155315A (en) | The adding method of augmented reality effect, device and mobile terminal in a kind of shooting | |
| CN111782115B (en) | Application program control method and device and electronic equipment | |
| US20230168737A1 (en) | Augmented reality object manipulation | |
| CN113194254A (en) | Image shooting method and device, electronic equipment and storage medium | |
| WO2022100262A1 (en) | Display device, human body posture detection method, and application | |
| CN113219851A (en) | Control device of intelligent household equipment, control method thereof and storage medium | |
| CN107995417B (en) | Photographing method and mobile terminal | |
| CN110086998B (en) | Shooting method and terminal | |
| CN110222567B (en) | Image processing method and device | |
| CN114025092A (en) | Shooting control display method and device, electronic equipment and medium | |
| CN112637655A (en) | Control method and system of smart television and mobile terminal | |
| CN113542832A (en) | Display control method, display device, and computer-readable storage medium | |
| CN108471549B (en) | Remote control method and terminal | |
| KR20210040435A (en) | Gesture recognition method, gesture processing method and device | |
| CN117234405A (en) | Information input method and device, electronic equipment and storage medium | |
| Muranaka et al. | A home appliance control system with hand gesture based on pose estimation | |
| CN114266305A (en) | Object identification method and device, electronic equipment and storage medium | |
| CN114245017A (en) | Shooting method and device and electronic equipment | |
| CN112347832A (en) | Unlocking method, device and equipment based on face recognition and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |