CN113132775B - Control method of electronic equipment, electronic equipment and storage medium - Google Patents
Control method of electronic equipment, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113132775B CN113132775B CN201911424686.6A CN201911424686A CN113132775B CN 113132775 B CN113132775 B CN 113132775B CN 201911424686 A CN201911424686 A CN 201911424686A CN 113132775 B CN113132775 B CN 113132775B
- Authority
- CN
- China
- Prior art keywords
- video frame
- preset
- preset point
- coordinate value
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a control method of electronic equipment, the electronic equipment and a storage medium, wherein the control method of the electronic equipment comprises the following steps: acquiring posture information of a person in front of the electronic equipment; the electronic equipment is controlled according to the posture information, the electronic equipment is controlled by acquiring the posture information of a person in front of the electronic equipment, the user can control the electronic equipment by changing the posture of the user, and the interaction experience of the electronic equipment is enriched.
Description
Technical Field
The present invention relates to the field of electronic device control technologies, and in particular, to a method for controlling an electronic device, and a storage medium.
Background
The television is used as a common household appliance, the frequency of use is very high in daily life, and although the smart television is greatly developed in recent years, the television still has more limitations in the use process at present and cannot provide richer interactive experience for users.
Thus, there is a need for improvement and development of the prior art.
Disclosure of Invention
In view of the above defects in the prior art, the present invention provides a control method for an electronic device, and a storage medium, and aims to solve the problem in the prior art that the interaction experience of the electronic device is not rich.
The technical scheme of the invention is as follows:
in a first aspect of the present invention, a method for controlling an electronic device is provided, where the method for controlling an electronic device includes:
acquiring gesture information of a user in front of electronic equipment;
and controlling the electronic equipment according to the gesture information.
The method for controlling the electronic device, wherein the step of acquiring the posture information of the user in front of the electronic device comprises:
recording a video of a user in front of the electronic equipment to obtain a video;
acquiring each preset point of a user body in a video;
and acquiring the posture information of the user in front of the electronic equipment according to the preset points.
The method for controlling the electronic device, wherein the obtaining of the posture information of the user in front of the electronic device according to the preset points includes:
acquiring first coordinate values respectively corresponding to the preset points in a first video frame of the video;
adjusting each first coordinate value to obtain each adjusted coordinate value corresponding to each preset point in the first video frame;
and acquiring the posture information of the body of the user in the first video frame according to the points corresponding to the adjustment coordinate values.
The method for controlling the electronic device, wherein the adjusting the first coordinate values and obtaining the adjusted coordinate values corresponding to the preset points in the first video frame respectively includes:
acquiring each second coordinate value corresponding to each preset point in a second video frame, wherein the second video frame is a previous video frame of the first video frame;
acquiring the Euclidean distance of each preset point on the first video frame according to the first coordinate value and the second coordinate value corresponding to each preset point;
and obtaining each adjustment coordinate value corresponding to each preset point in the first video frame according to the Euclidean distance of each preset point on the first video frame.
The method for controlling the electronic device, wherein the obtaining of the adjustment coordinate values corresponding to the preset points in the first video frame according to the euclidean distances of the preset points in the first video frame includes:
when the difference between the Euclidean distance of a preset point on the first video frame and the sliding average value corresponding to the preset point is smaller than a preset threshold value, setting the adjustment coordinate value of the preset point in the first video frame as the first coordinate value;
when the difference between the Euclidean distance of a preset point on the first video frame and the sliding average value corresponding to the preset point is larger than the preset threshold value, setting the adjustment coordinate value of the preset point in the first video frame as the second coordinate value corresponding to the preset point;
the sliding average value corresponding to the preset point is the average value of Euclidean distances of the preset point on N video frames before the first video frame, wherein N is a natural number greater than 0.
The control method of the electronic device, wherein the controlling the electronic device according to the gesture information comprises:
comparing the gesture information with preset gesture information;
and controlling the electronic equipment according to the comparison result of the posture information and the preset posture information.
The control method of the electronic device, wherein the preset posture information includes first posture information, and the controlling the electronic device according to the comparison result of the posture information and the preset posture information includes:
when the electronic equipment is running, if the posture information is kept unchanged within a preset time, the running is interrupted;
and when the electronic equipment is in the interrupted running state, if the posture information is matched with the first posture information, the running is recovered.
The control method of the electronic device, wherein the preset posture information includes second posture information, and the controlling the electronic device according to the comparison result of the posture information and the preset posture information includes:
and if the posture information is matched with the second posture information, sending out corresponding prompt information.
In a second aspect of the present invention, an electronic device is provided, where the electronic device includes: a processor, a storage medium communicatively coupled to the processor, the storage medium adapted to store a plurality of instructions; the processor is adapted to call instructions in the storage medium to execute a control method of an electronic device implementing any of the above.
In a third aspect of the present invention, a storage medium is provided, wherein the computer readable storage medium stores one or more programs, which are executable by one or more processors to implement the steps of the control method of an electronic device as described above.
The invention has the technical effects that: the invention provides a control method of electronic equipment, which controls the electronic equipment by acquiring the posture information of a user in front of the electronic equipment, realizes that the user can control the electronic equipment by changing the posture of the user, and enriches the interactive experience of the electronic equipment.
Drawings
Fig. 1 is a flowchart of a first embodiment of a control method of an electronic device according to the present invention;
2-3 are schematic diagrams of obtaining gesture information in the control method of the electronic device provided by the invention;
fig. 4 is a schematic diagram of an implementation of a control method for an electronic device provided by the present invention;
fig. 5 is a schematic diagram of an electronic device according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
The invention provides a control method of electronic equipment, which can be applied to the electronic equipment, wherein a processor in the electronic equipment can acquire gesture information of a user in front of the electronic equipment by executing the steps of the television control method and control the electronic equipment according to the gesture information. The electronic device may be a terminal that acquires user gesture information and controls the electronic device according to the gesture information, and a television is taken as an example to be described below.
Example one
Referring to fig. 1, fig. 1 is a flowchart of a first embodiment of a method for controlling an electronic device according to the present invention, where the method for controlling the electronic device includes:
and S100, acquiring gesture information of a user in front of the electronic equipment.
Specifically, in the present embodiment, the posture information is acquired by acquiring an image of a person in front of a television, and the acquiring the posture information of the person in front of the television includes:
and S110, recording the video of the user in front of the electronic equipment to obtain the video.
The television set may be provided with a camera, and the person in front of the television set is recorded by the camera to obtain a video, or the television set may be connected to a separately provided camera, for example, connected to the camera or a device having the camera in a connection manner such as a network or bluetooth, and the person in front of the television set is recorded by calling the connected camera to obtain the video. The television can also be started to record in a video recording state to obtain the video when being started, or an inductor can be arranged to start to record to obtain the video when a human body is induced to exist in front of the television.
And S120, acquiring each preset point of the user body in the video.
The preset points are preset points capable of reflecting the posture of the human body, such as contour points of the torso of the human body, and in the present embodiment, joint points of the human body in the video are acquired as the preset points.
Specifically, the video includes a plurality of frames, and acquiring the preset points of the human body in the video is to process each video frame in the video, acquire the preset points of the human body on each video frame, connect the preset points, and acquire the posture information of the human body on each video frame.
The method comprises the steps that each preset point of a human body in the acquired video can be realized through a pre-trained preset point identification model, the preset point identification model is trained through a plurality of first training samples, the first training samples comprise sample video frames and the preset points corresponding to the sample video frames, and the preset point identification model can realize the identification of the preset points from the video frames through deep learning training. As shown in fig. 2, after the video is obtained, the video frames of the video are input to the preset point identification model, and the preset point identification model outputs the preset points of the human body on the video frames of the video.
In the video, there may be a case where a plurality of human bodies exist in one video frame, in a possible implementation manner, after preset points of a human body in the video frame are acquired, the preset points are further grouped, so as to identify the preset points of each human body, where the grouping of the preset points may be performed by the preset point identification model, specifically, preset point grouping information corresponding to a sample video frame may be added to each first training sample of the preset point identification model, so that the preset points and the preset point grouping information in the video frame may be output according to the video frame by the preset point identification model when the video frame is acquired.
And S130, acquiring the posture information of the user in front of the electronic equipment according to the preset points.
The video is obtained by recording a person in front of the television, and the posture information of the person in front of the television can be obtained by obtaining the posture information of the human body in the video. In practical implementation, there may be situations where the image quality is not clear and there are many noisy images, and at this time, there may be errors in the preset points identified by the preset point identification model, so in this embodiment, when obtaining the posture information of the human body in the video according to the preset points, each preset point needs to be adjusted.
Specifically, the obtaining of the gesture information of the user in front of the electronic device according to the preset points includes:
s131, obtaining each first coordinate value corresponding to each preset point in a first video frame of the video.
As described above, the video includes a plurality of video frames, and acquiring the posture information of the human body in the video is to acquire the posture information of the human body in each video frame.
And when the first video frame of the video is acquired, identifying which points in the first video frame are preset points through the preset point identification model, so as to acquire the first coordinate value of each preset point.
S132, adjusting each first coordinate value, and obtaining each adjusted coordinate value corresponding to each preset point in the first video frame.
As described above, each preset point output by the preset point recognition model may have an error, and therefore, the first coordinate value of each recognized preset point needs to be adjusted to improve the accuracy of human body posture recognition.
The adjusting each first coordinate value to obtain each adjusted coordinate value corresponding to each preset point in the first video frame specifically includes:
s1321, obtaining each second coordinate value corresponding to each preset point in the second video frame.
The second video frame is a previous video frame of the first video frame, and since two consecutive frames in the video record images within a continuous time, the image contents in the second video frame and the first video frame are continuous.
S1322, obtaining the Euclidean distance of each preset point on the first video frame according to the first coordinate value and the second coordinate value corresponding to each preset point.
Specifically, it has been described above that the image contents in the second video frame and the first video frame are continuous, and therefore, there is a correspondence between each preset point in the second video frame and each preset point in the first video frame, for example, the knee joint in the first video frame and the knee joint in the first video frame are the same preset point, and of course, in the actual calculation, there is no limitation to identifying preset names to obtain the correspondence between the preset points by name, and since the time interval between two video frames is very short, it is also possible to simply determine that two closest preset points in the two video frames are the same preset point.
The euclidean distance, also called euclidean metric, is a real distance between two points in space, and the euclidean distance of a preset point on the first video frame may be expressed as: p t ＝||Y t -Y t-1 L, where t is the sequence number of the first video frame, P t Is a Euclidean distance, Y, of a preset point on the first video frame t The first coordinate value, Y, corresponding to a predetermined point t-1 The second coordinate value corresponding to a preset point, that is, the euclidean distance of a preset point on a video frame in the video is equal to the distance between the position point of the preset point on the video frame and the position point on the previous frame of the video frame. In two consecutive video frames, a human body may move, and therefore, the position of the preset point may change, but, because the time interval between two consecutive video frames is short and uniform, the position difference of the same preset point on the first video frame and the second video frame and the position difference of the same preset point on the other two consecutive video frames do not differ too much, in this embodiment, the position difference of the same preset point on the two consecutive video frames is reflected by a sliding average, and the sliding average corresponding to the preset point is an average of euclidean distances of the preset point on N video frames before the first video frame, where N is a natural number greater than 0, and the sliding average may be formulated as:
wherein, A t Is the sliding average, P t Is the Euclidean distance of a preset point on the first video frame. As can be seen from the foregoing description, the difference between the euclidean distance of the preset point on the first video frame and the moving average value should be within a certain range to be a reasonable value.
S1323, obtaining each adjustment coordinate value corresponding to each preset point in the first video frame according to the Euclidean distance of each preset point on the first video frame.
Specifically, the obtaining, according to the euclidean distance of each preset point on the first video frame, each adjustment coordinate value corresponding to each preset point in the first video frame includes:
s1323a, when the difference between the Euclidean distance of the preset point on the first video frame and the sliding average value corresponding to the preset point is smaller than a preset threshold, setting the adjustment coordinate value of the preset point in the first video frame as the first coordinate value.
Specifically, the preset threshold set in the present embodiment is 3 σ t ，σ t The standard deviation of the euclidean distance of the preset point is obtained according to the euclidean distances of the preset point on a plurality of video frames (all or part of the video frames before the first video frame may be selected), which reflects the degree of dispersion of the euclidean distances of the preset point on the plurality of video frames, and when the difference between the euclidean distance of the preset point on the first video frame and the sliding average value is smaller than a preset threshold, which reflects that the change of the first coordinate value of the preset point in the first video frame relative to the second coordinate value of the preset point in the second video frame is within a reasonable range, at this time, the identification of the position of the preset point is considered to be correct, and the adjusted coordinate value of the preset point in the first video frame is set to be the first coordinate value.
S1323b, when the difference between the Euclidean distance of the preset point on the first video frame and the sliding average value corresponding to the preset point is larger than a preset threshold, setting the adjustment coordinate value of the preset point in the first video frame as the second coordinate value corresponding to the preset point.
When the difference between the euclidean distance of the preset point on the first video frame and the sliding average value corresponding to the preset point is greater than the preset threshold, it indicates that the first coordinate value of the preset point in the first video frame is too large relative to the second coordinate value of the preset point in the second video frame, and there may be an identification error.
As can be seen from the above description, in this embodiment, when the first coordinate value in the first video frame is adjusted, the second coordinate value in the video frame before the first video frame needs to be obtained, so that when the first video frame is the first video frame of the video, the first coordinate value in the first video frame of the preset point is not adjusted.
The calculation mode of the adjustment coordinate value can be expressed by the following formula:
wherein t is the sequence number of the first video frame, S t Adjusting coordinate values, P, for a predetermined point in said first video frame t Is a Euclidean distance, Y, of a preset point on the first video frame t Is the first coordinate value, Y t-1 Is the second coordinate value, σ t Is the standard deviation, A t And N is the number of video frames taken before the first video frame when the sliding average is calculated.
After obtaining the adjustment coordinate values of the preset points in the first video frame, the method includes: s133, acquiring the gesture information of the user in the first video frame according to the points corresponding to the adjustment coordinate values.
As can be seen from the foregoing, the points corresponding to the adjustment coordinate values are the positions of the accurate preset points, and at this time, the points corresponding to the adjustment coordinate values are connected, as shown in fig. 3, and the connecting line of the points corresponding to the adjustment coordinate values is the posture information of the human body in the first video frame.
When there are multiple human bodies in the first video frame, as described above, when obtaining each preset point in the first video frame, the preset points are further grouped, and when obtaining the posture information of the human body in the first video frame according to each adjustment coordinate value, the points corresponding to the adjustment coordinate values of the preset points in the same group are connected.
In a possible implementation manner, the pose information of the human body further includes depth information of the human body in the video, that is, the distance between the human body and a camera that shoots the video, where the distance may be obtained by a distance prediction model trained in advance, specifically, the distance prediction model is trained based on a plurality of second training samples, where the second samples include a sample video frame and a distance between the human body in the sample video frame and the camera, and after deep learning of the second samples, the distance prediction model may obtain the distance between the human body in the first video frame and the camera.
As is apparent from the foregoing description, in the present embodiment, the posture information of the human body is acquired by identifying the preset points and connecting the preset points, so that the coordinate values of the preset points in the video frame can be adjusted, and the posture information of the human body in front of the television can be efficiently and accurately acquired.
It should be noted that, although the current smart tv and the current smart tv are greatly developed, most of the tvs still have relatively low CPU computing capabilities, and the computing capabilities are mostly used for rendering and calculating images, and a deep learning model cannot be run efficiently, so that the function expansion of the current tv is limited, in this embodiment, the step of acquiring the pose information of the person in front of the tv may be executed by the tv or by another terminal in communication connection with the tv, specifically, the tv may be connected in a tv control system, the tv control system includes a server, a tv and at least one other terminal, and may be that the tv or another terminal in the control system records the video of the person in front of the tv to acquire the video and send the video to the server, after acquiring the video in front of the tv, the server acquires the computing power of the tv and at least one other terminal in the control system, and sends the video to the terminal with the highest available computing power in the control system, that is, the terminal may be sent to the tv or connected to the tv for processing, and then acquires the pose information in real-time, and then the CPU may not extract the pose information, and may not perform the real-time processing on the video.
Referring to fig. 1 again, after gesture information of a user in front of the electronic device is acquired, the method for controlling the electronic device includes:
and S200, controlling the electronic equipment according to the posture information.
After the electronic equipment acquires the posture information, corresponding operation is carried out according to a comparison result of the posture information and preset posture information.
Specifically, the controlling the electronic device according to the gesture information includes:
s210, comparing the posture information with preset posture information;
s220, controlling the electronic equipment according to the comparison result of the posture information and the preset posture information. The preset posture information is one or more pieces of posture information pre-stored in the electronic device, and specifically, a posture information storage area may be provided in the electronic device, and the preset posture information is stored in the storage area. And after the posture information is acquired, controlling the electronic equipment according to the comparison result of the posture information and preset posture information.
In one implementation, the preset gesture information includes first gesture information, and the controlling the electronic device according to the comparison result of the gesture information and the preset gesture information includes:
s221a, when the electronic device is running, if the posture information is kept unchanged within a preset time, the running is interrupted.
Specifically, in order to prevent the user from watching the television in one posture for too long time and affecting the physical health, in this embodiment, if the posture information is kept unchanged for a preset time, the television stops playing, and in a possible implementation manner, when the playing is stopped, a prompt message may be sent, for example, a text is displayed on a display screen of the television or a voice is sent to prompt the user to keep the same posture for too long time to watch the television.
S221b, when the electronic equipment is in the state of interrupting operation, if the posture information is matched with the first posture information, the operation is recovered.
After the user watches the television in one posture for too long time and controls the television to interrupt playing, the specific first posture information can be displayed on the interface of the television, and the user needs to put a posture consistent with the first posture information to enable the television to recover playing, so that the interactive experience between the user and the television is enriched.
The operations in S221a and S221b may be performed in a normal mode, or may be performed in a child mode, where the child mode is a play mode beneficial for viewing by a child, and in the child mode, the preset duration may be set by an elder in a home, and in the child mode, when the play time of the television reaches the preset duration, the play is interrupted, and the first posture information is displayed, as shown in fig. 4, the child needs to take a posture consistent with the posture on the wall in fig. 4, and when the television receives the posture information in the video and matches the first posture information, the play is resumed, so that not only eyes can be protected, but also the child can get up and stretch the body in time when sitting for a long time, and the child is beneficial to the health of the body.
The child mode can be started by default when the television is started, or started when the television detects that a child is in front of the television through the camera, receives an exit password input by a user when receiving an instruction of the user to exit the child mode, and exits the child mode only when the exit password is consistent with a preset password.
In another possible implementation manner, the preset gesture information includes second gesture information, and the controlling the electronic device according to the comparison result between the gesture information and the preset gesture information includes:
and if the posture information is matched with the second posture information, sending out corresponding prompt information.
After the electronic device acquires the posture information, the posture information may be matched with preset second posture information, specifically, the second posture information is one or more pieces of posture information pre-stored in the electronic device, and the second posture information is posture information adverse to health, for example, posture information corresponding to a posture that a human body assumes when the electronic device is tilted, laid down, or too close to a television. When the posture information of the human body in the video is matched with the preset second posture information, the posture of a user watching the electronic equipment at present is not good for the health of the user, and the television sends out prompt information, wherein the preset prompt information can be played through voice or displayed through a popup window on a display interface of the electronic equipment.
It can be seen from the above embodiments that, the electronic device control method provided by the present invention controls the electronic device by obtaining the gesture information of the user in front of the electronic device, so that the user can control the electronic device by changing his own gesture, and the interaction experience of the electronic device is enriched.
Example two
Based on the first embodiment, the invention further provides an electronic device, and a functional block diagram of the electronic device can be as shown in fig. 5. The electronic equipment comprises a processor, a memory, a network interface, a display screen and a temperature sensor which are connected through a system bus. Wherein, the processor of the electronic equipment has the functions of calculation and control. The memory of the electronic equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the electronic device is used for connecting and communicating with an external electronic device through a network. The computer program is executed by a processor to implement the control method of the electronic device according to the first embodiment. The display screen of the electronic equipment can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor of the electronic equipment is arranged in the electronic equipment in advance and used for detecting the current operating temperature of the internal equipment.
The electronic equipment can also comprise a camera, and the camera is used for recording a video of a user in front of the electronic equipment to obtain the video.
It will be appreciated by those skilled in the art that the block diagram shown in fig. 5 is only a block diagram of a portion of the structure associated with the inventive arrangements and does not constitute a limitation of the electronic devices to which the inventive arrangements may be applied, and that a particular electronic device may include more or less components than those shown, or combine certain components, or have a different arrangement of components.
In one embodiment, an electronic device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor when executing the computer program implementing at least the following steps: acquiring gesture information of a user in front of the electronic equipment;
and controlling the electronic equipment according to the gesture information.
Wherein the step of acquiring the gesture information of the user in front of the electronic device comprises:
recording a video of a user in front of the electronic equipment to obtain a video;
acquiring each preset point of a user body in a video;
and acquiring the posture information of the user in front of the electronic equipment according to the preset points.
Wherein the obtaining of the gesture information of the user in front of the electronic device according to the preset points comprises:
acquiring first coordinate values respectively corresponding to the preset points in a first video frame of the video;
adjusting each first coordinate value to obtain each adjusted coordinate value corresponding to each preset point in the first video frame;
and acquiring the gesture information of the user in the first video frame according to the points corresponding to the adjustment coordinate values.
Wherein the adjusting each first coordinate value to obtain each adjusted coordinate value corresponding to each preset point in the first video frame includes:
acquiring each second coordinate value corresponding to each preset point in a second video frame, wherein the second video frame is a previous video frame of the first video frame;
acquiring the Euclidean distance of each preset point on the first video frame according to the first coordinate value and the second coordinate value corresponding to each preset point;
and obtaining each adjusting coordinate value corresponding to each preset point in the first video frame according to the Euclidean distance of each preset point on the first video frame.
Wherein, the obtaining of each adjustment coordinate value corresponding to each preset point in the first video frame according to the euclidean distance of each preset point on the first video frame includes:
when the difference between the Euclidean distance of a preset point on the first video frame and the sliding average value corresponding to the preset point is smaller than a preset threshold value, setting the adjustment coordinate value of the preset point in the first video frame as the first coordinate value;
when the difference between the Euclidean distance of a preset point on the first video frame and the sliding average value corresponding to the preset point is larger than the preset threshold value, setting the adjustment coordinate value of the preset point in the first video frame as the second coordinate value corresponding to the preset point;
the sliding average value corresponding to the preset point is the average value of Euclidean distances of the preset point on N video frames before the first video frame, wherein N is a natural number greater than 0.
Wherein the controlling the electronic device according to the gesture information comprises:
comparing the gesture information with preset gesture information;
and controlling the electronic equipment according to the comparison result of the posture information and the preset posture information.
Wherein the preset gesture information includes first gesture information, and the controlling the electronic device according to the comparison result of the gesture information and the preset gesture information includes:
when the electronic equipment is running, if the posture information is kept unchanged within a preset time, the running is interrupted;
and when the electronic equipment is in the interrupted running state, if the posture information is matched with the first posture information, the running is recovered.
Wherein the preset gesture information comprises second gesture information, and the controlling the electronic device according to the comparison result of the gesture information and the preset gesture information comprises:
and if the posture information is matched with the second posture information, sending corresponding prompt information.
EXAMPLE III
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases or other media used in the embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct Rambus Dynamic RAM (DRDRAM), and Rambus Dynamic RAM (RDRAM), among others.
The present invention provides a storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement a television control method as described in embodiment one.
It is to be understood that the invention is not limited to the examples described above, but that modifications and variations may be effected thereto by those of ordinary skill in the art in light of the foregoing description, and that all such modifications and variations are intended to be within the scope of the invention as defined by the appended claims.
Claims (6)
1. A control method of an electronic device, comprising the steps of:
acquiring gesture information of a user in front of the electronic equipment;
the step of acquiring the gesture information of the user in front of the electronic device comprises:
recording a video of a user in front of the electronic equipment to obtain a video;
acquiring each preset point of a user body in a video;
acquiring gesture information of a user in front of the electronic equipment according to the preset points;
the acquiring of the posture information of the user in front of the electronic device according to the preset points includes:
acquiring first coordinate values corresponding to the preset points in a first video frame of the video;
adjusting each first coordinate value to obtain each adjusted coordinate value corresponding to each preset point in the first video frame;
acquiring gesture information of the user in the first video frame according to the points corresponding to the adjustment coordinate values;
the adjusting each first coordinate value to obtain each adjusted coordinate value corresponding to each preset point in the first video frame includes:
acquiring each second coordinate value corresponding to each preset point in a second video frame, wherein the second video frame is a previous video frame of the first video frame;
acquiring the Euclidean distance of each preset point on the first video frame according to the first coordinate value and the second coordinate value corresponding to each preset point;
obtaining each adjusting coordinate value corresponding to each preset point in the first video frame according to the Euclidean distance of each preset point on the first video frame;
the obtaining of each adjustment coordinate value corresponding to each preset point in the first video frame according to the euclidean distance of each preset point on the first video frame includes:
when the difference between the Euclidean distance of a preset point on the first video frame and the sliding average value corresponding to the preset point is smaller than a preset threshold value, setting the adjustment coordinate value of the preset point in the first video frame as the first coordinate value;
when the difference between the Euclidean distance of a preset point on the first video frame and the sliding average value corresponding to the preset point is larger than the preset threshold value, setting the adjustment coordinate value of the preset point in the first video frame as the second coordinate value corresponding to the preset point;
the moving average value corresponding to the preset point is the average value of Euclidean distances of the preset point on N video frames before the first video frame, wherein N is a natural number greater than 0;
the calculation formula of the adjustment coordinate value is as follows:
wherein t is the sequence number of the first video frame, S t Adjusting coordinate values, P, for a predetermined point in said first video frame t Is a Euclidean distance, Y, of a preset point on the first video frame t Is the first coordinate value, Y t-1 Is the second coordinate value, σ t Is the standard deviation of Euclidean distances of a preset point on all or part of video frames before the first video frame, A t Is the moving average, wherein,
n is the number of video frames taken before the first video frame when the sliding average value is calculated;
connecting the points corresponding to the adjustment coordinate values to obtain the posture information of the human body in the first video frame;
when a plurality of human bodies exist in the first video frame, acquiring each preset point in the first video frame, grouping the preset points, and connecting points corresponding to the adjustment coordinate values of the preset points in the same group to obtain posture information of the human bodies in the first video frame;
and controlling the electronic equipment according to the gesture information.
2. The method according to claim 1, wherein the controlling the electronic device according to the gesture information includes:
comparing the gesture information with preset gesture information;
and controlling the electronic equipment according to the comparison result of the posture information and the preset posture information.
3. The method according to claim 2, wherein the preset gesture information includes first gesture information, and wherein controlling the electronic device according to the comparison result of the gesture information and the preset gesture information includes:
when the electronic equipment is running, if the posture information is kept unchanged within a preset time, the running is interrupted;
and when the electronic equipment is in an interrupted operation state, if the posture information is matched with the first posture information, the operation is recovered.
4. The method according to claim 2, wherein the preset posture information includes second posture information, and wherein the controlling the electronic apparatus according to the comparison result of the posture information and the preset posture information includes:
and if the posture information is matched with the second posture information, sending corresponding prompt information.
5. An electronic device, characterized in that the electronic device comprises a processor, a storage medium communicatively connected to the processor, the storage medium being adapted to store a plurality of instructions, the processor being adapted to call the instructions in the storage medium to perform the steps of implementing the control method of the electronic device according to any of the preceding claims 1-4.
6. A storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to carry out the steps of the control method of an electronic device according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911424686.6A CN113132775B (en) | 2019-12-30 | 2019-12-30 | Control method of electronic equipment, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911424686.6A CN113132775B (en) | 2019-12-30 | 2019-12-30 | Control method of electronic equipment, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113132775A CN113132775A (en) | 2021-07-16 |
| CN113132775B true CN113132775B (en) | 2023-03-10 |
Family
ID=76770785
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911424686.6A Active CN113132775B (en) | 2019-12-30 | 2019-12-30 | Control method of electronic equipment, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113132775B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102435A (en) * | 2013-04-02 | 2014-10-15 | 百度在线网络技术（北京）有限公司 | Method for adjusting posture of user in the process of using equipment and equipment |
| CN105307017A (en) * | 2015-11-03 | 2016-02-03 | Tcl集团股份有限公司 | Method and device for correcting posture of smart television user |
| CN108040276A (en) * | 2017-11-27 | 2018-05-15 | 信利光电股份有限公司 | A kind of Intelligent television control method and relevant apparatus |
| CN108229332A (en) * | 2017-12-08 | 2018-06-29 | 华为技术有限公司 | Bone attitude determination method, device and computer readable storage medium |
| CN110147717A (en) * | 2019-04-03 | 2019-08-20 | 平安科技（深圳）有限公司 | A kind of recognition methods and equipment of human action |
| CN110287755A (en) * | 2018-03-19 | 2019-09-27 | 广东欧珀移动通信有限公司 | Information processing method and device, electronic equipment, computer readable storage medium |
-
2019
- 2019-12-30 CN CN201911424686.6A patent/CN113132775B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104102435A (en) * | 2013-04-02 | 2014-10-15 | 百度在线网络技术（北京）有限公司 | Method for adjusting posture of user in the process of using equipment and equipment |
| CN105307017A (en) * | 2015-11-03 | 2016-02-03 | Tcl集团股份有限公司 | Method and device for correcting posture of smart television user |
| CN108040276A (en) * | 2017-11-27 | 2018-05-15 | 信利光电股份有限公司 | A kind of Intelligent television control method and relevant apparatus |
| CN108229332A (en) * | 2017-12-08 | 2018-06-29 | 华为技术有限公司 | Bone attitude determination method, device and computer readable storage medium |
| CN110287755A (en) * | 2018-03-19 | 2019-09-27 | 广东欧珀移动通信有限公司 | Information processing method and device, electronic equipment, computer readable storage medium |
| CN110147717A (en) * | 2019-04-03 | 2019-08-20 | 平安科技（深圳）有限公司 | A kind of recognition methods and equipment of human action |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113132775A (en) | 2021-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3477519A1 (en) | Identity authentication method, terminal device, and computer-readable storage medium | |
| CN104635920B (en) | The control method of gesture recognition device and gesture recognition device | |
| CN111669653A (en) | Playing control method, device, storage medium and television | |
| US9491263B2 (en) | Systems and methods for automatically modifying a picture or a video containing a face | |
| CN109089172B (en) | Bullet screen display method and device and electronic equipment | |
| CN107683446A (en) | Method and eye tracks equipment at least one user of automatic identification eye tracks equipment | |
| CN108897589B (en) | Human-computer interaction method and device in display equipment, computer equipment and storage medium | |
| CN110780742B (en) | Eyeball tracking processing method and related device | |
| CN110612530A (en) | Method for selecting a frame for use in face processing | |
| CN111062276A (en) | Human body posture recommendation method and device based on human-computer interaction, machine readable medium and equipment | |
| CN112312215B (en) | Startup content recommendation method based on user identification, smart television and storage medium | |
| CN110427849B (en) | Face pose determination method and device, storage medium and electronic equipment | |
| CN113835660A (en) | Display screen adjusting method and device, computer equipment and storage medium | |
| CN110969120B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN112148923A (en) | Search result sorting method, sorting model generation method, device and equipment | |
| CN111223549A (en) | Mobile end system and method for disease prevention based on posture correction | |
| CN114501144A (en) | Image-based television control method, device, equipment and storage medium | |
| CN113132775B (en) | Control method of electronic equipment, electronic equipment and storage medium | |
| CN109986553B (en) | Active interaction robot, system, method and storage device | |
| CN116363725A (en) | Portrait tracking method and system for display device, display device and storage medium | |
| CN113613070B (en) | Face video processing method and device, electronic equipment and storage medium | |
| CN113038257B (en) | Volume adjusting method and device, smart television and computer readable storage medium | |
| CN114727119B (en) | Live broadcast continuous wheat control method, device and storage medium | |
| CN111610886A (en) | Method and device for adjusting brightness of touch screen and computer readable storage medium | |
| CN114898755A (en) | Voice processing method and related device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |