CN116466814A - Action detection method, device, electronic equipment and storage medium - Google Patents

Action detection method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116466814A
CN116466814A CN202210027181.1A CN202210027181A CN116466814A CN 116466814 A CN116466814 A CN 116466814A CN 202210027181 A CN202210027181 A CN 202210027181A CN 116466814 A CN116466814 A CN 116466814A
Authority
CN
China
Prior art keywords
action
electronic device
video
electronic equipment
video segment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210027181.1A
Other languages
Chinese (zh)
Inventor
江祖赟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202210027181.1A priority Critical patent/CN116466814A/en
Publication of CN116466814A publication Critical patent/CN116466814A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234—Power saving characterised by the action undertaken
    • G06F1/3293—Power saving characterised by the action undertaken by switching to a less power-consuming processor, e.g. sub-CPU
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231—Monitoring the presence, absence or movement of users
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application relates to a motion detection method, a motion detection device, electronic equipment and a storage medium, and belongs to the technical field of terminals. The method comprises the following steps: determining a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by second electronic equipment, and the second electronic equipment is electronic equipment which establishes communication connection with the first electronic equipment; switching from the first system to the second system under the condition that the similarity between the first action and the second action is smaller than a first preset threshold value; playing a video segment corresponding to the second action through a second system; the power consumption of the first system is smaller than that of the second system. According to the scheme, the user does not need to be subjected to action correction reminding time period, and the second system does not need to be operated, so that the power consumption of the first electronic device is saved while the content of the detected motion data is enriched.

Description

Action detection method, device, electronic equipment and storage medium
Technical Field
The embodiment of the application relates to the technical field of terminals, in particular to a method and a device for detecting actions, electronic equipment and a storage medium.
Background
With the development of terminal technology, the functions of the terminal are becoming more and more abundant. For example, the terminal can play video to assist user movement, etc.
In the related art, a user can move along with video content in the process of playing the video by a terminal. In order to detect the movement process of the user, the movement data of the user is often detected by a wearable device that establishes a connection with the terminal. For example, the wearable device can detect data of heart rate, consumption, etc. of the user.
In the above related art, in order to save the power consumption of the wearable device, the wearable device can only detect the information such as the heart rate and the consumption of the user, and the realized function is single, so that the detection content of the motion data needs to be enriched on the premise of keeping the low power consumption of the wearable device. Therefore, a low-power-consumption motion detection method is needed.
Disclosure of Invention
The embodiment of the application provides a motion detection method, a motion detection device, electronic equipment and a storage medium, which can reduce the power consumption of the electronic equipment under the condition of enriching motion data. The technical scheme is as follows:
in one aspect, there is provided a motion detection method applied to a first electronic device, the first electronic device being capable of operating a first system and a second system, the method comprising:
Determining a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by second electronic equipment, and the second electronic equipment is electronic equipment which establishes communication connection with the first electronic equipment;
switching from the first system to the second system under the condition that the similarity of the first action and the second action is smaller than a first preset threshold value;
playing the video segment corresponding to the second action through the second system;
the power consumption of the first system is smaller than that of the second system.
In another aspect, there is provided an action detection apparatus applied to a first electronic device capable of operating a first system and a second system, the apparatus comprising:
the determining module is used for determining a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by second electronic equipment, and the second electronic equipment is electronic equipment which establishes communication connection with the first electronic equipment;
The switching module is used for switching from the first system to the second system under the condition that the similarity between the first action and the second action is smaller than a first preset threshold value;
the playing module is used for playing the video segment corresponding to the second action through the second system;
the power consumption of the first system is smaller than that of the second system.
In another aspect, an electronic device is provided that includes a processor and a memory; the memory stores at least one program code for execution by the processor to implement the method of motion detection as described in the above aspects.
In another aspect, a computer readable storage medium is provided, the computer readable storage medium storing at least one program code for execution by a processor to implement the action detection method of the above aspect.
In another aspect, a computer program product is provided, the computer program product storing at least one program code for execution by a processor to implement the method of motion detection as described in the above aspects.
In the embodiment of the application, the first action and the second action are determined through the first system, and when the difference between the first action and the second action is large, the first system is automatically switched to the second system, so that the action correction is performed on the user through the second system, and because the power consumption of the operation of the first system is smaller than that of the operation of the second system, the operation of the second system is not required in a time period when the operation correction reminding is not required for the user, and therefore the power consumption of the first electronic equipment is saved while the content of the detected motion data is enriched.
Drawings
FIG. 1 illustrates a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;
FIG. 2 illustrates a block diagram of a first electronic device, as shown in an exemplary embodiment of the present application;
FIG. 3 illustrates a flow chart of a method of motion detection illustrated in an exemplary embodiment of the present application;
FIG. 4 illustrates a flow chart of a method of motion detection illustrated in an exemplary embodiment of the present application;
FIG. 5 illustrates a flow chart of a method of motion detection illustrated in an exemplary embodiment of the present application;
FIG. 6 illustrates a flow chart of a method of motion detection illustrated in an exemplary embodiment of the present application;
FIG. 7 illustrates a flow chart of a method of motion detection illustrated in an exemplary embodiment of the present application;
FIG. 8 illustrates a flow chart of a method of motion detection illustrated in an exemplary embodiment of the present application;
fig. 9 shows a block diagram of an action detection device according to an exemplary embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
References herein to "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. In addition, the related data referred to in the present application may be data authorized by the user or sufficiently authorized by each party.
Referring to fig. 1, a schematic diagram of an implementation environment related to an action detection method according to an exemplary embodiment of the present application is shown. The implementation environment includes a first electronic device 100 and a second electronic device 200. Wherein the first electronic device 100 and the second electronic device 200 are connected through communication.
Wherein the second electronic device 200 is capable of playing video so that the user can follow the video for movement. The first electronic device 100 can detect motion data of the user based on the video played by the second electronic device 200 so that the user can know the motion condition of the user. For example, a first application is installed in the first electronic device 100, and a second application is installed in the second electronic device 200. The first application program is used for detecting the motion process of the user to obtain the motion data of the user. The second application is for playing video. The first application and the second application may be the same application or different applications, which is not specifically limited in the embodiment of the present application.
In the case where the first application and the second application are the same application, the first application (second application) performs the above-described different functions on the first electronic device 100 and the second electronic device 200, respectively. The first application program (second application program) on the first electronic device 100 and the second electronic device 200 log in the same account, so that the first electronic device 100 performs motion detection according to the video played by the second electronic device 200.
In the case where the first application and the second application are different applications, the first application and the second application may be bound by an account number, so that the first electronic device 100 can determine a video currently played through the bound second electronic device 200, so as to perform motion detection for the user based on the video.
In some embodiments, the implementation environment further includes a server, and the first electronic device 100 and the second electronic device 200 respectively establish a communication connection with the server. The server is a background server of the first application program and the second application program. The first electronic device 100 and the second electronic device 200 can acquire data such as a video to be played and an action set corresponding to the video from a server.
The first electronic device 100 may be a wearable electronic device, e.g., a watch, glasses, etc. The second electronic device 200 may be at least one of a mobile phone, a tablet computer, a PC (Personal Computer, a personal computer), and the like. The server may be at least one of a server, a server cluster composed of a plurality of servers, a cloud server, a cloud computing platform, and a virtualization center.
In an embodiment of the present application, the first electronic device 100 is capable of running a first system and a second system, please refer to fig. 2, which shows a block diagram of the structure of the first electronic device provided in an exemplary embodiment of the present application. The first electronic device 100 in this application includes one or more of the following components: a first processor 110, a second processor 120, and a memory 130.
In some embodiments, both the first processor 110 and the second processor 120 may include one or more processing cores. The first processor 110 and the second processor 120 connect various parts within the entire first electronic device 100 using various interfaces and lines, performing various functions of the first electronic device 100 and processing data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 130, and invoking data stored in the memory 130. Alternatively, each of the first and second processors 110 and 120 may be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The first processor 110 and the second processor 120 may each integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a Neural-network processor (Neural-network Processing Unit, NPU), a modem, and the like. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the NPU is used to implement artificial intelligence (Artificial Intelligence, AI) functionality; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the first processor 110 or the second processor 120, and may be implemented by a single chip.
In the embodiment of the present application, different processors may be used by the first electronic device 100 to operate different systems under different usage scenarios, so as to maintain the operation state of the first electronic device 100. For example, when the first electronic device 100 does not need to run an application, such as when the first electronic device 100 is in a locked state, the electronic device 100 may run the first processor 110 to implement the first system. When the first electronic device 100 runs an application, the running processor may be switched from the first processor 110 to the second processor 120, so as to switch from the first system to the second system.
In some embodiments, memory 130 includes random access Memory (Random Access Memory, RAM) and may also include Read-Only Memory (ROM). Optionally, the memory 130 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 130 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 130 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described below, etc.; the storage data area may store data (such as audio data, phonebook) created according to the use of the first electronic device 100, and the like.
In some embodiments, the first electronic device 100 further comprises a display screen. The display screen is a display component for displaying a user interface. Optionally, the display screen is a display screen with a touch function, and through the touch function, a user can perform touch operation on the display screen by using any suitable object such as a finger, a touch pen, and the like. The display screen is typically provided at the front panel of the first electronic device 100. The display screen may be designed as a full screen, a curved screen, a contoured screen, a double-sided screen, or a folded screen. The display screen can also be designed into a combination of a full screen and a curved screen, a combination of a special-shaped screen and a curved screen, and the like, which is not limited in this embodiment.
In addition, it will be appreciated by those skilled in the art that the structure of the first electronic device 100 illustrated in the above-described figures does not constitute a limitation of the first electronic device 100, and the first electronic device 100 may include more or less components than illustrated, or may combine certain components, or may have a different arrangement of components. For example, the first electronic device 100 further includes a microphone, a speaker, a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, wi-Fi) module, a power supply, a bluetooth module, and the like, which are not described herein.
It should be noted that the second electronic device 200 may operate the first system and the second system, or the second electronic device 200 may operate only one system. In the embodiment of the present application, the manner in which the second electronic device operates the system is not specifically limited. Accordingly, the second electronic device 200 has the same or different structure as the first electronic device 100, and in the embodiment of the present application, this is not particularly limited.
In the embodiment of the application, the first electronic device can detect the motion process of the user based on the video played by the second electronic device, so that the user is reminded. In the process of detecting the movement of the user by the electronic equipment, the electronic equipment can be switched between the first system and the second system so as to realize different functions. Referring to fig. 3, a flowchart of an action detection method according to an exemplary embodiment of the present application is shown. The method comprises the following steps:
step S301: the first electronic device determines a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by the second electronic device, and the second electronic device is an electronic device which establishes communication connection with the first electronic device.
The first action is an action generated by the user during the movement. In this step, the first electronic device detects the action of the user through the first system, and obtains the first action of the user. For example, the first electronic device shoots a moving picture of a user through a camera, and performs image analysis on the moving picture to obtain a first action of the user. The camera is a camera installed on the first electronic device, or the camera is a camera which is in communication connection with the first electronic device. In the embodiment of the present application, this is not particularly limited. For another example, the first electronic device detects the user's action by means of a sensor. For example, a gravity sensor detects a hand lifting operation of a user.
The second action is an action included in a video segment currently played by the second electronic device. The second electronic device plays a video, which may be a video for guiding the movement of the user, such as a sports teaching video. The video includes a video segment corresponding to at least one action. In this step, the first electronic device determines, according to the playing progress of the video, a second action corresponding to the currently played video segment.
It should be noted that the first electronic device may determine the first action first and then determine the second action. Accordingly, in response to detecting the first action, the first electronic device determines a second action included in the current video segment.
The first electronic device may also determine the second action first and then determine the first action. Correspondingly, the first electronic device determines a second action corresponding to the video segment based on the currently played video segment, and then performs action detection to obtain a first action.
The first electronic device may also determine the first action and the second action simultaneously. Accordingly, the first electronic device simultaneously determines a second action included in the currently played video segment and determines a first action of the user.
In the embodiment of the present application, the order in which the first electronic device determines the first action and the second action is not particularly limited.
After the first electronic device determines the first action and the second action, the first action and the second action are compared, so that the similarity of the first action and the second action is determined, if the similarity of the first action and the second action is not smaller than a first preset threshold value, the first electronic device continues to execute the step S301, and if the similarity of the first action and the second action is smaller than the first preset threshold value, the first electronic device executes the step S302.
Step S302: and the first electronic equipment is switched from the first system to the second system under the condition that the similarity of the first action and the second action is smaller than a first preset threshold, wherein the power consumption of the first system operation is smaller than that of the second system operation.
Referring to fig. 4, the first electronic device performs motion detection through the first system, and when the difference between the first motion and the second motion is large, the first electronic device switches from the first system to the second system so as to perform motion correction on the user through the second system. Correspondingly, the first electronic device generates a system switching instruction in response to the similarity of the first action and the second action being smaller than a first preset threshold; and waking up the second system based on the system switching instruction, and setting the first system to a dormant state.
In the embodiment of the application, the electronic equipment is switched from the first system to the second system based on the system switching instruction, so that the detection of the action of the user under the first system with low power consumption is realized, and the switching to the second system is realized when the action of the user is required to be corrected, and the power consumption of the electronic equipment is reduced.
It should be noted that the power consumption of the first system running is smaller than the power consumption of the second system running means that the power consumption of the first system and the second system under the same running condition. For example, when the first system and the second system both detect actions of the user, the power consumption of the first system is smaller than the power consumption of the second system.
Step S303: and the first electronic equipment plays the video segment corresponding to the second action through the second system.
In this step, the first electronic device displays an action detail interface through the second system, and plays the video segment corresponding to the second action on the action detail interface.
It should be noted that, after the first electronic device switches to the second system, the video segment corresponding to the second action may be played through the second system. The first electronic device can also display play options and cancel options in the action detail interface after switching to the second system, and respond to the triggering operation of the play options to play the video segment corresponding to the second action; and responding to the triggering operation of the cancel option, or switching back to the first system when the triggering operation of the play option is detected within the preset time period, and continuing to execute the step S301 through the first system. Before the system is switched, the first electronic device can also display a play option and a cancel option in the action detail interface, respond to the triggering operation of the play option, execute the step of switching from the first system to the second system, and play the video segment corresponding to the second action through the second system; and responding to the triggering operation of the cancel option, or detecting the triggering operation of the play option within a preset time period, and continuing to execute step S301 through the first system.
The other point to be described is that the first electronic device can detect the information such as heart rate and consumption of the user while detecting the first action of the user, and after the video playing is completed, the detected data such as heart rate variation and total consumption are sent to the second electronic device so that the second electronic device can record and display.
In the embodiment of the application, the first action and the second action are determined through the first system, and when the difference between the first action and the second action is large, the first system is automatically switched to the second system, so that the action correction is performed on the user through the second system, and because the power consumption of the operation of the first system is smaller than that of the operation of the second system, the operation of the second system is not required in a time period when the operation correction reminding is not required for the user, and therefore the power consumption of the first electronic equipment is saved while the content of the detected motion data is enriched.
It should be noted that, when the first electronic device detects that the similarity between the first action and the second action is smaller than the first preset threshold, the first electronic device may switch to the second system, and play the video segment corresponding to the second action through the second system. The first electronic device may also prompt the user in other ways when the difference between the first action and the second action is small, and switch to the second system to play the video segment corresponding to the second action when the difference between the first action and the second action is large. Referring to fig. 5, a flowchart of an action detection method according to an exemplary embodiment of the present application is shown. The method comprises the following steps:
Step S501: the first electronic device determines a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by the second electronic device, and the second electronic device is an electronic device which establishes communication connection with the first electronic device.
The principle of this step is the same as that of step S301, and will not be described here again.
Step S502: and under the condition that the similarity of the first action and the second action is smaller than a first preset threshold value and the similarity of the first action and the second action is larger than a second preset threshold value, the first electronic equipment outputs an action correction prompt, and the action correction prompt is used for prompting a user to adjust the first action to achieve the second action.
Wherein the second preset threshold is smaller than the first preset threshold.
The action correction prompt may be any message that can prompt the user. For example, the motion correction prompt may be a vibration prompt, a voice prompt, or the like. In the embodiment of the present application, the type of the action correction prompt is not particularly limited.
In the embodiment of the application, when the similarity between the first action and the second action is smaller than the first preset threshold value but larger than the second preset threshold value, the user is prompted to conduct action correction by outputting the action correction prompt, so that frequent switching between the first system and the second system is prevented, and faults caused by system switching are prevented.
Step S503: and switching from the first system to the second system under the condition that the similarity of the first action and the second action is not greater than a second preset threshold, wherein the power consumption of the first system is smaller than that of the second system.
The principle of this step is the same as that of step S302, and will not be described here again.
Step S504: and the first electronic equipment plays the video segment corresponding to the second action through the second system.
The principle of this step is the same as that of step S303, and will not be described here again.
In the embodiment of the application, the first action and the second action are determined through the first system, and when the difference between the first action and the second action is large, the first system is automatically switched to the second system, so that the action correction is performed on the user through the second system, and because the power consumption of the operation of the first system is smaller than that of the operation of the second system, the operation of the second system is not required in a time period when the operation correction reminding is not required for the user, and therefore the power consumption of the first electronic equipment is saved while the content of the detected motion data is enriched.
In the embodiment of the application, the first electronic device can determine the video segment corresponding to the second action through the playing time point in the second electronic device. Referring to fig. 6, a flowchart of an action detection method according to an exemplary embodiment of the present application is shown. The method comprises the following steps:
Step S601: the first electronic device determines a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by the second electronic device, and the second electronic device is an electronic device which establishes communication connection with the first electronic device.
The principle of this step is the same as that of step S301, and will not be described here again.
Step S602: and the first electronic equipment is switched from the first system to the second system under the condition that the similarity of the first action and the second action is smaller than a first preset threshold, wherein the power consumption of the first system operation is smaller than that of the second system operation.
The principle of this step is the same as that of step S302, and will not be described here again.
Step S603: and the first electronic equipment acquires the video to which the video segment corresponding to the second action belongs through the second system.
Wherein the video comprises a video segment corresponding to at least one action.
In the embodiment of the application, an action detection connection is established between the first electronic device and the second electronic device. The second electronic device sends a detection instruction to the first electronic device, wherein the detection instruction carries a video identifier of a video to which a video segment currently played by the second electronic device belongs. The first electronic equipment receives the detection instruction, and obtains the video of the video segment currently played by the second electronic equipment based on the video identifier carried by the detection instruction.
In some embodiments, the second electronic device stores the correspondence between the plurality of videos and the video identifier, and in this step, based on the video identifier, the video corresponding to the video identifier is obtained from the correspondence between the videos and the video identifier. In some embodiments, the second electronic device generates an acquisition request based on the video identifier, and sends the acquisition request to the server, and accordingly, the server sends the video corresponding to the video identifier to the first electronic device based on the acquisition request, and the first electronic device receives the video sent by the server.
Step S604: the first electronic device determines a point in time at which the second action corresponds in the video.
The time point is a time point corresponding to the playing progress of the video in the second electronic device. Accordingly, in some embodiments, the first electronic device obtains a time point corresponding to a playing progress of the video in the second electronic device.
Step S605: the first electronic device plays the video segment of the video from the point in time at the action detailing interface.
In this step, the first electronic device plays the video segment of the video in the action detail interface of the first electronic device based on the time point.
In the embodiment of the application, the video segment played in the first electronic device is determined through the time point of playing the video in the second electronic device, so that the first electronic device is ensured to accurately play the video corresponding to the second action, a user does not need to adjust the video playing progress, and user experience is further optimized.
In the embodiment of the application, the first action and the second action are determined through the first system, and when the difference between the first action and the second action is large, the first system is automatically switched to the second system, so that the action correction is performed on the user through the second system, and because the power consumption of the operation of the first system is smaller than that of the operation of the second system, the operation of the second system is not required in a time period when the operation correction reminding is not required for the user, and therefore the power consumption of the first electronic equipment is saved while the content of the detected motion data is enriched.
In this embodiment of the present application, when the first electronic device plays the video segment corresponding to the second action, the second electronic device may pause playing the video, so that after correcting the first action, the user continues to perform the movement based on the previous progress. Correspondingly, the control of playing video is realized between the first electronic equipment and the second electronic equipment through information interaction. Referring to fig. 7, a flowchart of an action detection method according to an exemplary embodiment of the present application is shown. In the embodiment of the application, the control of playing the video is illustrated by taking the interaction between the first electronic device and the second electronic device as an example. The method comprises the following steps:
Step S701: the second electronic equipment sends a detection instruction to the first electronic equipment, wherein the detection instruction comprises a video identifier of a video to which a video segment currently played by the second electronic equipment belongs.
Referring to fig. 8, a motion detection connection is established between a first electronic device and a second electronic device. The second electronic device sends a detection instruction to the first electronic device, wherein the detection instruction carries a video identifier of a video to which a video segment currently played by the second electronic device belongs. And the first electronic equipment receives the detection instruction and acquires the video segment currently played by the second electronic equipment based on the video identifier carried by the detection instruction.
Step S702: and the first electronic equipment receives the detection instruction sent by the second electronic equipment.
Referring to fig. 8, in this step, after receiving the detection instruction, the second electronic device sends a response message of the detection instruction to the second electronic device.
It should be noted that, referring to fig. 8, after the first electronic device establishes a connection with the second electronic device, the second electronic device starts to play the video, and the second electronic device may initiate an alignment instruction to the first electronic device based on the current playing progress of the video, where the alignment instruction is used to instruct the first electronic device to start to detect from the second action corresponding to the playing progress. Thus, the first electronic equipment is prevented from carrying out error detection on the action, and the detection accuracy is improved.
Step S703: the first electronic device determines an action set corresponding to the video from the action library based on the video identification.
The action library includes correspondence of video identifications of a plurality of videos to a set of actions. In this step, the first electronic device determines, from the correspondence between the video identifier and the action set, the action set corresponding to the video identifier.
It should be noted that the action library is stored locally to the first electronic device or the action library is stored in the server. In the embodiment of the present application, this is not particularly limited. In the case that the action library is stored in the server, the process of the first electronic device obtaining the action set is the same as the principle that the first electronic device obtains the video from the server based on the video identifier in step S603, which is not described herein.
Step S704: the first electronic device determines a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by the second electronic device, and the second electronic device is an electronic device which establishes communication connection with the first electronic device.
The principle of this step is the same as that of step S301, and will not be described here again.
Step S705: and the first electronic equipment is switched from the first system to the second system under the condition that the similarity of the first action and the second action is smaller than a first preset threshold value.
The principle of this step is the same as that of step S302, and will not be described here again.
Step S706: and the first electronic equipment plays the video segment corresponding to the second action through the second system.
The principle of this step is the same as that of step S303, and will not be described here again.
Step S707: the first electronic device sends a play pause instruction to the second electronic device.
The pause playing instruction is used for indicating the second electronic equipment to pause playing of the video segment corresponding to the second action.
Step S708: the second electronic device receives a play pause instruction.
Step S709: the second electronic device pauses playing the video based on the pause playing instruction.
In the implementation manner, the second electronic device pauses to play the video based on the pause playing instruction of the first electronic device, so that the user is prevented from missing the video played in the second electronic device when watching the video segment corresponding to the second action through the first electronic device, and the user experience is optimized.
Step S710: and responding to the completion of playing the video segment corresponding to the second action, and sending a continuous playing instruction to the second electronic equipment by the first electronic equipment.
The continuous playing instruction is used for indicating the second electronic equipment to continuously play the video of the video segment corresponding to the second action.
It should be noted that, before the first electronic device sends the play continuing instruction to the second electronic device, it is also able to confirm whether to trigger the second electronic device to continue playing the video. Correspondingly, the first electronic equipment displays a return training option; in response to the trigger operation of returning to the training option, step S709 is performed. Thus, the user can circularly play the video segment corresponding to the second action, and the user experience is optimized.
Step S711: the first electronic device switches from the second system to the first system.
In the implementation manner, when the first electronic device finishes playing the video segment corresponding to the second action, the first electronic device switches back to the first system from the second system, so that the first system is switched back in time, and the power consumption of the first electronic device is reduced.
Step S712: the second electronic device continues to play the video.
It should be noted that, in the process of detecting the user action by the first electronic device, if the communication connection between the first electronic device and the second electronic device is disconnected, the first electronic device may start the play timing, so that when the connection between the first electronic device and the second electronic device is reestablished, the first electronic device may determine the currently played video segment based on the play timing. Accordingly, in response to the communication connection between the first electronic device and the second electronic device being broken, the first electronic device starts a play timer; in response to reestablishing the communication connection between the first electronic device and the second electronic device, a currently playing video segment is determined based on the play timing.
It should be noted that, referring to fig. 8, when the video playing is completed, the second electronic device sends an end instruction to the first electronic device, where the end instruction is used to instruct the first electronic device to end the motion detection for the user.
The other point to be described is that, during the disconnection of the communication between the first electronic device and the second electronic device, if the playing timing of the first electronic device reaches the total playing duration of the video, the first electronic device automatically exits the action detection of the user, so as to prevent the first electronic device from failing to operate normally caused when the first electronic device and the second electronic device are disconnected from each other.
In the embodiment of the application, the first action and the second action are determined through the first system, and when the difference between the first action and the second action is large, the first system is automatically switched to the second system, so that the action correction reminding is performed on the user through the second system, and because the power consumption of the operation of the first system is smaller than that of the operation of the second system, the operation of the second system is not required in a time period when the operation correction reminding is not required on the user, and therefore the power consumption of the first electronic equipment is saved while the content of the detected motion data is enriched.
Referring to fig. 9, a block diagram of an action detection device according to an embodiment of the present application is shown. The motion detection means may be implemented as all or part of the processor by software, hardware or a combination of both. The device comprises:
the first determining module 901 is configured to determine, by using the first system, a first action and a second action, where the first action is an action of a user, the second action is an action included in a video segment currently played by a second electronic device, and the second electronic device is an electronic device that establishes a communication connection with the first electronic device;
a switching module 902, configured to switch from the first system to the second system when the similarity between the first action and the second action is less than a first preset threshold;
a playing module 903, configured to play, by using the second system, a video segment corresponding to the second action;
wherein the power consumption of the first system operation is less than the power consumption of the second system operation.
In some embodiments, the play module 903 includes:
the obtaining unit is used for obtaining the video to which the video segment corresponding to the second action belongs through the second system, wherein the video comprises at least one video segment corresponding to the second action;
A determining unit, configured to determine a corresponding time point of the second action in the video;
and the playing unit is used for detailing the interface in the action and playing the video segment of the video from the time point.
In some embodiments, the apparatus further comprises:
the first sending module is used for sending a pause playing instruction to the second electronic equipment, and the pause playing instruction is used for indicating the second electronic equipment to pause playing of the video segment corresponding to the second action;
the second sending module is used for responding to the completion of playing the video segment corresponding to the second action and sending a continuous playing instruction to the second electronic equipment, wherein the continuous playing instruction is used for indicating the second electronic equipment to continuously play the video to which the video segment corresponding to the second action belongs;
the switching module 902 is further configured to switch from the second system to the first system.
In some embodiments, the apparatus further comprises:
the display module is used for displaying the return training options;
and the second sending module is used for responding to the triggering operation of the return training option and sending a continuous playing instruction to the second electronic equipment.
In some embodiments, the apparatus further comprises:
the output module is used for outputting an action correction prompt which is used for prompting a user to adjust the first action to reach the second action when the similarity of the first action and the second action is smaller than a first preset threshold value and the similarity of the first action and the second action is larger than a second preset threshold value;
The switching module 902 is further configured to switch from the first system to the second system if the similarity between the first action and the second action is not greater than a second preset threshold.
In some embodiments, the apparatus further comprises:
the receiving module is used for receiving a detection instruction sent by the second electronic equipment, wherein the detection instruction comprises a video identifier of a video to which a video segment currently played by the second electronic equipment belongs;
the second determining module is used for determining an action set corresponding to the video from the action library based on the video identification;
the first determining module 901 is configured to determine, by the first system, the second action from the action set based on a point in time of the video segment in the video.
In some embodiments, the apparatus further comprises:
the timing module is used for responding to the disconnection of the communication between the first electronic equipment and the second electronic equipment and starting playing timing;
the playing module 903 is further configured to determine, based on a playing timing, a currently playing video segment in response to reestablishing a communication connection between the first electronic device and the second electronic device.
In the embodiment of the application, the first action and the second action are determined through the first system, and when the difference between the first action and the second action is large, the first system is automatically switched to the second system, so that the action correction reminding is performed on the user through the second system, and because the power consumption of the operation of the first system is smaller than that of the operation of the second system, the operation of the second system is not required in a time period when the operation correction reminding is not required on the user, and therefore the power consumption of the first electronic equipment is saved while the content of the detected motion data is enriched.
Embodiments of the present application also provide a computer readable medium storing at least one instruction that is loaded and executed by the processor to implement the action detection method as shown in the above embodiments.
Embodiments of the present application also provide a computer program product storing at least one instruction that is loaded and executed by the processor to implement the action detection method as shown in the various embodiments above.
Those skilled in the art will appreciate that in one or more of the examples described above, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, these functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
The foregoing description of the preferred embodiments is merely exemplary in nature and is in no way intended to limit the invention, since it is intended that all modifications, equivalents, improvements, etc. that fall within the spirit and scope of the invention.

Claims (10)

1. A method of motion detection for a first electronic device capable of operating a first system and a second system, the method comprising:
determining a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by second electronic equipment, and the second electronic equipment is electronic equipment which establishes communication connection with the first electronic equipment;
switching from the first system to the second system under the condition that the similarity of the first action and the second action is smaller than a first preset threshold value;
playing the video segment corresponding to the second action through the second system;
the power consumption of the first system is smaller than that of the second system.
2. The method of claim 1, wherein playing, by the second system, the video segment corresponding to the second action comprises:
Acquiring a video to which a video segment corresponding to the second action belongs by the second system, wherein the video comprises at least one video segment corresponding to the second action;
determining a corresponding point in time of the second action in the video;
and playing the video segment of the video from the time point at the action detail interface.
3. The method according to claim 1, wherein the method further comprises:
sending a play pause instruction to the second electronic device, wherein the play pause instruction is used for instructing the second electronic device to pause playing of the video to which the video segment corresponding to the second action belongs;
responding to the completion of playing the video segment corresponding to the second action, and sending a continuous playing instruction to the second electronic equipment, wherein the continuous playing instruction is used for indicating the second electronic equipment to continuously play the video to which the video segment corresponding to the second action belongs;
switching from the second system to the first system.
4. The method of claim 3, wherein before sending a resume play instruction to the second electronic device, the method further comprises:
displaying a return training option;
and responding to the triggering operation of returning to the training option, and executing the step of sending a play continuing instruction to the second electronic equipment.
5. The method of claim 1, wherein prior to the switching from the first system to the second system, the method further comprises:
outputting an action correction prompt for prompting a user to adjust the first action to reach the second action when the similarity of the first action and the second action is smaller than a first preset threshold value and the similarity of the first action and the second action is larger than a second preset threshold value;
and executing the step of switching from the first system to the second system under the condition that the similarity of the first action and the second action is not greater than a second preset threshold value.
6. The method of claim 1, wherein prior to determining, by the first system, the first action and the second action, the method further comprises:
receiving a detection instruction sent by the second electronic equipment, wherein the detection instruction comprises a video identifier of a video to which a video segment currently played by the second electronic equipment belongs;
determining an action set corresponding to the video from an action library based on the video identification;
the process of determining, by the first system, the second action includes:
Determining, by the first system, the second action from the set of actions based on a point in time of the video segment in the video.
7. The method according to claim 1, wherein the method further comprises:
starting a play timer in response to the disconnection of the communication connection between the first electronic device and the second electronic device;
in response to reestablishing the communication connection between the first electronic device and the second electronic device, a currently playing video segment is determined based on the play timing.
8. An action detection apparatus for use with a first electronic device capable of operating a first system and a second system, the apparatus comprising:
the determining module is used for determining a first action and a second action through the first system, wherein the first action is an action of a user, the second action is an action included in a video segment currently played by second electronic equipment, and the second electronic equipment is electronic equipment which establishes communication connection with the first electronic equipment;
the switching module is used for switching from the first system to the second system under the condition that the similarity between the first action and the second action is smaller than a first preset threshold value;
The playing module is used for playing the video segment corresponding to the second action through the second system;
the power consumption of the first system is smaller than that of the second system.
9. An electronic device comprising a processor and a memory; the memory stores at least one program code for execution by the processor to implement the action detection method of any one of claims 1 to 7.
10. A computer readable storage medium storing at least one program code for execution by a processor to implement the method of motion detection of any one of claims 1 to 7.
CN202210027181.1A 2022-01-11 2022-01-11 Action detection method, device, electronic equipment and storage medium Pending CN116466814A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210027181.1A CN116466814A (en) 2022-01-11 2022-01-11 Action detection method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210027181.1A CN116466814A (en) 2022-01-11 2022-01-11 Action detection method, device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116466814A true CN116466814A (en) 2023-07-21

Family

ID=87174015

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210027181.1A Pending CN116466814A (en) 2022-01-11 2022-01-11 Action detection method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116466814A (en)

Similar Documents

Publication Publication Date Title
CN108235086B (en) Video playing control method and device and corresponding terminal
CN106686396B (en) Method and system for switching live broadcast room
CN111698672B (en) Audio synchronization method of wireless earphone and wireless earphone
CN108228358B (en) Method, device, mobile terminal and storage medium for correcting vertical synchronization signal
CN111866433B (en) Video source switching method, video source playing method, video source switching device, video source playing device, video source equipment and storage medium
US20210352040A1 (en) Message sending method and terminal device
CN108135033B (en) Bluetooth connection method and mobile terminal
US20220286503A1 (en) Synchronization method and electronic device
US20220004357A1 (en) Audio signal outputting method and terminal device
CN105630846B (en) Head portrait updating method and device
US11165950B2 (en) Method and apparatus for shooting video, and storage medium
CN108958606B (en) Split screen display method and device, storage medium and electronic equipment
US11606423B2 (en) Method, apparatus, device, and storage medium for running stand-alone program
US20230037238A1 (en) Audio output mode switching method and electronic device
CN109753262B (en) Frame display processing method and device, terminal equipment and storage medium
EP4060956A1 (en) Data processing method and electronic device
CN107193551B (en) Method and device for generating image frame
CN110267142B (en) Mobile terminal and control method
CN108170362B (en) Application running state control method and mobile terminal
US20220417296A1 (en) Registration Method and Electronic Device
CN116466814A (en) Action detection method, device, electronic equipment and storage medium
CN111081283A (en) Music playing method and device, storage medium and terminal equipment
WO2015184959A2 (en) Method and apparatus for playing behavior event
CN110996003B (en) Photographing positioning method and device and mobile terminal
CN113268210A (en) Screen projection method, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination