CN114222184A - Multimedia playing control method, system, device and medium based on motion state - Google Patents
Multimedia playing control method, system, device and medium based on motion state Download PDFInfo
- Publication number
- CN114222184A CN114222184A CN202210101188.3A CN202210101188A CN114222184A CN 114222184 A CN114222184 A CN 114222184A CN 202210101188 A CN202210101188 A CN 202210101188A CN 114222184 A CN114222184 A CN 114222184A
- Authority
- CN
- China
- Prior art keywords
- motion
- playing
- preset
- multimedia
- preset threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1118—Determining activity level
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using image analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Medical Informatics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Physiology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Surgery (AREA)
- Social Psychology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a multimedia playing control method, a multimedia playing control system, multimedia playing control equipment and a multimedia playing control medium based on a motion state, wherein the method comprises the following steps: acquiring motion parameters and/or physiological parameters of a user, and acquiring motion activity of the user at least based on the motion parameters and/or physiological parameters; acquiring a media stream currently played by multimedia playing equipment, and adjusting a current playing parameter of the media stream based on a comparison result of the motion liveness and a first preset threshold value, so that a first difference value between the motion liveness and the first preset threshold value and a second difference value between the adjusted playing parameter and a preset playing parameter are in positive correlation; according to the method and the device, the playing parameters of the multimedia are adjusted according to the motion state, feedback is given to the user, and the motion efficiency of the user in motion is guaranteed.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, a system, a device, and a medium for controlling multimedia playing based on a motion state.
Background
Many people now like to exercise their body by running, or running on an indoor treadmill with headphones, or running outdoors, etc. Many athletes like to listen to music or watch videos while running, and at this time, the athletes are easily immersed in the videos and audios, so that the exercise efficiency is reduced. In the prior art, a feedback mechanism is not provided in time after the sporter is immersed in the audio and video, the sporter cannot be supervised to exercise, and the exercise efficiency and effect of the sporter are not ensured.
Disclosure of Invention
Aiming at the problems in the prior art, the invention aims to provide a multimedia playing control method, a multimedia playing control system, multimedia playing control equipment and multimedia playing control media based on a motion state, and the problem that a feedback mechanism cannot be timely provided to ensure the motion efficiency when a sporter is immersed in multimedia in the motion process in the prior art is solved.
In order to achieve the above object, the present invention provides a multimedia playing control method based on motion status, the method comprising the following steps:
s110, acquiring motion parameters and/or physiological parameters of a user, and acquiring motion activity of the user at least based on the motion parameters and/or physiological parameters;
s120, acquiring a media stream currently played by the multimedia playing device, and adjusting the current playing parameter of the media stream based on the comparison result of the motion liveness and the first preset threshold value, so that a first difference value between the motion liveness and the first preset threshold value and a second difference value between the adjusted playing parameter and the preset playing parameter are in positive correlation.
Optionally, the step S120 includes:
and when the motion activity is smaller than a first preset threshold value, deleting a first preset frame number or adding a preset blank frame number to the media stream.
Optionally, the step S120 includes:
determining a first preset frame number to be deleted or a preset blank frame number to be added according to a first difference between the motion activity and a first preset threshold;
and deleting the first preset frame number or adding the preset blank frame number to the media stream.
Optionally, the first preset frame number or the preset blank frame number is equal to an absolute value of a first difference between the motion activity and a first preset threshold.
Optionally, the step S120 includes:
and when the motion activity is smaller than a first preset threshold value, slowing down the playing speed of the media stream or reducing the output volume of the multimedia playing equipment.
Optionally, the method further comprises:
when the motion activity is smaller than a first preset threshold, judging whether the motion activity is smaller than a second preset threshold, and if so, controlling the media stream to pause playing; the second preset threshold is smaller than the first preset threshold.
Optionally, the preset playing parameter is a configuration parameter with the largest number of usage times in the historical data corresponding to all the historical users using the media stream.
Optionally, the multimedia playing device is used for playing a cloud live-broadcast teaching video of the fitness coach; the step S110 includes:
obtaining first limb action data of a coach based on a video played by multimedia playing equipment;
collecting second limb action data of the user based on a camera of the surrounding environment;
calculating the action matching degree of the first limb action data and the second limb action data; and taking the action matching degree as the motion activity degree.
Optionally, a camera is disposed on the treadmill, and step S110 includes:
acquiring moving image data of a user based on a camera on a treadmill;
and inputting the motion image data into a preset model for recognition and analysis, and acquiring the motion activity of the user.
Optionally, the step S110 includes:
collecting moving image data and physiological parameters of a user;
determining a first motion liveness based on the motion image data; and determining a second motion activity level based on the physiological parameter;
determining a final motion activity based on the first motion activity and the second motion activity.
The invention also provides a multimedia playing control system based on the motion state, which is used for realizing the multimedia playing control method based on the motion state, and the system comprises:
the motion activity determining module is used for acquiring motion parameters and/or physiological parameters of the user and obtaining the motion activity of the user at least based on the motion parameters and/or physiological parameters;
the motion liveness feedback module acquires a media stream currently played by the multimedia playing device, and adjusts the current playing parameter of the media stream based on the comparison result of the motion liveness and a first preset threshold value, so that a first difference value between the motion liveness and the first preset threshold value and a second difference value between the adjusted playing parameter and the preset playing parameter are in positive correlation.
The invention also provides a multimedia playing control device based on the motion state, which comprises:
a processor;
a memory having stored therein an executable program of the processor;
wherein the processor is configured to execute any one of the above steps of the motion state based multimedia playback control method via execution of the executable program.
The present invention also provides a computer-readable storage medium for storing a program, which when executed by a processor implements the steps of any one of the above-mentioned motion-state-based multimedia playback control methods.
Compared with the prior art, the invention has the following advantages and prominent effects:
the multimedia playing control method, the multimedia playing control system, the multimedia playing control equipment and the multimedia playing control medium based on the motion state provided by the invention have the advantages that the motion activity of the user is obtained, the multimedia playing parameters are adjusted based on the comparison result of the motion activity of the user and the first preset threshold value, the first difference value and the second difference value are in positive correlation, the human motion state and the playing condition of the media stream are combined, the playing parameters of the multimedia are adjusted according to the motion state, the feedback is given to the user, the assistance and the promotion of the user to maintain the normal motion efficiency are facilitated, and the motion experience of the user is improved.
Drawings
Other features, objects and advantages of the present invention will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of a multimedia playing control method based on motion states according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a multimedia playing control method based on motion states according to another embodiment of the present invention;
fig. 3 is a schematic diagram of a multimedia playing control method based on motion states according to another embodiment of the present invention;
fig. 4 is a schematic diagram of a multimedia playing control method based on motion states according to another embodiment of the present invention;
fig. 5 is a schematic diagram of a multimedia playing control method based on motion states according to another embodiment of the present invention;
fig. 6 is a schematic structural diagram of a multimedia playing control system based on motion states according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a multimedia playing control device based on motion states according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their repetitive description will be omitted.
As shown in fig. 1, an embodiment of the present invention discloses a multimedia playing control method based on motion status, which includes the following steps:
s110, acquiring the motion parameters and/or physiological parameters of the user, and obtaining the motion activity of the user at least based on the motion parameters and/or physiological parameters. Specifically, the motion parameter may be a running speed, a limb swing amplitude, a swing frequency, and the like, and the physiological parameter may be a heart rate, a pulse, and the like, which is not limited in this application. The motion activity calculation method can be set by a person skilled in the art as needed, for example, the motion parameter and/or the physiological parameter can be weighted and summed, or weighted and summed after being normalized respectively, and the like, which is not limited in the present application.
And S120, acquiring a media stream currently played by the multimedia playing device, and adjusting the current playing parameter of the media stream based on the comparison result of the motion activity and the first preset threshold value, so that a first difference value between the motion activity and the first preset threshold value and a second difference value between the adjusted playing parameter and the preset playing parameter are in positive correlation.
Specifically, the first difference may be a difference between the motion activity and a first preset threshold, or a deviation between the motion activity and the first preset threshold. The deviation may be calculated by referring to the prior art, for example, the ratio of the absolute value of the difference between the motion activity and the first preset threshold to the first preset threshold. Similarly, the second difference may be a difference between the adjusted playing parameter and the preset playing parameter, or a deviation between the adjusted playing parameter and the preset playing parameter. Before calculation, if there are multiple playing parameters, the multiple playing parameters may be quantized first, then a total playing parameter is calculated, for example, by means of weighted summation, and then the total playing parameter is used to calculate the difference or deviation.
The first preset threshold is the normal and reasonable motion activity of the user. The preset playing parameters are the normal playing parameters suitable for the user. For example, the playing parameter with the highest matching degree with the user in a database may be used. The database records the use times of different playing parameters, and the matching degree is the use times.
In an embodiment of the application, the first preset threshold may be obtained by analyzing historical motion data of the user, calculating motion activity degrees corresponding to all historical motion data, and using the motion activity degree with the largest number of times as the first preset threshold.
In an embodiment of the application, the preset playing parameter may be a configuration parameter with the largest number of times of use in history data corresponding to all history users using the media stream. The configuration parameter may be the configuration parameter that is used the most frequently in the historical exercise data corresponding to the user.
Therefore, the preset playing parameters and the first preset threshold can be set more accurately, and the accuracy of the disclosed multimedia playing control method is improved.
In this embodiment, the positive correlation between the first difference and the second difference may be that when the first difference is a positive value, the second difference is also a positive value. When the first difference is a negative value, the second difference is also a negative value. And the absolute value of the second difference decreases with decreasing absolute value of the first difference and increases with increasing absolute value of the first difference. That is, the smaller the absolute value of the first difference is, the smaller the absolute value of the second difference is. The larger the absolute value of the first difference, the larger the absolute value of the second difference.
The comparison result of the motion activity and the first preset threshold is that the motion activity is smaller than, equal to or larger than the first preset threshold.
In this embodiment, step S120 may include:
and when the motion activity is smaller than a first preset threshold value, reducing the playing parameters, so that the adjusted playing parameters are smaller than the preset playing parameters. The playing parameter may be a playing speed, a playing volume, a decoding rate of the media stream, or a completeness of the media stream. And when the motion activity is equal to the first preset threshold value, enabling the adjusted playing parameter to be equal to the preset playing parameter. And when the motion activity is greater than a first preset threshold value, enabling the adjusted playing parameter to be greater than a preset playing parameter.
In other embodiments, when the motion activity is greater than or equal to the first preset threshold, the adjusted playing parameters may be equal to the preset playing parameters. Or when the motion activity is equal to the first preset threshold, the adjusted playing parameter is equal to the preset playing parameter, and when the motion activity is greater than the first preset threshold, the adjusted playing parameter is less than the preset playing parameter. This is not limited by the present application.
In an embodiment of the present application, the adjusted current playing parameter may be a media stream decoding rate. And when the motion activity is smaller than a first preset threshold, decoding and playing the media stream at a first code rate lower than a preset decoding code rate, wherein the difference between the first code rate and the preset decoding code rate is equal to the first difference between the motion activity and the first preset threshold. Such decoded audio or video is of poorer quality and poorer intelligibility to provide the user with a feedback that helps him to maintain proper motion efficiency.
In other embodiments, step S120 may also include: and when the motion activity is smaller than a first preset threshold value, slowing down the playing speed of the media stream or reducing the output volume of the multimedia playing equipment.
The media stream may be an audio stream or a video stream. Illustratively, the first preset threshold may be 60, and the application is not limited thereto.
In another embodiment of the present application, another multimedia play control method based on motion states is disclosed. As shown in fig. 2, the method further includes, on the basis of the embodiment shown in fig. 1, the steps of:
s130, when the motion activity is smaller than a first preset threshold, judging whether the motion activity is smaller than a second preset threshold, if so, executing the step S140; if not, jumping to step S120.
S140, controlling the media stream to pause playing. The second preset threshold is smaller than the first preset threshold. This may provide a stronger feedback to the user, helping him to maintain a suitable exercise efficiency.
In another embodiment of the present application, another multimedia play control method based on motion states is disclosed. On the basis of the method including step S110 in the embodiment of fig. 1, step S120 is replaced by:
and acquiring a media stream currently played by the multimedia playing equipment, and deleting a first preset frame number or adding a preset blank frame number to the media stream when the motion activity is smaller than a first preset threshold value. Wherein, the number of the deleted or added frames is positively correlated with a first difference between the activity of the sport and a first preset threshold.
That is, when the motion activity of the user does not meet the standard specification, the media stream is subjected to frame deletion or frame addition, so that the quality of the played media stream is reduced, and feedback is provided for the user to help the user to keep proper motion efficiency.
In another embodiment of the present application, another multimedia play control method based on motion states is disclosed. As shown in fig. 3, on the basis of the method including step S110 in the embodiment of fig. 1, step S120 is replaced by:
s150, acquiring a media stream currently played by the multimedia playing device, and determining a first preset frame number to be deleted or a preset blank frame number to be added according to a first difference between the motion activity and a first preset threshold.
S160, when the motion activity is smaller than a first preset threshold, deleting the first preset frame number or adding the preset blank frame number to the media stream.
In this embodiment, in step S150, the first preset frame number or the preset blank frame number may be equal to an absolute value of a first difference between the motion activity and a first preset threshold. The following steps can be also included: the number of the deleted or added frames is in proportion of a preset multiple to the first difference. This is not limited by the present application. The embodiment performs frame deletion or frame addition processing on the media stream, and reduces the quality of the played media stream so as to provide feedback for a user and help the user to keep proper motion efficiency.
When the above-described deletion or addition is performed, the deletion or addition may be performed at fixed intervals or at random intervals.
In another embodiment of the present application, another multimedia play control method based on motion states is disclosed. The multimedia playing device is used for playing the cloud live-broadcast teaching video of the fitness coach. As shown in fig. 4, the embodiment further includes, on the basis of the step S120, the following steps:
s111, obtaining the first limb action data of the coach based on the video played by the multimedia playing device.
And S112, acquiring second limb action data of the user based on the camera of the surrounding environment.
And S113, calculating the action matching degree of the first limb action data and the second limb action data, and taking the action matching degree as the motion activity degree.
This embodiment utilizes the action matching degree of coach and student based on the scene of high in the clouds body-building teaching, as the motion liveness, gives the user promptly student's feedback based on this action matching degree, helps it to keep suitable motion efficiency, also can provide a feedback about action study normative for the user, does benefit to it and promotes the learning effect.
For example, the motion matching degree may be a ratio of the number of all motions to the number of coincident limb motions of the first limb motion data and the second limb motion data. The application is not limited.
In another embodiment of the present application, another multimedia play control method based on motion states is disclosed. The treadmill in this embodiment is provided with a camera, and the embodiment further includes, on the basis of including step S120:
the method includes the steps of collecting moving image data of a user based on a camera on the treadmill. And
and inputting the motion image data into a preset model for recognition and analysis, and acquiring the motion activity of the user.
Specifically, the motion activity is identified and obtained based on the motion image data, which can be implemented by referring to the prior art, for example, the limb swing amplitude and swing frequency of the user can be obtained based on the motion image data, and then weighted summation is performed on the obtained limb swing amplitude and swing frequency to calculate the motion activity, and the like, which is not described in detail herein.
Different from the prior art that the motion activity is calculated by using the physiological information of the user, the motion activity is calculated by using the motion image data of the user, so that more stereoscopic and more comprehensive calculation reference data can be obtained, the obtained motion activity is more accurate, and the accuracy of the disclosed multimedia playing control method is improved.
In another embodiment of the present application, another multimedia play control method based on motion states is disclosed. As shown in fig. 5, the embodiment further includes, on the basis of the step S120:
and S114, acquiring the moving image data and the physiological parameters of the user.
S115, determining a first motion activity based on the moving image data; and determining a second athletic activity level based on the physiological parameter.
And S116, determining the final motion activity degree based on the first motion activity degree and the second motion activity degree.
Different from the prior art that the motion activity is calculated by simply utilizing the physiological information of the user, the motion activity is calculated by comprehensively utilizing the motion image data and the physiological parameters of the user, so that more three-dimensional and more comprehensive calculation reference data can be obtained, the obtained motion activity is more accurate, and the accuracy of the disclosed multimedia playing control method is improved.
It should be noted that all the above embodiments disclosed in the present application can be freely combined, and the technical solutions obtained by combining them are also within the scope of the present application.
As shown in fig. 6, an embodiment of the present invention further discloses a multimedia playing control system 6 based on motion status, which includes:
the motion activity determining module 61 collects the motion parameters and/or physiological parameters of the user, and obtains the motion activity of the user based on at least the motion parameters and/or physiological parameters.
The motion activity feedback module 62 obtains a media stream currently played by the multimedia playing device, and adjusts a current playing parameter of the media stream based on a comparison result between the motion activity and a first preset threshold, so that a first difference between the motion activity and the first preset threshold and a second difference between the adjusted playing parameter and the preset playing parameter are in positive correlation.
It is understood that the multimedia playing control system based on motion state of the present invention also includes other existing functional modules supporting the operation of the multimedia playing control system based on motion state. The multimedia playing control system based on motion state shown in fig. 6 is only an example, and should not bring any limitation to the function and the scope of use of the embodiment of the present invention.
In this embodiment, the motion state-based multimedia playing control system is used to implement the motion state-based multimedia playing control method, so as to refer to the description of the motion state-based multimedia playing control method for the specific implementation steps of the motion state-based multimedia playing control system, which is not described herein again.
The embodiment of the invention also discloses a multimedia playing control device based on the motion state, which comprises a processor and a memory, wherein the memory stores an executable program of the processor; the processor is configured to execute the steps of the above-described motion-state-based multimedia playback control method via execution of an executable program. Fig. 7 is a schematic structural diagram of a multimedia playing control device based on motion state disclosed by the invention. An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 7. The electronic device 600 shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 7, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one memory unit 620, a bus 630 connecting the different platform components (including the memory unit 620 and the processing unit 610), a display unit 640, etc.
Wherein the storage unit stores program code that can be executed by the processing unit 610, such that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above-mentioned motion state based multimedia playback control method section of the present specification. For example, processing unit 610 may perform the steps as shown in fig. 1.
The storage unit 620 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)6201 and/or a cache memory unit 6202, and may further include a read-only memory unit (ROM) 6203.
The memory unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via the bus 630. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.
The invention also discloses a computer readable storage medium for storing a program, wherein the program realizes the steps of the multimedia playing control method based on the motion state when being executed. In some possible embodiments, the aspects of the present invention may also be implemented in the form of a program product, which includes program code for causing a terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above-mentioned motion-state-based multimedia playback control method of the present specification, when the program product is run on the terminal device.
As shown above, when the program of the computer-readable storage medium of this embodiment is executed, the motion activity of the user is obtained, the multimedia playing parameter is adjusted based on the comparison result between the motion activity of the user and the first preset threshold, and the first difference and the second difference are positively correlated, so that the human motion state and the playing condition of the media stream are combined, the multimedia playing parameter is adjusted according to the motion state, and the feedback is given to the user, which is beneficial to helping to urge the user to maintain normal motion efficiency and improve the user motion experience.
Fig. 8 is a schematic structural diagram of a computer-readable storage medium of the present invention. Referring to fig. 8, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
The multimedia playing control method, the multimedia playing control system, the multimedia playing control device and the multimedia playing control medium based on the motion state, which are provided by the embodiment of the invention, can be used for adjusting the multimedia playing parameters based on the comparison result of the motion activity of the user and the first preset threshold value and enabling the first difference value and the second difference value to be positively correlated, so that the human motion state and the playing condition of the media stream are combined, the playing parameters of the multimedia are adjusted according to the motion state, feedback is provided for the user, and the multimedia playing control method, the multimedia playing control system, the multimedia playing control device and the multimedia playing control medium based on the motion state are beneficial to helping to urge the user to maintain normal motion efficiency and improve the motion experience of the user.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (13)
1. A multimedia playing control method based on motion state is characterized by comprising the following steps:
s110, acquiring motion parameters and/or physiological parameters of a user, and acquiring motion activity of the user at least based on the motion parameters and/or physiological parameters;
s120, acquiring a media stream currently played by the multimedia playing device, and adjusting the current playing parameter of the media stream based on the comparison result of the motion liveness and the first preset threshold value, so that a first difference value between the motion liveness and the first preset threshold value and a second difference value between the adjusted playing parameter and the preset playing parameter are in positive correlation.
2. The motion-state-based multimedia playback control method according to claim 1, wherein the step S120 includes:
and when the motion activity is smaller than a first preset threshold value, deleting a first preset frame number or adding a preset blank frame number to the media stream.
3. The motion-state-based multimedia playback control method according to claim 2, wherein the step S120 includes:
determining a first preset frame number to be deleted or a preset blank frame number to be added according to a first difference between the motion activity and a first preset threshold;
and deleting the first preset frame number or adding the preset blank frame number to the media stream.
4. The motion state based multimedia playback control method of claim 3, wherein the first preset number of frames or the preset number of blank frames is equal to an absolute value of a first difference between the motion activity and a first preset threshold.
5. The motion-state-based multimedia playback control method according to claim 1, wherein the step S120 includes:
and when the motion activity is smaller than a first preset threshold value, slowing down the playing speed of the media stream or reducing the output volume of the multimedia playing equipment.
6. The motion state based multimedia playback control method of claim 1, wherein the method further comprises:
when the motion activity is smaller than a first preset threshold, judging whether the motion activity is smaller than a second preset threshold, and if so, controlling the media stream to pause playing; the second preset threshold is smaller than the first preset threshold.
7. The method as claimed in claim 1, wherein the preset playing parameter is a configuration parameter with the largest number of times of use in the historical data corresponding to all historical users using the media stream.
8. The exercise state-based multimedia playing control method according to claim 1, wherein the multimedia playing device is used for playing a cloud live teaching video of a fitness trainer; the step S110 includes:
obtaining first limb action data of a coach based on a video played by multimedia playing equipment;
collecting second limb action data of the user based on a camera of the surrounding environment;
calculating the action matching degree of the first limb action data and the second limb action data; and taking the action matching degree as the motion activity degree.
9. The method for controlling multimedia playing based on exercise status as claimed in claim 1, wherein a camera is provided on the treadmill, and the step S110 comprises:
acquiring moving image data of a user based on a camera on a treadmill;
and inputting the motion image data into a preset model for recognition and analysis, and acquiring the motion activity of the user.
10. The motion-state-based multimedia playback control method according to claim 1, wherein the step S110 includes:
collecting moving image data and physiological parameters of a user;
determining a first motion liveness based on the motion image data; and determining a second motion activity level based on the physiological parameter;
determining a final motion activity based on the first motion activity and the second motion activity.
11. A motion state based multimedia play control system for implementing the motion state based multimedia play control method according to claim 1, the system comprising:
the motion activity determining module is used for acquiring motion parameters and/or physiological parameters of the user and obtaining the motion activity of the user at least based on the motion parameters and/or physiological parameters;
the motion liveness feedback module acquires a media stream currently played by the multimedia playing device, and adjusts the current playing parameter of the media stream based on the comparison result of the motion liveness and a first preset threshold value, so that a first difference value between the motion liveness and the first preset threshold value and a second difference value between the adjusted playing parameter and the preset playing parameter are in positive correlation.
12. A multimedia play control apparatus based on a motion state, comprising:
a processor;
a memory having stored therein an executable program of the processor;
wherein the processor is configured to execute the steps of the motion state based multimedia playback control method of any of claims 1 to 10 via execution of the executable program.
13. A computer-readable storage medium storing a program, wherein the program when executed by a processor implements the steps of the motion state based multimedia playback control method according to any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210101188.3A CN114222184B (en) | 2022-01-27 | 2022-01-27 | Multimedia playing control method, system, equipment and medium based on motion state |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210101188.3A CN114222184B (en) | 2022-01-27 | 2022-01-27 | Multimedia playing control method, system, equipment and medium based on motion state |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114222184A true CN114222184A (en) | 2022-03-22 |
| CN114222184B CN114222184B (en) | 2023-08-15 |
Family
ID=80708777
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210101188.3A Active CN114222184B (en) | 2022-01-27 | 2022-01-27 | Multimedia playing control method, system, equipment and medium based on motion state |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114222184B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060124566A (en) * | 2005-05-31 | 2006-12-05 | 소니 가부시끼 가이샤 | Music playback apparatus and processing control method |
| EP1744301A1 (en) * | 2005-07-15 | 2007-01-17 | Samsung Electronics Co., Ltd. | Method, apparatus, and medium for controlling and playing sound effect by motion detection |
| US20130282157A1 (en) * | 2012-04-20 | 2013-10-24 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
| CN107005764A (en) * | 2014-11-21 | 2017-08-01 | 三星电子株式会社 | Earphone with activity control output |
| CN107978328A (en) * | 2017-12-21 | 2018-05-01 | 联想(北京)有限公司 | Information processing method and its device |
| CN109248414A (en) * | 2018-09-30 | 2019-01-22 | 深圳市科迈爱康科技有限公司 | Training based reminding method, device, equipment and readable storage medium storing program for executing |
| CN111202509A (en) * | 2020-01-17 | 2020-05-29 | 山东中医药大学 | Target heart rate monitoring method and device based on auditory expression strategy |
| WO2021196595A1 (en) * | 2020-04-02 | 2021-10-07 | 深圳创维－Rgb电子有限公司 | Exercise device control method and apparatus based on smart screen, and storage medium |
| US20210358071A1 (en) * | 2020-05-18 | 2021-11-18 | United Microelectronics Corp. | Automatic adjusting method for equipment and smart adjusting device using the same |
-
2022
- 2022-01-27 CN CN202210101188.3A patent/CN114222184B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060124566A (en) * | 2005-05-31 | 2006-12-05 | 소니 가부시끼 가이샤 | Music playback apparatus and processing control method |
| EP1744301A1 (en) * | 2005-07-15 | 2007-01-17 | Samsung Electronics Co., Ltd. | Method, apparatus, and medium for controlling and playing sound effect by motion detection |
| US20130282157A1 (en) * | 2012-04-20 | 2013-10-24 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
| CN107005764A (en) * | 2014-11-21 | 2017-08-01 | 三星电子株式会社 | Earphone with activity control output |
| CN107978328A (en) * | 2017-12-21 | 2018-05-01 | 联想(北京)有限公司 | Information processing method and its device |
| CN109248414A (en) * | 2018-09-30 | 2019-01-22 | 深圳市科迈爱康科技有限公司 | Training based reminding method, device, equipment and readable storage medium storing program for executing |
| CN111202509A (en) * | 2020-01-17 | 2020-05-29 | 山东中医药大学 | Target heart rate monitoring method and device based on auditory expression strategy |
| WO2021196595A1 (en) * | 2020-04-02 | 2021-10-07 | 深圳创维－Rgb电子有限公司 | Exercise device control method and apparatus based on smart screen, and storage medium |
| US20210358071A1 (en) * | 2020-05-18 | 2021-11-18 | United Microelectronics Corp. | Automatic adjusting method for equipment and smart adjusting device using the same |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114222184B (en) | 2023-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3563986A1 (en) | Robot, server and man-machine interaction method | |
| CN110876024B (en) | Method and device for determining lip action of avatar | |
| CN109766759A (en) | Emotion identification method and Related product | |
| CN111723784B (en) | Risk video identification method and device and electronic equipment | |
| CN111027486A (en) | Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom | |
| CN110298220B (en) | Action video live broadcast method, system, electronic equipment and storage medium | |
| US10783884B2 (en) | Electronic device-awakening method and apparatus, device and computer-readable storage medium | |
| CN109491915B (en) | Data processing method and device, medium and computing equipment | |
| CN109830277B (en) | Rope skipping monitoring method, electronic device and storage medium | |
| CN110531849A (en) | Intelligent teaching system based on 5G communication and capable of enhancing reality | |
| CN109582825B (en) | Method and apparatus for generating information | |
| CN113723530B (en) | Intelligent psychological assessment system based on video analysis and electronic psychological sand table | |
| US20210097887A1 (en) | Multimodal neural network for public speaking guidance | |
| US20230128721A1 (en) | Custom video workout programs for execution on an exercise machine | |
| CN111417014B (en) | Video generation method, system, device and storage medium based on online education | |
| CN110569910A (en) | method, device and equipment for processing live broadcast cycle and storage medium | |
| CN110111611A (en) | Information processing method, device, medium and electronic equipment | |
| US11928891B2 (en) | Adapting physical activities and exercises based on facial analysis by image processing | |
| US11302027B2 (en) | Methods and systems for managing virtual reality sessions | |
| CN110619888B (en) | AI voice rate adjusting method and device and electronic equipment | |
| US10180974B2 (en) | System and method for generating content corresponding to an event | |
| CN114222184B (en) | Multimedia playing control method, system, equipment and medium based on motion state | |
| US11023664B2 (en) | Persisting annotations applied to an electronic hosted whiteboard | |
| CN113591678A (en) | Classroom attention determination method, device, equipment, storage medium and program product | |
| CN112398952A (en) | Electronic resource pushing method, system, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |