CN113079416B - Multimedia intelligent control method, client and system - Google Patents
Multimedia intelligent control method, client and system Download PDFInfo
- Publication number
- CN113079416B CN113079416B CN202110370378.0A CN202110370378A CN113079416B CN 113079416 B CN113079416 B CN 113079416B CN 202110370378 A CN202110370378 A CN 202110370378A CN 113079416 B CN113079416 B CN 113079416B
- Authority
- CN
- China
- Prior art keywords
- information
- instruction
- multimedia
- intelligent control
- time point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000009471 action Effects 0.000 claims abstract description 39
- 239000012634 fragment Substances 0.000 claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 22
- 238000012937 correction Methods 0.000 claims description 37
- 238000004891 communication Methods 0.000 claims description 12
- 230000004927 fusion Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 4
- 230000009191 jumping Effects 0.000 abstract 1
- 230000000875 corresponding effect Effects 0.000 description 25
- 230000001276 controlling effect Effects 0.000 description 12
- 230000000694 effects Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 3
- 238000005520 cutting process Methods 0.000 description 3
- 230000003111 delayed effect Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 206010021639 Incontinence Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 210000003141 lower extremity Anatomy 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
- 210000001364 upper extremity Anatomy 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A multimedia intelligent control method, a client and a system, wherein the method comprises the following steps: acquiring first multimedia information and/or sensor information of a user in real time to acquire corresponding real-time action information; receiving a user instruction, acquiring corresponding second multimedia information, and dividing the second multimedia information into one or more fragment information; generating an intelligent control instruction based on the real-time action information and correcting the intelligent control instruction; and further controlling the content playing speed of the clip information. The resource consumption of multimedia processing is reduced, meanwhile, the user can flexibly control the playing of the multimedia by utilizing the action of the user, the situations of playing pause, jumping, incontinuous and the like are prevented, and the user can obtain immersive participation experience.
Description
Technical Field
The invention relates to the field of multimedia intelligent control, in particular to a multimedia intelligent control method, a client and a system.
Background
At present, due to factors such as distance, time, personnel flow and the like, people cannot physically go to a specific place to participate in specific activities, such as worship, praying, hall activities and the like, on-line Buddha products capable of providing prerecorded videos for users or remote live broadcast on site activities through the Internet are appeared on the market. But through these channels the user still has no "immersive" experience of participating in the venue campaign.
In recent years, in order to improve user experience, when providing internet video playing service for users, a somatosensory control method is applied, for example, the users can make specific actions to accelerate video playing, or personalized video clips are pieced together according to the actions of the users, and the scheme has the defects of single control form, hard and incoherent video playing and the like. There are some methods without calculating the force cost, for example, calculating the matching degree of the user action and the specific action in real time, so as to control the video to accelerate or decelerate to play, and because continuous image matching calculation needs to be performed on different video streams, the algorithm is complex, the force requirement is high, and the terminal cost requirement is too high.
Disclosure of Invention
In order to solve at least one of the problems, a simple and flexible multimedia intelligent control method and a product are provided, so that a user can obtain an immersive remote participation experience.
To achieve the above object, a first aspect of the present invention provides a multimedia intelligent control method, including: step 101, acquiring first multimedia information and/or sensor information of a user in real time, and acquiring corresponding real-time action information according to the first multimedia information and/or the sensor information; step 102, receiving a user instruction, wherein the user instruction comprises a standard fragment duration; acquiring second multimedia information corresponding to the user instruction; the second multimedia information comprises one or more worship elements, and the second multimedia information is divided into one or more piece information according to the worship elements; step 103, generating an intelligent control instruction based on the real-time action information, wherein the intelligent control instruction comprises a state instruction for controlling the playing speed and a decision instruction for playing the next piece of information; step 104, correcting the intelligent control instruction according to the standard segment duration to obtain a corrected decision instruction and a corrected state instruction; and 105, controlling the content playing speed of the fragment information according to the state instruction before correction and the state instruction after correction in the intelligent control instruction.
Preferably, the duration of each piece of the clip information is an integer multiple of the standard clip duration.
Preferably, the time interval between the modified decision instructions is an integer multiple of the standard segment duration.
Preferably, the step 104 specifically includes: and acquiring a time point of a current decision instruction in the intelligent control instruction, and if the time interval between the time point of the current decision instruction and the time point of a previous decision instruction is not equal to the integral multiple of the standard segment duration, delaying to correct the time point of the current decision instruction, so that the time interval between the corrected time point of the current decision instruction and the time point of the previous decision instruction is equal to the integral multiple of the standard segment duration. The steps further include: and determining a corresponding playing time point of the current fragment information according to the time point of the current decision instruction before correction, and determining a corrected state instruction based on the time interval between the corresponding playing time point of the current fragment information and the starting time point of the next fragment information and the delay correction time of the current decision instruction. Further, the step 105 specifically includes: according to the state instruction before correction, controlling the content playing speed before the corresponding playing time point of the current fragment information; and controlling the content playing speed after the corresponding playing time point of the current clip information according to the corrected state instruction.
Preferably, the step 102 further includes: and after the second multimedia information is acquired and before the second multimedia information is divided into one or more pieces of fragment information, carrying out fusion operation on the second multimedia information according to the first multimedia information.
According to the first aspect of the invention, the user can flexibly control the playing of the corresponding multimedia by utilizing the action of the user, so that the user obtains immersive participation experience when performing activities such as remote Buddha, and the like, and the specific beneficial effects at least comprise: firstly, the technical scheme does not need to splice multimedia fragments, and the user plays complete multimedia information with coherent links, so that play pause skip and incoherence can not occur; secondly, the technical scheme can carry out fusion processing on the multimedia information according to the current image of the user, so that the user side obtains the multimedia content participated in the user side in person; thirdly, the technical scheme does not need to carry out continuous image recognition matching operation on the video stream, only needs to correct and execute instructions according to the standard fragment duration, and can even place most of operations on a client to realize, so that compared with the prior art, the operation cost is greatly reduced, and the hardware requirement is lowered; fourth, the user can adjust the standard segment duration according to the needs of the user, so that balance between instantaneity and control accuracy is maintained, self-adjustment of the user is achieved, and immersive experience of the user is further enhanced.
The second aspect of the invention provides a multimedia intelligent control client, which comprises an acquisition module, an input module, a communication module, a first processing module, an instruction control module and a multimedia content playing module, wherein the acquisition module is used for acquiring first multimedia information and/or sensor information in real time and sending the acquired information to the first processing module; the input module is used for receiving a user instruction, wherein the user instruction comprises a standard fragment duration; the communication module is used for sending the user instruction to the multimedia intelligent control server and receiving second multimedia information sent by the multimedia intelligent control server, wherein the second multimedia information comprises one or more worship elements; the first processing module is used for receiving the first multimedia information and/or the sensor information sent by the acquisition module and processing the first multimedia information and/or the sensor information to obtain real-time action information; dividing the second multimedia information into one or more pieces of clip information according to the worship element; the instruction control module is used for generating an intelligent control instruction according to the real-time action information, correcting the intelligent control instruction based on the standard segment duration and obtaining a corrected decision instruction and a corrected state instruction; and the multimedia content playing module is used for controlling the content playing speed of the fragment information according to the state instruction before correction and the state instruction after correction.
In a third aspect, the present invention provides a multimedia intelligent control system, the multimedia intelligent control system comprising: the multimedia intelligent control server and the multimedia intelligent control client provided by the second aspect of the invention.
Compared with the prior art, the second and third aspects of the invention provide the user with products which can flexibly control corresponding multimedia playing by utilizing the actions of the user, thereby enabling the user to obtain immersive participation experience when performing activities such as remote Buddha. The client collects the user actions, and then generates and corrects a control instruction for controlling the playing of each piece of information according to the displayed multimedia content, so that the playing of each piece of information in the multimedia is controlled, and complex video splicing and editing operations are not required; meanwhile, because the activities such as remote Buddha, worship and the like do not require the action of a user to be synchronous and homomorphic with the action in the multimedia, the operation resources for matching and identifying the video real-time picture are saved, most of information processing work can be independently completed without depending on a server, and the operation cost is reduced; in addition, the user can adjust the standard segment duration according to own needs, and then revise intelligent control instruction for it can be on the basis that does not obviously increase the processing burden, control the multimedia effectively and link up and "follow" user action broadcast, and then realize user's self-interacting between instantaneity and control accuracy, further strengthen user's immersive experience.
Additional features and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a flowchart of a multimedia intelligent control method according to a first embodiment of the present invention;
fig. 2 is a schematic block diagram of a multimedia intelligent control client in a second embodiment of the present invention;
fig. 3 is a schematic block diagram of a multimedia intelligent control system according to a third embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, are intended to fall within the scope of the present invention.
Detailed description of the preferred embodiments
Referring to fig. 1, a first embodiment of the present invention provides a multimedia intelligent control method, which includes the following steps:
step 101, acquiring first multimedia information and/or sensor information of a user in real time, and acquiring corresponding real-time action information according to the first multimedia information and/or the sensor information.
Specifically, the first multimedia data of the user can be input in real time through the intelligent terminal or the camera, and the first multimedia data mainly comprises real-time dynamic multimedia data of the user, and sensor information can be acquired in real time through a sensor on the intelligent terminal and other wearable intelligent devices; extracting real-time motion information from the first multimedia information acquired in real time, for example, by processing the first multimedia information, extracting a motion speed, an acceleration, an upper limb motion, a lower limb motion, a head motion, a wrist overturn and the like of a user; or the real-time motion information of the user can be identified through the combination of the sensor information.
Step 102, receiving a user instruction, wherein the user instruction comprises a standard fragment duration; acquiring second multimedia information corresponding to the user instruction; the second multimedia information includes one or more worship elements, and the second multimedia information is divided into one or more clip information according to the worship elements.
Specifically, the user can upload the second multimedia information to the server side for storage, or the server side can make the second multimedia information in advance for storage, so that the specific second multimedia information can be matched for playing according to the instruction of the user. When a user sends out a user instruction, the user can set the desired standard segment duration, wherein the standard segment duration is a control reference of the second multimedia in the playing process, for example, for a 5-minute long-distance sacrifice figure of Buddha multimedia data, when a certain user Alice sets the desired standard segment duration for 10 seconds, the user Alice hopes to play the multimedia data with the 10 seconds as the control reference. The second multimedia data includes one or more worship elements, and the multimedia data of the remote sacrifice statue may include walking elements from temple gates to grand palace, upper tribute elements for raising tributes and placing tributes, kneeling elements such as bending over, squat down, kneeling down, etc., and may further include return gift elements such as rising up, bowing down, etc. According to the elements, the whole multimedia data can be divided into a plurality of fragment information, and in the actual operation process, the real cutting operation of the multimedia data is not needed, and each fragment information can be determined only by adding a corresponding time point. Therefore, the splicing operation of the multimedia is not needed, and the processing resources are saved.
When obtaining the segment information, as described above, the user wants to use the standard segment duration as the control reference, and then the duration of each segment information is preferably an integer multiple of the standard segment duration, for example, the multimedia data of the 5-minute remote sacrifice figure is used as the standard segment duration, and the user wants to obtain 10 segment information by adding the segment time point, and each segment information is 30 seconds. Of course, it should be understood by those skilled in the art that the duration of the clip information may not be an integer multiple of the standard clip duration, and for the purposes of this description, it is assumed that the aforementioned multimedia obtains 12 clip information pieces, each having a length of 25 seconds.
In addition, the second multimedia information can be fused according to the first multimedia information, for example, the real-time appearance form, the clothing expression and the like of the user are fused with the characters in the second multimedia, so that the user can obtain the multimedia content participated in the user himself.
And step 103, generating an intelligent control instruction based on the real-time action information, wherein the intelligent control instruction comprises a state instruction for controlling the playing speed and a decision instruction for playing the next piece of information.
Specifically, when the user transitions from the initial state to the active state, a first decision instruction is generated at this time, namely, the first clip information is played; for example, when Alice of the user generates an intelligent control instruction of forward movement at 13:58:00, the decision instruction is < sequence number 000; decision type; time 135800; correcting NULL, and then collecting that the moving speed of Alice of the user is 0.5 m/s, and correspondingly generating a state instruction < sequence number 000 according to a preset corresponding relation; a status type; a control value of 2; the pointer points to decision instruction number 001; correcting NULL, wherein the control value represents the speed of playing, then the user Alice stops moving at 13:58:07 and starts to lift the arms, and a decision instruction < sequence number 001 is generated at this time; decision type; time 135807; correcting NULL, and synchronously generating a state instruction < sequence number 001 according to a preset corresponding relation because the arm lifting speed is detected to be 0.1 m/s; a status type; a control value of 1; the pointer points to decision instruction number 002; correction NULL > … … similarly, since user Alice wants to control the playing of this multimedia data with 10 minutes of remote sacrifice statue by his own actions, she will continuously take various actions and accordingly will generate a series of intelligent control commands, i.e. a series of decision commands and status commands.
And 104, correcting the intelligent control instruction according to the standard segment duration to obtain a corrected decision instruction and a corrected state instruction.
The inventor team finds that, as a remote user Alice in the actual research and development process, she cannot accurately know the playing time of each action of the multimedia content due to the limitation of the field and the inexperience of the action, so that the action of the user Alice and the action of the person in the multimedia video playing cannot be synchronized, and if the user makes the corresponding action at the moment, the content of the multimedia video playing is switched, the jump and the incontinence of the video playing are caused, and even after the prior art is consulted, most schemes also need to perform corresponding jump, pre-cutting and other treatments on the multimedia data. However, in this embodiment, the correction control instruction is used to replace the correction multimedia itself, so that the processing difficulty is greatly reduced, and the processing resources are saved.
Specifically, for a decision instruction, first, a point in time of the current decision instruction is acquired. For example, current decision instruction < sequence number 001; decision type; time 135807; correcting NULL >; and secondly, judging whether the time interval between the time point of the current decision instruction and the time point of the previous decision instruction is equal to an integral multiple of the standard fragment duration. For example, the previous decision instruction is < sequence number 000; decision type; time 135800; correcting NULL >, and knowing by simple calculation that the time interval between the time point of the current decision instruction and the time point of the previous decision instruction is 7 seconds, because the user Alice takes 10 seconds as the standard segment duration, the time interval between the time point of the current decision instruction and the time point of the previous decision instruction is not equal to the integral multiple of the standard segment duration; then, the time point of the current decision instruction is delayed to be corrected, so that the time interval between the corrected time point of the current decision instruction and the time point of the previous decision instruction is equal to the integral multiple of the standard segment duration. Specifically, the time point of the current decision instruction is delayed and corrected for 3 seconds, so that the time interval between the current decision instruction and the previous decision instruction is equal to 10 seconds, which is an integer multiple of the standard segment duration of 10 seconds, and the corrected decision instruction is < sequence number 001; decision type; time 135807; correction 135810>.
Specifically, for the state instruction, first, a corresponding playing time point of the current clip information is determined according to a time point of the current decision instruction before correction. For example, the current decision instruction < sequence number 001; decision type; time 135807; NULL is corrected such that the time point is 13:58:07, that is, from 13:58:00, the 5-minute remote sacrifice statue multimedia has actually been played for 7 seconds, and it is assumed that this multimedia is played at twice the speed, that is, at 13:58:07, the 14 th second position of the first segment (25 seconds total of the first segment) in the multimedia is played, that is, the 14 th second is the corresponding playing time point of the current segment information. Then, a corrected state instruction is determined based on a time interval between a corresponding play time point of the current clip information and a start time point of the next clip information, and a delay correction time of the current decision instruction. The playing time point of the next piece of information is 25 seconds, the time interval between the corresponding playing time point (14 th seconds) of the current piece of information and the starting time point (25 th seconds) of the next piece of information is 9 seconds, the delay correction time of the current decision instruction is 3 seconds, the numerical relation of the delay correction time and the delay correction time is 3 times, and then the corrected state instruction is < sequence number 000; a status type; a control value 3; the pointer points to decision instruction number 001; correction 135807>.
And 105, controlling the content playing speed of the fragment information according to the state instruction before correction and the state instruction after correction in the intelligent control instruction.
Specifically, according to the state instruction before correction, controlling the content playing speed before the corresponding playing time point of the current clip information; and controlling the content playing speed after the corresponding playing time point of the current clip information according to the corrected state instruction. First, when the first fragment information is played, the state instruction before correction is < sequence number 000; a status type; a control value of 2; the pointer points to decision instruction number 001; modify NULL >, modified status instruction is < sequence number 000; a status type; a control value 3; the pointer points to decision instruction number 001; correction 135807>, the corresponding play time point has been determined to be 14 seconds, then the specific control should be as follows: and accelerating the playing at a speed of 2 times according to the state instruction before the correction when the playing is carried out for 0 to 14 seconds, and playing at a speed of 3 times according to the state instruction after the correction when the playing is carried out for 14 to 25 seconds.
It can be seen that, in the above scheme, while implementing the play control, the action is collected, the control instruction is generated and corrected, and then used for the play control, and thus the user can implement the control of playing all pieces of information of the whole multimedia information through the action of the user, while in terms of time delay, it can be clearly determined by the above scheme that the multimedia information may be delayed, for example, the user has already performed the action, but the multimedia has not yet played the corresponding action, but the delay does not exceed the standard segment duration at the maximum, that is, the purpose that the user implements the play control of the multimedia with the standard segment duration as the control reference is achieved. Meanwhile, the scheme does not prune any content of the multimedia information, and does not bring about resource consumption of multimedia data processing. In particular, when the multimedia information contains the user's own elements, due to the immersive experience, the user as the control party can not take any action by himself or herself to pay more attention to the ' own ' action in the multimedia information after doing a certain action when using the product, so that the scheme is particularly suitable for scenes related to remote Buddha and worship.
Detailed description of the preferred embodiments
Referring to fig. 2, a second embodiment of the present invention provides a multimedia intelligent control client, which includes an acquisition module, an input module, a communication module, a first processing module, an instruction control module, and a multimedia content playing module.
The acquisition module is used for acquiring the first multimedia information and/or the sensor information in real time and sending the acquired information to the first processing module. The intelligent terminal has more and more integrated functions, and can collect first multimedia information through modes such as a camera, an external component, short-range radio connection and the like, and generally, the first multimedia information comprises real-time dynamic data of a user and also can comprise information such as appearance gesture, image clothing and the like of the user. Meanwhile, the motion information of the user can be acquired through a sensor on the intelligent terminal, or a sensor deployed in a specific place, or a sensor on the wearable device.
And the input module is used for receiving a user instruction, wherein the user instruction comprises a standard fragment duration. The user can send user instructions to the intelligent terminal in the modes of key pressing, sound and the like, the client can provide corresponding instruction content input interfaces, and when the user sends the user instructions, the client can receive various instruction contents. The user instruction may include information about a second multimedia that the user wishes to play, so that the server matches multimedia content that meets the user's needs; the user instruction may further include a standard segment duration to reflect the user's requirement in terms of control criteria, and the subsequent play action is performed according to the standard segment duration, so that the multimedia play service provided by the product to the user meets the user's requirement.
And the communication module is used for sending the user instruction to the multimedia intelligent control server and receiving second multimedia information sent by the multimedia intelligent control server, wherein the second multimedia information comprises one or more worship elements. The existing remote communication technology covers various wireless communication modes and wired communication modes, and can meet the requirements of users for acquiring worship related multimedia contents. The communication module is also used for sending the first multimedia information to the multimedia intelligent control server, receiving the fusion multimedia information sent by the multimedia intelligent control server, and obtaining the fusion multimedia information after the fusion operation of the second multimedia information by the multimedia intelligent control server according to the first multimedia information. In order to enable the user to obtain immersive service experience, the communication module sends the first multimedia information which is acquired by the acquisition module and contains information such as appearance, gesture and dressing of the user to the server side, the server replaces, fuses and the like the second multimedia information, and people in the multimedia content provided for the user are the user, so that the user experience is improved.
The first processing module is used for receiving the first multimedia information and/or the sensor information sent by the acquisition module and processing the first multimedia information and/or the sensor information to obtain real-time action information; the second multimedia information is partitioned into one or more pieces of clip information based on the worship element. In particular, the first processing module may identify real-time motion information in the first multimedia information through existing various algorithms or identify specific real-time motion information according to a combination of various sensor information. Meanwhile, the first processing module can divide the whole section of multimedia data into a plurality of section information according to worship elements or other configuration files in the multimedia content, and in the actual operation process, the real cutting operation of the multimedia data is not needed, and each section information can be determined only by adding corresponding time points. Therefore, the splicing operation of the multimedia is not needed, and the processing resource is saved, so that the operation can be completed only by the client without the assistance of a server.
The instruction control module is used for generating an intelligent control instruction according to the real-time action information, correcting the intelligent control instruction based on the standard segment duration, and obtaining a corrected decision instruction and a corrected state instruction. In the specific embodiment of the invention, the user does not need to comprehensively and accurately identify various actions, and only needs to determine the state instruction for controlling the playing speed and the decision instruction for playing the next piece of information, so that the calculation can be independently completed by the client. The specific instruction correction process is described in detail in the first embodiment of the present invention, and will not be described herein.
And the multimedia content playing module is used for controlling the content playing speed of the fragment information according to the state instruction before correction and the state instruction after correction. The multimedia content playing module may be the module of the client, or may be composed of only one content playing control entity and an interface, where the content playing control entity realizes playing control, and the interface realizes that the client is connected with an external playing device, and the external playing device may be various displays, projectors, etc.
Detailed description of the preferred embodiments
Referring to fig. 3, a third embodiment of the present invention provides a multimedia intelligent control system, which includes a multimedia intelligent control client and a multimedia intelligent control server according to the second embodiment of the present invention. The structure and the function of the multimedia intelligent control client are not repeated, and only the main structure and the function of the multimedia intelligent control server are introduced.
The multimedia intelligent control server comprises a receiving component, a matching engine, a multimedia content library and a sending component. The receiving component is used for receiving user instruction information sent by the client and can also receive first multimedia information and other information sent by the client. The multimedia content library stores a plurality of second multimedia information, which may be content uploaded by a user or content provided by a service provider. The matching engine matches the multimedia content provided to the user according to the user instruction and sends the multimedia content to the client through the sending component.
In addition, the multimedia intelligent control server can further comprise a fusion component which is used for replacing, fusing and other operations on the second multimedia information according to the first multimedia information which is uploaded by the client and contains the information such as the appearance, the gesture and the dressing of the user, so that the fusion multimedia information containing the self-image of the user can be provided, and the user experience is improved.
Detailed description of the preferred embodiments
The fourth embodiment of the present invention also provides a computer-readable storage medium in which a computer program is stored, which when executed by a processor causes the processor to implement the method in the first embodiment of the present invention.
Although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments described above, or equivalents may be substituted for elements thereof, and any modifications, equivalents, improvements and changes may be made without departing from the spirit and principle of the present invention.
Claims (5)
1. The intelligent multimedia control method is characterized by comprising the following steps:
step 101, acquiring first multimedia information and/or sensor information of a user in real time, and acquiring corresponding real-time action information according to the first multimedia information and/or the sensor information;
step 102, receiving a user instruction, wherein the user instruction comprises a standard fragment duration; acquiring second multimedia information corresponding to the user instruction; the second multimedia information comprises one or more worship elements, and the second multimedia information is divided into one or more piece information according to the worship elements;
the duration of each piece of information is an integer multiple of the standard piece duration;
step 103, generating an intelligent control instruction based on the real-time action information, wherein the intelligent control instruction comprises a state instruction for controlling the playing speed and a decision instruction for playing the next piece of information;
step 104, correcting the intelligent control instruction according to the standard segment duration to obtain a corrected decision instruction and a corrected state instruction;
step 105, controlling the content playing speed of the fragment information according to the state instruction before correction and the state instruction after correction in the intelligent control instruction;
the time interval between the corrected decision instructions is an integer multiple of the standard segment duration;
the step 104 specifically includes: acquiring a time point of a current decision instruction in the intelligent control instruction, and if the time interval between the time point of the current decision instruction and the time point of a previous decision instruction is not equal to the integral multiple of the standard segment duration, delaying to correct the time point of the current decision instruction, so that the time interval between the corrected time point of the current decision instruction and the time point of the previous decision instruction is equal to the integral multiple of the standard segment duration;
the step 104 further includes: determining a corresponding playing time point of the current fragment information according to the time point of the current decision instruction before correction, and determining a corrected state instruction based on a time interval between the corresponding playing time point of the current fragment information and the starting time point of the next fragment information and the delay correction time of the current decision instruction;
the step 105 specifically includes: according to the state instruction before correction, controlling the content playing speed before the corresponding playing time point of the current fragment information; controlling the content playing speed after the corresponding playing time point of the current clip information according to the corrected state instruction;
the step 102 further includes: and after the second multimedia information is acquired and before the second multimedia information is divided into one or more pieces of fragment information, carrying out fusion operation on the second multimedia information according to the first multimedia information.
2. The multimedia intelligent control client is characterized by comprising an acquisition module, an input module, a communication module, a first processing module, an instruction control module and a multimedia content playing module, wherein,
the acquisition module is used for acquiring first multimedia information and/or sensor information in real time and transmitting the acquired information to the first processing module;
the input module is used for receiving a user instruction, wherein the user instruction comprises a standard fragment duration;
the communication module is used for sending the user instruction to the multimedia intelligent control server and receiving second multimedia information sent by the multimedia intelligent control server, wherein the second multimedia information comprises one or more worship elements;
the first processing module is used for receiving the first multimedia information and/or the sensor information sent by the acquisition module and processing the first multimedia information and/or the sensor information to obtain real-time action information; dividing the second multimedia information into one or more pieces of clip information according to the worship element; the duration of each piece of information is an integer multiple of the standard piece duration;
the instruction control module is used for generating an intelligent control instruction according to the real-time action information, correcting the intelligent control instruction based on the standard segment duration and obtaining a corrected decision instruction and a corrected state instruction;
the multimedia content playing module is used for controlling the content playing speed of the fragment information according to the state instruction before correction and the state instruction after correction;
the time interval between the corrected decision instructions is an integer multiple of the standard segment duration;
the instruction control module is specifically configured to obtain a time point of a current decision instruction in the intelligent control instruction, and delay correcting the time point of the current decision instruction if a time interval between the time point of the current decision instruction and a time point of a previous decision instruction is not equal to an integer multiple of the standard segment duration, so that the time interval between the corrected time point of the current decision instruction and the time point of the previous decision instruction is equal to the integer multiple of the standard segment duration;
the instruction control module is further configured to determine a corresponding playing time point of the current clip information according to the time point of the current decision instruction before correction, and determine a corrected state instruction based on a time interval between the corresponding playing time point of the current clip information and a starting time point of the next clip information and a delay correction time of the current decision instruction;
the multimedia content playing module is further configured to: according to the state instruction before correction, controlling the content playing speed before the corresponding playing time point of the current fragment information; and controlling the content playing speed after the corresponding playing time point of the current clip information according to the corrected state instruction.
3. The multimedia intelligent control client of claim 2, wherein the communication module is further configured to: and sending the first multimedia information to the multimedia intelligent control server, and receiving the converged multimedia information sent by the multimedia intelligent control server, wherein the converged multimedia information is obtained by the multimedia intelligent control server after the second multimedia information is converged according to the first multimedia information.
4. A multimedia intelligent control system, characterized in that the multimedia intelligent control system comprises: a multimedia intelligent control server, and a multimedia intelligent control client according to any of claims 2 to 3.
5. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the computer program causes the processor to implement the multimedia intelligent control method as claimed in claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110370378.0A CN113079416B (en) | 2021-04-07 | 2021-04-07 | Multimedia intelligent control method, client and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110370378.0A CN113079416B (en) | 2021-04-07 | 2021-04-07 | Multimedia intelligent control method, client and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113079416A CN113079416A (en) | 2021-07-06 |
| CN113079416B true CN113079416B (en) | 2024-03-26 |
Family
ID=76615349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110370378.0A Active CN113079416B (en) | 2021-04-07 | 2021-04-07 | Multimedia intelligent control method, client and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113079416B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20150080237A (en) * | 2013-12-31 | 2015-07-09 | 주식회사 케이티 | Method and Apparatus for Control of Multimedia Contents Play Based on User Action |
| CN111432245A (en) * | 2020-03-27 | 2020-07-17 | 腾讯科技（深圳）有限公司 | Multimedia information playing control method, device, equipment and storage medium |
| CN111904244A (en) * | 2020-08-31 | 2020-11-10 | 林仁亮 | Religion and custom worship system and worship method |
| CN111970568A (en) * | 2020-08-31 | 2020-11-20 | 上海松鼠课堂人工智能科技有限公司 | Method and system for interactive video playing |
| CN112422946A (en) * | 2020-11-30 | 2021-02-26 | 重庆邮电大学 | Intelligent yoga action guidance system based on 3D reconstruction |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9430128B2 (en) * | 2011-01-06 | 2016-08-30 | Tivo, Inc. | Method and apparatus for controls based on concurrent gestures |
-
2021
- 2021-04-07 CN CN202110370378.0A patent/CN113079416B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20150080237A (en) * | 2013-12-31 | 2015-07-09 | 주식회사 케이티 | Method and Apparatus for Control of Multimedia Contents Play Based on User Action |
| CN111432245A (en) * | 2020-03-27 | 2020-07-17 | 腾讯科技（深圳）有限公司 | Multimedia information playing control method, device, equipment and storage medium |
| CN111904244A (en) * | 2020-08-31 | 2020-11-10 | 林仁亮 | Religion and custom worship system and worship method |
| CN111970568A (en) * | 2020-08-31 | 2020-11-20 | 上海松鼠课堂人工智能科技有限公司 | Method and system for interactive video playing |
| CN112422946A (en) * | 2020-11-30 | 2021-02-26 | 重庆邮电大学 | Intelligent yoga action guidance system based on 3D reconstruction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113079416A (en) | 2021-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108632633B (en) | Live webcast data processing method and device | |
| US10938725B2 (en) | Load balancing multimedia conferencing system, device, and methods | |
| WO2020211385A1 (en) | Image special effect processing method, device, and live video streaming terminal | |
| CN103718166B (en) | Messaging device, information processing method | |
| US10477179B2 (en) | Immersive video | |
| EP3889912B1 (en) | Method and apparatus for generating video | |
| CN108632632B (en) | Live webcast data processing method and device | |
| US20220130077A1 (en) | Content modification in a shared session among multiple head-mounted display devices | |
| CN108635863B (en) | Live webcast data processing method and device | |
| US10617945B1 (en) | Game video analysis and information system | |
| CN112423022A (en) | Video generation and display method, device, equipment and medium | |
| CN112543342A (en) | Virtual video live broadcast processing method and device, storage medium and electronic equipment | |
| CN110162667A (en) | Video generation method, device and storage medium | |
| US20210084362A1 (en) | Method and system of processing information flow and method of displaying comment information | |
| CN113079416B (en) | Multimedia intelligent control method, client and system | |
| CN109474648B (en) | Virtual reality interaction compensation method and server-side equipment | |
| KR101939130B1 (en) | Methods for broadcasting media contents, methods for providing media contents and apparatus using the same | |
| CN110415318B (en) | Image processing method and device | |
| CN112492323B (en) | Live broadcast mask generation method, readable storage medium and computer equipment | |
| CN110602405A (en) | Shooting method and device | |
| KR20170127354A (en) | Apparatus and method for providing video conversation using face conversion based on facial motion capture | |
| WO2017087641A1 (en) | Recognition of interesting events in immersive video | |
| JP6100659B2 (en) | Information acquisition system, information acquisition method, and computer program | |
| US11095955B2 (en) | Method and system for delivering an interactive video | |
| CN113362243A (en) | Model training method, image processing method and apparatus, medium, and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |