CN105792003A - Interactive multimedia production system and method - Google Patents
Interactive multimedia production system and method Download PDFInfo
- Publication number
- CN105792003A CN105792003A CN201410800305.0A CN201410800305A CN105792003A CN 105792003 A CN105792003 A CN 105792003A CN 201410800305 A CN201410800305 A CN 201410800305A CN 105792003 A CN105792003 A CN 105792003A
- Authority
- CN
- China
- Prior art keywords
- interactive
- template
- equipment
- multimedia
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention relates to an interactive multimedia production system and method, wherein the system comprises a storage module for storing various interactive templates; an interactive unit generation module which is connected with the storage module and is used for invoking at least one interactive template from the storage module according to a preset interactive logic, adding selected multimedia resources in the invoked interactive template according to the control logic of the invoked interactive template and setting corresponding control parameters, thus generating interactive units; and an execution sequence determining module which is connected with the interactive unit generation module and determines the execution sequence of the interactive units generated by the interactive unit generation module according to the interactive logic. According to the method and the system, the interactive template is invoked according to the preset interactive logic; the multimedia resources are added in the interactive template, thus generating the interactive units; and the execution sequence of the interactive units is set, so, interactive multimedia can be produced rapidly and conveniently.
Description
Technical field
The present invention relates to multimedia technology field, particularly relate to a kind of interactive multimedia production system and method.
Background technology
At present, multimedia technology is widely used in a lot of fields, and compared with representing with word, the content that multimedia can represent is abundanter.The mode being represented content by multimedia has a lot, for instance, teacher can will be fabricated to the lesson file of the types such as PPT or flash in the course contents such as audio frequency, video, picture, word.But, represent in process in multimedia, if it is desired to realization and the interaction between beholder, it usually needs manually participate in.Such as, after manually stopping broadcasting, the person of representing to beholder, problem or the problem etc. of answer beholder are proposed.
Summary of the invention
Technical problem
In view of this, the technical problem to be solved in the present invention is to provide a kind of interactive multimedia system and method that can produce and interact with user.
Solution
In order to solve above-mentioned technical problem, according to one embodiment of the invention, it is provided that a kind of interactive multimedia production system, including:
Memory module, is used for storing multiple interaction template, and each described interaction template has the control logic pre-set and controls parameter；
Interactive unit generation module, it is connected with described memory module, for transferring at least one described interaction template from described memory module according to predetermined interaction logic, and add selected multimedia resource according to the control logic of the interaction template transferred to described transferred interaction template and arrange and control parameter accordingly, to generate interactive unit；
Execution sequence determines module, is connected with described interactive unit generation module, according to described interaction logic, it is determined that the execution sequence of the interactive unit that described interactive unit generation module generates.
For said system, in a kind of possible implementation, also include:
Simulation performs module, determines that module is connected with described execution sequence, and for according to described execution sequence, simulation performs each described interactive unit, with preview implementation effect；
Described interactive unit generation module is additionally operable to perform the implementation effect of module according to described simulation, and the described multimedia resource added in described transferred interaction template is deleted, replaced or increase operation；
Described execution sequence determines that module is additionally operable to perform the implementation effect of module according to described simulation, described transferred interaction template is deleted, replace, increases or sequentially adjust operation.
For said system, in a kind of possible implementation:
Described interaction template includes playing at least one in section mould plate, interactive template, conditional judgment section mould plate, calculation type template, miscellaneous function template；
Described broadcasting section mould plate is for controlling the broadcasting of multimedia resource added；
Described interactive template for controlling the broadcasting of the multimedia resource added according to the information gathered；
Described conditional judgment section mould plate is used for judging whether input information meets and imposes a condition, and according to judged result, controls the interactive unit continued executing with and/or the multimedia resource continuing broadcasting；
Described calculation type template is for when input information is numerical value, substituting into, by described numerical value, the computing formula preset and obtain result of calculation；
Described miscellaneous function template is for carrying out timing, issuing the user with the execution result reminded or monitor interactive unit.
For said system, in a kind of possible implementation, also include: template modified module, process at least one during described interaction template is deleted, increases or updated.
For said system, in a kind of possible implementation, also include: backup and reduction module, for the control parameter of described interactive unit and the information of multimedia resource are saved as backup file, according to the described backup file described interactive unit of reduction.
For said system, in a kind of possible implementation, also include: data transmission module, for uploading the interactive multimedia file of the multiple interactive unit including having determined that execution sequence to server, download described interactive multimedia file from described server.
For said system, in a kind of possible implementation, described multimedia resource includes at least one in audio file, video file, picture file, text, recording audio, recorded video, typing word, info web, control instruction.
For said system, in a kind of possible implementation, described control instruction is run for controlling at least one equipment in alert device, voice capture device, attitude information collecting device, physiology information detecting equipment, environment information acquisition equipment and multimedia play equipment；
Wherein, described attitude information collecting device includes at least one in body-sensing detection equipment, facial recognition device；
Described voice capture device includes at least one in mike, pick up；
Described physiology information detecting equipment includes ECG detecting equipment, E.E.G detects equipment, skin resistance identification equipment, pulse detection equipment, eye move at least one in identification equipment, Application on Voiceprint Recognition equipment, fingerprint identification device, personal recognition equipment, retinal recognition device；
Described environment information acquisition equipment is for gathering at least one in the temperature of user's local environment, humidity, light, location information；
Described multimedia play equipment includes at least one in audio-frequence player device, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visual apparatus.
In order to solve above-mentioned technical problem, according to one embodiment of the invention, it is provided that a kind of interactive multimedia production method, including:
Transferring at least one described interaction template from the multiple interaction template prestored according to predetermined interaction logic, each described interaction template has the control logic pre-set and controls parameter；
Control logic according to the interaction template transferred is added selected multimedia resource to described transferred interaction template and arranges and control parameter accordingly, to generate interactive unit,
According to described interaction logic, it is determined that the execution sequence of the interactive unit of generation.
For said method, in a kind of possible implementation, also include:
According to described execution sequence, simulation performs each described interactive unit, with preview implementation effect；
According to described implementation effect, the described multimedia resource added in described transferred interaction template is deleted, replaced or increase operation；
According to described implementation effect, described transferred interaction template is deleted, replace, increases or sequentially adjust operation.
For said method, in a kind of possible implementation:
Described interaction template includes playing at least one in section mould plate, interactive template, conditional judgment section mould plate, calculation type template, miscellaneous function template；
Described broadcasting section mould plate is for controlling the broadcasting of multimedia resource added；
Described interactive template for controlling the broadcasting of the multimedia resource added according to the information gathered；
Described conditional judgment section mould plate is used for judging whether input information meets and imposes a condition, and according to judged result, controls the interactive unit continued executing with and/or the multimedia resource continuing broadcasting；
Described calculation type template is for when input information is numerical value, substituting into, by described numerical value, the computing formula preset and obtain result of calculation；
Described miscellaneous function template is for carrying out timing, issuing the user with the execution result reminded or monitor interactive unit.
For said method, in a kind of possible implementation, also include: at least one process during described interaction template is deleted, increases or updated.
For said method, in a kind of possible implementation, also include: the information of the control parameter of described interactive unit and multimedia resource is saved as backup file, according to the described backup file described interactive unit of reduction.
For said method, in a kind of possible implementation, also include: upload the interactive multimedia file of the multiple interactive unit including having determined that execution sequence to server, download described interactive multimedia file from described server.
For said method, in a kind of possible implementation, described multimedia resource includes at least one in audio file, video file, picture file, text, recording audio, recorded video, typing word, info web, control instruction.
For said method, in a kind of possible implementation, described control instruction is run for controlling at least one equipment in alert device, voice capture device, attitude information collecting device, physiology information detecting equipment, environment information acquisition equipment and multimedia play equipment；
Wherein, described attitude information collecting device includes at least one in body-sensing detection equipment, facial recognition device；
Described voice capture device includes at least one in mike, pick up；
Described physiology information detecting equipment includes ECG detecting equipment, E.E.G detects equipment, skin resistance identification equipment, pulse detection equipment, eye move at least one in identification equipment, Application on Voiceprint Recognition equipment, fingerprint identification device, personal recognition equipment, retinal recognition device；
Described environment information acquisition equipment is for gathering at least one in the temperature of user's local environment, humidity, light, location information；
Described multimedia play equipment includes at least one in audio-frequence player device, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visual apparatus.
Beneficial effect
The embodiment of the present invention, can according to predetermined interaction logic, transfer the interaction template prestored, arrange the interaction template transferred control parameter accordingly and add selected multimedia resource to the interaction template transferred, interactive unit can be generated, again the execution sequence that interactive unit is determined according to interaction logic is arranged such that it is able to produce quickly and easily and realize mutual interactive multimedia with user.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, further feature and the aspect of the present invention will be clear from.
Accompanying drawing explanation
The accompanying drawing of the part comprising in the description and constituting description together illustrates the exemplary embodiment of the present invention, feature and aspect with description, and is used for explaining principles of the invention.
Fig. 1 is the schematic diagram of the interactive multimedia production system of the embodiment of the present invention one；
Fig. 2 be the embodiment of the present invention one interactive multimedia production system in play the schematic diagram of control logic of section mould plate；
Fig. 3 be the embodiment of the present invention one interactive multimedia production system in the schematic diagram of control logic of interactive template；
Fig. 4 be the embodiment of the present invention one interactive multimedia production system in calculate the schematic diagram of control logic of section mould plate；
Fig. 5 is the schematic diagram of the interactive multimedia production system of the embodiment of the present invention two；
Fig. 6 is the schematic diagram of the interactive multimedia production method of the embodiment of the present invention three.
Detailed description of the invention
The various exemplary embodiments of the present invention, feature and aspect is described in detail below with reference to accompanying drawing.Accompanying drawing labelling identical in accompanying drawing represents the same or analogous element of function.Although the various aspects of embodiment shown in the drawings, but unless otherwise indicated, it is not necessary to accompanying drawing drawn to scale.
Word " exemplary " special here means " as example, embodiment or illustrative ".Here should not necessarily be construed as preferred or advantageous over other embodiments as any embodiment illustrated by " exemplary ".
It addition, in order to better illustrate the present invention, detailed description of the invention below gives numerous details.It will be appreciated by those skilled in the art that there is no some detail, the equally possible enforcement of the present invention.In some instances, method, means, element and the circuit known for those skilled in the art are not described in detail, in order to highlight the purport of the present invention.
Embodiment 1
Fig. 1 is the schematic diagram of the interactive multimedia production system of the embodiment of the present invention one, as it is shown in figure 1, this system mainly may include that
Memory module 11, is used for storing multiple interaction template, and each described interaction template has the control logic pre-set and controls parameter；
Interactive unit generation module 13, it is connected with described memory module 11, for transferring at least one described interaction template from described memory module 11 according to predetermined interaction logic, and add selected multimedia resource according to the control logic of the interaction template transferred to described transferred interaction template and arrange and control parameter accordingly, to generate interactive unit；
Execution sequence determines module 15, is connected with described interactive unit generation module 13, determines the execution sequence of interactive unit that described interactive unit generation module generates according to described interaction logic.
Specifically, the memory module 11 of interactive multimedia production system can prestore to generate the interaction template of interactive multimedia, when user needs to realize certain interaction demand, interactive unit generation module 13 can according to predetermined interaction logic, from memory module 11, one or more interaction template of needs are transferred according to interaction logic, wherein, predetermined interaction logic can include the predetermined required interaction template of the demand according to user or user type, sequentially, the information such as parameter.Wherein, after the control logic according to the interaction template transferred is added selected multimedia resource in the interaction template transferred and is arranged corresponding control parameter, namely the controls parameter of the control logic of interaction template self, its internal multimedia resource added and setting is considered as being able to carry out mutual interactive most I performance element, abbreviation interactive unit.Therefore, each interactive unit generally includes the input (multimedia resource such as added) of self, output (such as performing result to next performance element output), controls logic, controls parameter etc., certainly according to concrete demand, some interactive unit is likely to the information etc. that do not export.Additionally, execution sequence determines that multiple interactive unit can be set up by module 15 according to certain execution sequence obtains an interactive unit sequence, can generating interactive multimedia, wherein, this execution sequence can be determined according to the interaction logic relevant with user's request.Additionally, the interactive multimedia generated by different interactive unit can realize different functions, for instance, it is achieved purpose mutual files or the interactive strategies such as mutual course, interactive movie, psychological counselling, coach directed, interaction entertainment.
Interaction template is according to controlling logic and controlling the difference of parameter, polytype can be divided into, such as, can include playing at least one in section mould plate, interactive template, conditional judgment section mould plate, calculation type template, miscellaneous function template, in order to realize the functions such as resource broadcasting, information gathering, conditional judgment, time control.Individually below to the control logic of interaction template with control parameter and illustrate, concrete template type, control logic and control the setting of parameter and can also arrange flexibly according to concrete demand.
Example one, playing section mould plate, major function is the broadcasting of multimedia resource that can control to add.The control logic playing section mould plate can have multiple, and the word content that maybe will add for being added to the files such as video in this template, audio frequency to finish shows certain time.As in figure 2 it is shown, a kind of example of the control logic for playing section mould plate, this control logic specifically may include that
L101, entrance are by, after playing the interactive unit A that section mould plate generates, reading the time out n second arranged.
L102, time-out n second.
The multimedia resource that L103, reading are added.
L104, judge whether text importing is set on, if it is perform L105, otherwise perform L106.
L105, show interface zone word output, it is possible to default multimedia resource such as: video, audio frequency etc. are directly play.
L106, show interface without word export, it is possible to default multimedia resource such as: video, audio frequency etc. are directly play.
After L107, multimedia resource finish, leave the interactive unit A generated by this broadcasting section mould plate.If there being other interactive unit after this interactive unit A, then enter other interactive unit.
Wherein, the time out n second, interactive unit A title etc. belong to play section mould plate control parameter, it is possible to arranged flexibly according to real needs by user.
The feature of this template is to add input (needing the content play), but can not export, and can directly terminate after finishing, and not to next interactive unit transmission data.
Example two, interactive template, its function is to control the broadcasting of the multimedia resource added according to the information gathered.Gather such as environmental information, the attitude information of user, voice or physiologic information etc., and according to how the information control collected plays the multimedia file added.For example, as it is shown on figure 3, the one control logic of interactive template may include that
After the interactive unit B that L201, entrance are generated by this interactive template, read the time out n second of setting, minimum active period x second, y second pause detection time, replay times.
L202, time-out n second.
L203, judge whether text importing is set on, if it is show the output of interface zone word, otherwise show that interface exports without word.
L204, broadcasting audio or video file, for instance to the problem that user plays sound, video or written form.
L205, judge whether user voice to be detected, if it is, represent that the problem that user is likely to playing has answer, after speech recognition, perform L207, otherwise perform L206.Wherein, the answer of user is also likely to be the touch form such as screen or feedback attitude, adopts voice response to illustrate for user in this example, and the form of other answers can similar process.
L206, judge that user is noiseless whether more than the y second, it is not above then returning performing L205, if it exceeds then judge whether replay times exceedes threshold value, L204 is returned when being not above threshold value, when exceeding threshold value then it is believed that play improper result, thus jumping out this interactive unit.
L207, judging that whether user voice length is more than the x second, if it is record performs L208 after identifying content, otherwise performs L208.
L208, judge whether the content of speech recognition meets presupposed information, for instance, whether user says OK, if it is performs L210, otherwise performs L209.
L209, judge user pause whether more than the y second, if it is, perform L210, otherwise return perform L208.
L210, stopping speech recognition and content record, leave this interactive unit B, it is possible to the content of speech recognition substitutes into next interactive unit.Wherein, the content of speech recognition potentially includes word, numeral, symbol etc..
Wherein, time out n second, the title of interactive unit B, minimum active period x second, y second pause detection time, replay times etc. belong to the control parameter of interactive template, it is possible to arranged flexibly according to real needs by user.Above-mentioned control logic is only a kind of example of interactive template, with specific reference to the difference of user's request, it is possibility to have other implementation.
Example three, calculation type template, its function is when input information is numerical value, described numerical value is substituted into the computing formula preset and obtains result of calculation, it is also possible to generate report to show user according to result of calculation.Concrete computing formula, it is possible to arrange flexibly to the different of the content of user report as required.As shown in Figure 4, the one control logic of calculation type template may include that
After the interactive unit C that L301, entrance are generated by this calculation type template, read the time out n second arranged.
L302, time-out n second.
L303, the numerical value reading input and problem.
L304, user confirm the numerical value of input.
The formula that L305, basis are preset calculates and shows result of calculation, is then departed from interactive unit C.Wherein, the type of displaying can be shown for word, numerical value is shown, figure shows (cake chart, axonometric chart, curve chart etc.).
Wherein, the time out n second, interactive unit C title etc. belong to play section mould plate control parameter, it is possible to arranged flexibly according to real needs by user.
Example four, conditional judgment section mould plate, its function could be for judging whether input information meets and imposes a condition, and according to judged result, controls the interactive unit continued executing with and/or the multimedia resource continuing broadcasting.Such as: the control logic of conditional judgment section mould plate can obtain from a upper interactive unit and perform result, input as self judges, according to the result judged, decide whether to perform result to next interactive unit output, or whether play the multimedia resource of interpolation, or whether jump to the operations such as other interactive unit.
Example five, miscellaneous function template, its function can include timing, issue the user with remind or in the execution etc. of monitoring interactive unit any one or multiple.Such as: the time can be shown at broadcast interface by the interactive unit of timing template generation；By reminding the interactive unit of template generation can issue the user with various types of prompting such as voice, word, vibration, light etc.；By monitoring whether normally the interactive unit of template generation can monitor the multimedia operation of current interactive, abnormal correction is occurring or is reminding.
Template above classification is merely illustrative, it is possible to have other mode classification.Such as: according to the information being capable of identify that, control logic and control the difference of parameter, it is also possible to interactive template is specifically subdivided into second level template, for instance interactive voice template, touch interaction template, user's attitude interaction template etc..It is further possible to second level template is sub-divided into the third level, fourth stage template etc., for instance interactive voice template is divided into the template identifying word, identifies the template of numeral, repeats the template etc. of enquirement.
With reference to the control logic of the interaction template of any of the above type, every kind of interaction template has the control parameter of self, and the particular content controlling parameter can be arranged flexibly according to the demand of user.Further, the general parameter of every kind of interaction template can be as shown in table 1 below, and Interaction parameters can be as shown in table 2 below.Table 1, table 2 are only the example of the control parameter of interaction template, are not the restrictions of the control parameter to interaction template, it is possible to the needs according to actual interactive function, and to controlling, parameter increases, deletes, arranges, amendment etc. operates flexibly.
Table 1 general parameter
| Title | Describe | Logic | Span |
| n | Interaction template is set and suspends the number of seconds performed | The 0-10 second |
Table 2 Interaction parameters
In a kind of possible implementation, the user of interactive multimedia production system such as intelligence tutor or teacher etc. needs the information passing to user can be realized by multimedia resource, therefore, the multimedia resource in interaction template can be added to and can include polytype, such as: audio file, video file, picture file, text, recording audio, recorded video, typing word, info web, control instruction etc., or the mixing of the above-mentioned type such as the mixing of video, audio frequency and picture.
Wherein, audio file, video file, picture file, text, it is possible to prestore in systems.And recording audio or recorded video, it is possible to the audio or video of the typing in real time such as the recording of system, video recording equipment is opened by user.Such as: operator can read passage with typing voice (true man's sound of recording or the sound according to phonetic synthesis), it is also possible to performs one section of song and dance with typing video.Additionally, user can also input word in real time, draw picture etc..Multimedia resource can also include the info webs such as web page address, when adding web page address in interaction template, performs interactive unit and can open the web page contents corresponding to this web page address.The type of the multimedia resource that a kind of interaction template can select can have multiple, and the concrete multimedia resource added can select flexibly according to the control logic of the interaction logic relevant for demand and interaction template.Interactive unit is added control instruction to control external alert device and issue the user with prompting, for instance, to bracelet one vibration command of transmission being connected with mobile phone, so that bracelet issues the user with vibrating alert.
Additionally, add control instruction in interactive unit can also control user profile collecting device, to gather the various information of user.Wherein, user profile collecting device such as voice capture device, attitude information collecting device, physiology information detecting equipment, environment information acquisition equipment etc..Specifically, attitude information collecting device can include at least one in body-sensing detection equipment, facial recognition device；Voice capture device can include at least one in mike, pick up；Physiology information detecting equipment can include ECG detecting equipment, E.E.G detects equipment, skin resistance identification equipment, pulse detection equipment, eye move at least one in identification equipment, Application on Voiceprint Recognition equipment, fingerprint identification device, personal recognition equipment, retinal recognition device；Environment information acquisition equipment may be used for gathering at least one in the temperature of user's local environment, humidity, light, location information (as utilized global positioning system (GlobalPositioningSystem, GPS) defined location information).
Additionally, add control instruction in interactive unit can also control the operation of multimedia play equipment, to play the multimedia resource of various form.Wherein, multimedia play equipment can include at least one in audio-frequence player device, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D (three-dimensional) visual apparatus.Based on this control instruction, the form represented to user that system is supported can have multiple, such as: play the contents such as audio frequency, video, word, numeral, figure by multimedia equipment can be controlled, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visual apparatus etc. can also be controlled in a corresponding manner, represent content to user.
In the embodiment of the present invention, interaction logic can be determined according to the scene that interactive multimedia to be applied and user's request, such as: determine required interaction logic according to different scenes such as psychological instruction, course display, interactive movies, determine the execution sequence of the interaction template extracted and the interactive unit generated further according to interaction logic.It is below several application scenarios of interaction logic.
Scene one, multimedia interactive courseware
Specifically, nursery teacher needs to use a kind of multimedia interactive courseware religion child's decorum ceremony.The interaction logic of this multimedia interactive courseware is as follows:
(1) prologue animation.
(2) teacher's video explains residents' civility of sitting down of standing up.
(3) teacher requires to stand up in child scene and sits down.
(4) interactive process judges child's whether correct action, and gives positive or negative and reply, until child can correctly accept guidance and take action.
(5) teacher's video explanation civilization pithy formula, and require that child repeats sentence by sentence.
(6) whether interactive process identification child repeats correctly, and gives positive or negative reply, until child can repeat correctly.
(7) animation is terminated.
According to above-mentioned interaction logic, the interactive multimedia of the embodiment of the present invention is adopted to generate system, it may be determined that the interaction template of needs is as follows:
A. the template of single broadcasting video, the multimedia resource wherein added is prologue animated video file.
B. the template of single broadcasting video, the multimedia resource wherein added is sat down for standing up residents' civility video file.
C. the template of single broadcasting video, the multimedia resource wherein added is stand up the video file sat down in requirement child scene.
D. the template that somatosensory device is interactive, it is judged that whether user stands or sit down.
E. carry out the template judged according to the execution result of d, according to the motion capture result that the template d interactive unit generated performs, judge, determine result if NO, then broadcast further instruction, and return the interactive unit that broadcasting is generated by template c.If positive result, then continue executing with by the interactive unit of next template generation.
F. the template of voice interface, resource file is the video that teacher explains civilization pithy formula, and video playback is complete, it is desirable to child repeats.The answer of speech detection child, and speech recognition content.
G. the template judged is carried out according to the execution result of f, the content according to the speech recognition of the upper template f interactive unit generated, judge, if content similarity >=80%, then continue next step.If content similarity < 80%, then provide prompting, and return to step f.
H. the template of single broadcasting video, resource file is for terminating animated video.
Wherein, the interaction template used by a～c, h is for playing section mould plate, and the interaction template used by d, f is interactive template, and the interaction template used by e, g is conditional judgment section mould plate.
Scene two, interactive movie
The interaction logic that multilamellar used by interactive movie is play includes:
(1) loop play video A1 from the beginning to the end.
(2) at upper strata overlay video B1, the audio frequency C1 of the video A1 of this loop play and audio frequency D1.
(3) after video B1, detect user's attitude, it is judged that whether user sits down, if user sits down, then play audio frequency C1, if be detected that user stands, then play audio frequency D1.
Select multiple interaction template according to this interaction logic, and determine that the execution sequence of the interactive unit generated by the interaction template selected is as follows:
A. the template of loop play video, the multimedia resource wherein added is video A1, and starts to perform next interactive unit after video A1 has play the N second simultaneously.
B. the template that somatosensory device is interactive, the multimedia resource wherein added is video B1, plays video B1 in the superposition of video A1 upper strata, and detects user's attitude in video B1 playing process.
C. the testing result according to b, when user's attitude is for standing, audio frequency C1 is play in superposition, and when user's attitude is for sitting down, then audio frequency D1 is play in superposition.
Wherein, the interaction template used by a is for playing section mould plate, and the interaction template used by b is interactive template, and the interaction template used by c is conditional judgment section mould plate.
Scene three, decompression psychological instruction
Specifically, decompression interaction logic used by psychological instruction includes:
(1) the relevant audio A 2 of decompression and video B2 are play to alleviate the pressure of user to user.
(2) in the process playing video B2, put question to the audio frequency C2～C5 of the various problems about pressure state to user, wait for a period of time after often puing question to a problem, gather answer D2～D5 that user answers a question.
(3) condition of user is detected, to determine that whether user is nervous.
(4) answer answered a question according to user and condition, it is determined that the pressure state of user also alleviates user's pressure.
According to this interaction logic, multiple interaction template of selection, and determine that the execution sequence of the interactive unit generated by the interaction template selected is as follows:
A. the template of single broadcasting audio frequency, the multimedia resource of its interpolation is audio A 2.
B. the template of single broadcasting audio frequency, the multimedia resource of its interpolation is video B2, and starts next interactive unit in the process playing video B2,
C. the template of voice interface, the multimedia resource of its interpolation is audio frequency C2～C5, and detects whether user answers the answer D2～D5 of problem, and wherein answer can be the various forms such as voice, touch, attitude.Additionally, audio frequency C2～C5 can add one interactive unit of formation in an interactive template to, it is also possible to be respectively added in multiple interactive template and form multiple interactive unit.
D. the template that somatosensory device is interactive, in order to detect the current attitude of user to determine that whether user is nervous, if according to the instruction execution etc. play
E. the execution result according to c and f, calculates the pressure state of user.Wherein, user can be asked in c to provide self pressure fraction with after decompression before depressurizing, start the interactive unit of this template generation mark given by user after decompression, generate pressure state report.
In above-mentioned interaction template, the interaction template used by a, b is for playing section mould plate, and the interaction template used by c, d is interactive template, and the interaction template used by e is calculation type template.
Embodiment 2
Fig. 5 is the schematic diagram of the interactive multimedia production system of the embodiment of the present invention two, as it is shown in figure 5, with differring primarily in that in a upper embodiment, this system can also include:
Simulation performs module 21, determines that module 15 is connected with described execution sequence, and for according to described execution sequence, simulation performs each described interactive unit, with preview implementation effect；
Described interactive unit generation module 13 is additionally operable to perform the implementation effect of module 21 according to described simulation, and the described multimedia resource added in described transferred interaction template is deleted, replaced or increase operation；
Described execution sequence determines that module 15 is additionally operable to perform the implementation effect of module 21 according to described simulation, described transferred interaction template is deleted, replace, increases or sequentially adjust operation.
Specifically, each interactive unit is generated at interactive unit generation module 13, after execution sequence determines the execution sequence that module 15 sets each interactive unit, simulation performs module 21 can according to described execution sequence, simulation performs each described interactive unit, can run according to the control parameter of interactive unit and control logic to represent relevant multimedia resource, reach the purpose of the implementation effect of preview interactive multimedia.
Further, if implementation effect is unsatisfied with by user, it is possible to determine, by execution sequence, the interaction template that module 15 is transferred, the interaction template transferred can be deleted, replace, revise, the process such as replacement.For example, it is possible to select the interaction template needing to add from the template base of system, and the interaction template of selection is dragged to editing area, it is possible to the interaction template transferred in editing area is deleted, replace, revise or replacement etc. processes.Further, execution sequence determines that module 15 can also adjust the execution sequence of the interactive unit that the interaction template transferred generates.
In addition, if implementation effect is unsatisfied with by user, interactive unit generation module 13 can also be passed through and adjust the multimedia resource added in each interaction template, the control parameter of the interaction template transferred is modified, and/or, the multimedia resource added in the interaction template transferred is deleted, replaces, revised, replacement etc. processes.Such as, the interaction template needing to adjust is selected at editing area, and revise the resource type needing to add in this interaction template, as input type is revised as recorded video from video file, the button then clicking on recorded video can start to record, and can revise and whether show word and input relevant word, it is also possible to choose whether insert pictures.Additionally, the multimedia resource added in template can also be deleted, revises by interactive unit generation module 13, replacement etc. processes.
In a kind of possible implementation, this interactive multimedia production system can also include:
Template modified module 23, processes at least one during described interaction template is deleted, increases or updated.Demand according to different application scene, user can pass through template modified module 23 and revise interaction template, again increases new interaction template, deletes unwanted interaction template.
In a kind of possible implementation, this interactive multimedia production system can also include:
Backup and reduction module 25, for saving as backup file by the control parameter of described interactive unit and the information of multimedia resource, according to the described backup file described interactive unit of reduction.Specifically, it is possible to the control parameter specifically arranged in interaction template and the multimedia file added save as independent backup file in systems, in order to later according to the interactive unit needed for backup file reduction and mutual files.
In a kind of possible implementation, this interactive multimedia production system can also include:
Data transmission module 27, for uploading the interactive multimedia file of the multiple interactive unit including having determined that execution sequence to server, downloads described interactive multimedia file from described server.Specifically, it is possible to the interactive multimedia file that system generates separately is deposited or derived, or uploads described interactive multimedia file to server, it is also possible to download described interactive multimedia file from described server.Wherein, interactive multimedia file can have multiple format, specifically can determine according to the type of the player used.
The interactive multimedia production system of the embodiment of the present invention, can according to predetermined interaction logic, transfer the interaction template prestored, arrange the interaction template transferred control parameter accordingly and add selected multimedia resource to the interaction template transferred, interactive unit can be generated, again the execution sequence that interactive unit is determined according to interaction logic is arranged such that it is able to produce quickly and easily and realize mutual interactive multimedia with user.
Embodiment 3
Fig. 6 is the schematic diagram of the interactive multimedia production method of the embodiment of the present invention three, and as shown in Figure 6, the method mainly may include that
Step 601, transferring at least one described interaction template from the multiple interaction template prestored according to predetermined interaction logic, each described interaction template has the control logic pre-set and controls parameter.
Step 602, add selected multimedia resource according to the control logic of the interaction template transferred to described transferred interaction template and arrange and control parameter accordingly, to generate interactive unit.
Step 603, according to described interaction logic, it is determined that the execution sequence of the interactive unit of generation.
Wherein, described interaction template includes playing at least one in section mould plate, interactive template, conditional judgment section mould plate, calculation type template, miscellaneous function template；
Described broadcasting section mould plate is for controlling the broadcasting of multimedia resource added；
Described interactive template for controlling the broadcasting of the multimedia resource added according to the information gathered；
Described conditional judgment section mould plate is used for judging whether input information meets and imposes a condition, and according to judged result, controls the interactive unit continued executing with and/or the multimedia resource continuing broadcasting；
Described calculation type template is for when input information is numerical value, substituting into, by described numerical value, the computing formula preset and obtain result of calculation；
Described miscellaneous function template is for carrying out timing, issuing the user with the execution result reminded or monitor interactive unit.
The concrete meaning of above-mentioned template type and example, and the particular type of multimedia resource and example, it is possible to referring to the associated description in said system embodiment.
In a kind of possible implementation, this interactive multimedia production method can also include:
Step 604, according to described execution sequence, simulation performs each described interactive unit, with preview implementation effect；
Step 605, according to described implementation effect, the described multimedia resource added in described transferred interaction template is deleted, is replaced or increase operation；
Step 606, according to described implementation effect, described transferred interaction template is deleted, replace, increase or order adjust operation.
In a kind of possible implementation, this interactive multimedia production method can also include:
At least one process during described interaction template is deleted, increases or updated.
In a kind of possible implementation, this interactive multimedia production method can also include:
The information of the control parameter of described interactive unit and multimedia resource is saved as backup file, according to the described backup file described interactive unit of reduction.
In a kind of possible implementation, this interactive multimedia production method can also include:
Upload the interactive multimedia file of the multiple interactive unit including having determined that execution sequence to server, download described interactive multimedia file from described server.
Specifically, this interactive multimedia production method can be performed by the interactive multimedia production system of above-described embodiment, and specific implementation may refer to the associated description of above-described embodiment.
The interactive multimedia production method of the embodiment of the present invention, can according to predetermined interaction logic, transfer the interaction template prestored, arrange the interaction template transferred control parameter accordingly and add selected multimedia resource to the interaction template transferred, interactive unit can be generated, again the execution sequence that interactive unit is determined according to interaction logic is arranged such that it is able to produce quickly and easily and realize mutual interactive multimedia with user.
The above; being only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any those familiar with the art is in the technical scope that the invention discloses; change can be readily occurred in or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with described scope of the claims.
Claims (16)
1. an interactive multimedia production system, it is characterised in that including:
Memory module, is used for storing multiple interaction template, and each described interaction template has the control logic pre-set and controls parameter；
Interactive unit generation module, it is connected with described memory module, for transferring at least one described interaction template from described memory module according to predetermined interaction logic, and add selected multimedia resource according to the control logic of the interaction template transferred to described transferred interaction template and arrange and control parameter accordingly, to generate interactive unit；
Execution sequence determines module, is connected with described interactive unit generation module, according to described interaction logic, it is determined that the execution sequence of the interactive unit that described interactive unit generation module generates.
2. interactive multimedia production system according to claim 1, it is characterised in that also include:
Simulation performs module, determines that module is connected with described execution sequence, and for according to described execution sequence, simulation performs each described interactive unit, with preview implementation effect；
Described interactive unit generation module is additionally operable to perform the implementation effect of module according to described simulation, and the described multimedia resource added in described transferred interaction template is deleted, replaced or increase operation；
Described execution sequence determines that module is additionally operable to perform the implementation effect of module according to described simulation, described transferred interaction template is deleted, replace, increases or sequentially adjust operation.
3. interactive multimedia production system according to claim 1 and 2, it is characterised in that described interaction template includes playing at least one in section mould plate, interactive template, conditional judgment section mould plate, calculation type template, miscellaneous function template；
Described broadcasting section mould plate is for controlling the broadcasting of multimedia resource added；
Described interactive template for controlling the broadcasting of the multimedia resource added according to the information gathered；
Described conditional judgment section mould plate is used for judging whether input information meets and imposes a condition, and according to judged result, controls the interactive unit continued executing with and/or the multimedia resource continuing broadcasting；
Described calculation type template is for when input information is numerical value, substituting into, by described numerical value, the computing formula preset and obtain result of calculation；
Described miscellaneous function template is for carrying out timing, issuing the user with the execution result reminded or monitor interactive unit.
4. interactive multimedia production system according to claim 1 and 2, it is characterised in that also include:
Template modified module, processes at least one during described interaction template is deleted, increases or updated.
5. interactive multimedia production system according to claim 1 and 2, it is characterised in that also include:
Backup and reduction module, for saving as backup file by the control parameter of described interactive unit and the information of multimedia resource, according to the described backup file described interactive unit of reduction.
6. interactive multimedia production system according to claim 1 and 2, it is characterised in that also include:
Data transmission module, for uploading the interactive multimedia file of the multiple interactive unit including having determined that execution sequence to server, downloads described interactive multimedia file from described server.
7. interactive multimedia production system according to claim 1 and 2, it is characterized in that, described multimedia resource includes at least one in audio file, video file, picture file, text, recording audio, recorded video, typing word, info web, control instruction.
8. interactive multimedia production system according to claim 7, it is characterized in that, described control instruction is run for controlling at least one equipment in alert device, voice capture device, attitude information collecting device, physiology information detecting equipment, environment information acquisition equipment and multimedia play equipment；
Wherein, described attitude information collecting device includes at least one in body-sensing detection equipment, facial recognition device；
Described voice capture device includes at least one in mike, pick up；
Described physiology information detecting equipment includes ECG detecting equipment, E.E.G detects equipment, skin resistance identification equipment, pulse detection equipment, eye move at least one in identification equipment, Application on Voiceprint Recognition equipment, fingerprint identification device, personal recognition equipment, retinal recognition device；
Described environment information acquisition equipment is for gathering at least one in the temperature of user's local environment, humidity, light, location information；
Described multimedia play equipment includes at least one in audio-frequence player device, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visual apparatus.
9. an interactive multimedia production method, it is characterised in that including:
Transferring at least one described interaction template from the multiple interaction template prestored according to predetermined interaction logic, each described interaction template has the control logic pre-set and controls parameter；
Control logic according to the interaction template transferred is added selected multimedia resource to described transferred interaction template and arranges and control parameter accordingly, to generate interactive unit,
According to described interaction logic, it is determined that the execution sequence of the interactive unit generated.
10. interactive multimedia production method according to claim 9, it is characterised in that also include:
According to described execution sequence, simulation performs each described interactive unit, with preview implementation effect；
According to described implementation effect, the described multimedia resource added in described transferred interaction template is deleted, replaced or increase operation；
According to described implementation effect, described transferred interaction template is deleted, replace, increases or sequentially adjust operation.
11. the interactive multimedia production method according to claim 9 or 10, it is characterised in that described interaction template includes playing at least one in section mould plate, interactive template, conditional judgment section mould plate, calculation type template, miscellaneous function template；
Described broadcasting section mould plate is for controlling the broadcasting of multimedia resource added；
Described interactive template for controlling the broadcasting of the multimedia resource added according to the information gathered；
Described conditional judgment section mould plate is used for judging whether input information meets and imposes a condition, and according to judged result, controls the interactive unit continued executing with and/or the multimedia resource continuing broadcasting；
Described calculation type template is for when input information is numerical value, substituting into, by described numerical value, the computing formula preset and obtain result of calculation；
Described miscellaneous function template is for carrying out timing, issuing the user with the execution result reminded or monitor interactive unit.
12. the interactive multimedia production method according to claim 9 or 10, it is characterised in that also include:
At least one process during described interaction template is deleted, increases or updated.
13. the interactive multimedia production method according to claim 9 or 10, it is characterised in that also include:
The information of the control parameter of described interactive unit and multimedia resource is saved as backup file, according to the described backup file described interactive unit of reduction.
14. the interactive multimedia production method according to claim 9 or 10, it is characterised in that also include:
Upload the interactive multimedia file of the multiple interactive unit including having determined that execution sequence to server, download described interactive multimedia file from described server.
15. the interactive multimedia production method according to claim 9 or 10, it is characterized in that, described multimedia resource includes at least one in audio file, video file, picture file, text, recording audio, recorded video, typing word, info web, control instruction.
16. interactive multimedia production method according to claim 15, it is characterized in that, described control instruction is run for controlling at least one equipment in alert device, voice capture device, attitude information collecting device, physiology information detecting equipment, environment information acquisition equipment and multimedia play equipment；
Wherein, described attitude information collecting device includes at least one in body-sensing detection equipment, facial recognition device；
Described voice capture device includes at least one in mike, pick up；
Described physiology information detecting equipment includes ECG detecting equipment, E.E.G detects equipment, skin resistance identification equipment, pulse detection equipment, eye move at least one in identification equipment, Application on Voiceprint Recognition equipment, fingerprint identification device, personal recognition equipment, retinal recognition device；
Described environment information acquisition equipment is for gathering at least one in the temperature of user's local environment, humidity, light, location information；
Described multimedia play equipment includes at least one in audio-frequence player device, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visual apparatus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410800305.0A CN105792003A (en) | 2014-12-19 | 2014-12-19 | Interactive multimedia production system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410800305.0A CN105792003A (en) | 2014-12-19 | 2014-12-19 | Interactive multimedia production system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105792003A true CN105792003A (en) | 2016-07-20 |
Family
ID=56385947
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410800305.0A Pending CN105792003A (en) | 2014-12-19 | 2014-12-19 | Interactive multimedia production system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105792003A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106844705A (en) * | 2017-02-06 | 2017-06-13 | 百度在线网络技术（北京）有限公司 | Method and apparatus for showing content of multimedia |
| CN106878761A (en) * | 2017-04-14 | 2017-06-20 | 武汉斗鱼网络科技有限公司 | Living broadcast interactive method, device and server |
| CN109979014A (en) * | 2017-12-27 | 2019-07-05 | 中华电信股份有限公司 | Augmented reality application generation system and method |
| CN110764618A (en) * | 2019-10-25 | 2020-02-07 | 郑子龙 | Bionic interaction system and method and corresponding generation system and method |
| CN111125384A (en) * | 2018-11-01 | 2020-05-08 | 阿里巴巴集团控股有限公司 | Multimedia answer generation method and device, terminal equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101630448A (en) * | 2008-07-15 | 2010-01-20 | 上海启态网络科技有限公司 | Language learning client and system |
| CN101770701A (en) * | 2008-12-30 | 2010-07-07 | 北京新学堂网络科技有限公司 | Movie comic book manufacturing method for foreign language learning |
| CN102289960A (en) * | 2011-07-28 | 2011-12-21 | 赵冬 | Interactive children's electronic book system |
| CN102918557A (en) * | 2010-06-01 | 2013-02-06 | 宋荣珠 | Electronic multimedia publishing systems and methods |
| US20130191891A1 (en) * | 2012-01-25 | 2013-07-25 | International Business Machines Corporation | Automatic provisioning of resources for meeting collaboration |
| CN103377568A (en) * | 2013-06-20 | 2013-10-30 | 浙江大学软件学院（宁波）管理中心（宁波软件教育中心） | Multifunctional child somatic sensation educating system |
| CN103533445A (en) * | 2013-10-28 | 2014-01-22 | 山东大学 | Flying theater playing system based on active interaction |
-
2014
- 2014-12-19 CN CN201410800305.0A patent/CN105792003A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101630448A (en) * | 2008-07-15 | 2010-01-20 | 上海启态网络科技有限公司 | Language learning client and system |
| CN101770701A (en) * | 2008-12-30 | 2010-07-07 | 北京新学堂网络科技有限公司 | Movie comic book manufacturing method for foreign language learning |
| CN102918557A (en) * | 2010-06-01 | 2013-02-06 | 宋荣珠 | Electronic multimedia publishing systems and methods |
| CN102289960A (en) * | 2011-07-28 | 2011-12-21 | 赵冬 | Interactive children's electronic book system |
| US20130191891A1 (en) * | 2012-01-25 | 2013-07-25 | International Business Machines Corporation | Automatic provisioning of resources for meeting collaboration |
| CN103377568A (en) * | 2013-06-20 | 2013-10-30 | 浙江大学软件学院（宁波）管理中心（宁波软件教育中心） | Multifunctional child somatic sensation educating system |
| CN103533445A (en) * | 2013-10-28 | 2014-01-22 | 山东大学 | Flying theater playing system based on active interaction |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106844705A (en) * | 2017-02-06 | 2017-06-13 | 百度在线网络技术（北京）有限公司 | Method and apparatus for showing content of multimedia |
| CN106878761A (en) * | 2017-04-14 | 2017-06-20 | 武汉斗鱼网络科技有限公司 | Living broadcast interactive method, device and server |
| CN106878761B (en) * | 2017-04-14 | 2019-08-02 | 武汉斗鱼网络科技有限公司 | Living broadcast interactive method, apparatus and server |
| CN109979014A (en) * | 2017-12-27 | 2019-07-05 | 中华电信股份有限公司 | Augmented reality application generation system and method |
| CN111125384A (en) * | 2018-11-01 | 2020-05-08 | 阿里巴巴集团控股有限公司 | Multimedia answer generation method and device, terminal equipment and storage medium |
| CN111125384B (en) * | 2018-11-01 | 2023-04-07 | 阿里巴巴集团控股有限公司 | Multimedia answer generation method and device, terminal equipment and storage medium |
| CN110764618A (en) * | 2019-10-25 | 2020-02-07 | 郑子龙 | Bionic interaction system and method and corresponding generation system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220148271A1 (en) | Immersive story creation | |
| US11151892B2 (en) | Internet teaching platform-based following teaching system | |
| US10726836B2 (en) | Providing audio and video feedback with character based on voice command | |
| CN105792003A (en) | Interactive multimedia production system and method | |
| CN103823561B (en) | expression input method and device | |
| KR101377235B1 (en) | System for sequential juxtaposition of separately recorded scenes | |
| JP2019521449A (en) | Persistent Companion Device Configuration and Deployment Platform | |
| CN102209184A (en) | Electronic apparatus, reproduction control system, reproduction control method, and program therefor | |
| CN108733209A (en) | Man-machine interaction method, device, robot and storage medium | |
| US10225621B1 (en) | Eyes free entertainment | |
| CN103348338A (en) | File format, server, view device for digital comic, digital comic generation device | |
| CN102981733A (en) | Information processing apparatus, moving picture abstract method, and computer readable medium | |
| JP2021528768A (en) | Multiple facial tracking methods, devices and electronics with facial special effects | |
| CN103430217A (en) | Input support device, input support method, and recording medium | |
| CN112004131A (en) | Display system | |
| Cox et al. | Moving object-based media production from one-off examples to scalable workflows | |
| US11315607B2 (en) | Information processing apparatus, information processing method, and non-transitory computer readable medium | |
| Saleme et al. | Towards a reference ontology on mulsemedia systems | |
| KR101721231B1 (en) | 4D media manufacture methods of MPEG-V standard base that use media platform | |
| JP2009075937A (en) | Equipment operation setting device | |
| KR101994086B1 (en) | a system voice changed story telling device and the mehtod thereof | |
| CN110362675A (en) | A kind of foreign language teaching content displaying method and system | |
| CN110087114A (en) | A kind of video control smart machine interaction systems and method | |
| US20190086997A1 (en) | System and method for providing stimulation to a user's senses | |
| KR101647442B1 (en) | Visual Contents Producing System, Method and Computer Readable Recoding Medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160720 |