CN104298722B - Digital video interactive and its method - Google Patents

Digital video interactive and its method Download PDF

Info

Publication number
CN104298722B
CN104298722B CN201410496014.7A CN201410496014A CN104298722B CN 104298722 B CN104298722 B CN 104298722B CN 201410496014 A CN201410496014 A CN 201410496014A CN 104298722 B CN104298722 B CN 104298722B
Authority
CN
China
Prior art keywords
information
user
medium data
module
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410496014.7A
Other languages
Chinese (zh)
Other versions
CN104298722A (en
Inventor
张鸿勋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201410496014.7A priority Critical patent/CN104298722B/en
Publication of CN104298722A publication Critical patent/CN104298722A/en
Application granted granted Critical
Publication of CN104298722B publication Critical patent/CN104298722B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a kind of digital video interactive and its method, the wherein system includes memory, includes subscribing broadcast mode and the multi-medium data of playing condition with the interaction scripts needed for user mutual, the interaction scripts for storing;Multimedia subsystem;Information gathering subsystem, for gathering the status information of user and/or the environmental information of user's local environment;And processor, it is connected respectively with the memory, the multimedia subsystem and described information acquisition subsystem, exported for transferring the multi-medium data in the interaction scripts according to the status information and/or the environmental information, and by the multi-medium data transferred to the multimedia subsystem.The digital video interactive and its method of the present invention can reduce the influence for teaching the individual factor of teacher to training, seeking advice from, the service effectiveness such as instruct, and improve the stability and validity of service effectiveness.

Description

Digital video interactive and its method
Technical field
The present invention relates to multimedia application field, more particularly to a kind of digital video interactive and its method.
Background technology
With becoming more meticulous for the division of labor in society, professional training, consulting, guidance are more and more.But trainer, consultant, Consultant is presently mainly to be taken on by people, the effect train, seek advice from, instructed and the close phase of Specialized Quality and condition of people Close.
Exchanged for example, generally psychological tutor and tutee needs are aspectant, psychological tutor is according to the shape of tutee State determines how to exchange with tutee, to reach the purpose for improving the mental health of tutee.It is in tired in psychological tutor Under exhausted state, it is possible to once in a while absent minded occur, so as to which easily carelessness tutee passes through limbs or language performance Some to instructing highly useful key messages, so as to cause to instruct less effective.Some psychological tutors' instructs experience not Foot, it is possible to the true anxiety point of tutee can not be captured quickly and can not effectively be suited the remedy to the case, so as to cause to be referred to The person's of leading experience is poor., it is apparent that being completely dependent on everybody of psychological tutor and tutee talks with the psychological instruction of progress, instruct Effect has very big uncertainty.
The content of the invention
Technical problem
In view of this, the technical problem to be solved in the present invention is to provide a kind of multimedia application system, to substitute at present Everybody talks with to provide the services such as training, consulting, guidance, so as to improve the stability of service effectiveness.
Solution
In order to solve the above-mentioned technical problem, according to one embodiment of the invention, there is provided a kind of digital video interactive, bag Include:
Memory, include subscribing broadcasting side with the interaction scripts needed for user mutual, the interaction scripts for storing The multi-medium data of formula and playing condition;
Multimedia subsystem;
Information gathering subsystem, for gathering the status information of user and/or the environmental information of user's local environment; And
Processor, it is connected respectively with the memory, the multimedia subsystem and described information acquisition subsystem, For transferring the multi-medium data in the interaction scripts according to the status information and/or the environmental information, and will be adjusted The multi-medium data taken is exported to the multimedia subsystem.
For said system, in a kind of possible implementation, the status information includes attitude information, the language of user In sound and physiologic information any one or it is a variety of, described information acquisition subsystem include following equipment any one or It is a variety of:
Attitude information collecting device, for gathering the attitude information of user;
Voice capture device, the voice sent for gathering user;
Physiology information detecting equipment, for gathering the physiologic information of user;
Environment information acquisition equipment, for gathering the environmental information.
For said system, in a kind of possible implementation, the attitude information collecting device detects including body-sensing In equipment, facial recognition device any one or it is a variety of.
For said system, in a kind of possible implementation, the voice capture device includes microphone, pickup Device, or at least one of other voice capture devices.
For said system, in a kind of possible implementation, the physiology information detecting equipment includes ECG detecting Equipment, E.E.G detection equipment, pulse detection equipment, eye move identification equipment, application on voiceprint recognition equipment, fingerprint identification device, palmmprint are known In other equipment, retinal recognition device any one or it is a variety of.
For said system, in a kind of possible implementation, the multimedia subsystem plays including audio In equipment, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visual apparatus Any one or it is a variety of.
For said system, in a kind of possible implementation, the processor includes:
Input module, it is connected with described information acquisition subsystem, for receiving the status information;
Transfer module, be connected respectively with the input module and the memory, for the status information with it is described In interaction scripts in the case of the playing condition matching of predefined multi-medium data, the matching is transferred from the memory Multi-medium data and its broadcast mode;
Output module, module is transferred and the multimedia subsystem is connected respectively with described, for being broadcast according to Mode is put to export the multi-medium data of the matching to the multimedia subsystem.
For said system, in a kind of possible implementation, the processor also includes speech processing module,
The speech processing module is connected with the input module and the module of transferring, for from the input module The voice in the status information is obtained, will after at least one of speech recognition, semantic analysis processing are carried out to the voice The semantic information of the phonetic representation sends to described and transfers module;And/or
The speech processing module transfers module and the output module is connected with described, for transferring module by described Word in the multi-medium data transferred carries out the processing of phonetic synthesis, and by synthesized voice output to the output mould Block.
For said system, in a kind of possible implementation, in addition to:
Environment adjust subsystem, be connected with the processor, for according to the processor be based on the environmental information with/ Or the environment residing for the user is adjusted for the regulating command that the interaction scripts are sent.
For said system, in a kind of possible implementation, the input module is additionally configured to, from described information Acquisition subsystem receives the environmental information;The module of transferring is additionally configured to, with reference to the environmental information from the storage The multi-medium data and its broadcast mode of the matching are transferred in device.
For said system, in a kind of possible implementation, the processor also includes:
Prompting module, it is connected respectively with the input module and the output module, for being in default in signal specific Term of reference in the case of, generate corresponding alerting signal and export to the output module, to cause the output mould The alerting signal is sent to corresponding alert device and played out by block, the signal specific include the status information and/ Or the environmental information.
In order to solve the above-mentioned technical problem, according to another embodiment of the present invention, there is provided a kind of multimedia interaction method, Using the digital video interactive and user mutual of any one structure in the embodiment of the present invention, methods described includes:
Information gathering subsystem gathers the status information of the user and/or the environmental information of user's local environment;
Processor is transferred and the user mutual according to the status information and/or the environmental information from memory Multi-medium data in required interaction scripts, and the multi-medium data transferred is exported to multimedia subsystem, institute Stating interaction scripts includes subscribing broadcast mode and the multi-medium data of playing condition;
The multimedia subsystem plays the multi-medium data received from the processor.
Beneficial effect
Can be according to residing for the various status informations of the user of information gathering subsystem collection and/or user by processor The environmental information of environment, the multi-medium data in interaction scripts is transferred from memory, and language is played by multimedia subsystem The multi-medium datas such as sound, video, complete to interact with user, reduce the individual factor of guidance teacher to training, seeking advice from, instructing The influence of service effectiveness, it is possible to increase the stability and validity of service effectiveness.
According to below with reference to the accompanying drawings becoming to detailed description of illustrative embodiments, further feature of the invention and aspect It is clear.
Brief description of the drawings
Comprising in the description and the accompanying drawing of a part for constitution instruction and specification together illustrate the present invention's Exemplary embodiment, feature and aspect, and for explaining the principle of the present invention.
Fig. 1 is the structural representation of the digital video interactive of one embodiment of the invention;
Fig. 2 is the structural representation of the digital video interactive of another embodiment of the present invention;
Fig. 3 is the structural representation of the digital video interactive of another embodiment of the present invention;
Fig. 4 is the structural representation of the digital video interactive of another embodiment of the present invention;
Fig. 5 is the structural representation of the digital video interactive of another embodiment of the present invention;
Fig. 6 is the flow chart of the multimedia interaction method of one embodiment of the invention.
Embodiment
Describe various exemplary embodiments, feature and the aspect of the present invention in detail below with reference to accompanying drawing.It is identical in accompanying drawing Reference represent the same or analogous element of function.Although the various aspects of embodiment are shown in the drawings, remove Non-specifically point out, it is not necessary to accompanying drawing drawn to scale.
Special word " exemplary " is meant " being used as example, embodiment or illustrative " herein.Here as " exemplary " Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the present invention, numerous details is given in embodiment below. It will be appreciated by those skilled in the art that without some details, the present invention can equally be implemented.In some instances, for Method, means, element and circuit well known to those skilled in the art are not described in detail, in order to highlight the purport of the present invention.
Embodiment 1
Fig. 1 is the structural representation of the digital video interactive of one embodiment of the invention.As shown in figure 1, the multimedia is handed over Mutual system can mainly include:Memory 11, include for storing with the interaction scripts needed for user mutual, the interaction scripts Subscribe broadcast mode and the multi-medium data of playing condition;Multimedia subsystem 13;Information gathering subsystem 15, is used for Gather the status information of user and/or the environmental information of user's local environment;And processor 17, with the memory 11st, the multimedia subsystem 13 and described information acquisition subsystem 15 connect respectively, for according to the status information And/or the environmental information transfers the multi-medium data in the interaction scripts, and by the multi-medium data transferred export to The multimedia subsystem 13.
Wherein, memory 11 can be arranged on local, can also set in server beyond the clouds, in interaction, The server of high in the clouds or local can be accessed by internet etc., to obtain required interaction scripts.Multimedia in interaction scripts Particular content, broadcast mode and the playing condition of data, the psychology that can be supported by foundation science of consciousness, depth psychology etc. The scheme of guidance determines.Wherein, the particular content of multi-medium data can be including but not limited to one or more snippets specific text The contents such as word, audio file, video file, hologram, virtual reality, augmented reality.The broadcast mode of multi-medium data can Be loop play, played in order, redirect broadcasting, superposition play, finish after terminate, finish and wait for a period of time after The various ways such as end.The playing condition of multi-medium data can include but be not limited only to the positive reply of user, negative reply, Do not reply, user's posture etc..For example, the video A of played in order, video B, in video B playing process, if detected User sits down, then plays audio C, if detecting that user stands, plays audio D.Wherein, video A, video B, audio C and Audio D is the particular content of multi-medium data in the interaction scripts;Loop play is that multi-medium data is broadcast in the interaction scripts Put mode;It is the playing condition of multi-medium data in the interaction scripts to judge whether user sits down.
In the digital video interactive of the present embodiment, when with user mutual, processor 17 can be according to information gathering The various status informations of user and/or the environmental information of user's local environment that system 15 gathers, interaction is transferred from memory 11 Multi-medium data in script, the multi-medium datas such as voice, video, completion and user are played by multimedia subsystem 13 Interaction, therefore, it is more that the digital video interactive of the present embodiment can apply to psychological consultation, coach directed, interaction entertainment etc. Kind field, a variety of demands that science solves user such as depressurize energization, when participating in the cintest state adjustment, interpersonal relationships is improved, career is advised Draw, see clearly heart demand, open artistic inspiration, arousing potential energy, subconsciousness understand, image understand, psychic trauma processing, health support Raw, rehabilitation soul is conserved, finds preferable companion, efficiently reaches target, feeling quotrient lifting, children's wisdom is developed, women happiness is shown loving care for, Old man's deathbed care, conjugal relation lifting, Learning Motive lifting, English interest excites, subject interest excites, team building, group The lifting of body cohesiveness, group's potential excite, and reduce and teach the individual factor of teacher to training, seeking advice from, the service effectiveness such as instructing Influence, it is possible to increase the stability and validity of service effectiveness.
Embodiment 2
Fig. 2 is the structural representation of the digital video interactive of another embodiment of the present invention.Label is identical with Fig. 1 in Fig. 2 Component there is identical function, for simplicity, omit the detailed description to these components.
As shown in Fig. 2 being with the main distinction of digital video interactive shown in Fig. 1, status information can include user Attitude information, in voice and physiologic information any one or it is a variety of, correspondingly, described information acquisition subsystem 15 can be with Including in attitude information collecting device 21, voice capture device 23, physiology information detecting equipment 25, environment information acquisition equipment 27 Any one or it is a variety of.
Wherein, attitude information collecting device 21 is used for the attitude information for gathering user, can specifically include body-sensing detection and set Standby 211, any one in facial recognition device 213 or a variety of.For example, indoor GPS, laser scanning can be used fixed The body-sensing detection devices 211 such as position equipment, infrared sensor or gravity sensor, detect the position where user, and at user In stand, sit down, jump, the attitude information such as bend over.The face-image pair of user can also be shot by facial recognition device 213 The facial emotions of user carry out face recognition, determine that the emotional state residing for user is such as cryyed, laugh, frown.Wherein, detect The position of the various equipment of attitude information can be adjusted according to concrete scene, such as:Set on the chair in room infrared Sensor, gravity sensor and indoor GPS are set on carpet, laser scanning location equipment etc. is set at the middle part in room.
Voice capture device 23 is used to gather the voice that user sends, and can specifically include microphone 231, pick-up 233, Or at least one of other voice capture devices, the voice of user can be recorded by microphone 231.In a kind of possible realization In mode, processor 17 can carry out the processing such as speech recognition, semantic analysis to the voice inputted from microphone 231, to enter The follow-up interactive controlling of row.In a kind of possible specific implementation, processor 17 can also be to being transferred based on interaction scripts Multi-medium data in word carry out the processing such as phonetic synthesis, and by synthesized voice output to multimedia subsystem 13。
Physiology information detecting equipment 25 is used to gather the physiologic information of user, can specifically include ECG detecting equipment 251, E.E.G detection equipment 253, pulse detection equipment 255, eye move identification equipment, application on voiceprint recognition equipment, fingerprint identification device, palmmprint are known In other equipment, retinal recognition device, facial recognition device any one or it is a variety of, not shown in equipment component figure.Lift For example, the heartbeat of user is detected using ECG detecting equipment 251, the expression user that palpitates quickly is at full stretch, the slow table of heartbeat Show that user more loosens;The brain wave of electroencephalograph detection user can also be used, regains consciousness, sleep to embody the brain of user and be in The state such as sleep, be nervous, loosen, think deeply;Pulse detection equipment 255 can also be used to detect the beat pulse of user, to determine to use The current tensity in family;It can also be tracked by eye movement of the eye move identification equipment to user, to determine user's mesh Preceding state in which is such as bowed, comes back, thought deeply.
Environment information acquisition equipment 27 can be various sensors, be arranged on some positions of user's local environment, to Gather the environmental informations such as the temperature of position, humidity, ambient sound, light.In a kind of possible implementation, environment letter The environmental information that breath collecting device 27 gathers can also include vibration signal, user touches some buttons and caused pressure or temperature Spend trigger signal etc..
It should be noted that the above is only the user that can be gathered status information and user residing for environmental information it is several Individual example, it is understood by one of ordinary skill in the art that the present invention answers not limited to this.In fact, completely can be according to practical application field Scape flexibly sets the status information of required collection, the particular content of environmental information, as long as the physiological status of user can be embodied i.e. Can.
In a kind of possible implementation, multimedia subsystem 13 can include audio-frequence player device 131, video Playback equipment 133, hologram projector equipment 135, virtual reality device 137, augmented reality equipment 138, bore hole 3D visions are set In standby 139 any one or it is a variety of.For fluent playing audio-video document, the various of multimedia subsystem 13 set It is standby stream media technology to be used to play multi-medium data.
In the digital video interactive of the present embodiment, when with user mutual, processor 17 can be according to information gathering The various states information such as attitude information, voice and the physiologic information of collection user of the user that system 15 gathers, from memory 11 The multi-medium data in interaction scripts is transferred, by multimedia subsystem by multi-medium data using voice, video, holography The various ways such as image projecting, virtual reality, augmented reality, bore hole 3D visions play out, and completion interacts with user's, because This, the digital video interactive of the present embodiment can apply to the multiple fields such as psychological consultation, coach directed, interaction entertainment, solution Certainly a variety of psychological needs of user, reduce the influence for teaching the individual factor of teacher to training, seeking advice from, the service effectiveness such as instruct, The stability and validity of service effectiveness can be improved.
Embodiment 3
Fig. 3 is the structural representation of the digital video interactive of another embodiment of the present invention.Label and Fig. 1, Fig. 2 in Fig. 3 Identical component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 3, being with the main distinction of above-described embodiment, processor 17 can include:Input module 31, with institute State information gathering subsystem 15 to connect, for receiving the status information;Module 33 is transferred, with the input module 31 and described Memory 11 connects respectively, the broadcasting bar for the predefined multi-medium data in the status information and the interaction scripts In the case that part matches, the multi-medium data and its broadcast mode of the matching are transferred from the memory 11;Output module 35, transfer module 33 and the multimedia subsystem 13 is connected respectively with described, for according to the broadcast mode by institute The multi-medium data for stating matching is exported to the multimedia subsystem 13.
For example, playing condition can be that the answer of user is negative reply after certain section of voice E, then played in audio After voice E in device plays interaction scripts, if the answer of the user that voice capture device 23 collects for " be, can With " etc. positive reply, then audio-frequence player device continue to play the video F after current speech E;If voice capture device 23 is adopted The answer of the user collected is negative replies such as " no, be not ", then can transfer module 33 and redirect and transfer another section of video G and send To video playback apparatus, after video playback apparatus plays the video, can continue to return to broadcasting video F, or according to tool The setting of body plays other multi-medium datas.The level and data content of specific redirect broadcasting can be according to the demands of practical application It is configured.
In a kind of possible implementation, digital video interactive can use a variety of Starting mode, including manually open Dynamic, automatic start, voice wake-up, questionnaire, E.E.G wakes up, body-sensing detects, game starts, light starts, wind-force starts, warm Degree startup, mechanically activated etc..For example, manually starting or the mode of questionnaire, can be carried from special staff to user Ask or ask user to fill in questionnaires, the interaction scripts according to needed for the answer of user determines the user and activation system.For another example, language The mode that sound wakes up, can preset wake-up voice, the activation system when collecting user and sending wake-up voice;Or by controlling After audio-frequence player device plays the recording putd question to user, after the voice answered a question for gathering user, to the language of user's answer After sound carries out the processing such as speech recognition and semantic analysis, it is determined that best suiting the interaction scripts and activation system of the user.For another example, machine Tool, which starts, to be realized by setting button, detection device vibration or rocking the modes such as state, detect push button signalling, vibration letter Number or activation system during jolt signal.For another example, startup of playing can be reached a standard game by setting, detect that game reaches a standard success Activation system afterwards.
In a kind of possible implementation, processor can use high in the clouds artificial intelligence to transport when progress script is transferred The mode of calculation, specifically, it can be predicted or recommended to user by intelligent algorithm according to the user behavior pattern of storage Most suitable solution, so that it is determined that corresponding interaction scripts.For example, if user had used the system, and remembered Record has certain mood in some scenarios, can by intelligent algorithm when user is solved the problems, such as under similar scene next time It is preferably the interaction scripts corresponding to the solution of the same mood of user's selection with the record before basis.Meanwhile may be used also To carry out statistical analysis using the historical record of the system to a large number of users using intelligent algorithm, draw has to most people The solution of effect, and corresponding interaction scripts are recommended into user.
In a kind of possible implementation, the processor also includes:Speech processing module 36, with the input module 31 and the module 33 of transferring connect respectively, for obtaining the voice in the status information from the input module 31, to institute After predicate sound carries out speech recognition, at least one of semantic analysis processing, by the semantic information of the phonetic representation send to It is described to transfer module 33.
In a kind of possible implementation, speech processing module 36 can also be with the module 33 and described defeated transferred Go out module 35 to connect, for the word in the multi-medium data transferred module 33 and transferred to be carried out to the processing of phonetic synthesis, And by synthesized voice output to the output module 35.
In the digital video interactive of the present embodiment, when with user mutual, processor 17 can be according to information gathering The various states information such as attitude information, voice and the physiologic information of user that system 15 gathers, is transferred and user from memory 11 Multi-medium data in the interaction scripts of behavior pattern matching, language is used by multimedia subsystem by multi-medium data The various ways such as sound, video, hologram projection, virtual reality, bore hole 3D visions play out, and completion interacts with user's, The multiple fields such as psychological consultation, coach directed, interaction entertainment are can apply to, a variety of psychological needs of user is solved, reduces Teach influence of the individual factor of teacher to training, seeking advice from, the service effectiveness such as instructs, it is possible to increase the stability of service effectiveness with have Effect property.
Embodiment 4
Fig. 4 is the structural representation of the digital video interactive of another embodiment of the present invention.Label and Fig. 1~Fig. 3 in Fig. 4 Identical component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 4, being with the main distinction of above-described embodiment, the processor 17 can also include prompting module 37, it is connected respectively with the input module 31 and the output module 35, for being in default term of reference in signal specific In the case of interior, generate corresponding alerting signal and export to the output module 35, to cause the output module 35 by institute State alerting signal and send to corresponding alert device and play out.Wherein, signal specific can include the status information and/or The environmental information, for example, the environment such as the E.E.G information of user, ecg information, pulse information, the temperature of external environment and brightness Information, in addition, signal specific can also be status information of his human or animal etc..Accordingly, term of reference can with E.E.G scope, Electrocardio scope, pulse range, temperature range etc..The alerting signal that prompting module 37 generates can be with a variety of, such as sound or video Deng multi-medium data, vibration instruction, signal light control instruction etc., various alerting signals can be preset in interaction scripts.
By taking E.E.G as an example, the electroencephalograph in information gathering subsystem 15 can detect the E.E.G of user, it is assumed that according to E.E.G Scope divided pressure rank, and the other threshold value of pressure stage is provided with, by β ripples obtained in the brain wave of electroencephalograph detection etc. Parameter area be 21~30Hz, it may be determined that user is currently in pressure state, and the threshold value pre-set is 25Hz, measurement As a result show that the current pressure of user is excessive.In this case, prompting module 37 can generate alerting signal, and by exporting mould Alerting signal is issued corresponding alert device and played out by block 35.Wherein, alert device can be multimedia subsystem 13 audio or video equipment or the vibrator set in addition, light etc..For example, one section of music is sent to audio Playback equipment 131, vibration instruction is sent to vibrator, or flicker instruction etc. is sent to signal light control equipment, can so led to It is excessive to cross sound, vibration, his pressure of light prompting.Furthermore, it is noted that power, degree of relaxation etc. can also carry out it is similar with pressure Processing.
In a kind of possible implementation, the output module 35 can also include reporting modules 38, with the input Module 31 and the output module 35 connect respectively, described before and after being played for the multi-medium data in the interaction scripts Whether the status information that input module 31 receives is changed, and generation state change is reported and exported to the output mould Block 35.
Specifically, in multimedia subsystem 13 is the interaction scripts that user's broadcasting matches with user behavior pattern Multi-medium data after, the user behavior pattern and status information of user may change, relatively multi-medium data play After the status information of the front and rear user, reporting modules 38 can generate and output state change report.For example, by before user's use The change generation of E.E.G afterwards etc. is using reporting, the α wave number quantitative changes in E.E.G are more, and β wave number quantitative changes are few, show user's more time In relaxation state, feeling of stress is alleviated and reduced.
The digital video interactive of the present embodiment can also be sent in addition to realizing the function in above-described embodiment for user Various promptings, generation state change report, can be applied to the multiple fields such as psychological consultation, coach directed, interaction entertainment, solve A variety of psychological needs of user, reduce the influence for teaching the individual factor of teacher to training, seeking advice from, the service effectiveness such as instruct, energy Enough improve the stability and validity of service effectiveness.
Embodiment 5
Fig. 5 is the structural representation of the digital video interactive of another embodiment of the present invention.Label and Fig. 1~Fig. 4 in Fig. 5 Identical component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 5, being with the main distinction of above-described embodiment, digital video interactive can also include:Environment is adjusted Sub-system 51, it is connected with the processor 17, for being based on the environmental information and/or the friendship according to the processor 17 Environment residing for the user is adjusted for the regulating command that mutual script is sent.For example, the environment regulation subsystem 51 can include Temperature-controlled appliance 511, moisture control unit 513, light units 515, wind control equipment 517, gas hair Go out in equipment 519 any one or it is a variety of.Each equipment for environment regulation mode can integrate in any combination Together, can also be respectively independent equipment, the present invention does not limit the concrete form of these equipment.May be pre- in interaction scripts The demand information of the adjusting ambient related to multi-medium data is first set, can be according to regulation when processor runs interaction scripts The demand information of environment generates corresponding regulating command, is sent to corresponding equipment in environment regulation subsystem 51.
In a kind of possible implementation, the input module 31 of the processor 17 is additionally configured to, from described information Acquisition subsystem 15 receives the environmental information;Transfer module 33 to be additionally configured to, with reference to the environmental information from the storage The multi-medium data and its broadcast mode of the matching are transferred in device 11.Specifically, the module 33 of transferring of processor can be In the case of the multi-medium data matched in interaction scripts with playing condition is mainly transferred according to reference state information, it can also join Examine multi-medium data and its broadcast mode that environmental information transfers matching.
Interaction scripts only can also be selected according to environmental information and transferred without reference to status information in addition, transferring module 33 The multi-medium data matched in interaction scripts with playing condition.For example, preset one in room such as secret room escapes scene The sensor of a little detection environmental informations, detects that environment temperature, humidity, brightness etc. reach some threshold value or user touches in sensor When touching some button, processor 17 can transfer the multi-medium data of interaction scripts corresponding to these environmental informations, and can be with The Voice & Video picture played to user is adjusted according to environmental information, so, in different environment, sound that user hears Or see that image can also occur to change accordingly.
The specific implementation of the digital video interactive can have it is a variety of, for example, can be embedding by the function of processor 17 In the operating system for entering smart machine, while realizing smart machine function itself, the multi-medium data of interaction scripts is played.Again Such as, processor 17 can also be made independent control device or control chip etc., controls its outside electroencephalograph, infrared sensing The operation of the equipment such as device, light, multimedia player.Specific example is as follows:
Example one, the operating system by the function insertion smart machine of digital video interactive.
For example, the function of the processor 17 of digital video interactive can be applied (APP) in smart mobile phone Mode implant procedure system.Wherein, information gathering subsystem can use microphone, infrared detector, the electrocardio in mobile phone Measurement apparatus etc., to gather the status informations such as the voice of user, body-sensing, electrocardio;Also, multimedia subsystem can use Loudspeaker, video player in mobile phone etc., to play the multi-medium data of interaction scripts.
It is similar with smart mobile phone, there is Intelligent bracelet, intelligent watch, intelligent helmet, the intelligence of operation independent disposal ability The equipment such as energy glasses, Intelligent flight device, can be embedded in the processor of digital video interactive in the operating system of equipment The information gathering and the module of multi-media player function that control function, operation interaction scripts, and bonding apparatus have in itself, are realized One or more functions of digital video interactive.
Example two, the part or all of function of processor, information gathering and multimedia etc. is integrated into control device, It is placed in the ad-hoc location of special scenes.
For example, the function of the processor of digital video interactive can be embedded in the multimedia player of interactive movie institute Control terminal, or the part or all of function by the processor of digital video interactive, information gathering and multimedia etc. It is integrated into independent control device.When running interaction scripts, control device can transfer the multi-medium data of interaction scripts, hair Deliver to a variety of multimedia play equipments such as the sound equipment that can play film, broadcasting and projector equipment so that multi-medium data regards Frequency is shown on motion picture screen.And it is possible to the ad-hoc location such as configuration information such as seat, roof, ground in cinema gathers The various equipment of subsystem, to gather the attitude information of user and voice etc., wherein, the guiding voice that cinema plays can be Multi-person speech, in some key points, corresponding video pictures, voice are transferred to complete according to contents such as the voices of the user of collection The conversion of different scenes, specifically mute can be presented by screen, special broadcasting can also be used according to concrete scene Mode, air is such as projected in using hologram or water curtain generates 3D images.In addition, environmental information can also be set in cinema Collecting device and environmental Kuznets Curves subsystem, the environmental information and/or friendship that processor can be gathered based on environment information acquisition equipment Mutual script sends regulating command to environment regulation subsystem, so as to by the temperature in environment regulator system fading margin cinema, The ambient conditions such as brightness, such as:When video pictures are ice cell, indoor temperature is turned down, when video pictures are Chaoyang, heightens Indoor Temperature Degree.
Institute is similar with interactive movie, and integrated control device can also be arranged at the electricity trip Room, theme park, role playing The ad-hoc location of the scenes such as room, secret room are escaped, gymnasium, operating room, with the other information collection in scene and multimedia Equipment realizes one or more functions of digital video interactive jointly.
Example three, the part or all of function of processor, information gathering and multimedia etc. is integrated into control chip, It is arranged in various products.
Compared with example two, the volume of control chip can be smaller than control device, and the integrated function of control chip can also Relatively less, the partial function of processor can be arranged to the server in high in the clouds, only by voice collecting, Posture acquisition sum It is integrated into according to functions such as transmission in control chip, then in playback equipments such as control chip external connection video, audios.
For example, the control chip for being integrated with Posture acquisition and information transfer capability is set in the products such as Yoga mat, carpet, The attitude information of collection user is sent to server, and server runs interaction scripts to control external audio amplifier to play voice.Again Such as, stickup or the embedded control chip for being integrated with the functions such as temperature acquisition, voice collecting and broadcasting on cup wall, gather user The information such as voice, body temperature and water temperature are sent to server, and server operation interaction scripts simultaneously control the loudspeaker on cup wall Voice is played, water temperature can also be adjusted or purified water.
Similar, integrated control chip can also be arranged at flashlight, Cellphone Accessories, intelligent earphone, intelligent sound box, intelligence Energy jewellery, intelligence are waken up in the products such as champignon, lamp, pen, tables and chairs, knapsack, tent, intelligent blood pressure instrument, intelligent scale, chest, chip In specifically integrated function can be changed accordingly according to the actual functional capability of different product.
It can be seen from above-mentioned example, digital video interactive can be arranged at various articles for daily use, household articles, office use In the several scenes such as product, travelling health-care article, amusement, health medical treatment or product, the appropriate knot with the function of some products itself Close, while product itself function is realized, can be interacted with user, realize the one or more of digital video interactive Function.
The digital video interactive of the present embodiment is in addition to realizing the function in above-described embodiment, additionally it is possible to residing for user Environment be adjusted, and can be arranged at articles for daily use, household office appliance, travelling body-building, room, amusement, health doctor Several scenes and the products such as treatment, the multiple fields such as psychological consultation, coach directed, interaction entertainment can be applied to, solve user's A variety of psychological needs, reduce the influence for teaching the individual factor of teacher to training, seeking advice from, the service effectiveness such as instruct, it is possible to increase The certainty and validity of service effectiveness.
Embodiment 6
Fig. 6 is the flow chart of the multimedia interaction method of one embodiment of the invention, as shown in fig. 6, this method can this hair The digital video interactive and user mutual of any one structure in bright above-described embodiment, methods described can specifically include following Step:
The environment letter of step 601, the status information of information gathering subsystem collection user and/or user's local environment Breath;
Step 602, processor according to the status information and/or the environmental information, transferred from memory with it is described The multi-medium data in interaction scripts needed for user mutual, and the multi-medium data transferred is exported to the multimedia and broadcast Subsystem is put, the interaction scripts include subscribing broadcast mode and the multi-medium data of playing condition;
Step 603, multimedia subsystem play the multi-medium data received from the processor.
For the multimedia interaction method of the present embodiment when with user mutual, information gathering subsystem can gather each of user Kind of status information, processor can transfer from memory the multi-medium data in interaction scripts according to status information, send extremely IP multimedia subsystem, IMS, which plays out, to complete to interact with user, reduces the individual factor of guidance teacher to training, seeking advice from, instructing Etc. the influence of service effectiveness, it is possible to increase the stability and validity of service effectiveness.
Further, can issue the user with various promptings, generation state change report, can be applied to psychological consultation, The multiple fields such as coach directed, interaction entertainment, solve a variety of psychological needs of user.
In addition, processor can also be adjusted by the environment residing for environment regulator system of users, and can be with Several scenes and the products such as articles for daily use, household office appliance, travelling body-building, room, amusement, health medical treatment are arranged at, can Applied to multiple fields such as psychological consultation, coach directed, interaction entertainments, solve a variety of psychological needs of user, reduce guidance Influence of the individual factor of teacher to training, seeking advice from, the service effectiveness such as instruct, it is possible to increase the certainty of service effectiveness and effectively Property.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (10)

  1. A kind of 1. digital video interactive, it is characterised in that including:
    Memory, for store with user mutual needed for interaction scripts, the interaction scripts include subscribe broadcast mode and The multi-medium data of playing condition;
    Multimedia subsystem;
    Information gathering subsystem, for gathering the status information of user and/or the environmental information of user's local environment;And
    Processor, it is connected, is used for respectively with the memory, the multimedia subsystem and described information acquisition subsystem Transfer the multi-medium data in the interaction scripts according to the status information and/or the environmental information, and will be transferred Multi-medium data is exported to the multimedia subsystem;
    The processor includes:
    Input module, it is connected with described information acquisition subsystem, for receiving the state letter from described information acquisition subsystem Breath and/or the environmental information;
    Module is transferred, is connected respectively with the input module and the memory, for being interacted in the status information with described In script in the case of the playing condition matching of predefined multi-medium data, the more of the matching are transferred from the memory Media data and its broadcast mode, and/or, the multimedia of the matching is transferred from the memory with reference to the environmental information Data and its broadcast mode;
    Output module, module is transferred and the multimedia subsystem is connected respectively with described, for according to the broadcasting side Formula exports the multi-medium data of matching to the multimedia subsystem.
  2. 2. digital video interactive according to claim 1, it is characterised in that the status information includes the posture of user In information, voice and physiologic information any one or it is a variety of, described information acquisition subsystem include following equipment it is any It is one or more kinds of:
    Attitude information collecting device, for gathering the attitude information of user;
    Voice capture device, the voice sent for gathering user;
    Physiology information detecting equipment, for gathering the physiologic information of user;
    Environment information acquisition equipment, for gathering the environmental information.
  3. 3. digital video interactive according to claim 2, it is characterised in that the attitude information collecting device includes body Feel detection device, in facial recognition device any one or it is a variety of.
  4. 4. digital video interactive according to claim 2, it is characterised in that the voice capture device includes Mike At least one of wind, sound pick-up.
  5. 5. digital video interactive according to claim 2, it is characterised in that the physiology information detecting equipment includes the heart Electrical detection device, E.E.G detection equipment, pulse detection equipment, eye move identification equipment, application on voiceprint recognition equipment, fingerprint identification device, In fingerprint identification device, retinal recognition device any one or it is a variety of.
  6. 6. digital video interactive according to claim 1, it is characterised in that the multimedia subsystem includes sound Frequency playback equipment, video playback apparatus, hologram projector equipment, virtual reality device, augmented reality equipment, bore hole 3D visions In equipment any one or it is a variety of.
  7. 7. digital video interactive according to claim 1, it is characterised in that the processor also includes speech processes mould Block,
    The speech processing module is connected with the input module and the module of transferring, for being obtained from the input module Voice in the status information, after at least one of speech recognition, semantic analysis processing are carried out to the voice, by described in The semantic information of phonetic representation sends to described and transfers module;And/or
    The speech processing module transfers module and the output module is connected with described, for transferring module calls by described Multi-medium data in word carry out the processing of phonetic synthesis, and by synthesized voice output to the output module.
  8. 8. digital video interactive according to claim 1, it is characterised in that also include:
    Environment adjusts subsystem, is connected with the processor, for being based on the environmental information and/or institute according to the processor The regulating command that interaction scripts are sent is stated the environment residing for the user is adjusted.
  9. 9. digital video interactive according to claim 8, it is characterised in that the processor also includes:
    Prompting module, it is connected respectively with the input module and the output module, for being in default ginseng in signal specific In the case of in the range of examining, generate corresponding alerting signal and export to the output module, to cause the output module will The alerting signal sends to corresponding alert device and played out, and the signal specific includes the status information and/or institute State environmental information.
  10. 10. a kind of multimedia interaction method, it is characterised in that using the multimedia interactive any one of claim 1 to 9 System and user mutual, methods described include:
    Information gathering subsystem gathers the status information of the user and/or the environmental information of user's local environment;
    Processor according to the status information and/or the environmental information, transferred from memory with the user mutual needed for Interaction scripts in multi-medium data, and the multi-medium data transferred is exported to multimedia subsystem, the friendship Mutual script includes subscribing broadcast mode and the multi-medium data of playing condition;
    The multimedia subsystem plays the multi-medium data received from the processor.
CN201410496014.7A 2014-09-24 2014-09-24 Digital video interactive and its method Active CN104298722B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410496014.7A CN104298722B (en) 2014-09-24 2014-09-24 Digital video interactive and its method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410496014.7A CN104298722B (en) 2014-09-24 2014-09-24 Digital video interactive and its method

Publications (2)

Publication Number Publication Date
CN104298722A CN104298722A (en) 2015-01-21
CN104298722B true CN104298722B (en) 2018-01-19

Family

ID=52318447

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410496014.7A Active CN104298722B (en) 2014-09-24 2014-09-24 Digital video interactive and its method

Country Status (1)

Country Link
CN (1) CN104298722B (en)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105117116B (en) * 2015-05-06 2018-11-02 湖南工学院 The system and method for obtaining the behavioral data for executing manipulation tasks
CN104993986A (en) * 2015-06-23 2015-10-21 深圳四极联合科技有限公司 Multimedia control system suitable for infants and special populations
US10607063B2 (en) * 2015-07-28 2020-03-31 Sony Corporation Information processing system, information processing method, and recording medium for evaluating a target based on observers
CN106649365A (en) * 2015-11-02 2017-05-10 冠捷投资有限公司 Content screening method capable of actively protecting users
CN105446953A (en) * 2015-11-10 2016-03-30 深圳狗尾草智能科技有限公司 Intelligent robot and virtual 3D interactive system and method
CN105496136B (en) * 2015-12-10 2018-03-06 嘉兴学院 A kind of information networking method of Intelligent water cup
CN105701211A (en) * 2016-01-13 2016-06-22 北京光年无限科技有限公司 Question-answering system-oriented active interaction data processing method and system
US10134198B2 (en) 2016-04-19 2018-11-20 Adobe Systems Incorporated Image compensation for an occluding direct-view augmented reality system
CN105975060A (en) * 2016-04-26 2016-09-28 乐视控股(北京)有限公司 Virtual reality terminal as well as control method and apparatus therefor
CN107432977A (en) * 2016-05-27 2017-12-05 南京抹香鲸信息科技有限公司 A kind of virtual reality psychological training system based on big data
CN106264567A (en) * 2016-06-27 2017-01-04 苏州奇展信息科技有限公司 A kind of multi-functional psychological counselling chair of computer assisted therapy
CN106200956A (en) * 2016-07-07 2016-12-07 北京时代拓灵科技有限公司 A kind of field of virtual reality multimedia presents and mutual method
CN106028223A (en) * 2016-07-26 2016-10-12 广东欧珀移动通信有限公司 Control method and device of intelligent loudspeaker box and the intelligent loudspeaker box
CN107835288A (en) * 2016-09-16 2018-03-23 天津思博科科技发展有限公司 The interdynamic recreational apparatus realized using intelligent terminal
CN106394443B (en) * 2016-09-23 2019-05-10 上海蔚来汽车有限公司 Vehicle device broadcasting system and method
CN106453051A (en) * 2016-10-10 2017-02-22 深圳万发创新进出口贸易有限公司 Multimedia interaction system
CN108073272A (en) * 2016-11-18 2018-05-25 北京智能管家科技有限公司 A kind of control method for playing back and device for smart machine
CN106679686B (en) * 2017-01-03 2019-08-30 京东方科技集团股份有限公司 A kind of wearable device
CN110446996A (en) * 2017-03-21 2019-11-12 华为技术有限公司 A kind of control method, terminal and system
CN107196990A (en) * 2017-04-06 2017-09-22 罗问清 A kind of intelligent children's black and white projecting apparatus of cloud
CN108972569A (en) * 2017-06-02 2018-12-11 富泰华工业(深圳)有限公司 Medical robot
EP3473181B1 (en) * 2017-10-20 2020-02-19 Siemens Healthcare GmbH Image recording device, method for operating a medical image recording device, computer program and electronically readable data carrier
CN107945848A (en) 2017-11-16 2018-04-20 百度在线网络技术(北京)有限公司 A kind of exercise guide implementation method, device, equipment and medium
CN108196503B (en) * 2017-12-29 2020-10-30 安徽创视纪科技有限公司 On-off control device based on human body bridge and control system thereof
CN108256972A (en) * 2018-01-16 2018-07-06 上海裕铃信息科技有限公司 A kind of business model of immersion social activity
CN108459486A (en) * 2018-02-05 2018-08-28 广州市水方信息科技有限公司 A kind of holophotal system based on the projection of yarn curtain
CN108762503A (en) * 2018-05-24 2018-11-06 深圳万智联合科技有限公司 A kind of man-machine interactive system based on multi-modal data acquisition
CN108937931A (en) * 2018-06-08 2018-12-07 荣摩智能科技有限公司 A kind of multifunctinoal health management system
CN109064793A (en) * 2018-06-22 2018-12-21 四川省有份儿智慧科技有限公司 A kind of full subject sage of the past parent based on holographic technique awards and Knowledge interaction intelligent space
CN108829255A (en) * 2018-06-22 2018-11-16 四川省有份儿智慧科技有限公司 A kind of real-time adaptive holography interactive system based on acquiring brain waves technology
CN108881996A (en) * 2018-07-17 2018-11-23 北京新唐思创教育科技有限公司 Generate and show method, apparatus, equipment and the medium of the sequence of multi-media segment
CN109003658A (en) * 2018-07-20 2018-12-14 杭州行开科技有限公司 A kind of naked eye 3D interaction systems for self-closing disease
CN108992762A (en) * 2018-08-20 2018-12-14 上海心远科教设备有限公司 Intelligent multidimensional scene type psychology and pressure persuasion system and leading method
CN111308703A (en) * 2018-12-04 2020-06-19 宏达国际电子股份有限公司 Head-mounted display system and image generation method thereof
CN109541957A (en) * 2018-12-29 2019-03-29 青岛小鸟看看科技有限公司 Intelligent interaction device
TWI719385B (en) * 2019-01-11 2021-02-21 緯創資通股份有限公司 Electronic device and voice command identification method thereof
CN110600141B (en) * 2019-09-11 2022-11-29 孙皓 Fusion bionic robot remote care system based on holographic image technology
CN110764618A (en) * 2019-10-25 2020-02-07 郑子龙 Bionic interaction system and method and corresponding generation system and method
CN111163342A (en) * 2020-01-14 2020-05-15 恒信东方文化股份有限公司 Intelligent interaction system and method thereof
CN112929754A (en) * 2020-11-23 2021-06-08 开封大学 Broadcast interactive system is shown to transmission positive energy video

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149950A (en) * 2007-11-15 2008-03-26 北京中星微电子有限公司 Media player for implementing classified playing and classified playing method
CN102903375A (en) * 2011-07-25 2013-01-30 富泰华工业(深圳)有限公司 Music player and play method
CN103198844A (en) * 2013-04-16 2013-07-10 广州番禺巨大汽车音响设备有限公司 Stereo music adjustment method and stereo music adjustment system based on temperature

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4626376B2 (en) * 2005-04-25 2011-02-09 ソニー株式会社 Music content playback apparatus and music content playback method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149950A (en) * 2007-11-15 2008-03-26 北京中星微电子有限公司 Media player for implementing classified playing and classified playing method
CN102903375A (en) * 2011-07-25 2013-01-30 富泰华工业(深圳)有限公司 Music player and play method
CN103198844A (en) * 2013-04-16 2013-07-10 广州番禺巨大汽车音响设备有限公司 Stereo music adjustment method and stereo music adjustment system based on temperature

Also Published As

Publication number Publication date
CN104298722A (en) 2015-01-21

Similar Documents

Publication Publication Date Title
CN104298722B (en) Digital video interactive and its method
US9779751B2 (en) Respiratory biofeedback devices, systems, and methods
CN109298779B (en) Virtual training system and method based on virtual agent interaction
KR20200130231A (en) Direct live entertainment using biometric sensor data for detection of neural conditions
US20190240842A1 (en) Robot assisted interaction system and method thereof
CN100573622C (en) Multimedia brainwave feedback children learning and training method and instrument for training
US20190369725A1 (en) Guided virtual reality system for relaxing body and mind
US20220314078A1 (en) Virtual environment workout controls
US11205408B2 (en) Method and system for musical communication
JPH10151223A (en) Wellness system
CN102473320A (en) Bringing a visual representation to life via learned input from the user
US20070078294A1 (en) Dynamic relaxation and motivational agent
CN109745163A (en) Body gesture guidance method and system
JP2006293979A (en) Content providing system
JP2005346471A (en) Information processing method and apparatus
JP4215256B2 (en) Communication system that conveys a sense of unity
CN115016648A (en) Holographic interaction device and processing method thereof
CN110639172A (en) Augmented reality rehabilitation training system based on rich scenes
Connolly Public speaking skills for dummies
CN112863644A (en) Method, device, equipment and storage medium for training memorial idea based on VR technology
McDaniel et al. Therapeutic haptics for mental health and wellbeing
Senger et al. Serious gaming: enhancing the quality of life among the elderly through play with the multimedia platform SilverGame
CN211751684U (en) Panoramic psychological consulting room
CN113633870B (en) Emotion state adjustment system and method
CN113223718B (en) One-stop emotion releasing system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant