CN1729934A - Interactive multimedia bio-feedback arrangement - Google Patents
Interactive multimedia bio-feedback arrangement Download PDFInfo
- Publication number
- CN1729934A CN1729934A CN 200510028013 CN200510028013A CN1729934A CN 1729934 A CN1729934 A CN 1729934A CN 200510028013 CN200510028013 CN 200510028013 CN 200510028013 A CN200510028013 A CN 200510028013A CN 1729934 A CN1729934 A CN 1729934A
- Authority
- CN
- China
- Prior art keywords
- trainee
- signal
- physiological
- video
- multiplication factor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention relates to a device used for biofeedback training, especially relating to the interactive-reaction multimedia device, which controlled by the physiological signal of trainee and/or the condition of consciousness. The invention comprises a physiological and/or consciousness monitoring module, a signal processing identification module, a control module and a execution module, which detects the physiological signal and/or the condition of consciousness of the trainee, monitors the changes, and calculates the control instruction according to said changes for controlling, regulating and changing the images, voice, motions and other actions of the execution modules in different patterns, so the effect of biofeedback training can be strengthened while it can help the trainee to better adjust the physiologic status and the psychological condition. The invention can be widely used in variable health care and clinical medicine fields.
Description
Affiliated technical field
The present invention relates to be applied to the device of biofeedback training, relate in particular to a kind of biofeedback training device by trainee's physiological signal and/or state of consciousness control, cross reaction formula, multimedia type.In particular, this device is by physiological signal and/or state of consciousness monitoring modular, signal processing and identification module, control module and execution module etc. are partly formed, by surveying trainee's physiological signal and/or state of consciousness, monitor its change, change degree according to physiological signal and/or state of consciousness, calculate the control corresponding instruction, control, regulate and change the video of various dissimilar execution module, sound, motion and other actions, come the effect of enhanced biological feedback training, help the trainee better to regulate self-physiological status and mental status, can be widely used in fields such as multiple health care and clinical treatment.
Background technology
Individual's pressure is excessive, mental pressure is admitted by most of scientists above the fact that certain load may cause multiple metabolic disease and somatopsychic illness, studies confirm that: adopt scientific and effective relaxation training to help to alleviate individual tense situation, alleviate individual's mental pressure, thereby reduce the excessive multiple disease that causes of pressure significantly.
The effective relaxation training method that is confirmed by a lot of clinical researches is a biofeedback training, and by understanding own intravital various physiological activity states, the physiological status that association draws oneself up is alleviated individual's tense situation to user when carrying out relaxation training.
Biofeedback is a kind of advanced person's a behavioral medicine therapeutic modality, and the trainer is by the immediate feedback of own physiological signal, and association regulates and control individual's physiological parameter, thereby regulates individual's physical and mental statuse better.Can be used for multiple health purpose and therapeutic purposes, by modern medicine turn out to be a kind ofly have no side effect, respond well behavioral medicine therapeutic modality.
A lot of developed countries such as the U.S. very widely the applying biological feedback at multiple fitness programme, and the diagnosis of various clinical disease and treatment, American National medicine and food control office have also ratified biofeedback system and have used the various clinical prevention and treatment of diseases.
Although biofeedback training is the crystallization of modern behavioral medicine and modern biological project, represent advanced society-psychology-biomedical model, but some weakness of biofeedback system itself have seriously hindered the popularization of biofeedback training method, universal and application widely.
Advancing by leaps and bounds of computer technology, for the development of biofeedback apparatus and technology provides wide platform and good development space, at present several companies of the U.S. to have developed several functionalities powerful, broad-spectrum biofeedback isolated plant.These devices must cooperate specialized hardware and equipment to use, and price is extremely expensive, is difficult to popularization and application.And common defects that these devices exist are, instant physiological status prompting in the process that lacks training does not have clear and definite indication to the change degree of trainee's physiological status, thereby the trainee can not be known understand the levels of precision of own physiological status variation.Thereby can not give full play to positive surface strengthening in the behavioral medicine principle, the instant ultimate principle of strengthening, the effect of influence training.In addition, also there is following inferior position in these devices:
1) the prior biological feedback device only has the direct feedback signal of bio signal, and user must ownly be judged degree and the state that oneself loosens from the acousto-optic feedback signal.This determination methods was both inaccurate, also can disperse the attention of user and influenced the effect of relaxation training.
2) in biofeedback training,, also install the achievement of reminding or encouraging user to obtain, the effect that the obvious minimizing behavior of meeting is strengthened because user can not definitely be understood the training effect.Thereby violate the basic principle of behavioral medicine, the curative effect that reduction should obtain.
3) user is in biofeedback training, owing to can not definite quantitative understanding oneself train effect that is obtained and the progress that obtains, thereby be unfavorable for that the Guidance Counselor is that user is worked out long-term training program, can not utilize accurately that feedack improves training method in the training.
4) prior biological feedback device training method is uninteresting and dull, do not have recreational and entertainment content, lack interest, competitiveness and complexity, user is difficult to adhere to for a long time, some edge customer may not can be interested in initiatively to use, thereby has limited popularizing and promoting of this method.
Therefore, a kind of relaxation instructing device that can provide fast, confirm the biofeedback training effect accurately, easily is provided, suitable guidance is provided in biofeedback training, and allow user definitely understand the relaxation state of oneself at any time, and with the training before correlated effect, can make the training effect better, more remarkable treatment effect.
Simultaneously, by above-mentioned device, with intensity of variation before and after physiological status and the mental status in the user training, be converted into instruction, drive multiple devices such as various amusement device, game device, telecontrol equipment, contest device, allow user when health is trained, obtain amusement and enjoyment, reach health purpose simultaneously in amusement and enjoyment.Such device may attract more people to adopt biofeedback training to reach healthy and prevent, treats the purpose of disease.
Summary of the invention
In order to realize purpose of the present invention, the feature of the technical solution used in the present invention is, this is a kind of by the biofeedback training device by trainee's physiological signal and/or state of consciousness control, cross reaction formula, multimedia type.In particular, this device is by physiological signal and/or state of consciousness monitoring modular, signal processing and identification module, control module and execution module etc. are partly formed, by surveying trainee's physiological signal and/or state of consciousness, monitor its change, change degree according to physiological signal and/or state of consciousness, calculate the control corresponding instruction, control, regulate and change the video of various dissimilar execution module, sound, motion and other actions, come the effect of enhanced biological feedback training, help the trainee better to regulate self-physiological status and mental status, can be widely used in fields such as multiple health care and clinical treatment.
Technical characterictic of the present invention is, in training process, continue to monitor one or more physiological signals of testee, with the physiological signal of gathering amplify, after conditioning, A/D convert digital signal to, adopt computer installation and special-purpose software that physiological signal is handled, analyzes, calculated, result of calculation and trainee's physiological signal baseline value are compared, calculate the multiplication factor of representing trainee's physiological signal to change degree, and the latter is converted into output order.
Be applied to the physiological signal of apparatus of the present invention control, can be the various forms of body surface physiological signals of human body, comprise physiological signals such as pulse wave signal, electrocardiosignal, EEG signals, electromyographic signal, the skin signal of telecommunication, breath signal, shell temperature signal, blood pressure signal, oxygen saturation signal, electro-ocular signal, ocular movement signal.Above-mentioned physiological signal can adopt corresponding special-purpose physiological signal sensor collection.This bioelectrical signals or the non-electrical signal of being gathered by physiological signal sensor is transformed into the standard electric signal by pick off and further amplifies, nurses one's health.The physiological signal acquisition module is made of above-mentioned various universal or tailored version physiological signal sensors in apparatus of the present invention.
Every index that apparatus of the present invention are used to monitor trainee's physiological signal is a standard to observe the Human Physiology relaxation state, and these indexs can be the changes of variation, respiratory frequency or amplitude of respiration variations of heart rate in RR-50 quantity, PP-50 quantity, LH component, HF component or LF/HF ratio, unit interval in monitoring pulse wave or the ecg wave form, electromyographic signal variations, eeg number change, shell temperature variation, the variation of skin conductivity, blood pressure, blood oxygen saturation change, interior oxygen of unit interval and carbon dioxide content etc.Best selection is that physiological signal sensor is worn easily, does not influence trainee's activity, does not increase trainee's misery, and index is reliable and stable, and repeatability is strong, tests, analyzes correlated physiological signal type easily.In addition, because the biofeedback of different physiological signals control difficulty is inconsistent, consider that abecedarian and new hand grasp complexity, can be from the simplest breathing biofeedback training, after allowing the trainee that certain understanding and cognition is arranged, adopt pulse wave sensor monitoring RR-50 quantity, progressively develop into test electromyographic signal, the skin signal of telecommunication, skin temperature signal, adopt the EEG signals biofeedback at last.Also can be according to trainee's personal health state, select the most suitable trainee individual's biofeedback form.The physiological signal of gathering carries out preposition amplification, power frequency filtering, A/D and converts digital signal to, by the computer interface circuit, exports digital signal to computer installation.
Physiological signal in apparatus of the present invention amplifies conditioning module, is made up of bioelectrical signals amplifier, A/D converter, computer interface circuit, according to dissimilar physiological signals, can select dissimilar special uses or general biological electric amplifier for use.Amplifier is made up of the instrument amplifier of high cmrr usually.A/D converter can adopt 8,12 or 16 A/D converters, selects according to different sample rates and degree of accuracy.The computer interface circuit can adopt the multiple interfaces mode, comprises usb mode, and the RS232 interface mode perhaps adopts direct computer serial line interface or parallel interface mode to export digital signal to computer.Physiological signal amplifies conditioning module, can adopt commercially available universal signal regulating panel and data acquisition board, also can design voluntarily according to the type of physiological signal, makes the device of special-purpose specific use.Above-mentioned physiological signal amplifies, conditioning module is carried out preposition amplification, power frequency filtering, A/D with the physiological signal of gathering and converted digital signal to, by the computer interface circuit, exports digital signal to computer installation.
Physiological single processing in apparatus of the present invention, analysis, calculating, reservoir module, it is the computer installation of various ways, by central processing unit (CPU), program storage device (RAM), archival memory (ROM) constitutes, can be any type of computer installation, comprise desktop computer, notebook computer, palm-type computer (PDA), monolithic computer or single-borad computer, Industry Control computer etc.These computer installations are equipped with input, output device, control device, multimedia device and operating system software and the special signal of necessity and import, handle, analyze, calculate, control software, according to different physiological signals and different actuating unit, the suitable computer installations of multimedia device selection.Physiological single processing, analysis, calculating, reservoir module, accept the physiological signal of input, physiological signal to input carries out various processing, adopt special instrument to analyze the signal of handling, the signal of analyzing is stored, and compared calculating with the physiological signal baseline value that is stored in the data reservoir module, calculate multiplication factor and rank thereof, with the acousto-optic pattern,, show instant multiplication factor rank and labelling thereof by multimedia device.With the multiplication factor rank, be converted into digital signal simultaneously, export video, sound equipment, motion and other actions of control execution module to.
Technical characterictic of the present invention is that the change degree of physiological status decides the variation of all kinds execution module when training by monitoring, calculate the trainee.This numerical value is by measuring the physiological signal numerical value of trainee when training, and itself and trainee's physiological signal baseline value compared, calculate multiplication factor, represent the degree of trainee's physiological status change at that time with this, and with the multiplication factor rank be converted into numeral or the simulation control instruction, control execution module various variations.The amplitude that physiological signal changed when the trainee trained and the intensity of variation of various actuating units are linear, and physiological status was loosened more when the trainee trained, and was in relaxed state more, and the intensity of variation of various actuating units changes more greatly.Otherwise physiological status was nervous more when the trainee trained, and is in tension more, and the intensity of variation of various actuating units is more little.
Technical characterictic of the present invention is, the trainee's who adopts in apparatus of the present invention physiological signal baseline value is the basis that changes of monitoring trainee physiological status and with reference to contrast number.The order of accuarcy that baseline value is measured directly influences the accuracy of monitoring result.The method of testing of trainee's baseline value can be a various ways, can be before the training beginning, at the quiet sitting position of trainee after five minutes, began to measure certain physiological signal 1 minute to 10 minutes, preferably 2~3 minutes, calculate its mean values, as certain physiological signal baseline value of trainee individual, be recorded in the trainee individual retaining case, so that can call at any time.Trainee's baseline value also can be the physiological signal numerical value when biofeedback training finishes before adopting, and can also be the mean values of gathering trainee's physiological signal in 2~5 minutes in training beginning back.Adopt said method test baseline value all to be allowed to, the most important thing is that any one trainee or the group of undergoing training must adopt with a kind of physiological signal, with a kind of analysis calculation method, and with a kind of method establishment of base line value, otherwise the result of training loses accuracy.
Technical characterictic of the present invention is, the numerical value of monitoring in apparatus of the present invention is the change of trainee's physiological signal in training, the absolute value of trainee's physiological signal is nonsensical, the physiological signal change value relatively of the change representative of any one period that has only physiological signal in training, be only decision training effect's key, it is dynamic, variation that the physiological signal numerical value in this device changes.Calculate the ratio of certain time period physiological signal numerical value and physiological signal baseline value, just represent the change degree of this time period trainee's physiological status, the measurements and calculations physiological signal changes the interval of degree and cycle can free adjustment, but it can not be lower than 30 seconds at interval at least, otherwise too short time interval can not effectively calculate the mean values of physiological signal, bigger error may occur.Be preferably in 30 seconds to 5 minutes the blanking time of measurements and calculations, Best Times 30 seconds to 60 seconds, the manager is free adjustment as required.
Technical characterictic of the present invention is the degree that adopts multiplication factor to represent trainee's physiological status to change in this device.Multiplication factor calculates the baseline value of the physiological signal numerical value of instant measurement when adopting training divided by this physiological signal, and baseline value is stored among the RAM as constant.Meaning for more direct demonstration and expression multiplication factor, adopt multiplication factor rank and labelling to represent the degree of multiplication factor, multiplication factor rank that multiplication factor is corresponding with it and multiplication factor labelling mutual relation adopt form to leave among the RAM of computer installation, can the quickly look-up (see figure 3) by look-up table.Representing the instant physiological status of trainee to change the multiplication factor rank of degree and multiplication factor labelling can be presented in the actuating unit in the display screen in face of the trainee automatically.Trainee's physiological status suggestion voice content of multiplication factor representative also can be pointed out the trainee (see figure 3) by earphone.Trainee's multiplication factor changes in the unit interval automatically in training, and the amplitude of change depends on the change of trainee's physiological status.The interval that multiplication factor upgrades depends on and can adjust blanking time of the calculating multiplication factor that presets.Should be provided with this blanking time according to the particularity of actuating unit, should humorous mediation cooperate between the two.
Technical characterictic of the present invention is, when trainee's multiplication factor rank undesirable, the whole people's of toning the physiological status and the trainee comes round, when reaching the physiological status of more loosening, the trainee can select " breathing simulation " option, in case this option is selected, computer installation is selected suitable respiratory frequency and breathing cycle automatically according to the present multiplication factor rank of trainee, and instruct the trainee to breathe with speech simulation and video simulated mode and improve the physiology relaxation state, multiplication factor and the (see figure 4) that concerns of breathing analogue signal by adjustment.The trainee also can adjust individual's relaxation state by other modes, comprises the method for various relaxation trainings and biofeedback training.
Technical characterictic of the present invention is, apparatus of the present invention also can be by monitoring trainee's physiological signal, the state of consciousness of monitoring the trainee changes, control the variation of execution module by the change degree of calculating state of consciousness, a kind of mode of practicality is by gathering trainee's EEG signals, calculate α ripple (8~13Hz) in the brain wave respectively, β ripple (14~30Hz), θ ripple (4~7Hz), (<3.5Hz) performance number (adopting the fast Fourier conversion method) is when the α performance number obviously increases the δ ripple, when becoming in the brain wave advantage waveform, proof trainee state of consciousness is in the Vigilance relaxation state, be optimal relaxation state, at this moment, the variation that execution module presets, α ripple advantage degree is high more, and execution module changes more greatly.
Technical characterictic of the present invention is that the described execution module of apparatus of the present invention comprises various computer multi-media devices, video device, PA-system, entertainment device and telecontrol equipment.Computer video multimedia device is wherein important a kind of, the computer stereo device, and the light PA-system is beautified the environment, and improves the device of atmosphere, and the skimulated motion device also can become its ingredient.
Computer video multimedia device in apparatus of the present invention is made up of photographic head, the PC that has Video processing hardware, special-purpose multimedia software, CD-ROM and DVD-ROM, computer monitor.The instruction that this device transmits according to control module, under the dedicated multimedia software-driven, feedback shows various videos, finishes the function of interactive biofeedback.The form of feedback is varied, can select according to trainee's ownness and hobby, a kind of feasible mode is, shoot with video-corder trainee individual's video with photographic head, and after handling, computer CPU is presented on the display screen, when change of trainee's physiological signal and/or state of consciousness change, the definition of trainee's video, brightness, color change thereupon.When before the training beginning, selecting to show the default value of trainee individual video, individual's portrait should be not too clear, some is fuzzy, color is lighter, brightness is lower, picture is more gloomy, and increase when trainee's physiology, mental status degree of relaxation, when multiplication factor numerical value increased, the definition of portrait increased, it is bright-coloured that color turns, it is bright that picture becomes, and multiplication factor rank and image sharpness, color, brightness present the positivity correlation curve, can preset form and give correspondence, and be housed among the RAM, regulate automatically along with the change of multiplication factor numerical value.
The mode of another kind of video multimedia feedback is to adopt the blue curtain of video display nonlinear editing technology, in computer hard disc, preserve multiple different background picture in the mode of graphic file, when biofeedback training, take individual's portrait video in real time, synthetic with it, be combined as synthesising pattern.In advance that different multiplication factor ranks is corresponding with the different background picture in the drive software, and be stored among the RAM with the form of constant table, when trainee's physiology, mental status change and when causing that multiplication factor changes, software calls the background frame of regulation automatically and the portrait picture is synthetic in real time, is combined into different new pictures.Background frame before the training can be the generic background common, not too clear, that landscape is general, and the multiplication factor rank raising along with the trainee presents beauty, clear, bright graceful landscape.
Also having the multimedia feedback system of a kind of video is to adopt blue curtain background formula television technology and device, in computer hard disc, store the cameo shot of multistage in the video file mode through the different content of montage, content can be various contents, the building sign of country variant, different story backgrounds, the Different Culture background also can be placed in the mode of CD optic disc or DVD optic disc through the cameo shot of montage and to wait among CD-ROM or the DVD-ROM and calling.In biofeedback training, take individual's portrait video in real time, synthetic with it, be combined as synthetic video.Drive software is corresponding with different cameo shots with different multiplication factor ranks in advance, and be stored in the constant table form among the RAM of computer, when causing that when the change of trainee's Physiological Psychology state multiplication factor changes, the cameo shot of software-calling convention and real-time image are synthetic, synthetic different new cameo shot.Improve with the multiplication factor rank in the training, cameo shot should be more and more lucid and more lively, beautiful and bright-coloured.
Above-mentioned composite image and synthetic video can be synthetic in advance, synthetic picture of video or cameo shot before training with the trainee.Above-mentioned image and cameo shot also can be not synthetic image and video, directly call broadcast according to different multiplication factor ranks.Equally, the different images and the video of above-mentioned demonstration also can be other guide and type, for example, when multiplication factor increases, show as in image or the video display that beauty's quantity gets more and more or more and more beautiful; Or it is increasing to show as right; Or it is more and more to show as money and wealth; Or it is more and more taller and bigger to show as self-image; Or the strength that shows as oneself is increasing etc.
Technical characterictic of the present invention is that sound equipment multimedia device in apparatus of the present invention is made up of the synthetic interface (MIDI) of PC, digital music instruments, CD-ROM, public address set, speaker or earphone, the dedicated multimedia software etc. of band sound card.The instruction that this device transmits according to control module, under the dedicated multimedia software-driven, feedback shows various sound equipments, finishes the function of interactive biofeedback.Its implementation comprises the volume of regulating sound equipment, changes the balance of both sides volume, changes the rhythm of music, changes different genres of music and tune etc.
A kind of feasible feedback system is, and is directly that the multiplication factor rank is corresponding with volume, is stored among the computer RAM in the mode of constant table, and the multiplication factor rank is high more, and volume is big more.And in the default value before training, volume is turned down, and only indistinctly can hear, along with degree of relaxation is high more, volume progressively improves.When testing the bilateral physiological signal at the same time, the different multiplication factor ranks that bilateral different acquisition physiological signal can be calculated are regulated corresponding with the left and right sides volume, when both sides physiological signal universal time coordinated, the volume equilibrium of bilateral sound equipment, when in case the both sides physiological signal is inharmonious, then physical alterations both sides sound equipment equilibrium.
Another kind of feasible feedback system is, before training, select a sample music melody, its rhythm is medium fast speed, meanwhile, the multiplication factor rank is regulated the rhythm of controlling this music melody by the synthetic interface of digital music instruments, when the multiplication factor rank is high more, the rhythm of music melody is more and more slower, the relaxation state of reflection human body.
Also have a kind of feasible feedback system to be, adopt the audio file mode to store different audio files in computer hard disc, or place music CD in CD-ROM, according to different multiplication factor ranks, according to the correspondence table that presets in the multimedia software, the different genres of music tune is called in selection, and along with the multiplication factor rank increases, the music melody that calls is graceful more, tonequality is good more, rhythm is slow more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention can adopt the olfactory sensation feedback system, and along with the multiplication factor rank increases, fragrance is more and more stronger or change different fragrance, allows trainee's intensive training effect.Its implementation is that the fragrance diaphragm is placed on the electric heater, and after multiplication factor reached certain rank, electric heater started, and the high more electrical heating temperature of rank is high more, and fragrance is strong more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention can adopt perfusion to be rich in the mode of anion oxygen, other increases along with trainee's multiplication factor level, when threshold values that triggering is preset, the oxygen flow that is rich in anion pours into to the trainee by face shield or the breather that hangs over the nose below, make it feel pure and fresh air and the intravital energy of enhancing more, the mode of realization is oxygen cylinder or oxygen bag supply oxygen.The collateral branch of oxygen pipeline has one to pay ion generator generation anion, and blows into oxygen pipeline with fan, and the rank that multiplication factor increases is many more, and oxygen flow is big more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention also can be in the chair done of trainee vibrating device and heater to be housed, in case the multiplication factor rank is touched its threshold values that presets, chair produces the rhythmicity vibration and medicated cushion progressively heats, the multiplication factor rank is high more, the amplitude of chair vibration is big more, and frequency is fast more.Its implementation is to install motor and cam gear additional in the seat bottom surface.Motor drives the cam rotation and produces vibration, and motor speed is fast more, and frequency of vibration is high more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention also can adopt music fountain seal box or miniature aquarium, said apparatus does not have light-illuminating before training, no music accompaniment, when trainee's multiplication factor numerical value triggered the threshold values that presets, light was shinny gradually, accompaniment music sounds, the rank of multiplication factor is high more, and light is bright more, and the volume of accompaniment music is high more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention can also be to install various lights of stage with rotation, glittering function around ceiling top, training place and wall, arrange the surround sound audio amplifier around in the room, in case trainee's multiplication factor numerical value triggers the threshold values that presets, light lights gradually all around, and surround sound musical background is all around sounded.The multiplication factor rank is high more, and light is bright more, and the frequency of flicker and rotation is fast more, and the volume of accompaniment music is big more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention also can adopt the motor type device, and trainee's seat is fixed on and can rotates, or on can the device of lifting, when trainee's multiplication factor numerical value triggered default value, the trainee rose and/or rotation along with seat.The multiplication factor rank is high more, and the rate of climb is fast more, and the speed of rotation is fast more.
Technical characterictic of the present invention is, the feedback system of apparatus of the present invention can also be sealed compartment of design, multiple blinking light is housed in the cabin, stero set, and the generating means of oxygen and anion is arranged, when trainee's multiplication factor numerical value touched the threshold values that presets, light was glittering, music is played, and the oxygen flow that is rich in anion pours into in the cabin.Seat in the sealed compartment vibrates synchronously, and the rhythm of action of said apparatus and multiplication factor rank present the positive correlation curve.
The invention has the beneficial effects as follows, propose the colourful cross reaction type of a kind of feedback system, multimedia biofeedback training device, the interest of raising biofeedback training and recreational.
Description of drawings
The embodiment that the present invention enumerates gathers pulse wave signal, analyzes the system design scheme of RR50 quantity as monitoring human degree of relaxation changeable device.
Fig. 1 is the functional structure block diagram of device
Fig. 2 is the circuit theory diagrams of device
Fig. 3 is a multiplication factor suggestion content sketch map
Fig. 4 is multiplication factor and breathes the analog frequency sketch map
The specific embodiment
Embodiment: pulse type bio-feedback arrangement
Adopt pulse transducer to gather pulse signal, make up as biofeedback signals with pulse signal or pulse wave analysis result, can fast, accurately confirm the relaxation instructing device of user biofeedback training effect, the control instruction that the user physiological status that this device sends changes degree can drive various different entertainment devices, this device adopts standard interface to be connected with PC, with the data of gathering and (or) analysis result transfers to PC storage, analysis.
The physiology signal that the physiological signal acquisition module is gathered, (RR-50 time number extracts) is stored in signal reservoir module 502 in order after treatment, judge module 503 will through the current index of the RR50 signal that extraction be stored in storage module 502 in before the RR-50 signal of extraction compare, and determine that whether RR-50 time present number be than increasing in the past, if RR-50 time number increases, then represent the physiological data condition improvement.
When detailed interpre(ta)tive system function, at first explain the index of expression physiological status, in electrocardiogram and among the pulse wave figure, the R ripple of a heartbeat and next time the interval between the R ripple of heartbeat be referred to as RR at interval, RR is at interval as a kind of index, can represent the autonomic function of human body, RR at interval can be as a kind of accurately and effectively index of expression human body physiological state.
RR pulse wave at interval absolute value at interval corresponding to two successive heartbeats when RR50 is defined in a preset time section (as a minute) measurement pulse wave changes 50ms or more number of times; the value of RR50 is big more; the experimenter loosens more; the value of RR50 is more little; the experimenter is nervous more, and in the daily routines process, the value of RR50 is less than 10 times/minute; in bed is 30 times/minute, exists certain relation between the relaxation state of RR50 and user.The threshold value whether experimenter loosens is about 15 times/minute RR50 value.If the value of RR50 surpasses this value, just think that the experimenter is in relaxation state.
Strictly say, the R ripple of " R " expression heartbeat of RR50, the peak value of pulse wave is corresponding to this R ripple, therefore, RR50 may also be referred to as PP50, that is measures two absolute values between the adjacent P crest value and change the number of times that 50ms or more number of times are PP-50, and the meaning of its measurement is consistent with RR-50.
By various control sequences and the various control data of CPU, various instruction set and enquiry form etc. are stored in memory under program (ROM, read-only memory), in addition, ROM also stores various voice messaging model, so that under different instruction, by different language guiding user.
Data memory (RAM, random access memory (RAM)), be used to store pulse wave signal, the index of expression degree of relaxation, measure the time of these indexs etc., and be used as the computer of the inferior counting number of the detection that measurement index index when detecting increases in time, when CPU carries out mathematical calculation, RAM also can be used as the computing zone, and RAM corresponds to signal storage module 502 among Fig. 1.
Man machine interface is sent instruction according to the button of user operation, and show, simultaneously, the running status of display system, result that controlled state and physiological status are compared and trend, keyboard drive circuit in the man machine interface, the operation of control button is transferred to CPU with the push-button type of operating with an interrupt signal.
The pressure-type pulse transducer is a kind of pressure transducer, can be placed on finger or wrist and scratch side, this kind pick off is experienced the vibration of pulse wave, and the waveform that pressure is changed is converted into the signal of telecommunication, through signal amplify and signal condition after and transmit as the pulse wave detection signal.The photoelectric type pulse transducer is a kind of optical pickocff, can be placed on gill lappet position on the finger of user, this kind pick off comprises light emitting diode and photaesthesia transistor, light emitting diode emission light is to finger, after the finger medium vessels was accepted emission light, portions of light reflexed to the sensing crystal pipe, produced the opto-electronic conversion effect behind the photaesthesia transistor acknowledge(ment) signal, the photosignal that produces is through amplifying and nursing one's health the back and transmit as pulse wave signal.
A/D converter is accepted the pulse wave signal that transmits from pulse transducer, is digital signal with analog signal conversion, and with switched digital data transmission to bus, sound source is made up of speaker, and the pulse of RR-50 the number of output that can directly feed back is on the one hand exported the number of times of RR-50 in the unit interval with certain audio frequency and tone, during the RR-50 increased frequency, audio frequency is accelerated, and tone improves, and intensity of sound increases, and when RR-50 number reduces, audio frequency slows down, and tone reduces, and intensity of sound weakens.On the other hand, speaker provides the various promptings relevant with somatosensory to user, and the physiological status that CPU is different according to user is called the different linguistic information models that preset, different physiological statuss of prompting user and degree of relaxation.
The sound source drive circuit is one and is used for the drive circuit of being sounded and showing through the D/A change-over circuits through RR-50 severals pulses of handle extracting by CPU, simultaneously, also is to be used for reading the drive circuit that produces specifically warning or verbal messages from ROM by CPU.
The light beam driver is a drive circuit that is used for being shown through the D/A change-over circuit through the RR-50 pulse number that extracts by CPU the diode light beam, the diode light beam is the array that light emitting diode is formed, shape is similar to light beam, the glittering height of light beam is directly proportional with the RR-50 pulse number, unit interval, RR-50 number was many more, and the glittering number of diode light beam light emitting diode is many more.
Liquid crystal display is used to show the various message and the figure of the demonstration information that forms with CPU, the physiological status, controlled state, speaker and the liquid crystal display that show user correspond to reminding module 504,505 among Fig. 1, display driver is from CPU reading displayed information, be converted to the form that is applicable to display, and the demonstration of control liquid crystal display.
Intervalometer has the common function that clocks, the measurement clock time the during measurement of its output when the measurement data.Another critical function of intervalometer is that a default period sends an interrupt signal by bus to CPU1 in the past at the clock time default by CPU or by CPU, at this moment also provide interrupt signal to be since the last type that CPU presets or after the information that forms of a type.
The I/O interface is other equipment that are used for the device outside, personal computer for example, also for example, the game machine control box sends or accepts the communication means of various information, can be connected with lead or cable between these communication means (by universal or special connector) or standard interface circuit (USB between the equipment such as large-scale amusement device control box, RX23232C etc.) connect, can also adopt multiple remote control mode (for example, infrared remote controller, radio radiological unit etc.).
Claims (9)
1. the present invention relates to be applied to the device of biofeedback training, relate in particular to a kind of by trainee's physiological signal and/or state of consciousness control, the cross reaction formula, the biofeedback training device of multimedia type, in particular, this device is by physiological signal and/or state of consciousness monitoring modular, signal processing and identification module, control module and execution module etc. are partly formed, by surveying trainee's physiological signal and/or state of consciousness, monitor its change, change degree according to physiological signal and/or state of consciousness, calculate the control corresponding instruction, control, regulate and change the video of various dissimilar execution module, sound, motion and other actions, come the effect of enhanced biological feedback training, help the trainee better to regulate self-physiological status and mental status, can be widely used in fields such as multiple health care and clinical treatment.
2. according in the described device of claim 1, technical characterictic of the present invention is, in training process, continue to monitor one or more physiological signals of testee, the physiological signal of gathering is amplified, conditioning, after A/D converts digital signal to, adopt computer installation and special-purpose software that physiological signal is handled, analyze, calculate, result of calculation and trainee's physiological signal baseline value are compared, calculate the multiplication factor of representing trainee's physiological signal to change degree, and the latter is converted into output order, be applied to the physiological signal of apparatus of the present invention control, can be the various forms of body surface physiological signals of human body, comprise pulse wave signal, electrocardiosignal, EEG signals, electromyographic signal, the skin signal of telecommunication, breath signal, the shell temperature signal, blood pressure signal, oxygen saturation signal, electro-ocular signal, physiological signals such as ocular movement signal, above-mentioned physiological signal can adopt corresponding special-purpose physiological signal sensor collection, this bioelectrical signals or the non-electrical signal of gathering by physiological signal sensor, being transformed into the standard electric signal by pick off further amplifies, conditioning, the physiological signal acquisition module is made of above-mentioned various universal or tailored version physiological signal sensors in apparatus of the present invention.
3. according in the described device of claim 1, technical characterictic of the present invention is, apparatus of the present invention also can be by monitoring trainee's physiological signal, the state of consciousness of monitoring the trainee changes, control the variation of execution module by the change degree of calculating state of consciousness, a kind of mode of practicality is by gathering trainee's EEG signals, calculate α ripple (8~13Hz) in the brain wave respectively, the β ripple (14~30Hz), and the θ ripple (4~7Hz), δ ripple (<3.5Hz) performance number (adopting the fast Fourier conversion method), when the α performance number obviously increases, when becoming in the brain wave advantage waveform, proving that trainee's state of consciousness is in the Vigilance relaxation state, is optimal relaxation state, at this moment, the variation that execution module presets, α ripple advantage degree is high more, and execution module changes more greatly.
4. according in the described device of claim 1, the described execution module of apparatus of the present invention, comprise various computer multi-media devices, video device, PA-system, entertainment device and telecontrol equipment, computer video multimedia device are wherein important a kind of, the computer stereo device, the light PA-system, beautify the environment, improve the device of atmosphere, the skimulated motion device also can become its ingredient.
5. according in the described device of claim 1, it is characterized in that, computer video multimedia device, by photographic head, the PC that has Video processing hardware, special-purpose multimedia software, CD-ROM and DVD-ROM, computer monitor is formed, the instruction that this device transmits according to control module, under the dedicated multimedia software-driven, feedback shows various videos, finish the function of interactive biofeedback, the form of feedback is varied, can select according to trainee's ownness and hobby, a kind of feasible mode is, shoot with video-corder trainee individual's video with photographic head, and after handling, computer CPU is presented on the display screen, when change of trainee's physiological signal and/or state of consciousness change, the definition of trainee's video, brightness, color changes thereupon, when before the training beginning, selecting to show the default value of trainee individual video, individual's portrait should be not too clear, some is fuzzy, color is lighter, brightness is lower, and picture is more gloomy, and when trainee's physiology, the mental status degree of relaxation increases, when multiplication factor numerical value increases, the definition of portrait increases, and it is bright-coloured that color turns, and it is bright that picture becomes, multiplication factor rank and image sharpness, color, brightness presents the positivity correlation curve, can preset form and give correspondence, and be housed among the RAM, regulate automatically along with the change of multiplication factor numerical value.
6. according in the described device of claim 1, it is characterized in that, the mode of another kind of video multimedia feedback is, adopt the blue curtain of video display nonlinear editing technology, in computer hard disc, preserve multiple different background picture in the mode of graphic file, when biofeedback training, take individual's portrait video in real time, synthetic with it, be combined as synthesising pattern, in advance that different multiplication factor ranks is corresponding with the different background picture in the drive software, and be stored among the RAM with the form of constant table, when trainee's physiology, mental status changes and causes when multiplication factor changes, software calls the background frame of regulation automatically and the portrait picture is synthetic in real time, is combined into different new pictures, and the background frame before the training can be common, not too clear, the generic background that landscape is general, multiplication factor rank raising along with the trainee presents beauty, clear, bright graceful landscape.
7. according in the described device of claim 1, it is characterized in that, also having the multimedia feedback system of a kind of video is to adopt blue curtain background formula television technology and device, in computer hard disc, store the cameo shot of multistage in the video file mode through the different content of montage, content can be various contents, the building sign of country variant, different story backgrounds, the Different Culture background, also can be placed on through the cameo shot of montage and to wait among CD-ROM or the DVD-ROM and calling in the mode of CD optic disc or DVD optic disc, in biofeedback training, take individual's portrait video in real time, synthetic with it, be combined as synthetic video, drive software is corresponding with different cameo shots with different multiplication factor ranks in advance, and be stored in the constant table form among the RAM of computer, when causing that when the change of trainee's Physiological Psychology state multiplication factor changes, the cameo shot of software-calling convention and real-time image are synthetic, synthetic different new cameo shot, improve with the multiplication factor rank in the training, cameo shot should be more and more lucid and more lively, beautiful and bright-coloured.
8. according in the described device of claim 1, technical characterictic of the present invention is, sound equipment multimedia device in apparatus of the present invention, PC by the band sound card, digital music instruments is synthesized interface (MIDI), CD-ROM, public address set, speaker or earphone, compositions such as dedicated multimedia software, the instruction that this device transmits according to control module, under the dedicated multimedia software-driven, feedback shows various sound equipments, finish the function of interactive biofeedback, its implementation comprises the volume of regulating sound equipment, change the balance of both sides volume, change the rhythm of music, change different genres of music and tune etc.
9. according in the described device of claim 1, it is characterized in that, the feedback system of apparatus of the present invention can adopt the olfactory sensation feedback system, and along with the multiplication factor rank increases, fragrance is more and more stronger or change different fragrance, allow trainee's intensive training effect, its implementation is that the fragrance diaphragm is placed on the electric heater, and after multiplication factor reached certain rank, electric heater started, the high more electrical heating temperature of rank is high more, and fragrance is strong more.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200510028013 CN1729934A (en) | 2005-07-21 | 2005-07-21 | Interactive multimedia bio-feedback arrangement |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200510028013 CN1729934A (en) | 2005-07-21 | 2005-07-21 | Interactive multimedia bio-feedback arrangement |
Publications (1)
Publication Number | Publication Date |
---|---|
CN1729934A true CN1729934A (en) | 2006-02-08 |
Family
ID=35962380
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200510028013 Pending CN1729934A (en) | 2005-07-21 | 2005-07-21 | Interactive multimedia bio-feedback arrangement |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN1729934A (en) |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102462489A (en) * | 2010-11-15 | 2012-05-23 | 绿谷(集团)有限公司 | Method for detecting static degree of human body in retreat process and static sitting device |
CN102715902A (en) * | 2012-06-15 | 2012-10-10 | 天津大学 | Emotion monitoring method for special people |
CN102737677A (en) * | 2012-06-18 | 2012-10-17 | 哈尔滨工业大学深圳研究生院 | Electroencephalogram signal-based multi-media feedback control system |
CN101609086B (en) * | 2008-06-18 | 2013-03-27 | 英业达股份有限公司 | System and method for generating action advice by analyzing all previous measured physiological status data |
CN103584872A (en) * | 2013-10-29 | 2014-02-19 | 燕山大学 | Psychological stress assessment method based on multi-physiological-parameter integration |
CN103637774A (en) * | 2013-12-18 | 2014-03-19 | 王昌利 | Human startle reflex experimental system and working method thereof |
CN103736255A (en) * | 2013-09-22 | 2014-04-23 | 国家康复辅具研究中心 | Along-channel and collateral-conduction guiding feedback rehabilitation training system used for lower limb potential development training |
CN103961837A (en) * | 2013-01-24 | 2014-08-06 | 朱程锦 | Device for training coordinate ability of brain, hands, eyes and ears |
CN104759016A (en) * | 2015-04-21 | 2015-07-08 | 安徽阳光心健心理咨询有限公司 | Multi-channel body and mind feedback control system |
CN104771183A (en) * | 2015-04-21 | 2015-07-15 | 安徽阳光心健心理咨询有限公司 | Chainless motion sensing interaction psychological system |
CN104918163A (en) * | 2015-06-19 | 2015-09-16 | 成都腾悦科技有限公司 | Touch control electroencephalogram alpha wave signal induction Bluetooth headset |
CN105054392A (en) * | 2015-09-18 | 2015-11-18 | 李林国 | Intelligent skirt |
CN105637515A (en) * | 2013-10-17 | 2016-06-01 | 皇家飞利浦有限公司 | Promoting physical activity |
CN105816997A (en) * | 2016-05-28 | 2016-08-03 | 玉最光 | Body building and entertaining method |
WO2017092346A1 (en) * | 2015-12-04 | 2017-06-08 | 乐视控股(北京)有限公司 | Image processing method and device |
CN107335181A (en) * | 2017-08-22 | 2017-11-10 | 彭从文 | Interactive open air body-building walking aid |
CN107802263A (en) * | 2016-09-08 | 2018-03-16 | 候俊英 | A kind of wearable sound feedback system based on Electroencephalo signal |
CN108095742A (en) * | 2018-02-02 | 2018-06-01 | 华北理工大学 | A kind of examination hall examinee decompression method and device |
CN109432566A (en) * | 2018-11-07 | 2019-03-08 | 深圳智能光谱有限公司 | A kind of physiological parameter navigation adjusting method, control assembly and regulating device |
CN110038257A (en) * | 2019-04-26 | 2019-07-23 | 漳州卫生职业学院 | A kind of exercise load test macro |
CN110743077A (en) * | 2019-08-05 | 2020-02-04 | 北京泷信科技有限公司 | Sound wave relaxation equipment and psychological adjustment training method thereof |
CN110811573A (en) * | 2019-10-29 | 2020-02-21 | 依脉人工智能医疗科技(天津)有限公司 | Device and method for regulating and controlling brain alertness based on photoelectric pulse feedback |
CN111221411A (en) * | 2019-11-18 | 2020-06-02 | 京东方科技集团股份有限公司 | Painted screen |
TWI801128B (en) * | 2022-02-09 | 2023-05-01 | 金寶電子工業股份有限公司 | Feedback device for sense of taste, and feedback system and feedback method for using the same |
CN116132899A (en) * | 2023-04-18 | 2023-05-16 | 杭州汇听科技有限公司 | Remote verification and adjustment system of hearing aid |
-
2005
- 2005-07-21 CN CN 200510028013 patent/CN1729934A/en active Pending
Cited By (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101609086B (en) * | 2008-06-18 | 2013-03-27 | 英业达股份有限公司 | System and method for generating action advice by analyzing all previous measured physiological status data |
CN102462489A (en) * | 2010-11-15 | 2012-05-23 | 绿谷(集团)有限公司 | Method for detecting static degree of human body in retreat process and static sitting device |
CN102715902A (en) * | 2012-06-15 | 2012-10-10 | 天津大学 | Emotion monitoring method for special people |
CN102737677A (en) * | 2012-06-18 | 2012-10-17 | 哈尔滨工业大学深圳研究生院 | Electroencephalogram signal-based multi-media feedback control system |
CN103961837A (en) * | 2013-01-24 | 2014-08-06 | 朱程锦 | Device for training coordinate ability of brain, hands, eyes and ears |
CN103736255B (en) * | 2013-09-22 | 2016-11-09 | 国家康复辅具研究中心 | Following through leading network pilot feedback rehabilitation training system of lower limb development of potential training |
CN103736255A (en) * | 2013-09-22 | 2014-04-23 | 国家康复辅具研究中心 | Along-channel and collateral-conduction guiding feedback rehabilitation training system used for lower limb potential development training |
CN105637515A (en) * | 2013-10-17 | 2016-06-01 | 皇家飞利浦有限公司 | Promoting physical activity |
CN103584872A (en) * | 2013-10-29 | 2014-02-19 | 燕山大学 | Psychological stress assessment method based on multi-physiological-parameter integration |
CN103637774A (en) * | 2013-12-18 | 2014-03-19 | 王昌利 | Human startle reflex experimental system and working method thereof |
CN104759016A (en) * | 2015-04-21 | 2015-07-08 | 安徽阳光心健心理咨询有限公司 | Multi-channel body and mind feedback control system |
CN104771183A (en) * | 2015-04-21 | 2015-07-15 | 安徽阳光心健心理咨询有限公司 | Chainless motion sensing interaction psychological system |
CN104918163A (en) * | 2015-06-19 | 2015-09-16 | 成都腾悦科技有限公司 | Touch control electroencephalogram alpha wave signal induction Bluetooth headset |
CN105054392A (en) * | 2015-09-18 | 2015-11-18 | 李林国 | Intelligent skirt |
WO2017092346A1 (en) * | 2015-12-04 | 2017-06-08 | 乐视控股(北京)有限公司 | Image processing method and device |
CN105816997A (en) * | 2016-05-28 | 2016-08-03 | 玉最光 | Body building and entertaining method |
CN107802263A (en) * | 2016-09-08 | 2018-03-16 | 候俊英 | A kind of wearable sound feedback system based on Electroencephalo signal |
CN107335181A (en) * | 2017-08-22 | 2017-11-10 | 彭从文 | Interactive open air body-building walking aid |
CN107335181B (en) * | 2017-08-22 | 2019-05-10 | 滨州学院 | Interactive open air body-building walking aid |
CN108095742A (en) * | 2018-02-02 | 2018-06-01 | 华北理工大学 | A kind of examination hall examinee decompression method and device |
CN109432566A (en) * | 2018-11-07 | 2019-03-08 | 深圳智能光谱有限公司 | A kind of physiological parameter navigation adjusting method, control assembly and regulating device |
CN110038257A (en) * | 2019-04-26 | 2019-07-23 | 漳州卫生职业学院 | A kind of exercise load test macro |
CN110743077A (en) * | 2019-08-05 | 2020-02-04 | 北京泷信科技有限公司 | Sound wave relaxation equipment and psychological adjustment training method thereof |
CN110743077B (en) * | 2019-08-05 | 2022-08-12 | 北京泷信软件技术有限公司 | Sound wave relaxation equipment and psychological adjustment training method thereof |
CN110811573A (en) * | 2019-10-29 | 2020-02-21 | 依脉人工智能医疗科技(天津)有限公司 | Device and method for regulating and controlling brain alertness based on photoelectric pulse feedback |
CN111221411A (en) * | 2019-11-18 | 2020-06-02 | 京东方科技集团股份有限公司 | Painted screen |
TWI801128B (en) * | 2022-02-09 | 2023-05-01 | 金寶電子工業股份有限公司 | Feedback device for sense of taste, and feedback system and feedback method for using the same |
CN116132899A (en) * | 2023-04-18 | 2023-05-16 | 杭州汇听科技有限公司 | Remote verification and adjustment system of hearing aid |
CN116132899B (en) * | 2023-04-18 | 2023-06-16 | 杭州汇听科技有限公司 | Remote verification and adjustment system of hearing aid |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN1729934A (en) | Interactive multimedia bio-feedback arrangement | |
CN101337103B (en) | Pressure and emotion adjustment system and a physiology signal acquisition device | |
CN108461126A (en) | In conjunction with virtual reality(VR)The novel intelligent psychological assessment of technology and interfering system | |
CN100573622C (en) | Multimedia brainwave feedback children learning and training method and instrument for training | |
CN1739817A (en) | Personalized stereo health training method and equipment | |
CN201299884Y (en) | Intelligent psychological body and mind feedback training device | |
CN1833616A (en) | Multi-conduction brain biological information feedback instrument | |
Molnar-Szakacs et al. | Shared affective motion experience (SAME) and creative, interactive music therapy | |
AU2006217448A1 (en) | Methods and systems for physiological and psycho-physiological monitoring and uses thereof | |
CN102198301A (en) | Music playing system based on body feature monitoring | |
CN1716267A (en) | Individual stereo health preserving method and device | |
Yu et al. | RESonance: Lightweight, room-scale audio-visual biofeedback for immersive relaxation training | |
Yu et al. | Designing Auditory Display of Heart Rate Variability in Biofeedback Context. | |
CN102641541A (en) | Three-dimensional (3D) somatosensory biofeedback comprehensive relaxing and training system | |
Eaton et al. | The space between us: evaluating a multi-user affective brain-computer music interface | |
CN112870521A (en) | Immersive exercise psychology rehabilitation training system | |
CN113975583A (en) | Emotion persuasion system based on virtual reality technology | |
Ortiz et al. | Biosignal-driven art: beyond biofeedback | |
CN1723840A (en) | Personal and digital health-care aid | |
CN116785553B (en) | Cognitive rehabilitation system and method based on interface type emotion interaction | |
Marentakis et al. | Using breath-like cues for guided breathing | |
Edmonds et al. | On physiological computing with an application in interactive art | |
Balzer | Chronobiology—as a foundation for and an approach to a new understanding of the influence of music | |
Viriyasaksathian et al. | EMG-based upper-limb rehabilitation via music synchronization with augmented reality | |
CN116868277A (en) | Emotion adjustment method and system based on subject real-time biosensor signals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |