Background technology
Virtual reality is the more advanced artificial intelligent means of comprehensive computer, and it can build an imagination space by instruments such as computer graphical (CG) technology and sensing technologies.And thisly comprise that imagination space that vision, audition and sense of touch diversification experience is difficult to realize or even can not realize in the real world often.
Concerning the crowd that mental illness or obstacle are arranged, more be that people are reluctant that the reality faced experiences.Virtual reality then can carry out the psychotherapy for shrink and patient build a bridge on the psychotherapy better under the help of virtual reality.Important feature such as the psychotherapy's method under the virtual reality is saved energy muscle power because its technical factor has determined it time saving and energy saving, has more sense of reality, and effect is obvious.
Now, psychology combines with virtual reality technology more and more.The research of virtual reality technology in the psychology field is usually directed to visually-perceptible psychology and physiology, audition perception psychology and contents such as physiology, Memory and Cognition psychology.Psychological phenomenon in the process of understanding things such as sensation, consciousness, memory, thinking, the imagination is the important topic of psychological study always.Utilize vision, the auditory system of virtual reality technology manufacturing can carry out psychological study well.The psychologic participation of development need of virtual reality technology simultaneously and can set up some objective judgment criteria to it.
Virtual reality psychotherapy system at the exploitation of special mental disease has appearred in perfect along with the development of the theories of psychology and virtual reality technology.Social research of University of Nottingham and psychiatry research group are to studying with the different phobia of virtual reality system treatment.California, USA Kaiser-Permanente medical team has developed a cover virtual reality technology has been applied to the pilot system of altophobia treatment, and makes 90% participant reach therapeutic goal.
The therapeutive example of a lot of virtual realities has appearred in research by experiment.Some has just utilized the ultimate principle of virtual reality these virtual realities psychotherapy, as people such as C.Botella to people such as the treatment of claustrophobia, Brenda K to treatment of flying phobia etc.Also have some more near the psychotherapy's method and the aid design of practical significance virtual reality, they are substantially based on software design, and virtual environment is carried out modeling and redrawn, and realize interaction by means such as visual effect device and haptic effect devices.As stress lack of proper care etc. after treating attention deficit hyperactivity disorder, altophobia, wound.The exploitation of this virtual reality psychotherapy's software because its specific aim is too strong, often makes patient's object colony competitive list one of treatment.But compare with the therapeutic effect of non-virtual reality, action effect is fairly obvious.
The development motive force of virtual reality applications derives from the development of computer virtual reality technology.Development along with the science and technology and the theories of psychology, virtual reality technology psychotherapy field begins to be used widely, and to trend development applied widely, truer, interactive and that feeling of immersion is stronger, with psychotherapy's present situation of thoroughly reforming based on the imagination world.
Summary of the invention
The objective of the invention is, utilize psychotherapy's system help mental illness patient to overcome mental maladjustment, reaching ideal psychotherapy's effect. its structure comprises the photographic head that is used for characteristics of human body's collection, the synthetic computer set of Video processing and background, sound identification module on computers is installed, wireless messages R-T unit and be installed in micromachine shaking device on the patient body, be connected by data wire between photographic head and the computer, carry out communication by the wireless messages R-T unit between micromachine and the computer, connect by data wire between the computer.
1 psychological principle of the present invention
Psychological principle of the present invention is the document that comes from " out-of-body experience " that U.S.'s " science " magazine delivers in August, 2007.This article points out to utilize simple virtual reality technology, and scientist has painstakingly cheated people's brain, makes them produce rare out-of-body experience and self consciousness.Promptly people can experience him " seeing " own and surrounding outside the health of oneself.Felt that by the experiment people consciousness of oneself left health, and the health of oneself from visual observation.It is the consciousness of confusion reigned how in the process of integrating various sensory information that this achievement in research has disclosed human brain.
The phenomenon of " out-of-body experience " that the Henrik Ehrsson of University College London and the OlafBlanke of Institute for Research and Technology of Swiss Confederation have led two experimental verifications respectively, the brain that promptly just can cheat us easily by simple method.
The detailed process of experiment is:
What (1) be in a good state of health is sitting on the chair by the experiment people, and lays video camera at 2 meters, its rear, is used for taking its back posture.And then allow and put on special glasses by the experiment people, by the screen in these glasses, test the people and can be seen the image of video camera shooting.
(2) brandish rod up and down before video camera, after being tested people's chest and make same action with the rod contact simultaneously, most quilt experiment people reply, feel that the health of oneself is positioned at video camera the place ahead, oneself seem to see that from behind others is the same.
(3) after experiencing link (2), research worker is flung to hammer with one again to video camera, is tested the people all to have made the neural reflex that quails.This can be construed to by the experiment people feels that the health of oneself is in before the video camera and the reaction of making.
Result of experiment proves, after vision and sense of touch were separated, the sensory information of brain was handled and become chaotic, so brain creates a hallucination, makes the people experience the not health of necessary being of a tool.
According to this psychological principle, we carry out the therapeutive research of virtual reality.Virtual reality technology and mental experiment method are applied on the psychotherapy,, experience virtual psychotherapy's environment intuitively by stimulus to the sense organ.Cooperate psychiatrist's guiding, and then it is short to reach treatment time, the outstanding effect target.
The service condition of 2 psychotherapy systems
At first require the patient can be from virtual vision equipment the current health of Real Time Observation oneself, imaginary spatial scene is placed oneself in the midst of in simulation, and requires to reach people's thinking separates such one " out-of-body experience " with body effect.Like this, virtual body under the vision is stimulated just can be by the brain of visual impact to the people, thereby improve people's psychology awareness.Secondly, requirement all with doctor's language guide, can be experienced interactive signal simultaneously in whole process.Strengthen the patient by the prompting (can be modes such as vibrations, heating) of voice and perception device and realize sympathetic response.
3 psychotherapy's system structure
Structure of the present invention comprises the photographic head that is used for characteristics of human body's collection, the synthetic computer of Video processing and background, sound identification module on computers is installed, wireless messages R-T unit and be installed in micromachine shaking device on the patient body, be connected by data wire between photographic head and the computer, carry out communication by the wireless messages R-T unit between micromachine and the computer, connecting by data wire between the computer. overall construction design is as shown in Figure 1. and the vision part is an input equipment with the photographic head, transmitting the image of collection to graphics processing unit by USB. processing unit is inserted in the virtual environment video after human body is extracted from actual scene, and with background environment, personage and prospect animation carry out synthetic in real time. and to handle the back and output in experiencer's the visual field by the virtual reality glasses. the sense of touch part is input with the instruction of shrink, manage by program message, with the response message that obtains, send to serial communication equipment, arrive at perception device by wireless transmission as the haptic effect device, make the experiencer can experience pilot signal. the audition part is an input equipment with the mike, real-time Transmission doctor's guide, Markov model identification patient's simple answer is drawn in employing. in addition, cooperate the stereo music of virtual scene in addition, control output by message manager.
Wherein, image processing process is distributed in two processing units by pipeline organization, and by successively bearing image acquisition and processing and Flame Image Process output task respectively, two cell processing processes are carried out simultaneously.For the image of width of cloth n * n size, pipeline organization can make the time complexity of Flame Image Process by n
2Reduce to n.In fact, the former finishes image acquisition and feature extraction in two processing units, and the latter finishes the synthetic and display process work with virtual image.
The hardware aspect of invention, hardware is the main factor that influences processing speed.Wherein mainly comprise CPU, hard disk, photographic head, network adapter.Consider the portability of psychotherapy system and the adaptability of interface exploitation, select 32 processor and operating system (Windows XP).Secondly, because the demand of real-time speed, cause too complexity of real time imaging Processing Algorithm, we adopt adaptable frame difference method to carry out human body identification, so memory requirements of the present invention is less, adopt the 512MDDR2 internal memory in the experiment, actual taking only for about 20M (deciding) on the real time imaging complexity.The 3rd, pipeline organization requires quick undelayed network communication is provided, so the present invention takes LAN or the PC distich mode of 10M/s.
For strengthening the sense of reality of virtual reality psychotherapy system, need carry out certain guiding to patient's consciousness.The consciousness guide means comprises vision guide, language guiding and sense of touch guiding.
Prompting and guiding for vision, after characteristics of human body's real time video collection is handled, make second processing unit obtain the image information behind the two-value labelling and the both full-pixel information of bianry image foreground point by network interface, realize the synthetic of video by graphics process Unit second.Synthetic prospect animation, real-time portrait and background video three parts of having comprised of video.The prospect animation carries out the parameter transmission by MFC and Flash software interface to be realized; Background video is the various real scenes of gathering in advance.Prospect effect and background animation all have storehouse separately to deposit, and use for program to access.Extract the picture frame of virtual background in player window, the binary image homogeneous one that obtains behind coordinate and original real-time personage's video, the extraction personage is corresponding.Bianry image is labeled as the background image region of prospect, replaces the resulting human body image that is under the virtual background with the colored RGB image pixel of original every pixel 24 bits information.The prospect animation adopts the mode of transparent pinup picture to combine frame by frame with the front result.The output dynamic real-time of synthetic video shows, improves the feeling of immersion in psychotherapy's process.
Voice guide is cooperated in real time by shrink to be finished, for tactile prompting and guiding.Promptly give the patient real sense of touch at reasonable time.The present invention adopts wireless signal transmission module, and the miniature vibration motor of mated ends is realized the haptic effect device.Whole device is divided into transmitter and receptor two parts.Transmitter is responsible for sending with the coding of upper machine communication and wireless signal; Received signal is responsible for by receptor and haptic effect is given in decoding.The message management interface of system can be given sender unit by serial ports with transducing signal according to the difference of instruction.Signal in the transmitter arrives 2262 unlimited sending modules and carries out the wireless signal transmission through decoded operation and the follow-up drive circuit of single-chip microcomputer 89C52.Meanwhile, the receptor that contains 2272 wireless receiving modules that human body carries just can be according to the wireless signal that receives, and decoding translates different response messages, expresses by the perception device of terminal.
Effect of the present invention and benefit are: patient's mental status meeting changes along with the experience of scene, regulate reality environment, by vibrations, voice, vision mutual, the patient feels calm gradually and enters virtual environment, owing to photographic head, vibration motor, Mike are cheap, be convenient to the patient and adhere to training, pressure in effectively alleviation work, the life adds reality environment targetedly, adheres to that for a long time training can make patient's rehabilitation from mental illness come out.
The specific embodiment
Below in conjunction with Figure of description structure of the present invention and operation principle are described further:
A kind of psychotherapy system, the treatment step is as follows:
Step 1: the configuration of virtual scene, according to the physical characteristic and the imaging characteristics of CMOS photographic head, and the characteristics of human eye vision are arranged experimental situation.Adopt the COMS photographic head, its focusing range be 50mm to the infinity, maximum frame per second is 30fps, the image color figure place be 24 very color, the USB2.0 interface connects.The virtual reality glasses adopt the VG920C type video eyeglasses of iTheater company.Glasses are exported with the stereophony audio frequency by VGA interface receiving video signals.Ambient light is common daylight (the strong available incandescent lamp compensation of indoor and outdoor light contrast gets final product).Processing unit adopts two computers that become pipeline organization, and the core processing frequency is 2.66G.Selected 2262/2272 wireless transmission/receiver module carries out the vibration signal transmission, moves for the monomer personage in the experiment.
Step 2: the patient enters virtual scene
Because the physical characteristic of CMOS photographic head sensor devices, after the patient enters virtual scene, the patient to the distance of photographic head for requiring more than the 3m, guarantee the photosensitive effect of cmos device, avoid strong illumination or light dark excessively simultaneously, the video image size is 320 * 240 * 3, handles by the software under the MFC environment among the PC, and synthetic background is the video of AVI form.The display end of system has two, and one is to carry out the virtual reality glasses that virtual reality is experienced for the patient, and another is the display of the system PC control station of psychological guidance personnel operation.
Step 3: the virtual psychotherapy of patient
In virtual scene, the patient fully incorporates virtual environment, with own hight coordinate and unification on consciousness in the own and reality in the virtual environment, when action generations such as some stimulation in the virtual scene as beating, patient's real health produces corresponding impression, the computer corresponding data that transmission is returned according to health, after judging that virtual patient and the patient in the reality realize high unity, psychologic status according to the patient provides different treatment scene and therapeutic scheme, guiding patient's psychology is broken through mental maladjustment, reaches therapeutic purposes.Following example is made according to psychological educational circles famous " soft crisp Ovum Anas domestica " case, relaxation treatment scheme at psychentonia: after the patient puts on virtual glasses, at first appear at the patient at the moment be a face wall, the centre is a Yishanmen, on the patient is placed on hands door handle in the virtual scene, door is opened, bright and beautiful sunshine is arranged outdoors, azure sky, green meadow.The patient sits on the ground, and many white clouds are constantly wafted.After the patient simply answers some psychological problems of system by Mike, realize a quartzy Ovum Anas domestica gradually and appear at oneself head top, to patient's two shoulders, waist, shank constantly melts then, when being melted to corresponding organ, the patient can feel that this organ sites has the wet impression of respective wet.All dissolve back (by the control of the PC of system control station) etc. whole quartzy Ovum Anas domestica, finish virtual psychotherapy.