TWI566745B - Headset apparatus and associated simulating system and method - Google Patents

Description

Head mounted device and related simulation system, simulation method

The present invention relates to a head mounted device and related analog system and simulation method, and more particularly to a head mounted device for sensing physiological signals and related analog systems and simulation methods.

The average life expectancy of modern people is getting longer and longer, and as the age increases, various degradation phenomena gradually emerge. How to delay the occurrence of degradation at the same time as it grows older has become a subject that must be faced. Among them, the elderly are prone to degeneration due to neural wiring, which causes damage to brain cognitive function. The deterioration of nerve conduction affects the judgment and responsiveness of the elderly and creates the risk of falling out of balance and falling.

When the elderly fall, because the elderly often have high-community comorbiddiseases, such as osteoporosis, organ function deterioration, even a slight fall may pose a great danger. Even the fall has become the main cause of accidental death among the elderly over 65 years old.

In order to prevent the elderly from falling, the walking device and the walking stick are often used as an aid. However, the aids only provide passive prevention. In view of delaying the deterioration of nerve conduction in the elderly, the existing types of accessories have failed to provide effective prevention.

An embodiment of the present invention is an analog system comprising: a head mounted device having a plurality of sensing points for sensing a plurality of physiological signals; a converter, Electrically connected to the sensing points, which analyze the physiological signals and generate at least one parameter; and a context simulator electrically connected to the converter, which displays a virtual environment and according to the at least one parameter Adjust the context of the virtual environment.

Another embodiment of the present invention is a simulation method applied to a simulation system, the simulation method comprising the steps of: sensing a plurality of physiological signals; analyzing the physiological signals and generating at least one parameter; displaying a virtual environment; And adjusting the context of the virtual environment according to the at least one parameter.

A further embodiment of the present invention is a head mounted device, the signal being connected to a converter and a context simulator, comprising: a plurality of sensing points for sensing a plurality of physiological signals; and a transmitting module Transmitting the physiological signals to the converter, wherein the converter analyzes the physiological signals and generates at least one parameter, and the context simulator adjusts a context of a virtual environment according to the at least one parameter.

In order to better understand the above and other aspects of the present invention, the preferred embodiments are described below, and in conjunction with the drawings, the detailed description is as follows:

1‧‧‧simulation system

11, 21‧‧‧ head mounted devices

13, 23‧‧‧ converter

15, 25‧‧‧ Situation Simulator

17, 27‧‧‧ trigger

12‧‧‧ seats

13a‧‧‧First IIR bandpass filter

13b‧‧‧Second IIR bandpass filter

13c‧‧‧Third IIR bandpass filter

131, 231‧‧‧ Signal Processing Module

133, 233‧‧‧Signal Analysis Module

113, 213‧‧‧Transmission module

135, 235‧‧‧ receiving module

111a-111n, 211a-211n‧‧‧ Sensing points

Figure 1 is a schematic illustration of an analog system in accordance with an embodiment of the present invention.

Figure 2 is a flow chart of the simulation method of the present invention.

Figure 3 is a schematic view of the user wearing the head mounted device on the head.

Figure 4 is a plan view of the head mounted device of the present invention.

Figure 5 is a schematic diagram showing the relative potentials and corresponding parameters of the sensing points formed by the head mounted device of the present invention.

Figure 6 is a schematic diagram showing the generation of parameters after sensing physiological signals of the present invention.

Figure 7, which is a flow chart for opening a trigger based on the sensory motion rhythm energy state.

Fig. 8A is a schematic diagram showing the state of the sensory motor rhythm energy in a general state.

Figure 8B is a schematic diagram of the use of a sensory motion rhythm energy matching trigger.

Fig. 9 is a schematic diagram showing the change of the energy of the rhythm of the motion with respect to time in response to whether the trigger generates a trigger signal or not.

Figure 10, which is based on the trigger signal generated by the trigger, the sensory motor rhythm A schematic diagram of the amount versus frequency change.

Fig. 11 is a schematic diagram of sensing an physiological signal of an eye movement using an eye movement sensing point.

Figure 12A is a schematic diagram of the physiological signal of the eye movement when the user looks to the right.

Figure 12B is a schematic diagram of the physiological signal of the eye movement wave when the user looks to the left.

Figure 13 is a flow chart for determining the direction of the user's line of sight based on the physiological signal of the eye movement.

Figure 14, which is a block diagram of the internal construction of the simulation system of the present invention.

Figure 15 is another block diagram of the internal construction of the simulation system of the present invention.

The present invention provides a simulation system, a simulation method, and a head mounted device for human brain development. The present invention utilizes various physiological signals to provide an idea of an interactive situational game, and its use is quite extensive. In addition to its use to prevent degeneration of the elderly's brain, it can also be used for infants' sensory integration and balance training. Furthermore, the present invention can also provide the selection and matching function of the augmented context product according to the sensing result of the physiological signal, or provide the selection service according to the future brain wave, determine the consumer pricing, and provide the mind development.

Please refer to FIG. 1 , which is a schematic diagram of a simulation system according to an embodiment of the present invention. The simulation system 1 of this embodiment includes a head mounted device 11, a converter 13, a situation simulator 15, and a flip-flop 17.

The head mounted device 11 has a plurality of sensing points (not depicted) for sensing physiological signals. Converter 13 is used to analyze physiological signals and generate parameters. The context simulator 15 is used to display a virtual environment. When the user views the virtual environment, it seems to be in the virtual environment, and the location can be moved in the virtual environment according to the user's idea. For example, the situation simulator 15 can be used with the application software to let the user feel that he is driving. Among them, it is assumed that the parameters such as the speed and direction of the car correspond to the physiological parameters of the user. That is, let the user change the moving speed and direction of the car (or object carrier) according to its own idea and attention.

While the user uses the context simulator 15, the head mounted device 11 continuously senses the physiological signals of the user through the sensing points. These physiological signals are transmitted through The conversion of the device 13 forms a more understandable parameter. The parameters may include: an instantaneous kinetic energy parameter, an instantaneous balance parameter, an instantaneous direction parameter, an interest degree parameter, and the like. The instantaneous kinetic energy parameter may correspond to the control of the moving speed, the instantaneous direction parameter may correspond to the direction control, and the interest degree parameter may correspond to the user's preference for various types of transactions.

After these parameters are provided to the context simulator 15, the context simulator 15 can adjust the context of the virtual environment based on the parameters. For example, when the value of the instantaneous kinetic energy parameter is larger, the context simulator 15 controls the display screen through the application software, so that the user feels that the acceleration is being accelerated. Alternatively, when the immediacy direction parameter corresponds to the left turn, the context simulator 15 controls the display screen through the application software, so that the user can generate the feeling of being currently moving forward and turning left.

The user sits on the seat 12 when the user uses the simulation system. Among them, a trigger 17 is provided below the seat. The trigger signal generated by the trigger 17 can stimulate the user through the seat 12. In conjunction, the user's mental state and mind will be stimulated and triggered. Accordingly, the parameters will change as a result of the trigger signal being generated.

Please refer to Fig. 2, which is a flow chart of the simulation method of the present invention. The simulation method of the present invention comprises the steps of: sensing a plurality of physiological signals (step S1); analyzing the physiological signals and converting the physiological signals into immediate kinetic energy parameters, instantaneous balance parameters, instantaneous direction parameters, interest degree parameters, etc. (steps S3); displaying the virtual environment, and adjusting the context of the virtual environment according to the parameters (step S5). In the general case, steps S1, S3, and S5 are processes performed by the analog system cycle. Furthermore, the simulation method of the present invention can further generate a trigger signal and perform feedback (step S7). The simulation method of the present invention further forms a loop process by the generation of the trigger signal.

Please refer to FIG. 3, which is a schematic diagram of the user wearing the head mounted device on the head. As mentioned above, there are multiple sensing points (Fz, G, Fp1, Fp2, E1, E2, A1, A2) on the head mounted device. Of course, in actual applications, the number and location of sensing points are not limited to this.

When the user puts on the head mounted device 11, the sensing point will be attached to User's head. Depending on the sensing position, the sensing points can be classified into: brain wave sensing points (Fz, Fp1, Fp2), eye wave sensing points (E1, E2), and grounding sensing points (G). Among them, brain wave sensing points (Fz, Fp1, Fp2) are used to sense physiological signals of electroencephalogram (EEG). The eye movement sensing points (E1, E2) are used to sense physiological signals of electrooculography (EOG).

In Fig. 3, the electroencephalogram sensing point includes a central electroencephalogram sensing point Fz, a left electroencephalogram sensing point Fp1, and a right electroencephalogram sensing point Fp2. The central brain wave sensing point Fz is attached to the front half of the center line of the user's head and is used to sense the central brain wave physiological signal. The left brain wave sensing point Fp1 is attached to the upper left of the user's forehead and is used to sense the physiological signal of the left brain wave. The right brain wave sensing point Fp2 is attached to the upper right side of the user's forehead and is used to sense the right brain wave physiological signal.

As described above, the brainwave physiological signals sensed by the head mounted device 11 include: a central brain wave physiological signal, a left brain wave physiological signal, and a right brain wave physiological signal. The invention can calculate the sensorimotor rhythm (SMR) energy according to the central brain wave physiological signal.

In an embodiment, the sensory motor rhythm energy may define/represent the immediacy kinetic energy parameter when the virtual environment is displayed. Moreover, the present invention sets the speed at which the context simulator converts the virtual environment to a positive correlation with the level of the sensory motion rhythm energy. On the other hand, the α, β, θ, and δ wave energies are obtained by using the left brain wave physiological signal and the right brain wave physiological signal. The α, β, θ, and δ wave energies correspond to the instantaneous balance parameters when the virtual environment is displayed.

In another embodiment, the gamma wave energy is derived using the left brainwave physiological signal and the right brainwave physiological signal. And, the sensed sensory motor rhythm energy and the gamma wave energy are converted into an interest degree parameter. After the interest level parameter is sensed, the virtual environment may further determine the user's preference with reference to the interest level parameter. Also, the virtual environment will adjust the displayed screen according to the interest level parameter. For example: firstly sense the sensed motion rhythm energy and gamma wave energy conversion After the interest level parameter, the interest degree parameter is identified and interpreted. When the interest degree parameter indicates that the user likes the mountain forest, the user is allowed to see the display screen of the mountain forest; and when the interest degree parameter represents that the user likes the underwater world, the user is allowed to see the display screen of the underwater world.

In FIG. 3, the eye movement sensing point includes: a left eye movement sensing point E1 and a right eye movement sensing point E2. The left eye movement sensing point E1 is attached to the left side of the left eye of the user by about one centimeter for sensing the physiological signal of the left eye movement. The right eye movement sensing point E2 is attached to the right side of the user's right eye about one centimeter for sensing the physiological signal of the right eye movement wave. Wherein, after taking the difference between the physiological signal of the left eye movement and the physiological signal of the right eye movement, the difference is defined as the physiological signal of the differential eye movement. And, the differential eye wave physiological signal corresponds to an instantaneous direction parameter when the virtual environment is displayed. The instantaneous direction parameter is used to determine the direction in which the context simulator converts the virtual environment.

Please refer to Fig. 4, which is a plan view of the head mounted device of the present invention. Each sensing point of the head mounted device can utilize electrodes to conduct physiological signals. The material of the electrode need not be limited, and any conductive material can be used in combination. Depending on the number of electrodes required to sense the physiological signal, the electrode sensing approach can be distinguished as: a bipolar electrode or a unipolar electrode. When the bipolar electrode is used, the electrode system of the ground sensing point G is attached to the front half of the center line of the user's head, and a potential difference is formed with the remaining sensing points. When using a single-pole electrode, simply connect the individual sensing points to capture the corresponding physiological signal. Hereinafter, the connection method using the bipolar electrodes will be described with reference to Fig. 5.

Please refer to FIG. 5, which is a schematic diagram showing the relative potentials and corresponding parameters of the sensing points formed by the head mounted device of the present invention. This table further clarifies how the relative potential measured at each sensing point is used as a basis for judging the virtual environment.

The potential difference (E1-G) between the left eye movement sensing point E1 and the ground sensing point G is used as the first channel CH1. And, the physiological signal measured by the first channel CH1 is defined as a left eye motion wave physiological signal. Similarly, using the right eye movement A potential difference (E2-G) between the sensing point E2 and the ground sensing point G is used as the second channel CH2. And, the physiological signal measured by the second channel CH2 is defined as a right eye motion wave physiological signal. Here, the difference between the right eye movement physiological signal and the left eye motion physiological signal is used to define the differential eye movement physiological signal.

The potential difference (Fz-G) between the central brain wave sensing point Fz and the ground sensing point G is used as the third channel CH3. And, the central brainwave physiological signal is measured by the third channel CH3. The central brainwave physiological signal can be used to calculate the SMR energy. Moreover, the SMR energy corresponds to the instantaneous kinetic energy parameter of the virtual environment, which is equivalent to the speed of the virtual environment.

The potential difference (Fp1-G) between the left electroencephalogram sensing point Fp1 and the ground sensing point G is used as the fourth channel CH4. And, the left brain wave physiological signal is measured by the fourth channel CH4. The left brain wave physiological signal can be used to determine the balance state of the left brain. Therefore, the left brain wave physiological signal corresponds to the instantaneous balance parameter of the virtual environment, which is equivalent to the balance sensing function of the virtual environment.

The potential difference (Fp2-G) between the right brain wave sensing point Fp2 and the ground sensing point G is used as the fifth channel CH5. And, the right brain wave physiological signal is measured by the fifth channel CH5. The right brainwave physiological signal can be used to determine the balance of the right brain. Therefore, the right brain wave physiological signal corresponds to the instantaneous balance parameter of the virtual environment, which is equivalent to the balance sensing function of the virtual environment.

In addition, the central brain wave physiological signal, the left brain wave physiological signal, and the right brain wave physiological signal may also correspond to the interest level parameter. In addition to the aforementioned electroencephalogram sensing points and eye movement sensing points, the head mounted device 11 may also include more sensing points. For example, the sensing points A1, A2 listed here can measure other types of EMG signals through the reference electrode. Of course, various types of EMG signals and corresponding physiological features can also be used as a reference for adjusting the virtual environment.

Please refer to FIG. 6 , which is a schematic diagram of parameters generated after the physiological signal is sensed by the present invention. This figure further illustrates steps S1 and S3 of Fig. 2.

In the foregoing process, step S1 may further include sub-steps of detecting each physiological signal, for example, using a central brain wave sensing point and a ground sensing point (CH3) Sensing the central brain wave physiological signal; using the left brain wave sensing point and the grounding sensing point (CH4) to sense the left brain wave physiological signal; using the right brain wave sensing point and the grounding sensing point (CH5) to sense the right brain Radio wave physiological signal; sensing the left eye movement wave physiological signal by using the left eye movement wave sensing point and the ground sensing point (CH2); and sensing the right side by using the right eye movement wave sensing point and the ground sensing point (CH1) Eye movement physiological signals, etc.

Furthermore, step S3 may further include the steps of: amplifying the physiological signal after receiving the physiological signal (step S31); removing the filtered physiological signal, filtering the noise (step S22), and filtering processing (step S35).

For different types of physiological signals, step S35 can be used with different types of filters. For example: for the right eye movement physiological signal and the left eye movement physiological signal, the first IIR bandpass filter 13a with a frequency of 1-5 Hz is used; for the central brain wave physiological signal, the second IIR with a frequency of 12-15 Hz is used. The band pass filter 13b; and the right side brain wave physiological signal and the left brain wave physiological signal are filtered by the third IIR band pass filter 13c to obtain α, β, θ, δ, γ waves.

Thereafter, the filtered physiological signal is converted from the analog format to the digital format (step S37); and the physiological signal of the digital format is analyzed to generate a parameter (step S39).

See Figure 7, which is a flow chart for turning on the trigger based on the SMR energy state. First, it is judged whether or not the SMR energy is lower than the energy lower limit threshold (step S71). If the result of the determination in the step S71 is negative, the representative trigger 17 does not need to be activated, so the flow ends. If the result of the determination in the step S71 is affirmative, the trigger 17 is turned on, and the trigger signal (Schumann resonance wave) is generated by the flip-flop 17 (step S73). Thereafter, when the physiological signal is measured again, the SMR energy is increased (step S75). Furthermore, it is judged whether or not the SMR energy is higher than the energy upper limit threshold (step S77). If the decision result in the step S77 is affirmative, the trigger 17 is turned off (step S79). On the other hand, if the decision result in the step S77 is negative, the trigger 17 is continuously turned on (step S73). Regarding the effect of the trigger 17 on the SMR energy, reference is made to the description of Figures 8A, 8B, 9, and 10.

Please refer to Figure 8A, which shows the SMR energy in a general state. intention. This figure represents a change in the SMR energy parameter when the user is in general use. When the SMR energy parameter is in this interval, the user feels that his movement speed in the virtual environment is substantially stable and is not too fast or too slow.

See Figure 8B for a schematic representation of the SMR energy matching trigger. When the user's attention is less concentrated or weaker, the value of the SMR energy parameter converted from the physiological signal is also lower. Figure 8B assumes that the SMR energy parameter converted from the physiological signal is always below the energy lower threshold before the first time point t1. At this point, the user feels that the movement speed in the virtual environment is very slow, and may even cause stagnation.

It is assumed here that the flip-flop 17 generates a trigger signal at the first time point t1. According to an embodiment of the invention, the trigger 17 is a Schumann resonance generator and the trigger signal is between 12-15 Hz. For example, the trigger signal is a Schumann resonance wave (14 Hz). The generation of the Schumann resonance wave has an effect of giving feedback to the user. Further, the physiological signal sensed by the user also changes in response to the feedback resonance. According to this, the converted SMR energy will start to increase at the first time point t1. At this point, the user feels that his movement speed in the virtual environment is greatly increased, which is similar to the phenomenon of stepping on the accelerator.

When the SMR energy is above the energy upper threshold, the trigger 17 can stop generating the trigger signal at the second time point t2. When the trigger 17 just stops generating the trigger signal at the second time point t2, the user's SMR energy can still be maintained for a period higher than the energy upper threshold.

Thereafter, the SMR energy begins to decrease at the third time point t3. It is assumed here that the SMR energy after the third time point t3 is maintained between the energy upper limit threshold and the energy lower limit threshold. Therefore, the trigger 17 does not need to be restarted. It can be seen that the use of the trigger 17 can achieve the effect of improving the instantaneous SMR energy of the brain wave.

See Figure 9, which is a schematic diagram of SMR energy versus time, depending on whether the trigger generates a trigger signal or not. In this figure, the vertical axis represents the amplitude of the SMR energy and the horizontal axis represents the time. Here, the line segment L1 represented by a broken line corresponds to a case where the SMR energy is changed with respect to time when the trigger 17 is not turned on. The line segment L1' represented by a solid line corresponds to a case where the SMR energy is changed with respect to time when the trigger 17 is turned on and a Schumann resonance wave is generated. According to this figure, it can be seen that when the trigger 17 is turned on and the Schumann resonance wave is generated, the SMR energy is high.

See Figure 10, which is a schematic diagram of SMR energy versus frequency change in response to a trigger signal generated by a trigger. In this figure, the vertical axis represents SMR energy and the horizontal axis represents time. Wherein, the line segment L1 represented by a broken line corresponds to a case where the SMR energy changes with respect to the frequency when the trigger is not turned on. The line segment L1' represented by a solid line corresponds to a case where the SMR energy is changed with respect to frequency when the flip-flop 17 is turned on and a Schumann resonance wave is generated. According to this figure, it can be seen that when the flip-flop 17 is turned on and the Schumann resonance wave is generated, the energy corresponding to the SMR band (12 to 15 Hz) is high.

Please refer to Fig. 11, which is a schematic diagram of sensing the physiological signals of the eye waves by using the eye movement sensing points. When humans turn left and right, usually the eyeball will first turn in the direction of going. In conjunction, when the eyeball rotates, the cornea and retina produce a large potential change. Therefore, the converter can determine the direction of the eyeball rotation based on the waveform of the eye movement wave. In this figure, the ground sensing point is connected to the user's eyebrow position. The left eye movement sensing point E1 is set to about one centimeter to the left of the left eye, about the position between the user's left eye and the left temple, and the right eye movement sensing point E2 is set to about one centimeter to the right of the right eye. At about the position between the user's right eye and the right temple.

Please refer to Fig. 12A, which is a schematic diagram of the differential eye movement physiological signal when the user looks to the right. When the eyeball moves to the right, the differential eyewave physiological signal will exhibit a negative potential shift. It can be seen from this figure that the physiological signal of the differential eye movement wave will be pulled down quickly, then pulled up, and then resumed.

Please refer to Fig. 12B, which is a schematic diagram of the differential eye movement physiological signal when the user looks to the left. When the eyeball moves to the left, the differential eyewave physiological signal will exhibit a positive potential shift. It can be seen from this figure that the physiological signal of the differential eye movement wave will be pulled up quickly, then pulled down and then restored.

Please refer to Figure 13, which is based on the physiological signal of differential eye movement. A flow chart that breaks the direction of the user's line of sight. First, the left eye movement physiological signal and the right eye motion physiological signal are received (step S301), and IIR band pass filtering is performed (step S303). Thereafter, the differential eye wave physiological signal is calculated, and it is judged whether or not the slope of the differential eye wave physiological signal is changed and the amplitude exceeds 80 μV (step S305).

If the result of the determination in step S305 is negative, it is determined that the user's eyeball has not moved (step S309). If the result of the determination in step S305 is affirmative, the eyeball representing the user is moved. At this time, it is further determined why the user's eyeball moves in the direction.

Next, it is judged whether or not the slope of the differential eye wave physiological signal is negative from positive (step S307). If the result of the determination in step S307 is affirmative, the eyeball is moved to the right (step S311, see Fig. 12A). If the result of the determination in step S307 is negative, it means that the eyeball is moved to the left (step S313, see Fig. 12B).

The following is a block diagram of the possible two analog systems. The dotted line between the devices represents the signal connection, that is, various types of wired (such as: USB data lines, network routes, etc.) or wireless transmission (such as: Bluetooth, wireless network, near field communication, etc.) can be used. .

Please refer to Fig. 14, which is a block diagram showing the internal construction of the simulation system of the present invention. The head mounted device 11 includes a plurality of sensing points 111a-111n and a transfer module 113. The sensing points 111a-111n and the transfer module 113 are connected to each other. The transmitting module 113 can transmit the physiological signals sensed by the sensing points 111a-111n to the receiving module 135 of the converter 13 through various wired or wireless methods.

The converter 13 includes a receiving module 135, a signal processing module 131, and a signal analyzing module 133. The signal processing module 131 is electrically connected to the receiving module 135. After receiving the physiological signal, the signal processing module 131 amplifies the physiological signal, removes the noise and the filtering process, and then converts the physiological signal into an analog format. The signal analysis module 133 analyzes the physiological signals in the digital format to generate parameters. The converter 13 can be electrically connected to the context simulator 15 via a data transmission line; or the converter 13 can transmit parameters to the context simulator 15 via a wired network or a wireless network for use as a screen content for adjusting the virtual environment. In addition, the trigger 17 is used to respond to the situational mode. The simulator 15 and the parameters generate a trigger signal.

According to the concept of the invention, the trigger 17 does not directly control the head mounted device 11. First, the user is stimulated by the trigger 17, which in turn causes the physiological signals measured by the sensing points 111a-111n to change. At this time, the context simulator 15 will change the screen content of the virtual environment. Accordingly, the physiological signal of the user sensed via the head mounted device 11 will be changed by seeing the changed picture content.

In actual application, the appearance and form of the converter 13 need not be limited. The converter 13 may be partially embedded in the head mounted device 11 and partially integrated into the context simulator 15. Figure 15 is a block diagram of another implementation of the simulation system. Of course, the actual application and implementation of the analog system can also be used in other types of architecture.

Please refer to Fig. 15, which is another block diagram of the internal construction of the simulation system of the present invention. The internal structure of the simulation system of Fig. 14 and Fig. 15 is substantially similar. The difference between the two is that the interior of the converter 23 is integrated into the head mounted device 21 and the context simulator 25, respectively.

The physiological signals measured by the head-mounted device 21 through the sensing points 211a-211n are amplified by the signal processing module 231, filtered, filtered, IIR filtered, analog-digital converted, and transmitted to the transmitting module 213 to The receiving module 235. The receiving module 235 further transmits the physiological signals of the digital format to the signal analysis module 233 that is electrically connected to each other. After analyzing the physiological signal of the digital format, the signal analysis module 233 generates parameters as a reference basis for the context simulator 25 to display the virtual environment. In addition, the trigger 27 is used to generate a trigger signal in response to the context simulator 25 and parameters. The trigger 27 does not directly control the head mounted device 11, but changes the physiological signal measured by the sensing points 211a-211n by generating an image to the user.

In one embodiment of the invention, Monster Milktruck is disclosed on the Internet using Google Earth. Users can control the car to move on Google Earth. Where, the size of the SMR energy is used to control the car to advance or stop; The movement of the eyeball controls the car to turn left and right. Allow users to navigate in Google Earth in an intuitive way. Embodiments of the present invention further test the time it takes for three subjects to arrive at the Eiffel Tower from the center of Paris in the virtual environment of Google Earth. In addition, three tests were repeated for each subject.

For the first subject, the time taken to perform three tests was 213 seconds, 167 seconds, and 128 seconds. For the second subject, the time taken to perform three tests was: 122 seconds, 55 seconds, and 34 seconds. For the third subject, the time spent performing three tests was 184 seconds, 114 seconds, and 93 seconds.

It can be seen from the experimental results that each subject needs to spend more time to reach the destination during the first test. However, after being familiar with the manipulation interface and learning how to regulate their own balance and sensory motion rhythms, the subject can complete the test in a short period of time. Accordingly, the simulation system of the present invention allows the subject to grasp the essentials of each control through practice, fine-tuning and balancing the left and right directions, and maintaining a certain speed and shortening the arrival time. The process of this kind of exercise can promote the balance of the brain of the user and achieve the effect of stimulating the operation of the brain.

In accordance with an embodiment of the present invention, in conjunction with a brainwave response and context simulator, an analog system is provided that produces an effect that mimics the world. The Situation Simulator can be used with the Google Earth database to allow users to view the map, topographic maps, 3D buildings, etc., by arbitrarily selecting the location to be on the Earth. Alternatively, the Situation Simulator can be paired with Google Sky's database to allow users to explore the galaxy and explore rich geographic content in the sky. The virtual environment displayed by the situation simulator can be displayed through the display panel, the virtual reality glasses, and the projection device. Moreover, the virtual environment can be displayed using a flat display mode or a stereoscopic display mode.

In addition to the flexibility of the selection of the database, the context simulator of the present invention can also change the complexity of the virtual environment. That is, the presented virtual environment is adjusted corresponding to the degree of response of the user.

For example: for users of the initial level, assume the situation simulator The virtual environment shown is the Nevada desert. In this virtual environment, there are only a few virtual obstacles, and the simulation system is based on training basic balance perception.

Secondly, for users of intermediate level, it is assumed that the virtual environment displayed by the situation simulator is Egypt, Sydney, etc., although these areas are still relatively open despite the existence of construction. At this time, the simulation system is mainly based on training high response and balance perception.

Furthermore, for high-level user-level trainers, the situation simulator can display bustling metropolitan areas such as Taipei and Tokyo. In these virtual environments, users must avoid virtual obstacles such as vehicles and pedestrians. This type of virtual environment is suitable for training highly responsive, balanced, and sensory integration.

According to another embodiment of the invention, the simulation system can be used in conjunction with a commercial website. For example, the physiological signal of the subject is sensed through the head-mounted device, and the degree of interest parameter obtained from the physiological signal is used to determine the degree of preference of the subject for various transactions or items. Then, according to the sensed interest degree parameter, the context simulator is used to display the personalized image corresponding to the subject. For example, for a subject who likes outdoor activities, information about equipment required for outdoor activities is displayed. This embodiment can be further utilized in conjunction with a variety of websites that provide goods or services, thereby providing a more versatile type of goods or services that the user desires.

Through the headset, the simulation method, and the simulation system of the present invention, the user can stimulate the development of the cranial nerve through the virtual environment. For the elderly, the simulation system can maintain the stimulation of the cranial nerves without the need for too much physical strength, so as to avoid the effects of the disuse syndrome. The use of simulation systems as a low-risk exercise for rehabilitation is highly secure and reduces the risk of field training. Therefore, the headgear, the simulation method, and the simulation system of the present invention can also be applied to a limb assist or a game aid such as autism or depression.

Of course, the simulation system of the present invention can also be used by ordinary people as a training attention, exercise control idea, and the like. For example, the head mounted device, the simulation method, and the simulation system of the present invention can also allow children to perform sensory integration and balance training through a virtual environment. Or, after sensing the degree of interest of the subject, providing the function of augmenting the situational product selection according to the mode of interest of the user, and For the purpose of spiritual development.

It will be apparent to those skilled in the art that, in the foregoing description, various logical blocks, modules, circuits, and method steps may be implemented by electronic hardware, computer software, or a combination of both. And the manner of connection between the implementations, whether the above description uses signal connection, connection, coupling, electrical connection or other types of alternatives, the purpose is only to illustrate the implementation of logic blocks, modules In the circuit, method and method steps, the exchange and transmission of signals, data and control information can be achieved through different means. Therefore, the terms used in the specification will not form a limitation in the case of the connection between the case, and will not deviate from the scope of the case due to the difference in the way of connection.

In conclusion, the present invention has been disclosed in the above preferred embodiments, and is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

1‧‧‧simulation system

11‧‧‧ head mounted device

13‧‧‧ converter

15‧‧‧Scenario Simulator

17‧‧‧ Trigger

12‧‧‧ seats

Claims (22)

An analog system comprising: a head mounted device having a plurality of sensing points for sensing a plurality of physiological signals; a converter electrically coupled to the sensing points for analyzing the physiological signals and generating At least one parameter, wherein the at least one parameter is an immediate kinetic energy parameter, an immediate balance parameter, an instantaneous direction parameter, and an interest degree parameter; and a context simulator electrically connected to the converter Displaying a virtual environment and adjusting the context of the virtual environment according to the at least one parameter. The simulation system of claim 1, wherein the sensing points comprise: a central brain wave sensing point attached to a front half of a center line of the user's head, and used Sensing a central brainwave physiological signal; a left brainwave sensing point attached to the left frontal lobe of the user and used to sense a left brainwave physiological signal; a right brainwave sensing point Attached to the right frontal lobe of the user and used to sense a right brain wave physiological signal; a left eye movement wave sensing point attached to the left eye of the user and used The first eye movement wave physiological signal is sensed; and a right eye movement wave sensing point is attached to the right eye of the user and used to sense a right eye motion wave physiological signal. The simulation system of claim 2, wherein the sensing points further comprise: a grounding sensing point attached to a front half of a center line of the user's head, and the rest The sensing points form a potential difference. The simulation system of claim 2, wherein the central brainwave physiological signal corresponds to an instantaneous kinetic energy parameter. The analog system of claim 1, further comprising: a trigger electrically connected to the converter, which generates a trigger signal, wherein the at least one parameter is changed due to the generation of the trigger signal . The simulation system of claim 5, wherein the trigger is a Schumann resonance wave generator, and the trigger signal is a Schumann resonance wave having a frequency between 12-15 Hz. The simulation system of claim 5, wherein the trigger signal is a Schumann resonance wave having a frequency between 12 and 15 Hz. The simulation system of claim 1, wherein the virtual environment is a Google Earth or a Google Sky. The simulation system of claim 1, wherein when a user wears the head mounted device, the sensing points are attached to the user's head. The analog system of claim 1, wherein the converter comprises: a signal processing module electrically connected to the sensing points, after receiving the physiological signals, the physiological signals Amplifying, removing noise and filtering, thereby converting the physiological signals into a digital format; and a signal analysis module analyzing the physiological signals of the digital format and generating the at least one parameter. A simulation method for an analog system including a head mounted device, the simulation method comprising the steps of: sensing a plurality of physiological signals through the head mounted device; analyzing the physiological signals and generating at least one parameter, wherein The at least one parameter is an instantaneous kinetic energy parameter, an instantaneous balance parameter, an immediate direction parameter, and an interest degree parameter; displaying a virtual environment; and adjusting a context of the virtual environment according to the at least one parameter. The simulation method of claim 11, wherein the step of sensing the physiological signals comprises the step of sensing a central brainwave physiological signal at a position in the front half of the centerline of the head. The simulation method of claim 11, wherein the step of sensing the physiological signals comprises the steps of: sensing a left brain wave physiological signal at a position of the left prefrontal lobe; A right brain wave physiological signal is sensed at the position of the right prefrontal lobe. The simulation method of claim 11, wherein the step of sensing the physiological signals comprises the steps of: sensing a left-eye eye wave physiological signal on the left side of the left eye; and sensing on the right eye right side A right eye movement wave physiological signal. The simulation method of claim 11, further comprising the step of generating a trigger signal, wherein the trigger signal causes a change in the instantaneous kinetic energy parameter. The simulation method of claim 15, wherein the step of generating the trigger signal comprises the steps of: generating the trigger signal when the instantaneous kinetic energy parameter is lower than an energy lower threshold; and when the instantaneous kinetic energy When the parameter is higher than the energy upper threshold, the trigger signal is stopped. The simulation method of claim 11, wherein the step of analyzing the physiological signals and generating the at least one parameter comprises the steps of: receiving the physiological signals; amplifying the physiological signals, removing noise and Filtering, wherein the physiological signals are converted from an analog format to a digital format; and the physiological signals of the digital format are analyzed to generate the at least one parameter. A head mounted device is coupled to a converter and a context simulator, comprising: a plurality of sensing points that sense a plurality of physiological signals; and a transmitting module that transmits the physiological signals to The converter, wherein the converter analyzes the physiological signals and generates at least one parameter, and the context simulator adjusts a context of a virtual environment according to the at least one parameter, wherein the at least one parameter is an instantaneous kinetic energy parameter , an instantaneous balance parameter, an instantaneous direction parameter, and an interest degree parameter. The head mounted device of claim 18, wherein the sensing points comprise: a central brain wave sensing point attached to a front half of a center line of the user's head. And used to sense a central brainwave physiological signal. The head-mounted device of claim 18, wherein the sensing points comprise: a left brain wave sensing point attached to a position above the left frontal lobe of the user and used for Sensing a left brain wave physiological signal; and a right brain wave sensing point attached to the position of the user's right frontal lobe and for sensing a right brain wave physiological signal. The head-mounted device of claim 18, wherein the sensing points comprise: a left-eye eye wave sensing point attached to the left side of the user's left eye and used for sensing A left-eye eye wave physiological signal is measured; and a right-eye eye wave sensing point is attached to the right eye of the user and used to sense a right eye motion wave physiological signal. The head mounted device of claim 18, wherein the head mounted device further comprises: a grounding sensing point attached to a front half of a center line of the user's head, and A potential difference is formed with the remaining sensing points.