WO2019015765A1

WO2019015765A1 - Apparatus for measuring or training an emotion or behavior

Info

Publication number: WO2019015765A1
Application number: PCT/EP2017/068409
Authority: WO
Inventors: Johannes FUSS; Daniel BIEDERMANN; Tim KURJAK
Original assignee: Universitätsklinikum Hamburg-Eppendorf; Dessoi Advanced Technologies Gmbh
Priority date: 2017-07-20
Filing date: 2017-07-20
Publication date: 2019-01-24

Abstract

An apparatus(1) for measuring or training an emotion or behavior (21) of a subject (2), wherein said emotion or behavior (21) is triggered or fostered by a specific sensory stimulus (22) and wherein the apparatus (1) comprises: a test area (3) comprising at least a first area (31) and a second area (32) between which the subject(2) is able to move; and stimulation means (4) that are configured to deliver a sensory impression (41) to the subject (2), wherein in said sensory impression (41), the first area (31) and the second area (32) are associated with different amounts of the sensory stimulus (22). A method (100) to align the sensory impression (41) delivered by stimulation means (4) to a test area (3).

Description

Apparatus for measuring or training an emotion or behavior

The invention relates to tools for the measuring or training an emotion or behavior of a subject, and for the alignment of stimulation means in general.

Background

There are certain stimuli to which certain humans react with a strong emotion or behavior, such as anxiety. For example, a human may be susceptible to vertigo and fear when exposed to height or depth as a stimulus, or may be susceptible to kinetosis when different senses of his body convey contradictory information about motion to his brain. Presently, there is no practical way to test a human subject whether he is susceptible to vertigo, kinetosis, unconditioned anxiety or other strong reactions because the corresponding stimulus cannot be created in a laboratory setting in a manner that appears "convincing" to the subject's brain. The subject therefore only learns that he is susceptible when a real situation containing a sufficient amount of the stimulus arises. This may have unpleasant consequences (e.g., if a boat trip is spent vomiting), and may also be a safety hazard (e.g., if a construction worker is suddenly overwhelmed by vertigo and unable to move any further on his own).

For rodents and other small laboratory animals, a test tool is available. It is known under the term "elevated plus maze", EPM, and comprises a plus-shaped structure with two open and two enclosed arms. The animal is placed at the intersection point, and it is measured whether the animal ventures onto the open arms or whether an aversion against heights or open spaces coerces the animal into the apparent safety of the enclosed arms. This test is used commercially, e.g., in the screening of drug compounds that are supposed to relieve anxiety. For humans, the EPM is not practicable. To create a sufficiently strong stimulus, the open arms would have to be elevated so high above the ground that safety measures against injury by falling off the EPM would have to be put into place. These safety measures would in turn tell the subject's brain that there is no danger, negating the effect of the intended stimulus.

Objective of the invention

It is therefore the objective of the invention to provide a tool with which a human subject can be tested for reactions to stimuli that previously could not be created in a laboratory setting in a sufficiently realistic manner. To this end, the invention provides an apparatus and a corresponding computer product, as well as an alignment method and a corresponding computer program product. Advantageous embodiments are given in the respective dependent claims.

Disclosure of the invention

The invention provides an apparatus for measuring or training an emotion or behavior of a subject, wherein said emotion or behavior is triggered or fostered by a specific sensory stimulus. The apparatus comprises:

a test area comprising at least a first area and a second area between which the subject is able to move; and

stimulation means that are configured to deliver a sensory impression to the subject, wherein in said sensory impression, the first area and the second area are associated with different amounts of the sensory stimulus. It was found that by augmenting the test area with the stimulation means, surprisingly, the sensory stimulus may be delivered to the subject so convincingly that it is taken for real by the subject's brain. In other words, the stimulation means uncouple the amount of the sensory stimulus delivered from the physical properties of the test area. In addition, compared with just taking the subject outside to a setting where the stimulus is present, the amount of the stimulus is more controllable. This means that the apparatus can be used to measure the degree of the emotion or behavior more accurately: the reaction of the subject can be measured as a function of the amount of stimulus delivered. The reaction of the subject may depend on the amount of stimulus in a non-linear manner. For example, there may be a threshold amount required to trigger any reaction at all. The possibility to control the amount of the stimulus also has the effect that the apparatus can be used for training. For example, a worker intending to work at heights may be exposed to increasing levels of vertigo- inducing height as a stimulus in order to become immune against vertigo.

In a very simple exemplary embodiment, the test area including the first area and the second area may be drawn or projected on a surface, such as a floor. The first area may then, for example, be surrounded by pictures containing a first amount of the sensory stimulus, and the second area may be surrounded by pictures containing a second, higher amount of the sensory stimulus. The pictures therefore serve as the stimulation means.

The sensory impression may include a representation of the test area that is spatially aligned to the test area. By suitably adapting this representation, the stimulus may be pointed out even more. For example, when height or depth is conveyed as a stimulus, the representation of the first area may be something that suggests solid ground (e.g., a pavement), while the representation of the second area may be something that suggests a height (e.g., an open mesh flooring or a diving board).

However, the sensory impression may also be designed around the test area, i.e., it may be designed not to contain a representation of the test area.

In a specially advantageous embodiment of the invention, the test area comprises at least one structure that is physically distinguishable from the surrounding environment, so as to be stepped onto or into by the subject. Specifically, the structure may be walk-on-able by the subject. For example, the test area may be distinguishable from the surrounding environment in a haptic manner, i.e., the subject may be able to feel a boundary of the test area somehow. For example, the test area may be surrounded by some sort of feelable barrier against which the subject can brush when moving. The structure may also, for example, be a protrusion above the surrounding environment, a recess within the surrounding environment, or have a ground with a texture that is different from the texture of the ground in the surrounding environment, so that the subject may feel when his feet hit or cross the boundary of the test area, or stand on an edge of the test area. If the test area is made physically distinguishable by these or other means, the sensory stimulus is delivered in a more convincing manner, i.e., the brain of the subject will be more likely to take the stimulus for real: the immersion of the subject in the test scenario is higher. As a prime example, in a specially advantageous embodiment of the invention, the test area may comprise at least two elongate structures that intersects at least at one point. The subject may then, e.g., be placed at the intersection point, and the decision when and where the subject moves may be evaluated as a measure for the emotion or behavior under test.

In a further specially advantageous embodiment of the invention, the stimulation means are configured to deliver a sensory impression of a chasm surrounding at least one of the first area and the second area, so as to convey height or depth as the sensory stimulus. As outlined before, height and depth are specific stimuli that previously could not be conveyed in a sufficiently realistic manner in a laboratory setting because the required safety measures would have at least partially negated the very effect of the stimulus.

However, the stimulation means may be configured to deliver any kind of stimulus, depending on which emotion or behavior is to be measured or trained. For example, the emotion or behavior may be a phobic reaction (due to, e.g., bananaphobia), so the stimulus may, for example, be the presence of the object of the phobia (e.g., bananas) in pictures. A visual stimulus is a prime example, but it is not required that the stimulus be a visual one. For example, the stimulation means may also be configured to deliver a sound, a smell, a taste, a haptic stimulation, a temperature or an electric stimulation to the subject.

Also, combinations of different kinds of stimuli are possible and advantageous. For example, when there is the visual impression of a chasm, this may be augmented by the sound of falling rocks.

In a specially advantageous embodiment of the invention, the apparatus comprises a physical barrier to hinder the subject from leaving the test area in at least one of the first area and the second area. The effect of this is two-fold. First, the subject can be prevented from accidentally leaving the test area in a case where he cannot see the boundary of the test area, e.g., if he is wearing a goggle-type augmented-reality or virtual-reality device that delivers the sensory impression while at the same time blocking direct sight of the surrounding environment. Second, the impression of the elevated-plus maze, namely the distinction between open and closed arms, can be created.

The physical barrier, however, is not required to be actually present in order to achieve said effects. In a further specially advantageous embodiment of the invention, the stimulation means are configured to deliver a sensory impression that comprises said barrier. For example, the barrier may be included in a visible sensory impression, and/or the subject may be given some haptic feedback when approaching or hitting the barrier.

In a specially advantageous embodiment of the invention, the stimulation means comprise at least one display or projector configured to display at least part of the sensory impression in the surroundings of the test area. This kind of impression is very strong because the major part of the sensory information that is delivered to the human brain enters via the eyes, and this information is delivered most rapidly. In a specially advantageous embodiment of the invention, the apparatus further comprises at least one sensor to detect the position of the subject in the test area. Specifically, this sensor may be used to distinguish whether the subject is in the first area or in the second area. The information captured with the sensor may be used for the quantitative measurement of the emotion or behavior, e.g., by studying the time- position profile of the subject. It may, e.g., be measured how long the subject hesitates to change from one area into the next and how fast the subject then moves. The information may also be fed back to the stimulation means to alter the sensory impression. In the example of height as a stimulus detailed above, the visual and/or auditory impression of falling rocks may specifically be triggered when the subject crosses from the first area to the second area.

In a further specially advantageous embodiment of the invention, the apparatus further comprises at least one sensor to detect the gaze direction of the subject. The gaze direction is another reaction of the subject to the sensory stimulus that may be an early sign before the subject moves from one area to the other. Furthermore, making the sensory impression dependent on the gaze direction may cause the delivery of the sensory stimulus contained therein to be even more convincing and realistic. Alternatively or in combination, other sensors may be used to measure any other suitable biochemical and psychophysiological quantities that may serve as indicators for the emotion and/or behavior.

To provide a sensory impression with a high impact, in a specially advantageous embodiment of the invention, the stimulation means comprise a goggle-type wearable augmented or virtual reality device configured to deliver a sensory impression that is dependent on the position of the subject in the test area and/or on the gaze direction of the subject. The impact may be increased further by delivering audio via headphones that block other noise from the surrounding environment, and/or play sound that corresponds to the sensory impression. At the same time, the wearable device may contain, or be tracked by, sensors for determining the position, and/or the gaze direction, of the subject. For example, the wearable device may come with a scanning device that is adapted to track the wearable device in space. Preferably, the sensory impression further comprises sound, a blowing wind, and/or heat. A blowing wind is specifically advantageous to further strengthen an impression of height, because in real life, a greater height is associated with more wind. Heat can be achieved with infrared lights that are mounted to the ceiling to strengthen the impression of being outside (simulating sun beams, a fire or other heat sources).

A computer may be used as the central element in the apparatus. The computer may, for example, create, and control the delivery of, the sensory impression. At the same time, the computer may be used to record the position, and/or the gaze direction, of the subject, and any feedback of this position or gaze direction onto the sensory impression. Therefore, a fair amount, or all, of the functionality of the apparatus may be implemented in software running on the computer. This software is a product of its own that may be sold separately to empower a computer that is coupled to stimulation means with the functionality of the invention. The invention therefore also relates to a computer program product, comprising machine-readable instructions which, when executed by a computer communicatively coupled to stimulation means, causes a combination of the stimulation means and a test area to form an apparatus according to the invention. To have a maximum effect, the sensory impression should be spatially aligned to the test area. If there is a noticeable misalignment, this may convey to the brain of the subject that the sensory impression is not real, negating the intended effect. The invention therefore also provides a method to align the sensory impression delivered by stimulation means to a test area. This method comprises the steps of:

fixing at least one marker in the test area;

determining the position of the marker relative to an origin in the test area; determining the dimensions of the test area;

tracking, by the stimulation means, a position of the marker relative to the stimulation means; and

determining, from the position of the marker relative to the stimulation means in combination with the position of the marker relative to the origin of the test area and the dimensions of the test area, the position and orientation of the test area. The main a priori information used in this method is the position of the marker relative to an origin in the test area. This position may, for example, be determined by measuring. However, this is not the only manner. The position may, for example, also be determined by inserting the marker into a receptacle in the test area. The marker can then be removed and re-inserted and will always be at the same defined position of the receptacle.

The dimensions of the test area may be pre-measured, or it may be automatically determined, e.g., from a photograph. The alignment may also be performed adaptively without a marker. For example, a camera may register boundaries of the test area and then successively vary the positions and sizes of elements of the sensory impression until the boundaries of the sensory impression are flush with the boundaries of the test area. In a specially advantageous embodiment of the invention, a handheld controller of an augmented or virtual reality device that serves as stimulation means is used as at least one marker. One or even two controllers are typically packaged with each such device, and because all interaction of between the user and the apparatus is via the wearable device itself, the controllers are not needed for this purpose. Augmented or virtual reality devices typically have a built-in tracking function that specifically tracks the controllers, so by using a controller as a marker, best use can be made of the existing hardware. If a marker is used, preferably, at least two markers are fixed in different positions in the test area. In this manner, in addition to the position, the orientation of the test area may be determined as well.

Advantageously, the method further comprises: providing, in the test area, a fixture that comprises an inverse shape of at least a portion of the marker. Such fixture may, for example, be 3D-printed.

Advantageously, the alignment can make use of existing hardware that comes with an augmented or virtual reality device. It can therefore be implemented in software that is a product of its own. The invention therefore also relates to a computer program product, comprising machine-readable instructions which, when executed by a computer communicatively coupled to an augmented or virtual reality device serving as stimulation means, and/or by an augmented or virtual reality device, cause the computer, and/or the augmented virtual reality device, to perform at least the tracking of the marker (if present) and the determining of the position and orientation of the test area. Description of the Figures

Further advantageous embodiments will now be described in detail using Figures without any intention to limit the scope of the invention. The Figures show:

Figure 1 : Exemplary embodiment of an apparatus 1;

Figure 2: Delivery of different amount of the stimulus 22 to the subject 2;

Figure 1 illustrates an exemplary embodiment of the apparatus 1. The test area 3 consists of a wooden cross comprising two bars 33 and 34 intersecting in a center 35 where the subject 2 is standing in the snapshot shown in Figure 1. Outside the area of the center 35, on top of the first bar 33, there is a first area 31 , and on top of the second bar 34, there is a second area 32. A sensory impression 41 that is delivered to the subject 2 differs between the first area 31 and the second area 32 in the content of height as the stimulus 22: In the first area 31, the visual sensory impression 41 contains a railing 36, 36a that suggests safety from heights. In the second area 32, the visual sensory impression 41 contains a chasm 22a with sharp spikes 22b at its bottom that will spear through anyone falling on top of them. This suggests a great height and danger.

The sensory impression 41 is delivered through a goggle-type wearable device 43 that serves as the stimulation means 4. The wearable device 43 comprises a display 42. In addition, the subject 2 is wearing headphones 43a that are actuated by the wearable device 43. The position and orientation of the wearable device 43 are tracked by means of two laser scanning lighthouses 43b and 43 c. The lighthouses

43b and 43c therefore serve as a sensor 51 that detects the position of the subject 2 in the test area 3, as well as a sensor 52 that detects the gaze direction of the subject 2.

Figure 2 illustrates the effect that the different sensory impressions 41 associated with the first area 31 and the second area 32 have on the subject 2. In the first area 31, the sensory impression 41 contains only very little of the stimulus 22, here: height. By contrast, in the second area 32, the sensory impression 41 contains very much of this stimulus. When the sensory impression 41 is delivered to the subject 2, the amount of stimulus 22 contained therein is converted into emotion or behavior 21 within the brain of the subject 2.

Figure 3 illustrates the alignment of the test area 3 with respect to the sensory impression 41 delivered by the stimulation means 4 in the example apparatus 1 according to Figure 1. For the alignment, handheld controllers 44, 45 of an augmented or virtual reality device that serves as stimulation means 4 are used. As the first step of the alignment method 100, a fixture 46 that comprises an inverse shape of at least a portion of a handheld controller 44, 45 is placed in the test area 3. In step 110, the controller 44, 45 is placed into the fixture 46, so its position relative to an origin in the test area 3 can be very easily determined in step 120: it follows from the known position of the fixture 46.

In step 130, the dimensions of the test area 3 are determined. For example, these dimensions may be pre-stored, but the dimensions may, e.g., also be actively determined by scanning.

In step 140, the position of the handheld controller 44, 45 relative to the stimulation means 4 is tracked by the laser scanning lighthouses 43b and 43 c, by radio or by any other suitable means. From this position in combination with the position of the controller 44, 45 relative to the origin of the test area and the dimensions of the test area, the position and orientation of the test area are determined in step 150. List of reference signs

1 measurement or training apparatus

2 subject

21 emotion or behavior of subject

22 sensory stimulus giving rise to emotion or behavior 21

22a chasm as stimulus 22 conveying height

22b spikes as stimulus 22 conveying danger

3 test area

31 first area in test area 3

32 second area in test area 3

33, 34 structures in test area 3

35 intersection point of structures 33, 34

36 physical barrier of test area 3

36a impression of physical barrier 36

4 stimulation means

41 sensory impression delivered by means 4 to subject 2

42 display or projector displaying impression 41

43 goggle-type wearable device in stimulation means 4

43a headphones

44, 45 marker for alignment 100

46 fixture for marker 44, 45

51 sensor to detect position of subject 2

52 sensor to detect gaze direction of subject 2

100 alignment method

105 providing fixture 46

110 fixing marker 44 in test area 3

120 determining position of marker 44, 45

130 determining dimensions of test area 3 140 tracking position of marker 44, 45

150 determining position and orientation of test area 3

Claims

1. An apparatus (1) for measuring or training an emotion or behavior (21) of a subject (2), wherein said emotion or behavior (21) is triggered or fostered by a specific sensory stimulus (22) and wherein the apparatus (1) comprises:

a test area (3) comprising at least a first area (31) and a second area (32) between which the subject (2) is able to move; and

stimulation means (4) that are configured to deliver a sensory impression (41) to the subject (2), wherein in said sensory impression (41), the first area (31) and the second area (32) are associated with different amounts of the sensory stimulus (22).

2. The apparatus (1) according to claim 1, wherein the test area (3) comprises at least one structure (33, 34) that is physically distinguishable from the surrounding environment, so as to be stepped onto or into by the subject (2).

3. The apparatus (1) according to any one of claims 1 or 2, wherein the test area (3) comprises at least two elongate structures (33, 34) that intersect at least at one point (35).

4. The apparatus (1) according to any one of claims 1 to 3, wherein the stimulation means (4) are configured to deliver a sensory impression (41) of a chasm (22a) surrounding at least one of the first area (31) and the second area (32), so as to convey height or depth as the sensory stimulus (22).

5. The apparatus (1) according to any one of claims 1 to 4, further comprising a physical barrier (36) to hinder the subject (2) from leaving the test area (3) in at least one of the first area (31) and the second area (32).

6. The apparatus (1) according to any one of claims 1 to 5, wherein the stimulation means (4) are configured to deliver a sensory impression (41) that comprises a barrier (36a) to hinder the subject (2) from leaving the test area (3) in at least one of the first area (31) and the second area (32)

7. The apparatus (1) according to any one of claims 1 to 6, wherein the stimulation means (4) comprise at least one display or projector (42) configured to display at least part of the sensory impression (41) in the surroundings of the test area

(3) .

8. The apparatus (1) according to any one of claims 1 to 7, further comprising at least one sensor (51) to detect the position of the subject (2) in the test area (3).

9. The apparatus (1) according to any one of claims 1 to 8, further comprising at least one sensor (52) to detect the gaze direction of the subject (2).

10. The apparatus (1) according to any one of claims 8 or 9, wherein the stimulation means (4) comprise a goggle-type wearable device (43) configured to deliver a sensory impression (41) that is dependent on the position of the subject (2) in the test area (3), and/or on the gaze direction of the subject (2).

11. The apparatus (1) according to any one of claims 1 to 10, wherein the sensory impression (41) further comprises sound, a blowing wind, and/or heat.

12. A computer program product, comprising machine -readable instructions which, when executed by a computer communicatively coupled to stimulation means

(4) , causes a combination of the stimulation means (4) and a test area (3) to form an apparatus (1) according to any one of claims 1 to 11.

13. A method (100) to align the sensory impression (41) delivered by stimulation means (4) to a test area (3), comprising the steps:

fixing (110) at least one marker (44, 45) in the test area (3);

determining (120) the position of the marker (44, 45) relative to an origin in the test area (3);

determining (130) the dimensions of the test area (3);

tracking (140), by the stimulation means (4), a position of the marker (44, 45) relative to the stimulation means (4); and

determining (150), from the position of the marker (44, 45) relative to the stimulation means (4) in combination with the position of the marker (44, 45) relative to the origin of the test area and the dimensions of the test area (3), the position and orientation of the test area (3).

14. The method (100) according to claim 13, wherein the fixing (110) at least one marker (44) in the test area (3) specifically is: fixing (110) at least two markers (44,

45) in different positions in the test area (3).

15. The method (100) according to any one of claims 13 to 14, wherein a handheld controller of an augmented or virtual reality device that serves as stimulation means (4) is used as at least one marker (44, 45).

16. The method (100) according to any one of claims 13 to 15, further comprising: providing (105), in the test area (3), a fixture (46) that comprises an inverse shape of at least a portion of the marker (44, 45).

17. A computer program product, comprising machine -readable instructions which, when executed by a computer communicatively coupled to an augmented or virtual reality device serving as stimulation means (4), and/or by an augmented or virtual reality device (4), cause the computer, and/or the augmented virtual reality device (4), to perform at least steps 140 and 150 of the method (100) according to any one of claims 13 to 16.