AT519543B1 - Control device for a computer application - Google Patents

Abstract

In a control device for a computer application, in particular controller for computer games, which has a substantially spherical shape and at least two control buttons on the ball surface, which are arranged to be actuated by two fingers of the ball at least partially comprehensive hand, further comprising at least one Acceleration sensor for detecting an acceleration of the control unit, the control unit comprises a device for measuring the electrical line resistance of the skin having at least two electrodes arranged in the region of or on the control buttons, and it is a sensor for non-contact temperature measurement, in particular an IR temperature sensor, for measuring the temperature of the palm of the hand at least partially surrounding the ball.

Description

Description: The invention relates to a control device for a computer application, in particular controller for computer games, which has a substantially spherical shape and at least two control buttons on the ball surface, which are arranged to be actuated by two fingers of the ball at least partially comprehensive hand are further comprising at least one acceleration sensor for detecting an acceleration of the control unit.

The invention further relates to a system comprising a control device and a computer program with software code, wherein the control device has a data transmission interface for transmitting data to the computer program, wherein the data comprises the operating state of the control buttons and biofeedback data, wherein the software code adapted is that the course of a computer game is influenced depending on the data.

Controllers for computer games are known in various forms. They are held either in one hand or in both hands and operated with the fingers. Usually, such controllers have several action buttons on the front, possibly also on the shoulders and on the back. The operation of the individual keys is detected by suitable switches and / or sensors and corresponding signals transmitted wireless or wired to a personal computer or a game console to control the flow of a computer game in response to the key press.

For motion control in computer games controllers are also equipped with motion or acceleration sensors, wherein a spatial movement of the controller is determined and used for a corresponding motion control in computer game.

It is also already known to use computer programs, e.g. Control computer games depending on biofeedback data of a user. For example, US 2003/195040 A1 describes a game controller that incorporates various biofeedback sensors, such as those described in US Pat. a plethysmography-based pulse sensor, a temperature sensor and a skin resistance measurement. The use of biofeedback data allows the determination of a user's state of stress.

However, when the biofeedback sensors are integrated into operation keys of the controller, there is a problem that the biofeedback sensors provide appropriate data only when the corresponding operation key is touched. However, controlling a computer game does not ensure that the user touches the operation buttons for such a period of time or with a pressure such that the associated biofeedback sensors provide reliable data. Rather, the frequency and intensity of the touch depends on the particular application or game.

The present invention therefore aims to develop a control device of the type mentioned in that the extraction of biofeedback data improved, the quality of the biofeedback data increases and the occurrence of falsified biofeedback data can be detected.

To achieve this object, the invention essentially provides in a control device of the type mentioned above, that the control device comprises a device for measuring the electrical line resistance of the skin having at least two electrodes arranged in the region of or on the control buttons, and in that a sensor for non-contact temperature measurement, in particular an IR temperature sensor, is provided for measuring the temperature of the palm of the hand which at least partially surrounds the ball.

Characterized in that in addition to a measurement of the electrical line resistance of the skin, a non-contact temperature measurement of the skin, it is possible to easily validate the resistance measurement data. The skin conductivity is primarily influenced by the activity of the sweat glands, whereby the sweat secretion is controlled by the autonomic nervous system and thus can not be consciously influenced. When sweat is produced, the ability of the skin to conduct electricity increases, so that the skin conductance increases or the line resistance decreases. The resistance value is useful, for example, in the context of biofeedback training to measure the state of excitement relative to a particular stimulus. If, as is the case with the controller according to the invention, the measurement of the cable resistance of the skin is carried out over at least two electrodes arranged in the region of or on the operating keys, a reliable measurement can only be achieved if the user presses the operating keys with his fingers in the correct position and touched with sufficient contact pressure.

In the course of a computer game, however, the proper simultaneous touch of both control buttons is not guaranteed, since the actuation of the control buttons often followed by a release of the keys. The additional measurement of the skin temperature makes it possible in the context of the invention to check the resistance values determined by the device for measuring the line resistance or their change with the aid of the skin temperature measured values and to detect an incorrect resistance measurement. The invention here is based on the fact that the changed as a result of sweat secretion line resistance has a corresponding change in the surface temperature of the skin result. An increase in the moisture of the skin leads namely due to the evaporative cooling to a reduction in temperature. Conversely, a reduction in the moisture of the skin leads to an increase in temperature. The resistance measurements are therefore recognized as correct values only if the skin temperature changes analogously in accordance with the known physical relationships.

Characterized in that the temperature of the skin surface is determined by means of a non-contact sensor, correct temperature readings are obtained regardless of whether the user touches the controller with the palm or not. A preferred embodiment provides in this context that the temperature sensor is designed as an infrared temperature sensor.

If, as part of the validation of the resistance measurement data by means of comparison with the data of the temperature sensor and / or the pulse measurement data (see below) a deviation from setpoints is detected, a visual and / or acoustic feedback can be made that the fingers are correct to be positioned. Furthermore, the application can be interrupted from this point in time, so as not to falsify the game results.

Characterized in that the controller is designed as a ball, an ergonomically favorable detection of the controller is made possible by hand, wherein the hand comprises the ball at least partially. In this case, the operation keys are positioned so that they can be touched by two fingers of the ball at least partially enclosing the ball. The temperature sensor for measuring the skin temperature is in this case positioned so that it is directed to the palm of the ball at least partially comprehensive hand when the fingers touch the control buttons.

The controller may preferably at least partially have an elastic surface coating, which consists for example of a silicone material, so that the controller can also be used in the manner of an anti-stress ball.

Under a spherical shape is understood in the broadest sense, any form that can be at least partially encompassed by an entire hand and predominantly has a curved surface. It can therefore be a spherical shape, but also an egg shape or the shape of an ellipsoid of revolution. Furthermore, the spherical shape may also have at least a partial flattening, e.g. this serves to set up the control unit on a flat surface without fear of rolling away.

A particularly advantageous integration of the electrodes of the line resistance measurement in the control keys is achieved in that the at least two control buttons each have at least one contact surface area of an electrically conductive material, which form the electrodes of the device for measuring the electrical line resistance of the skin. The electrically conductive pad areas are electrically connected to the line resistance measurement device so that it can measure the electrical resistance of the circuit that closes between the electrodes via the user's fingers. The contact surface areas may preferably be designed as galvanized areas of the operating buttons. The substrate of the galvanization may be a conventional plastic part of the control button.

The conductive pad region is preferably formed on a movable element of the control buttons, i. on an element, which is pressed in the course of a key operation and comes back to the original position after the key operation. This ensures that a touch of the contact surface area is maintained during the key press.

To obtain additional biofeedback data, which are useful, for example, in the context of biofeedback training, may preferably be provided that the control unit comprises at least one optical sensor for plethysmographic pulse measurement. The pulse of the user is a characteristic which, like the resistance of the dermal line, allows conclusions to be drawn about the user's state of stress.

Preferably, the optical sensor is integrated into a control button so that the pulse can be measured at the touch of the button. A preferred embodiment provides in this context that at least one control button has a transparent window, behind which the optical sensor for plethysmographic pulse measurement is arranged. Plethysmographic pulse measurement is an optical procedure in which the pulsatile change in blood volume in the tissue is measured indirectly via light absorption. For the pulse measurement, a light source is required, which is arranged under the window and irradiates the finger arranged on the operating key. The feature of the transparency of the window refers to the wavelength of the radiation source, i. the window must be transparent to the wavelength of the radiation source. As a radiation source, an LED can be used, for example, the green light (wavelength 535nm), red light (wavelength 660nm) or infrared light (wavelength 940nm) emits. In order to realize several measuring paths, it is also possible to use two or three light sources simultaneously, which emit light with mutually different wavelengths. The light source need not necessarily be placed directly below the window, but the light from a remote light source can be directed to the window by means of a light guide.

A arranged below the window photoelectric sensor detects the light reflected from the irradiated tissue and generates an electric signal proportional to the reflected light or the light intensity of the reflected light. The photoelectric sensor need not necessarily be placed directly below the window, but the light reflected from the irradiated tissue may also be directed to a remote sensor via an optical fiber whose light receiving end is located below the window.

It is particularly preferred if two optical sensors are provided for plethysmographic pulse measurement and the at least two control buttons each have a transparent window behind which each one of the two optical sensors is arranged. This allows a redundant pulse measurement, which allows a pulse measurement even if only one of the two control buttons is touched or actuated.

Advantageously, it is provided that the electrode forming the contact surface area of the control buttons is annular and surrounds the transparent window. This results in a particularly space-saving integration of both the line resistance measurement and the pulse measurement in the control button.

The plethysmographic pulse measurement additionally allows determination of heart rate variability (HRV) in a measurement accuracy sufficient for non-medical devices in order to supplement the relaxation ability training recommendations based on the measured

Derive stress levels.

A further preferred embodiment provides that the control unit comprises a temperature sensor for measuring the ambient temperature. This temperature sensor is preferably located in an area of the ball that remains free when encased by the user's hand, i. not covered by hand. The measurement of the ambient temperature makes it possible to calibrate the biofeedback data. It has been observed that some of the biofeedback data describing the user's stress state are ambient temperature dependent. For example, the sweat secretion and thus the skin conduction resistance at constant stress state at higher ambient temperature is more pronounced than at lower ambient temperature.

Preferably, the control unit has a vibration unit. The vibration unit can be used to generate an excitation condition at the user, whereby the change of the biofeedback data resulting from the vibration, in particular a change of a value representing the stress condition, is determined and evaluated and used for diagnostic analysis.

The at least one acceleration sensor is preferably part of an inertial measuring unit arranged in the control unit, which is designed to detect a movement of the control unit in three spatial dimensions. The inertial measuring unit preferably comprises a plurality of acceleration sensors, a plurality of rotation rate sensors and optionally a magnetic field sensor. For the detection of six kinematic degrees of freedom are three mutually orthogonal acceleration sensors for the detection of the translational movement in the x-, y- and z-axis and three orthogonal rotationally mounted sensors for detecting rotating movements about the x-, y- and z -Axis provided.

To solve the problem underlying the invention, a system comprising an inventive control device and a computer program with software code is provided according to a second aspect of the invention, wherein the control device has a data transmission interface for transmitting data to the computer program, wherein the data is the operating state the biofeedback data include the sensor data of the at least one acceleration sensor, the measurement data of the means for measuring the electrical line resistance of the skin, the sensor data of the sensor for non-contact temperature measurement of the skin and possibly the sensor data of the at least one optical Sensors for plethysmographic pulse measurement and possibly the sensor data of the temperature sensor for measuring the ambient temperature, wherein the software code is adapted so that the course of a computer game depending on the biofeedback Data is affected.

For example, the computer game simulate an activity on the screen, which is executed in the simulation all the better or more accurate or unerring, the greater the physical rest or relaxation of the user. The physical relaxation is determined, for example, on the basis of the pulse measurement, the skin resistance measurement and / or the skin temperature measurement. For example, when the computer game simulates the activity of archery, the inertial measurement unit of the controller detects the movement of the arcuate and the aiming, so that the computer program uses the corresponding motion data for the virtual representation of the arcuate and the aiming on the screen. How exactly the user hits the target when shooting the bow now depends on the user's relaxation. The game can therefore be played in the sense of a biofeedback training, the goal of which is that the user can perform certain body functions, e.g. to control and consciously influence the heart rate, sweat secretion and the like.

The computer program may in this case be stored on a data storage device, made available as a downloadable file, or be available in a working memory of a computer or a game console for executing software code. The computer is preferably equipped with a data communication interface for wireless or wired transmission of data from and possibly to the controller, wherein the data received via the data communication interface of the computer data are supplied to the computer program. The data communication interface of the controller and the data communication interface of the computer are matched and may, for example, comply with the specifications of the USB standard. Alternatively, the data communication interfaces may be configured to establish radio data transmission, for example via short range radio, e.g. about blue-tooth.

The computer can be used as a personal computer (PC) or as a portable device, such as a personal computer. be designed as a smartphone or the like.

The software code is preferably adapted so that the measurement data of the device for measuring the electrical line resistance of the skin and the sensor data of the sensor for non-contact temperature measurement of the skin are evaluated such that a comparison of the change in the line resistance and the change in skin temperature made in such a way becomes that a defined influence on the course of the computer game takes place only when the line resistance decreases and at the same time the skin temperature decreases or when the line resistance increases and at the same time increases the skin temperature.

Furthermore, it can be provided that the software code is adapted so that the sensor data of the temperature sensor for measuring the ambient temperature for the calibration of the remaining biofeedback data are used.

Furthermore, the software code may be adapted to match the data of the optical sensors for plethysmographic pulse measurement and the determination of the pulse based on the data of only one of the two sensors, if only one sensor is touched by the user's finger, or the determination of the pulse based on the data of the two sensors, when both sensors are touched by one finger of the user.

To implement a biofeedback training, which may be integrated, for example, in a computer game, the software code is preferably adapted so that from the biofeedback data, a value of the physical stress state of the user is calculated.

In order to enable the user to control the state of stress, the software code is preferably adapted so that the value of the physical stress condition is transmitted to the control unit and the control unit is designed to display an optical signal dependent on the value of the physical stress condition. For example, the value of the physical stress condition may be signaled based on a color code, where each color represents a different state of stress.

The invention will be explained in more detail with reference to an embodiment schematically illustrated in the drawing. 1 shows a front view of the control device, FIG. 2 shows a plan view of the control device according to the arrow II of FIG. 1, [0039] FIG. 3 shows a side view of the control device according to the arrow III of FIG 1 and [0040] FIG. 4 is a side view of the control device according to the arrow IV of FIG. 1.

In Fig. 1, the controller or the controller 1 is shown, which is substantially spherical and has a flattening 2, so that the controller 1 can be placed on a flat surface 3. The controller 1 has two control buttons 4 and 5, which are resiliently mounted and can be pressed against the force of a spring element. The control buttons 4 and 5 are designed in the present embodiment as elongated tongues, which are pivotally mounted at its upper end. Alternatively, the control buttons can also be designed as conventional, in particular circular or rectangular push buttons, similar to the keys of a computer keyboard. The control buttons 4 and 5 comprise a front portion 6, on each of which a finger tip of the user comes to rest when the respective finger extends along the longitudinal extent of the tongue. The region 6 in each case has an annular contact surface region 7, which forms an electrode of a line resistance measuring unit. From the annular contact surface area 7, a window 8 is enclosed, under which a light source and a photoelectric sensor are arranged, which form a unit for plethysmographic pulse measurement.

Furthermore, the control device has a substantially along the great circle of the ball over an angle of about 180 ° extending light strip 9, which may be formed by a light guide, is fed into the light of a light source, not shown.

In the plan view of Fig. 2 it can be seen that the ball further carries an IR temperature sensor 10 which is directed against the Flandinnenfläche when the Fland comprises the ball so that the fingertips of two fingers on the areas 6 to come lie.

In the side view of FIG. 3, an on / off switch 11 is shown, which is arranged in the region of the end of the luminous strip 9. On the diametrically opposite side of the ball, as shown in Fig. 4, there is a receptacle 12 of a data communication interface, e.g. for a USB plug, provided. Electrical energy can also be supplied to the controller via the data communication interface in order to charge the electrical energy store arranged in the interior of the controller.

Furthermore, the controller 1 can have LEDs (not shown) as well as control sensors for checking the state of charge of the electrical energy store. The LEDs indicate when the charge state for a valid result is too low and a recharge becomes necessary.

In a preferred use of the controller as a controller for a software application for biofeedback training, the data of the various sensors can be weighted with an integrated calibration function, whereby the action priorities and training goals can be varied. For example, with the controller, it is not only possible to measure and train the stress, but also to activate it. This makes it possible to determine the ability to relax, where on the one hand the activation level is determined (on the basis of the pulse sensors) and on the other hand the ability to relax is determined on the basis of the Flautleitwert combined with the body temperature. This allows conclusions to be drawn on the physical constitution and overall stress tolerance.

Claims (14)

claims A computer application controller, particularly a computer game controller, having a substantially spherical shape and having at least two control buttons on the ball surface arranged to be actuated by two fingers of a hand at least partially surrounding the ball, further comprising at least one Acceleration sensor for detecting an acceleration of the control device, characterized in that the control device comprises a device for measuring the electrical line resistance of the skin having at least two arranged in the region of or on the control buttons electrodes, and that a sensor for non-contact temperature measurement, in particular an IR Temperature sensor, for measuring the temperature of the palm of the ball is provided at least partially comprehensive hand. 2. Control device according to claim 1, characterized in that the at least two control buttons each have at least one contact surface area made of an electrically conductive material, which form the electrodes of the device for measuring the electrical line resistance of the skin. 3. Control device according to claim 1 or 2, characterized in that the control unit comprises at least one optical sensor for plethysmographic pulse measurement. 4. Control device according to claim 3, characterized in that at least one control button has a transparent window, behind which the optical sensor is arranged for plethysmographic pulse measurement. 5. Control device according to claim 4, characterized in that two optical sensors are provided for plethysmographic pulse measurement and the at least two control buttons each have a transparent window, behind each of which one of the two optical sensors is arranged. 6. Control device according to claim 4 or 5, characterized in that the electrode forming the contact surface area of the control buttons is annular and surrounds the transparent window. 7. Control device according to one of claims 1 to 6, characterized in that the control device comprises a temperature sensor for measuring the ambient temperature. 8. Control device according to one of claims 1 to 7, characterized in that the control device has a vibration unit. 9. A system comprising a control device according to one of claims 1 to 8 and a computer program with software code, wherein the control device has a data transmission interface for transmitting data to the computer program, the data comprising the operating state of the control buttons and biofeedback data, wherein the biofeedback Data, the sensor data of the at least one acceleration sensor, the measurement data of the device for measuring the electrical line resistance of the skin, the sensor data of the sensor for non-contact temperature measurement of the skin and possibly the sensor data of at least one optical sensor for plethysmographic pulse measurement and possibly the sensor data of the temperature sensor Measuring the ambient temperature, wherein the software code is adapted so that the flow of a computer game is influenced in dependence on the biofeedback data. 10. System according to claim 9, characterized in that the software code is adapted so that the measurement data of the device for measuring the electrical line resistance of the skin and the sensor data of the sensor for non-contact temperature measurement of the skin are evaluated such that a comparison of the change in line resistance and the change of the skin temperature is made such that a defined influence on the course of the computer game takes place only when the line resistance decreases and at the same time the skin temperature decreases or when the line resistance increases and at the same time increases the skin temperature. 11. System according to claim 9 or 10, characterized in that the software code is adapted so that the sensor data of the temperature sensor for measuring the ambient temperature for the calibration of the remaining biofeedback data are used. 12. System according to claim 9, 10 or 11, characterized in that the software code is adapted so that the data of the at least two optical sensors are adjusted for plethysmographic pulse measurement and the determination of the pulse is based on the data of only one of the two sensors, when only one sensor is touched by the user's finger, or the determination of the pulse is based on the data of the two sensors when both sensors are touched by one finger of the user. 13. System according to one of claims 9 to 12, characterized in that the software code is adapted so that from the biofeedback data, a value of the physical stress state of the user is calculated. 14. System according to claim 13, characterized in that the software code is adapted so that the value of the physical stress state is transmitted to the control unit and the control unit is designed to display a dependent on the value of the physical stress condition optical signal. 4 sheets of drawings