Pedally and/or manually controlled user interface
The present invention relates to a pedally and/or manually controlled user interface for a computer or a corresponding device, such as game consoles, slot machines, midi players and the like, and which consists of sensors connected programmatically or by way of a logic element to the device to be controlled.
It is an object of an apparatus of the invention to diversify the alternation of feet and hands in the process of controlling a computer and similar equipment, to expand maneuverability and to improve ergonomics, e.g. through a change of working position by standing up, moving about or sitting down from time to time, in order to reduce manual strain, as well as to introduce alternative ways and means to control various systems.
Pedally controlled cursor controllers and user interfaces connectable to a computer have been available in the marketplace for quite some time. Most of the time, these devices are based on various types of pedal systems, wherein both feet are allocated a given, most often a clearly defined area and the movements of said pedals provide means for controlling the operation of a computer program. German patent publications DE 19622557 and 19649586 as well as the International patent application WO 95/34872 disclose a computer-connectable controller, which is based on a pedal solution.
The pedal disclosed in German publication DE 4336153 comprises a panel placed on the floor, which is provided with a second panel movable horizontally along a guide rail. The second panel is further provided with a vertically oriented guide rail, along which the pedal is moving. The cursor operation is accomplished by a combination of lateral and vertical movements of one foot.
Various types of pedal solutions have also been described in the International application WO 97/35277 and EP publication 0480709.
US publication 5334997 further discloses a controller, comprising a control ball under both feet, operable by the sole of one's foot. Each foot is further provided
with lateral switches controllable by the side of the foot and with forward switches controllable by the toes.
In all such prior art equipment the question is about a floor-installed, quite complicated, yet functionally limited device.
It is an object of the present invention to provide a user interface, which is structurally simple, functionally versatile and operatively reliable, and which is readily displaceable and even portable, whenever necessary.
The apparatus of the invention is characterized in that it comprises a sensor element, which is a film type or panel type unit constituted by a number of sensors and said sensors establish functionally independent subareas within the sensor unit.
The apparatus of the invention can be used for replacing or supplementing currently available control devices. The mat or panel design of an apparatus of the invention affords the apparatus a number of benefits, it is compact, easy to fit (the foundation need not be horizontally level), easily portable (the mat can be rolled up, for example), the user interface can have its size and shape adjusted as required by a particular application.
In a preferred embodiment, the panel or mat type of sensor assembly is supported or unsupported. If desirable, the sensors can be set on a more solid foundation to provide a panel type supported sensor unit. An unsupported sensor unit is constituted by a floor-laid mat without its own support structure.
The choice of material is important. The sensor device is manufactured from a film type of material, which can be laminated with mechanical switches, it can be made from a piezoelectric material, such as polyvinyldene fluorine film, or it can be produced by using a new, so-called electromechanical film (EMFi-electrome- chanical film - FI 95039). The inventive user interface is preferably constituted by a plurality of sensors which establish preferred subareas in a mat type of user interface. The number of sensors is selected according to a relevant application
and can be subsequently and optionally increased, if necessary. Hence, the shape and general outline of a sensor unit can be modified and adjusted in accordance with a particular application and available space.
In an apparatus of the invention, the sensors can be connected to controlled devices the same way as generally similar user interfaces, game and media controllers, mouses etc., e.g. programmatically or by way of a separate logic unit, or via a preamplifier to a micro-controller and further to a suitable connection in a computer or the like. The amplifier and/or the micro-controller is in a per se known manner provided with selector switches capable of selecting various operating modes for the sensors.
A user interface of the invention can be applied to generally available systems, such as PC and Mac environments, game consoles, various slot machine games, midi-players and the like equipment. In addition, the apparatus is functional with various products and devices in the field of entertainment electronics. The apparatus is also highly suitable for rehabilitation of the physically handicapped and for physical education, as well as for teaching and rehearsing dance, music or groups, as well as generally for applications in which it is desirable to liberate the hands for more functions by using the feet to control various hardware assemblies, whereby the apparatus can be preferably exploited for example in occasions like lectures and presentations.
Of course, the apparatus is also adaptable to all such applications which currently employ a variety of "joystick" and GAMEPAD type control elements. In this case, the question may be about the drive and control of quite large, heavy-duty equipment, the control of which is carried out by the above-mentioned control elements.
The present invention will be described more closely in the following examples, which disclose one embodiment of the invention.
Example 1 : Game controller
This example deals with a controller according to the invention intended for game operation. This requires functions at least as follows: motion control at least in four different points of compass, firing, leaps, and game-specific special features.
The apparatus can be manufactured from EMFi-film. EMFi is an elastic plastic film with a thickness of 0.05 mm. When subjected to a variable mechanical (or acoustic) force, the film develops a potential, which feature has been exploited in the inventive controller.
The EMFi-film is made from two-way stretched polypropylene film. During the course of stretching, the film develops small flat bubbles, which make it elastic in perpendicular direction. During the manufacturing process, the interior of a film is further supplied with a permanent electric charge. The final composition is obtained by means of metal foils vapour-deposited or laminated on both sides of the plastic film. The film has an extremely high sensitivity to an external dynamic force, even up to 100 pC/N.
The inventive controller comprises a general-purpose pedally and/or manually controlled user interface, which functions as a game controller. The user interface is constituted by an EMFi-sensor or controller mat, the composition of which consists of manually laminated EMFi sensors. The sensor field is about one square meter in size and contains nine EMFi sensors, which are bonded to a 4 mm thick aluminium sheet. The sensors make up a grid-like block of switches, whose wirings are made in thin copper strips and then cabled in a controller box. On top of the sensor surface is bonded an ordinary plastic membrane as mechanical protection and a surface material. Fig. 1 depicts a block diagram for the apparatus.
The operation of grid frames in the user interface can be determined by means of switches present in the controller box. In addition to directions of motion, the available options include five programmable function sensors.
The sensors are connected via preamplifiers to a micro-controller. When pressed or stepped on, a grid space emits a signal to the preamplifiers, which are in a voltage tracking circuit for creating as high-speed an operation as possible. The signals are then carried to A/D converters in the micro-controller and processed in the circuit as desired, as well as converted to fit the adapter of an analog game controller used in a PC computer.
The micro-controller and, at the same time the entire apparatus, is operationally controlled by setting switches present in the controller box. Since a major portion of the operation control for the apparatus is programmed in a micro-controller present in the apparatus, it will be easy to make subsequent operational changes, if desirable. It is done simply by replacing a program in the re-storing program memory of the circuit.
The selector switches present in a control unit enable the selection of a variety of operating modes for the user interface, as well as a variety of functions for some sensors. All switches have two positions, which are ON and OFF. In each switch, these refer to operating modes as follows:
• Switch 1. Power mode/speed mode
ON Power mode in operation. When a sensor is stepped on, the motion of a game controller in a selected direction begins. The motion does not stop until stepping off the sensor.
OFF Speed mode in operation. The stepping frequency (time between successive steps) on a sensor sets the same in a directly proportional motion. The higher the stepping frequency, the larger the motion. If standing still on a sensor, the game controller motion stops as well.
Switch 2. Operation of a sensor 5
ON Sensor 5 in the middle of a mat in operation.
OFF Sensor 5 in the middle of a mat out of operation.
Switch 3. Keyboard operation of sensor 5
ON When in operation, the middle sensor functions as switch 1 for game controller.
OFF When in operation, the middle sensor functions as a motion stopper.
• Switch 4. Keyboard operation of sensor 1 , 3, 7 and 9
ON Sensors in the corners of a mat function as switches 1-4 for game controller.
OFF Sensors in the corners function as intermediate points of compass
(Northeast, Southeast etc.) in the control.
Switch 5. Operation of game controller 2
ON One (external) of the game controllers in operation. Only two game controller switches in operation and the other two switches in operation in the other controller. Enables the use of e.g. a joystick or the like as an accessory to the mat. The control unit has an adapter for the external controller. The ON position of switch 5 overrides the operation of switch 4 as regards sensors 7 and 9.
OFF One of the game controllers out of operation. All four switches in the mat controller in operation.
• Switch 6. Sensitivity of speed mode
ON High sensitivity. Even a rather slow stepping rate brings about motion.
OFF Low sensitivity. Only a rapid stepping rate brings about motion.
user has a possibility of downloading functions via internet,
wireless operation.
Example 2: Midi-operation
The apparatus has a range of operation which extends also to midi-applications. Increasing the number of press keys provides a keyboard, which comprises the entire octave, additional octaves or desirable effects or special features and which can be used for playing or composing music. Augmentation of the apparatus can be used to create a range for composing music by moving and hopping therein. Children in particular would be certainly inspired by this type of playful creation of music.
Example 3: Handicapped users
In handicapped groups, physical exercise plays a major role in rehabilitation. The threshold for learning about the computer environment may sometimes be overwhelming as a result of the technical nature of the hardware or simply for physical reasons. The control of a computer with feet can be managed and the working of a cursor by hopping or moving about on mat gives the impression of a less technical apparatus which can be touched even by a person with not much experience about computers.
Example 4: Amusement park operation
In the largest scale, the use of this apparatus would be in funfairs and amusement parks. It could be used to control a multitude of various operations, for example
• a variety of slot machines,
group games as a large mat,
"a giant piano".
Example 5. Operation in dance training
This apparatus is applicable to dance training by increasing slightly the size of a mat and by reducing the size of sensors, i.e. by increasing the number of sensors. The apparatus could also e.g. respond to a faulty step by vibration or the like.
Example 6: Operation in lectures and presentations
The inventive sensor mat can be preferably used in various types of lecture occasions, as well as in presentations, in which the presenter can use his or her feet to control a display screen or some other larger display device, leaving his or her hands free for other purposes.
Example 7: Control of machines and equipment
The inventive user interface can also be used for such applications which are currently employed for the control of major equipment, machines, ships, etc., whereby manual controllers are not needed.