US20010001556A1 - Data augmentation system and method - Google Patents
Data augmentation system and method Download PDFInfo
- Publication number
- US20010001556A1 US20010001556A1 US09/764,485 US76448501A US2001001556A1 US 20010001556 A1 US20010001556 A1 US 20010001556A1 US 76448501 A US76448501 A US 76448501A US 2001001556 A1 US2001001556 A1 US 2001001556A1
- Authority
- US
- United States
- Prior art keywords
- data
- augmentation
- computer
- character
- movements
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
Definitions
- the present invention relates generally to computer data input and data manipulation devices, and more particularly, to a system and method for augmenting data generated by peripheral devices and for integrating the augmented data into a program running on a computer system.
- Virtual reality systems are computer based systems that provide the experience to a participant of acting in a simulated environment that forms a three dimensional virtual world. These systems are used in several different applications such as commercial flight simulators, surgical training systems, and entertainment systems including computer games and video arcade games to name a few.
- the participant In virtual reality systems, the participant often wears a head-mounted device that enables viewing of a virtual reality world generated by the computer.
- the system also includes means for interacting with the virtual world, such as known data generation or manipulation devices.
- the data manipulation devices include known pointing devices, such as joysticks, or specially configured gloves that contain sensors and actuators, for interacting with objects in the virtual world.
- a data generating body suit may be provided to enable the user to influence and to feel objects in the virtual world.
- Computer generated animation is an increasingly prevalent media form. Computer generated animation is presently being used in such applications as full-length motion pictures, crime reenactments, short length films, television commercials, and children's cartoons.
- An expeditious method of creating computer generated animation comprises providing actors with all, or some, of the virtual reality equipment previously discussed, so that the wearer of the equipment can control the movements of a character in the animation, so that the character can act out scenes in the animation as directed. Since a director of the computer animation can view and direct the actions of an actor wearing the equipment as they are performing, the director can make any desired changes to the actions of the actor as they are performing to obtain the desired scene. Thus, the director can control the actions of the character as a scene is being performed, for generating the computer animation in real time.
- virtual reality systems include a computer that processes data generated by the equipment worn on the actor for controlling the movements of an object, such as a character for example, in a computer animation.
- a disadvantage of known virtual reality systems is that the data generated by the equipment and processed by the computer only enables the character controlled by the system to mimic the movements of the actor. Thus, if it is desired for the character to have exaggerated features or movements, such as facial expressions, the character controlled by the actor must first be created, or mapped, by the system with the desired exaggerated features.
- a disadvantage of mapping exaggerated features to obtain the desired appearance of the character is that the character's appearance is permanently altered with the exaggerated features. Thus, the character no longer has a normal appearance if desired. Therefore, a substantial disadvantage of prior art virtual reality systems, many of which are used for creating computer generated animation, is that means are not provided for augmenting the data generated by the equipment and processed by the system to control the virtual reality character. Therefore, it would be advantageous to provide a virtual reality system that augments data generated by the equipment thereof, for temporarily enhancing the movements or features of a character controller by the system.
- a prior art virtual reality system is disclosed in U.S. Pat. No. 5,515,078, to Greschler et al.
- the system includes a base and a chair with an attached monitor that may be rotated with respect to the base by the user of the system.
- a measuring device determines the rotational position of the chair.
- the system includes joysticks that have bases attached to the chair or the monitor so that they move with the chair. Data from the joysticks and from the measuring device are sent to a processor, which accesses a database defining a virtual world and generates an image on the monitor.
- the monitor image represents apparent movement within and through the virtual world represented by the databases.
- Devices have been provided in the prior art that measure the relative position and orientation of a body in space, then transmit relative data to a computer for processing the data. These devices may include a body suit that has a number of sensors, or receivers, for determining the position of the body in space.
- a body suit that has a number of sensors, or receivers, for determining the position of the body in space.
- One such device is disclosed in U.S. Pat. No. 4,945,305, to Blood.
- the device disclosed therein quantitatively measures the position of receiver antennae relative to transmitter antennae.
- the device includes transmitter antennae consisting of a two or three axis aparallel transmitter antennae that generates at least two DC magnetic vectors.
- a pulsed DC signal sequentially supplies the aparallel antennae with DC poles to drive the antennae, to generate the DC magnetic vectors.
- a like number of aparallel receiver antennae are provided to detect the DC magnetic vectors.
- the number of transmitter antennae multiplied by the number of receiver antennae is at least equal to the number of degrees of freedom of the desired quantitative measurement of the position of the receiver antenna relative to the transmitter antennae.
- Means for compensating for the effects of the earth's magnetic field on the operation of the device are also provided. Additionally included are signal processing means to ascertain the magnitude of the detected DC magnetic vectors and to quantitatively compute the relative position and orientation of the receiver antennae relative to the transmitter antennae.
- the system of the present invention couples to a data collection computer along with data generating equipment, such as a data generating body suit, for augmenting data generated by the equipment.
- Augmentation data generated by the invented system and body movement data generated by the body suit can be simultaneously transmitted to the data collection computer which may contain a data base defining a virtual world.
- the body suit generates movement data and transmits the data to the data collection computer for controlling the movements of an object, a character in the virtual world for example, an operator of the invented system monitors the data generated by the equipment and activates the system to selectively augment data generated thereby, for enhancing the movements of the character.
- the invented system transmits the augmentation data to the data collection computer to augment the data generated by the equipment so that the character has exaggerated movements or cartoonish features.
- the system and method of the present invention augments the data generated by the data-generating device without overwriting the data generated thereby, so that the exaggerated movements of the character can continuously track the movements indicated by the data generating equipment, if desired.
- the invented system can remain inactive, so that the character in the virtual world may have a smile substantially similar to the wearer.
- the operator of the invented system desires to augment the smile of the character, the operator activates the system for transmitting augmentation data to the data collection computer simultaneously with the movement data indicating the wearer's smile.
- the augmentation data can enhance the movement data, so that the character has a substantially larger smile, such as a cartoonish grin, for a selected time period.
- the operator can reduce or cease transmission of augmentation data, so that the character has expressions that are again analogous to the wearer's expressions.
- the system comprises an interface module coupled to the data collection computer and to peripheral data generating devices that may include specially configured joysticks that are provided with electronic circuitry that generates control signals upon activation by the operator, for achieving desired data augmentation.
- the circuitry includes a plurality of control means that output control signals to provide such functions as calibrating the data generating equipment, horizontal and vertical positioning, and means for augmenting the movement data generated by the equipment, such as controlling cartoonish or other special effects.
- the circuitry of each of the peripheral devices also includes multiplexer means having an output coupled to the interface module for transmitting augmentation data to the data collection computer and a plurality of inputs, with an input coupled to each of the control means.
- the multiplexer means continuously checks its inputs for sensing signals generated by the control means coupled thereto, for determining activation thereof. Upon activation of any of the control means, the multiplexer means receives signals generated thereby and transmits the signals to the interface module, for transmitting augmentation data determined by the activated control means to the computer.
- Memory means may also be provided to retain information as to the different types of control means that the particular device embodies, and to determine which specific control means is coupled to each input of the multiplexer means.
- the interface module is coupled between the peripheral devices and data collection computer for receiving signals generated by the devices and for transmitting augmentation data to the computer.
- the module has a plurality of inputs for coupling the peripheral devices thereto. The inputs of the module are continuously checked for sensing signals generated by the control means of the peripheral devices.
- the interface module also includes a processor for controlling data flow therethrough. As control signals are received from the control means, the module first converts the signals to digital values, to prepare the signals for processing. Data indicating the control means that generated the control signals and its associated peripheral device are grouped with the digital values of the control signals and is transmitted to the data collection computer as augmentation data.
- the interface module may also be provided with memory means for data storage.
- the memory means may include nonvolatile data storage means for storing information regarding the interconnections between each of the peripheral devices and the module, and volatile data storage means for storing augmentation data to be transmitted to the collection computer.
- the groups of augmentation data are then transmitted to the data collection computer for processing.
- the collection computer performs processing on the augmentation data to prepare the data for integration into a program running on the computer.
- the augmentation data is prepared for integration into the program by first sorting the groups of augmentation data as they are received from the interface module, for determining the particular peripheral device and the control means thereof that produced the augmentation data. Augmentation data received from the interface module is continuously sorted, organized, and configured into data records for integrating the data into the program.
- Augmentation data records are then integrated into a program, such as a virtual reality data base that defines a virtual world, running on the computer.
- the augmentation data enhances and may alter the movements of an object, such as a cartoon figure or character in the virtual world, so that the character is capable of having either somewhat normal movements or having augmented, or cartoonish, type movements and characteristics, as desired by the operator.
- the method of the present invention preferably comprises initially activating the invented system.
- the data collection computer transmits a request signal to the interface module to determine the number of peripheral data generating devices coupled thereto and the configuration of each of the different devices.
- the interface module transmits the configuration information to the data computer. Since each control means generates a specific type of control signal for generating augmentation data cc augment a specific feature or enhance specific movements of the character, the configuration information communicates to the data collection computer the specific type of augmentation data generated by each control means.
- the data collection computer receives the configuration information from the interface module, the computer is prepared to receive augmentation data therefrom, along with movement data output from the data generating equipment, such as a body suit, face movement tracking device, or both, or other and additional equipment.
- the data generating equipment such as a body suit, face movement tracking device, or both, or other and additional equipment.
- the equipment begins generating movement data, indicating the wearer's movements.
- An operator of the invented system which could be the wearer or another person, monitors the movements of the wearer.
- the operator actuates a selected control means of one of the peripheral devices to augment the desired feature.
- the control means may be used to augment such functions as calibrating the data generating equipment, horizontal and vertical positioning, and means for augmenting the movement data generated by the equipment, such as controlling cartoonish or other special effects.
- the cartoon and special effects could include causing the character's eyes to pop out of their head, roll and unroll the tongue of the character, raise and lower their eyebrows, or any other desired facial expression or body movement desired.
- the operator desires to augment eyebrow movement of the wearer, for causing the eyebrow to move substantially upwardly on the wearer's face to give the character a cartoonish appearance for example, the operator actuates the predetermined control means for generating augmentation data to augment movement of the eyebrow.
- the control means may comprise a button or other type switch, for generating specific control signals upon activation thereof for providing a predetermined enhancement of eyebrows movement.
- the button may comprise a variable output device, such as a potentiometer for instance, that is capable of generating output signals of varying amplitude, that are used to control the degree of augmentation of the augmented feature, such as the eyebrow.
- movement of the eyebrow such as raising the eyebrow may be only slightly enhanced, moving the eyebrow upwardly on the character's forehead or may be enhanced greatly, moving the character's eyebrows completely off their head to give the character a cartoon appearance, or enhance the cartoonish appearance of the character.
- the augmentation data is generated for a time period determined by the type of control means activated and collection computer or interface module, for example. If the activated control means comprises a momentary switch the activation time period thereof is preferably determined by either collection computer or interface module. When utilizing a variable output control means the activation time period thereof may be determined by the operator. The operator preferably is capable of determining the degree of augmentation of the selected feature, for adjusting the augmentation of the feature from null augmentation to full augmentation, as desired. As the augmentation data generated by activating the control means is transmitted to the collection computer, the movement data generated by the equipment is simultaneously transmitted to the computer for integrated the data simultaneously for altering the program running on the computer. Thus, the character's appearance can range from a substantially normal appearance to a cartoonish appearance as desired by the operator and determined by the data collection computer.
- FIG. 1 is a block diagram of a system for augmenting data and for integrating the augmented data into a program running on a computer system of the preferred embodiment of the present invention
- FIG. 2 is a block diagram of a peripheral device of the system of the preferred embodiment of the present invention.
- FIG. 3 is a schematic representation of the peripheral device of the system of the preferred embodiment of the present invention.
- FIG. 4 is a flow diagram of a method for augmenting data and for integrating the augmented data into a program running on a computer system of the preferred embodiment of the present invention.
- FIG. 1 of the drawings there is shown generally at 10 , a preferred embodiment of a system for augmenting data and for integrating the augmented data into a program running on a computer system constructed according to the principles of the present invention.
- the system of the present invention 10 couples to a computing system, shown generally at 12 , that collects and processes data generated by the system 10 and data generated by data generating equipment 14 .
- the data generating equipment 14 may comprise a data generating body suit, face movement tracking device, data generating glove, combinations thereof, or other and additional equipment.
- the data generating equipment 14 is configured for use with the computing system 12 , for integrating the data generated thereby into a data base defining a virtual world running on the computing system 12 .
- the system and method of the present invention 10 generates augmentation data, for augmenting movement data generated by the equipment 14 .
- the augmentation data generated by the invented system 10 and body movement data 15 generated by the equipment 14 can be simultaneously transmitted to the computing system 12 for augmenting and enhancing the movements of an object, such as a character, in the virtual world.
- the system 10 comprises an interface module 16 coupled to a first computer 18 of the computing system 12 .
- the first or data collection computer is, is coupled to the interface module 16 using known coupling means such as a serial or parallel data cable 20 , or wireless transmission means.
- a serial data cable 20 configured for high data transmission rates is provided for coupling the interface module 16 to the collection computer 18 .
- the interface module 16 has an output 22 and a plurality of inputs 24 .
- the invented module 16 may be configured with up to eight inputs 24 for coupling up to eight peripheral data generating devices 26 thereto.
- the peripheral devices 26 may comprise any suitable data generating device that is configurable for use with the invented system 10 .
- Suitable data generating devices 26 may include computer keyboards, pointing devices such as computer mice, data generating gloves, and computer joysticks.
- at least one specially configured joystick 26 A, along with other suitable devices comprise the peripheral devices 26 for generating signals representative of the desired augmentation data.
- the joystick 26 A includes a handle 28 , a base 30 for supporting the handle 28 , and a data cable 32 for coupling the joystick 26 A to the interface module 16 .
- the joystick 26 A is provided with a plurality of different type control signal generating means preferably 34 , 36 that generate specific control signals for generating augmentation data to augment a specific feature or enhance specific movements of the character.
- the control signals by the signal generating means 34 , 36 provide such functions as calibrating the data generating equipment 14 , horizontal and vertical positioning of an object such as a character or portion of a character in the virtual world, and means for augmenting the movement data generated by the equipment 14 , such as controlling cartoonish or other special effects.
- a first type 34 of the signal generating means comprises a momentary button or other type switch, while a second type 36 comprises a variable output switch device.
- each of the momentary switches 34 is provided for generating augmentation data that enhances or augments a selected feature or movement of the character a predetermined degree for a selected time period.
- the invented joystick 26 A may be provided with a push button switch 34 A located on an end 38 of the handle and with a second momentary switch 34 B positioned in a trigger region 40 of the handle 28 .
- the second type signal generating means 36 may comprise known devices, such as potentiometers for instance, that are capable of generating output signals of varying amplitude.
- a variable output device 36 A such as a commercially available pressure sensor is positioned in a thumb grip 44 depression of the trigger region 40 .
- the amplitude of signals generated thereby may increase or decrease as desired, for controlling the degree of augmentation of the augmented feature of the character.
- augmentation or enhancement of the predetermined feature may be only slightly enhanced, or may be enhanced greatly, to give the character a cartoon appearance or enhance the cartoonish appearance of the character, as controlled by the signals generated by the output device 36 A and controllable by the operator.
- each of the peripheral devices 26 further includes a multiplexer means 46 for selecting activated control signal generating means 34 , 36 to transmit control signals to the interface module 16 .
- the multiplexer means 46 preferably comprises an integrated semiconductor circuit device embodying known multiplexing circuitry.
- the multiplexer 46 has a plurality of inputs 48 coupled to outputs 50 of the signal generating means 34 , 36 and an output 52 for coupling the peripheral device 26 to an input 24 of the interface module 16 .
- the multiplexer 46 continuously samples its inputs 48 for sensing signals generated by activated control means 34 , 36 . Upon sensing activation of any of the control means 34 , 36 the multiplexer 46 selects the control means 34 generating the signal, to receive signals generated thereby and transmits the signals to the interface module 16 , for causing specific augmentation data to be generated.
- Nonvolatile memory means 54 may also be provided to retain information regarding the control means 34 , 36 .
- the memory means 54 comprises a known Electrically Erasable Programmable Read Only Memory (FEPROM) device and is programmed as is well known in the art.
- the EEPROM 54 is programmed with information that provides the collection computer 12 with the specific configuration of each control means 34 , 36 and the input 48 of the multiplexer 46 that the control means 34 , 36 is connected to.
- the invented interface module 16 is coupled between the peripheral devices 26 and data collection computer 18 for receiving signals generated by the devices 26 and for transmitting data representative of the generated signals to the computer 18 .
- An analog to digital (A-D) converter 56 is coupled between each output 52 of each peripheral device 26 and each input 24 of the module 16 for converting the analog signals generated by the control means 34 , 36 of the devices 26 to digital values.
- the module's inputs 24 are coupled to a multiplexer 58 retained therein.
- the multiplexer 58 again comprises a commercially available semiconductor device and functions in a manner analogous to the multiplexer 46 provided in each of the peripheral devices 26 . Accordingly, each of the plurality of multiplexer inputs 24 coupled are to the output 52 of each of the peripheral devices 26 .
- the multiplexer 58 continuously samples its inputs 24 for sensing signals output from each of the peripheral devices 26 , via the data cable 32 .
- the multiplexer 58 selects the peripheral device 26 , to receive signals generated thereby and transmit the signals to the data collection computer 18 , for causing specific augmentation data to be generated.
- the interface module 16 also includes a processor 60 , which may comprise any suitable semiconductor micro-controller device, for controlling data flow through the module 16 .
- An analog power source 61 and a digital power source 63 are coupled to the module 16 for supplying power thereto.
- the analog source 61 and digital source 63 are preferably each provided to reduce noise generated by the module.
- control signals are received by tile module 16 from the peripheral devices 26 , via the multiplexer 58 , the signals are first converted to digital values by the A-D converter 56 , to prepare the signals for processing.
- Data indicating the control means 34 , 36 that generated the control signals and its associated peripheral device 26 are grouped with the digital values of the control signals by the processor 60 to form the augmentation data.
- the processor 60 may also perform other desired data processing functions including digital signal level calibration and noise reduction, for example.
- the augmentation data may be transmitted to the data collection computer 12 for processing by the system 12 .
- the interface module 16 may also be provided with memory means 62 for data storage.
- the memory means 62 preferably includes nonvolatile data storage means 64 , such as an FEPROM, and volatile data storage means 66 , such as a known Random Access Memory (RAM) device.
- the LEPROM 64 is programmed with information that provides the collection computer 18 with the specific configuration of each of the peripheral devices 26 and the input 24 of the multiplexer 58 that the device 26 is connected to.
- the RAM device 66 may be provided for temporarily storing augmentation data to be transmitted to the collection computer 18 .
- the computing system 12 comprises the data collection computer 18 coupled to the interface module 16 for receiving augmentation data therefrom and a processing computer 68 for receiving processed augmentation data from the collection computer 18 .
- the data collection computer 18 includes a central processing unit (CPU) 70 for performing some processing on the augmentation data and a memory means 72 that may contain a processing program.
- CPU central processing unit
- the collection computer 18 continuously receives augmentation data as it is transmitted from the interface module 16 .
- the data is processed by first sorting the data into groups of data, with each data group representing data that is generated by a specific control means 34 , 36 of a specific device 26 .
- the processor 70 continuously sorts and organizes the data according to the control means 34 , 36 that generated the data, and configures the data into data records to prepare the data for processing by the processing computer 68 .
- the data collection computer 18 may also perform additional processing on the augmentation data, such as low-pass noise filtering or some normalization of the data.
- the processing computer 68 includes a CPU 74 that performs additional processing on the sorted augmentation data records and a memory means 76 that preferably contains a data base program defining a virtual world.
- the CPU 74 processes the data and integrates the data into the data base program running on the computer 68 for augmenting or enhancing the movements of an object, such as a cartoon figure or character in the virtual world.
- the augmentation data causes the character to have augmented, or cartoonish, type movements and characteristics, as controlled by the specific control means 34 , 36 generating the control signals that generate the augmentation data.
- the computer 18 As the data collection computer 18 is receiving augmentation data from the interface module 16 , the computer 18 is also receiving movement data generated by the data generating equipment 14 . Some data processing, such as noise filtering and normalization, may be performed on the movement data as it is received by the computer 18 . After processing, the movement data is transmitted to the processing computer 68 for integration into the data base program running on the computer 68 for controlling the movements of the character and for augmentation of the movement data by the processed augmentation data.
- Some data processing such as noise filtering and normalization
- the method of the present invention 20 is invoked in start block 80 .
- the invented system 10 initially activated.
- the computer system 12 transmits a request signal to the interface module 16 to obtain configuration and number of peripheral device information stored in the EEPROM 64 thereof.
- the module 16 transmits a request signal to each of the peripheral devices 26 for accessing the configuration information stored in each LEPROM 64 thereof.
- the configuration information is transmitted to the computer system 12 in processes block 88 .
- the data collection computer 18 is then prepared to receive augmentation data from the interface module 16 , along with movement data output from the data generating equipment 14 .
- the equipment 14 begins generating movement data, indicating the wearer's movements, and transmitting the movement data to the data collection computer 18 in process block 90 .
- an operator of the invented system 10 which could be the wearer or another person, monitors the movements of the wearer.
- the operator actuates a selected control means 34 , 36 of one of the peripheral devices 26 to augment a desired feature or features, or facial expression, for example of the wearer.
- the operator desires to augment eyebrow movement of the wearer, for causing the eyebrow to move substantially upwardly on the wearer's face to give the character a cartoonish appearance for example, the operator actuates a predetermined one, or more, of the control means 34 , 36 for generating augmentation data to augment movement of the eyebrow.
- the control means 34 , 36 generates control signals that are determined by the type of control means for achieving a desired augmentation of the movement data.
- the control means activated comprises the second type of control means 36 , such as the pressure sensor 36 A
- the control means 36 may be incrementally activated for achieving a predetermined enhancement of eyebrows movement.
- movement of the eyebrow such as raising the eyebrow may be only slightly enhanced, moving the eyebrow upwardly on the character's forehead or may be enhanced greatly, moving the character's eyebrows completely off their head to give the character a cartoon appearance, or enhance the cartoonish appearance of the character.
- the augmentation data is generated for a time period determined by the type of control means 34 , 36 activated and data collection computer 18 , for example. If the activated control means comprises a momentary switch 34 , the activation time period thereof is preferably determined by the collection computer 18 . When utilizing a variable output control means 36 the activation time period thereof may be determined by the operator. The operator preferably is capable of determining the degree of augmentation of the selected feature, for adjusting the augmentation of the feature from null augmentation to full augmentation, as desired.
- the data collection computer's processor 70 continuously sorts and organizes the data, then transmits the data to the processing computer 68 .
- the processing computer 68 receives the data transmitted by the collection computer 18 , in process block 94 for integration into the data base program running on the computer 68 for controlling the movements of the character and for augmentation of the movement data by the processed augmentation data.
- the augmentation data generated by activated the control means 34 , 36 is continuously transmitted to the collection computer 18
- the movement data generated by the equipment is simultaneously transmitted to the computer 18 for integrating the data simultaneously for altering the program running on the processing computer 68 .
- the character's appearance can range from a substantially normal appearance to a cartoonish appearance as desired by the operator and determined by the processing computer 68 .
- the method of the present invention terminates at end block 96 .
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
A system and method for augmenting data and for integrating the augmented data into a program running on a computer system is provided. The invented system couples to a data collection computer along with data generating equipment, such as a body suit, for augmenting data generated thereby. Augmentation data generated by the system and body movement data generated by the suit is simultaneously transmitted to the computer containing a data base defining a virtual world. As the suit generates movement data and transmits the data to the computer for controlling the movements of an object in the virtual world, an operator of the system monitors the data generated by the equipment and activates the system to selectively augment data generated thereby, for enhancing the movements of the character. The invented system transmits the augmentation data to the data collection computer to augment the data generated by the equipment so that the character, has exaggerated movements or cartoonish features. Additionally, the system and method of the present invention augments the data generated by the data generating device without overwriting the data generated thereby, so that the exaggerated movements of the character can continuously track the movements indicated by the data generating equipment.
Description
- This patent application is a continuation of U.S. patent application Ser. No. 09/066,720 filed Apr. 23, 1998 for DATA AUGMENTATION SYSTEM AND METHOD which in turn is a continuation-in-part of U.S. patent application Ser. No. 60/044,608 filed Apr. 24, 1997, both of which applications are incorporated herein by this reference thereto.
- 1. Field of the Invention
- The present invention relates generally to computer data input and data manipulation devices, and more particularly, to a system and method for augmenting data generated by peripheral devices and for integrating the augmented data into a program running on a computer system.
- 2. Description of the Related Art
- Virtual reality systems are computer based systems that provide the experience to a participant of acting in a simulated environment that forms a three dimensional virtual world. These systems are used in several different applications such as commercial flight simulators, surgical training systems, and entertainment systems including computer games and video arcade games to name a few.
- In virtual reality systems, the participant often wears a head-mounted device that enables viewing of a virtual reality world generated by the computer. The system also includes means for interacting with the virtual world, such as known data generation or manipulation devices. The data manipulation devices include known pointing devices, such as joysticks, or specially configured gloves that contain sensors and actuators, for interacting with objects in the virtual world. Additionally, a data generating body suit may be provided to enable the user to influence and to feel objects in the virtual world.
- Computer generated animation is an increasingly prevalent media form. Computer generated animation is presently being used in such applications as full-length motion pictures, crime reenactments, short length films, television commercials, and children's cartoons. An expeditious method of creating computer generated animation comprises providing actors with all, or some, of the virtual reality equipment previously discussed, so that the wearer of the equipment can control the movements of a character in the animation, so that the character can act out scenes in the animation as directed. Since a director of the computer animation can view and direct the actions of an actor wearing the equipment as they are performing, the director can make any desired changes to the actions of the actor as they are performing to obtain the desired scene. Thus, the director can control the actions of the character as a scene is being performed, for generating the computer animation in real time.
- It is known that virtual reality systems include a computer that processes data generated by the equipment worn on the actor for controlling the movements of an object, such as a character for example, in a computer animation. A disadvantage of known virtual reality systems, is that the data generated by the equipment and processed by the computer only enables the character controlled by the system to mimic the movements of the actor. Thus, if it is desired for the character to have exaggerated features or movements, such as facial expressions, the character controlled by the actor must first be created, or mapped, by the system with the desired exaggerated features.
- A disadvantage of mapping exaggerated features to obtain the desired appearance of the character is that the character's appearance is permanently altered with the exaggerated features. Thus, the character no longer has a normal appearance if desired. Therefore, a substantial disadvantage of prior art virtual reality systems, many of which are used for creating computer generated animation, is that means are not provided for augmenting the data generated by the equipment and processed by the system to control the virtual reality character. Therefore, it would be advantageous to provide a virtual reality system that augments data generated by the equipment thereof, for temporarily enhancing the movements or features of a character controller by the system.
- A prior art virtual reality system is disclosed in U.S. Pat. No. 5,515,078, to Greschler et al. Disclosed therein is a system for receiving positional information and displaying a virtual world based on the positional information. The system includes a base and a chair with an attached monitor that may be rotated with respect to the base by the user of the system. A measuring device determines the rotational position of the chair. The system includes joysticks that have bases attached to the chair or the monitor so that they move with the chair. Data from the joysticks and from the measuring device are sent to a processor, which accesses a database defining a virtual world and generates an image on the monitor. The monitor image represents apparent movement within and through the virtual world represented by the databases.
- Devices have been provided in the prior art that measure the relative position and orientation of a body in space, then transmit relative data to a computer for processing the data. These devices may include a body suit that has a number of sensors, or receivers, for determining the position of the body in space. One such device is disclosed in U.S. Pat. No. 4,945,305, to Blood. The device disclosed therein quantitatively measures the position of receiver antennae relative to transmitter antennae. The device includes transmitter antennae consisting of a two or three axis aparallel transmitter antennae that generates at least two DC magnetic vectors. A pulsed DC signal sequentially supplies the aparallel antennae with DC poles to drive the antennae, to generate the DC magnetic vectors. A like number of aparallel receiver antennae are provided to detect the DC magnetic vectors.
- The number of transmitter antennae multiplied by the number of receiver antennae is at least equal to the number of degrees of freedom of the desired quantitative measurement of the position of the receiver antenna relative to the transmitter antennae. Means for compensating for the effects of the earth's magnetic field on the operation of the device are also provided. Additionally included are signal processing means to ascertain the magnitude of the detected DC magnetic vectors and to quantitatively compute the relative position and orientation of the receiver antennae relative to the transmitter antennae.
- Although the devices disclosed in the above enumerated prior art references have improved features, there still exists a need for a virtual reality system that augments data generated by the equipment thereof for temporarily enhancing the movements or features of a character controller by the system.
- These and other objects and advantages of the present invention are achieved by providing a system and method for augmenting data and for integrating the augmented data into a program running on a computer system. The system of the present invention couples to a data collection computer along with data generating equipment, such as a data generating body suit, for augmenting data generated by the equipment. Augmentation data generated by the invented system and body movement data generated by the body suit can be simultaneously transmitted to the data collection computer which may contain a data base defining a virtual world.
- As the body suit generates movement data and transmits the data to the data collection computer for controlling the movements of an object, a character in the virtual world for example, an operator of the invented system monitors the data generated by the equipment and activates the system to selectively augment data generated thereby, for enhancing the movements of the character. The invented system transmits the augmentation data to the data collection computer to augment the data generated by the equipment so that the character has exaggerated movements or cartoonish features. Additionally, the system and method of the present invention augments the data generated by the data-generating device without overwriting the data generated thereby, so that the exaggerated movements of the character can continuously track the movements indicated by the data generating equipment, if desired.
- For example, if a wearer of a particular piece of data generating equipment such as a head set smiles, the invented system can remain inactive, so that the character in the virtual world may have a smile substantially similar to the wearer. However, if the operator of the invented system desires to augment the smile of the character, the operator activates the system for transmitting augmentation data to the data collection computer simultaneously with the movement data indicating the wearer's smile. The augmentation data can enhance the movement data, so that the character has a substantially larger smile, such as a cartoonish grin, for a selected time period. When it is desired to have the character again track the wearer's expressions, the operator can reduce or cease transmission of augmentation data, so that the character has expressions that are again analogous to the wearer's expressions.
- In the preferred embodiment of the present invention, the system comprises an interface module coupled to the data collection computer and to peripheral data generating devices that may include specially configured joysticks that are provided with electronic circuitry that generates control signals upon activation by the operator, for achieving desired data augmentation. The circuitry includes a plurality of control means that output control signals to provide such functions as calibrating the data generating equipment, horizontal and vertical positioning, and means for augmenting the movement data generated by the equipment, such as controlling cartoonish or other special effects.
- The circuitry of each of the peripheral devices also includes multiplexer means having an output coupled to the interface module for transmitting augmentation data to the data collection computer and a plurality of inputs, with an input coupled to each of the control means. The multiplexer means continuously checks its inputs for sensing signals generated by the control means coupled thereto, for determining activation thereof. Upon activation of any of the control means, the multiplexer means receives signals generated thereby and transmits the signals to the interface module, for transmitting augmentation data determined by the activated control means to the computer. Memory means may also be provided to retain information as to the different types of control means that the particular device embodies, and to determine which specific control means is coupled to each input of the multiplexer means.
- In the present invention, the interface module is coupled between the peripheral devices and data collection computer for receiving signals generated by the devices and for transmitting augmentation data to the computer. The module has a plurality of inputs for coupling the peripheral devices thereto. The inputs of the module are continuously checked for sensing signals generated by the control means of the peripheral devices. The interface module also includes a processor for controlling data flow therethrough. As control signals are received from the control means, the module first converts the signals to digital values, to prepare the signals for processing. Data indicating the control means that generated the control signals and its associated peripheral device are grouped with the digital values of the control signals and is transmitted to the data collection computer as augmentation data.
- The interface module may also be provided with memory means for data storage. The memory means may include nonvolatile data storage means for storing information regarding the interconnections between each of the peripheral devices and the module, and volatile data storage means for storing augmentation data to be transmitted to the collection computer.
- The groups of augmentation data are then transmitted to the data collection computer for processing. The collection computer performs processing on the augmentation data to prepare the data for integration into a program running on the computer. The augmentation data is prepared for integration into the program by first sorting the groups of augmentation data as they are received from the interface module, for determining the particular peripheral device and the control means thereof that produced the augmentation data. Augmentation data received from the interface module is continuously sorted, organized, and configured into data records for integrating the data into the program.
- Augmentation data records are then integrated into a program, such as a virtual reality data base that defines a virtual world, running on the computer. The augmentation data enhances and may alter the movements of an object, such as a cartoon figure or character in the virtual world, so that the character is capable of having either somewhat normal movements or having augmented, or cartoonish, type movements and characteristics, as desired by the operator.
- The method of the present invention preferably comprises initially activating the invented system. Upon initial activation of the system, the data collection computer transmits a request signal to the interface module to determine the number of peripheral data generating devices coupled thereto and the configuration of each of the different devices. Upon determining the number and configuration of the peripheral devices coupled thereto, the interface module transmits the configuration information to the data computer. Since each control means generates a specific type of control signal for generating augmentation data cc augment a specific feature or enhance specific movements of the character, the configuration information communicates to the data collection computer the specific type of augmentation data generated by each control means.
- Once the data collection computer receives the configuration information from the interface module, the computer is prepared to receive augmentation data therefrom, along with movement data output from the data generating equipment, such as a body suit, face movement tracking device, or both, or other and additional equipment.
- As a wearer of the equipment begins moving about, the equipment begins generating movement data, indicating the wearer's movements. An operator of the invented system, which could be the wearer or another person, monitors the movements of the wearer. When desired, the operator actuates a selected control means of one of the peripheral devices to augment the desired feature. As discussed, the control means may be used to augment such functions as calibrating the data generating equipment, horizontal and vertical positioning, and means for augmenting the movement data generated by the equipment, such as controlling cartoonish or other special effects. The cartoon and special effects could include causing the character's eyes to pop out of their head, roll and unroll the tongue of the character, raise and lower their eyebrows, or any other desired facial expression or body movement desired.
- If the operator desires to augment eyebrow movement of the wearer, for causing the eyebrow to move substantially upwardly on the wearer's face to give the character a cartoonish appearance for example, the operator actuates the predetermined control means for generating augmentation data to augment movement of the eyebrow. The control means may comprise a button or other type switch, for generating specific control signals upon activation thereof for providing a predetermined enhancement of eyebrows movement. Alternatively, the button may comprise a variable output device, such as a potentiometer for instance, that is capable of generating output signals of varying amplitude, that are used to control the degree of augmentation of the augmented feature, such as the eyebrow. Thus, movement of the eyebrow, such as raising the eyebrow may be only slightly enhanced, moving the eyebrow upwardly on the character's forehead or may be enhanced greatly, moving the character's eyebrows completely off their head to give the character a cartoon appearance, or enhance the cartoonish appearance of the character.
- The augmentation data is generated for a time period determined by the type of control means activated and collection computer or interface module, for example. If the activated control means comprises a momentary switch the activation time period thereof is preferably determined by either collection computer or interface module. When utilizing a variable output control means the activation time period thereof may be determined by the operator. The operator preferably is capable of determining the degree of augmentation of the selected feature, for adjusting the augmentation of the feature from null augmentation to full augmentation, as desired. As the augmentation data generated by activating the control means is transmitted to the collection computer, the movement data generated by the equipment is simultaneously transmitted to the computer for integrated the data simultaneously for altering the program running on the computer. Thus, the character's appearance can range from a substantially normal appearance to a cartoonish appearance as desired by the operator and determined by the data collection computer.
- It is therefore an object of the present invention to provide a system and method for augmenting data generated by virtual reality equipment;
- It is another object of the present invention to provide a system and method for augmenting data generated by virtual reality equipment thereof and for integrating the augmented data into a program running on a computer system for altering the program;
- It is another object of the present invention to provide a system and method for augmenting data generated by virtual reality equipment for temporarily enhancing the movements and features of a character controller by the system; and
- It is another object of the present invention to provide a system and method for augmenting data generated by virtual reality equipment for enhancing the movements and features of a character controller by the system and which enables the enhanced movements and features of the character to mimic the movements of a wearer of the virtual reality equipment.
- The objects and features of the present invention, which are believed to be novel, are set forth with particularity in the appended claims. The present invention, both as to its organization and manner of operation, together with further objects and advantages, may best be understood by reference to the following description, taken in connection with the accompanying drawings, in which:
- FIG. 1 is a block diagram of a system for augmenting data and for integrating the augmented data into a program running on a computer system of the preferred embodiment of the present invention;
- FIG. 2 is a block diagram of a peripheral device of the system of the preferred embodiment of the present invention;
- FIG. 3 is a schematic representation of the peripheral device of the system of the preferred embodiment of the present invention; and
- FIG. 4 is a flow diagram of a method for augmenting data and for integrating the augmented data into a program running on a computer system of the preferred embodiment of the present invention.
- The detailed description set forth below in connection with the appended drawings is intended as a description of presently-preferred embodiments of the invention and is not intended to represent the only forms in which the present invention may be constructed and/or utilized. The description sets forth the functions and the sequence of steps for constructing and operating the invention in connection with the illustrated embodiments. However, it is to be understood that the same or equivalent functions and sequences may be accomplished by different embodiments that are also intended to be encompassed within the spirit and scope of the invention.
- Referring now to FIG. 1 of the drawings, there is shown generally at10, a preferred embodiment of a system for augmenting data and for integrating the augmented data into a program running on a computer system constructed according to the principles of the present invention. The system of the
present invention 10 couples to a computing system, shown generally at 12, that collects and processes data generated by thesystem 10 and data generated bydata generating equipment 14. Thedata generating equipment 14, may comprise a data generating body suit, face movement tracking device, data generating glove, combinations thereof, or other and additional equipment. Preferably, thedata generating equipment 14 is configured for use with thecomputing system 12, for integrating the data generated thereby into a data base defining a virtual world running on thecomputing system 12. - The system and method of the
present invention 10 generates augmentation data, for augmenting movement data generated by theequipment 14. The augmentation data generated by the inventedsystem 10 and body movement data 15 generated by theequipment 14 can be simultaneously transmitted to thecomputing system 12 for augmenting and enhancing the movements of an object, such as a character, in the virtual world. - Referring to FIGS.1-3, in the preferred embodiment of the present invention, the
system 10 comprises aninterface module 16 coupled to afirst computer 18 of thecomputing system 12. The first or data collection computer is, is coupled to theinterface module 16 using known coupling means such as a serial orparallel data cable 20, or wireless transmission means. Preferably, aserial data cable 20 configured for high data transmission rates is provided for coupling theinterface module 16 to thecollection computer 18. Theinterface module 16 has anoutput 22 and a plurality ofinputs 24. The inventedmodule 16 may be configured with up to eightinputs 24 for coupling up to eight peripheraldata generating devices 26 thereto. - The
peripheral devices 26 may comprise any suitable data generating device that is configurable for use with the inventedsystem 10. Suitabledata generating devices 26 may include computer keyboards, pointing devices such as computer mice, data generating gloves, and computer joysticks. Preferably, at least one specially configuredjoystick 26A, along with other suitable devices comprise theperipheral devices 26 for generating signals representative of the desired augmentation data. Thejoystick 26A includes ahandle 28, abase 30 for supporting thehandle 28, and adata cable 32 for coupling thejoystick 26A to theinterface module 16. - The
joystick 26A is provided with a plurality of different type control signal generating means preferably 34, 36 that generate specific control signals for generating augmentation data to augment a specific feature or enhance specific movements of the character. The control signals by the signal generating means 34, 36 provide such functions as calibrating thedata generating equipment 14, horizontal and vertical positioning of an object such as a character or portion of a character in the virtual world, and means for augmenting the movement data generated by theequipment 14, such as controlling cartoonish or other special effects. - A
first type 34 of the signal generating means comprises a momentary button or other type switch, while asecond type 36 comprises a variable output switch device. In the preferred embodiment, each of themomentary switches 34 is provided for generating augmentation data that enhances or augments a selected feature or movement of the character a predetermined degree for a selected time period. The inventedjoystick 26A may be provided with apush button switch 34A located on anend 38 of the handle and with a secondmomentary switch 34B positioned in atrigger region 40 of thehandle 28. - The second type signal generating means36 may comprise known devices, such as potentiometers for instance, that are capable of generating output signals of varying amplitude. In the
present invention 10, avariable output device 36A, such as a commercially available pressure sensor is positioned in athumb grip 44 depression of thetrigger region 40. As an operator (not shown) of the inventedjoystick 26A presses on thesensor 36A, the amplitude of signals generated thereby may increase or decrease as desired, for controlling the degree of augmentation of the augmented feature of the character. Thus, augmentation or enhancement of the predetermined feature may be only slightly enhanced, or may be enhanced greatly, to give the character a cartoon appearance or enhance the cartoonish appearance of the character, as controlled by the signals generated by theoutput device 36A and controllable by the operator. - Referring to FIG. 2 and FIG. 3, each of the
peripheral devices 26 further includes a multiplexer means 46 for selecting activated control signal generating means 34, 36 to transmit control signals to theinterface module 16. The multiplexer means 46 preferably comprises an integrated semiconductor circuit device embodying known multiplexing circuitry. Themultiplexer 46 has a plurality ofinputs 48 coupled tooutputs 50 of the signal generating means 34, 36 and anoutput 52 for coupling theperipheral device 26 to aninput 24 of theinterface module 16. - The
multiplexer 46 continuously samples itsinputs 48 for sensing signals generated by activated control means 34, 36. Upon sensing activation of any of the control means 34, 36 themultiplexer 46 selects the control means 34 generating the signal, to receive signals generated thereby and transmits the signals to theinterface module 16, for causing specific augmentation data to be generated. Nonvolatile memory means 54 may also be provided to retain information regarding the control means 34, 36. In the preferred embodiment, the memory means 54 comprises a known Electrically Erasable Programmable Read Only Memory (FEPROM) device and is programmed as is well known in the art. TheEEPROM 54 is programmed with information that provides thecollection computer 12 with the specific configuration of each control means 34, 36 and theinput 48 of themultiplexer 46 that the control means 34, 36 is connected to. - Referring now to FIG. 1 and FIG. 2 of the drawings, the invented
interface module 16 is coupled between theperipheral devices 26 anddata collection computer 18 for receiving signals generated by thedevices 26 and for transmitting data representative of the generated signals to thecomputer 18. An analog to digital (A-D)converter 56 is coupled between eachoutput 52 of eachperipheral device 26 and eachinput 24 of themodule 16 for converting the analog signals generated by the control means 34, 36 of thedevices 26 to digital values. The module'sinputs 24 are coupled to amultiplexer 58 retained therein. Themultiplexer 58 again comprises a commercially available semiconductor device and functions in a manner analogous to themultiplexer 46 provided in each of theperipheral devices 26. Accordingly, each of the plurality ofmultiplexer inputs 24 coupled are to theoutput 52 of each of theperipheral devices 26. Themultiplexer 58 continuously samples itsinputs 24 for sensing signals output from each of theperipheral devices 26, via thedata cable 32. - Upon sensing signals generated by any of the
devices 26, themultiplexer 58 selects theperipheral device 26, to receive signals generated thereby and transmit the signals to thedata collection computer 18, for causing specific augmentation data to be generated. Theinterface module 16 also includes aprocessor 60, which may comprise any suitable semiconductor micro-controller device, for controlling data flow through themodule 16. Ananalog power source 61 and adigital power source 63 are coupled to themodule 16 for supplying power thereto. Theanalog source 61 anddigital source 63 are preferably each provided to reduce noise generated by the module. - As control signals are received by
tile module 16 from theperipheral devices 26, via themultiplexer 58, the signals are first converted to digital values by theA-D converter 56, to prepare the signals for processing. Data indicating the control means 34, 36 that generated the control signals and its associatedperipheral device 26 are grouped with the digital values of the control signals by theprocessor 60 to form the augmentation data. Theprocessor 60 may also perform other desired data processing functions including digital signal level calibration and noise reduction, for example. After processing, the augmentation data may be transmitted to thedata collection computer 12 for processing by thesystem 12. - The
interface module 16 may also be provided with memory means 62 for data storage. The memory means 62 preferably includes nonvolatile data storage means 64, such as an FEPROM, and volatile data storage means 66, such as a known Random Access Memory (RAM) device. TheLEPROM 64 is programmed with information that provides thecollection computer 18 with the specific configuration of each of theperipheral devices 26 and theinput 24 of themultiplexer 58 that thedevice 26 is connected to. TheRAM device 66 may be provided for temporarily storing augmentation data to be transmitted to thecollection computer 18. - Referring again to FIG. 1 of the drawings, in the preferred embodiment of the
present invention 10, thecomputing system 12 comprises thedata collection computer 18 coupled to theinterface module 16 for receiving augmentation data therefrom and aprocessing computer 68 for receiving processed augmentation data from thecollection computer 18. Thedata collection computer 18 includes a central processing unit (CPU) 70 for performing some processing on the augmentation data and a memory means 72 that may contain a processing program. - The
collection computer 18 continuously receives augmentation data as it is transmitted from theinterface module 16. As the augmentation data is received by thecomputer 18, the data is processed by first sorting the data into groups of data, with each data group representing data that is generated by a specific control means 34, 36 of aspecific device 26. Theprocessor 70 continuously sorts and organizes the data according to the control means 34, 36 that generated the data, and configures the data into data records to prepare the data for processing by theprocessing computer 68. Thedata collection computer 18 may also perform additional processing on the augmentation data, such as low-pass noise filtering or some normalization of the data. - The
processing computer 68 includes aCPU 74 that performs additional processing on the sorted augmentation data records and a memory means 76 that preferably contains a data base program defining a virtual world. As the augmentation data records transmitted from thedata collection computer 18 are received by theprocessing computer 68, theCPU 74 processes the data and integrates the data into the data base program running on thecomputer 68 for augmenting or enhancing the movements of an object, such as a cartoon figure or character in the virtual world. The augmentation data causes the character to have augmented, or cartoonish, type movements and characteristics, as controlled by the specific control means 34, 36 generating the control signals that generate the augmentation data. - As the
data collection computer 18 is receiving augmentation data from theinterface module 16, thecomputer 18 is also receiving movement data generated by thedata generating equipment 14. Some data processing, such as noise filtering and normalization, may be performed on the movement data as it is received by thecomputer 18. After processing, the movement data is transmitted to theprocessing computer 68 for integration into the data base program running on thecomputer 68 for controlling the movements of the character and for augmentation of the movement data by the processed augmentation data. - Referring now to FIG. 4 of the drawings, the method of the
present invention 20 is invoked instart block 80. Inprocess block 82 the inventedsystem 10 initially activated. Upon initial activation of thesystem 10, inprocess block 84, thecomputer system 12 transmits a request signal to theinterface module 16 to obtain configuration and number of peripheral device information stored in theEEPROM 64 thereof. Inprocess block 86, themodule 16 transmits a request signal to each of theperipheral devices 26 for accessing the configuration information stored in each LEPROM 64 thereof. Upon receiving the configuration information from each of theperipheral devices 26 andinterface module 16, the configuration information is transmitted to thecomputer system 12 in processes block 88. Thedata collection computer 18 is then prepared to receive augmentation data from theinterface module 16, along with movement data output from thedata generating equipment 14. - As a wearer (not shown) of the equipment begins moving about, the
equipment 14 begins generating movement data, indicating the wearer's movements, and transmitting the movement data to thedata collection computer 18 inprocess block 90. Simultaneously, inprocess block 90, as the movement data from theequipment 14 is received by thecomputer 18, an operator of the inventedsystem 10, which could be the wearer or another person, monitors the movements of the wearer. When desired, the operator actuates a selected control means 34, 36 of one of theperipheral devices 26 to augment a desired feature or features, or facial expression, for example of the wearer. - For example, if the operator desires to augment eyebrow movement of the wearer, for causing the eyebrow to move substantially upwardly on the wearer's face to give the character a cartoonish appearance for example, the operator actuates a predetermined one, or more, of the control means34, 36 for generating augmentation data to augment movement of the eyebrow. The control means 34, 36 generates control signals that are determined by the type of control means for achieving a desired augmentation of the movement data. For example, if the control means activated comprises the second type of control means 36, such as the
pressure sensor 36A, the control means 36 may be incrementally activated for achieving a predetermined enhancement of eyebrows movement. Thus, movement of the eyebrow, such as raising the eyebrow may be only slightly enhanced, moving the eyebrow upwardly on the character's forehead or may be enhanced greatly, moving the character's eyebrows completely off their head to give the character a cartoon appearance, or enhance the cartoonish appearance of the character. - The augmentation data is generated for a time period determined by the type of control means34, 36 activated and
data collection computer 18, for example. If the activated control means comprises amomentary switch 34, the activation time period thereof is preferably determined by thecollection computer 18. When utilizing a variable output control means 36 the activation time period thereof may be determined by the operator. The operator preferably is capable of determining the degree of augmentation of the selected feature, for adjusting the augmentation of the feature from null augmentation to full augmentation, as desired. - In
process block 92, the data collection computer'sprocessor 70 continuously sorts and organizes the data, then transmits the data to theprocessing computer 68. Theprocessing computer 68 receives the data transmitted by thecollection computer 18, inprocess block 94 for integration into the data base program running on thecomputer 68 for controlling the movements of the character and for augmentation of the movement data by the processed augmentation data. The augmentation data generated by activated the control means 34, 36 is continuously transmitted to thecollection computer 18, the movement data generated by the equipment is simultaneously transmitted to thecomputer 18 for integrating the data simultaneously for altering the program running on theprocessing computer 68. Thus, the character's appearance can range from a substantially normal appearance to a cartoonish appearance as desired by the operator and determined by theprocessing computer 68. The method of the present invention terminates atend block 96. - Those skilled in the art will appreciate that various adaptations and modifications of the just-described preferred embodiments can be configured without departing from the scope and spirit of the invention. Therefore, it is to be understood that, within the scope of the appended claims, the invention may be practiced other than as specifically described herein.
Claims (5)
1. A system for augmenting data comprising:
control signal generating means for generating selected control signals representative of selected augmentation data;
interface means coupled to the control signal generating means for receiving the control signals therefrom for generating augmentation data determined by the control signals; and
computing means for integrating the augmentation data into a data base program running on the computing means, the computing means applying the augmentation data to character movement data manipulated by the data base program for the direct enhancement thereof.
2. The system of wherein the augmentation data is integrated into the data base program for altering selected components of the program for predetermined time periods.
claim 1
3. The system of wherein the data base program defines a virtual world, the augmentation data integrated into the data base for altering the characteristics of an object in the virtual world.
claim 2
4. The system of further comprising:
claim 3
data generating means for generating data for controlling the movements of the object; and
the computing means integrating the data into the data base for controlling the movements of the object in the virtual world and simultaneously processing the augmentation data for augmenting the characteristics of the object, as the object is controlled by the data generating means.
5. The system of wherein the augmentation data augments at least one predetermined characteristic of the object, as the object is controlled by the data generated by the data generating means.
claim 4
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/764,485 US20010001556A1 (en) | 1997-04-24 | 2001-01-09 | Data augmentation system and method |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US4460897P | 1997-04-24 | 1997-04-24 | |
US09/066,720 US6232989B1 (en) | 1997-04-24 | 1998-04-23 | Data augmentation system and method |
US09/764,485 US20010001556A1 (en) | 1997-04-24 | 2001-01-09 | Data augmentation system and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/066,720 Continuation US6232989B1 (en) | 1997-04-24 | 1998-04-23 | Data augmentation system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20010001556A1 true US20010001556A1 (en) | 2001-05-24 |
Family
ID=21933309
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/066,720 Expired - Fee Related US6232989B1 (en) | 1997-04-24 | 1998-04-23 | Data augmentation system and method |
US09/764,485 Abandoned US20010001556A1 (en) | 1997-04-24 | 2001-01-09 | Data augmentation system and method |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/066,720 Expired - Fee Related US6232989B1 (en) | 1997-04-24 | 1998-04-23 | Data augmentation system and method |
Country Status (2)
Country | Link |
---|---|
US (2) | US6232989B1 (en) |
WO (1) | WO1998048344A2 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010047183A1 (en) | 2000-04-05 | 2001-11-29 | Salvatore Privitera | Surgical device for the collection of soft tissue |
US20080146965A1 (en) | 2003-08-11 | 2008-06-19 | Salvatore Privitera | Surgical Device for The Collection of Soft Tissue |
KR101640043B1 (en) * | 2010-04-14 | 2016-07-15 | 삼성전자주식회사 | Method and Apparatus for Processing Virtual World |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5015083A (en) * | 1989-05-19 | 1991-05-14 | Rockwell International Corporation | Aircraft vision augmentation system with adjustable external mirror and cockpit mirror |
DE69223489T2 (en) * | 1991-09-09 | 1998-07-16 | Sun Microsystems Inc | Device and method for managing the assignment of identification values of display attributes and of several hardware color tables |
WO1994012913A1 (en) * | 1992-11-27 | 1994-06-09 | Voxel | Methods and apparatus for making holograms |
US5818462A (en) * | 1994-07-01 | 1998-10-06 | Digital Equipment Corporation | Method and apparatus for producing complex animation from simpler animated sequences |
US6031549A (en) * | 1995-07-19 | 2000-02-29 | Extempo Systems, Inc. | System and method for directed improvisation by computer controlled characters |
US5995518A (en) * | 1997-05-01 | 1999-11-30 | Hughes Electronics Corporation | System and method for communication of information using channels of different latency |
-
1998
- 1998-04-23 WO PCT/US1998/008446 patent/WO1998048344A2/en active Application Filing
- 1998-04-23 US US09/066,720 patent/US6232989B1/en not_active Expired - Fee Related
-
2001
- 2001-01-09 US US09/764,485 patent/US20010001556A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
WO1998048344A3 (en) | 1999-03-04 |
WO1998048344A2 (en) | 1998-10-29 |
US6232989B1 (en) | 2001-05-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10720189B2 (en) | Haptic effect generation for space-dependent content | |
JP6276882B1 (en) | Information processing method, apparatus, and program for causing computer to execute information processing method | |
EP0634031B1 (en) | Apparatus and method for eye tracking interface | |
US5517021A (en) | Apparatus and method for eye tracking interface | |
CN105264460B (en) | Hologram object is fed back | |
CN105027030B (en) | The wireless wrist calculating connected for three-dimensional imaging, mapping, networking and interface and control device and method | |
US6072467A (en) | Continuously variable control of animated on-screen characters | |
US20200402265A1 (en) | Image processing apparatus, content processing system, and image processing method | |
EP3364272A1 (en) | Automatic localized haptics generation system | |
US20070149282A1 (en) | Interactive gaming method and apparatus with emotion perception ability | |
KR20180070681A (en) | Select virtual objects in 3D space | |
US20100214214A1 (en) | Remote input device | |
KR20150129621A (en) | Systems and methods for providing haptic feedback for remote interactions | |
US5929844A (en) | First person perspective control system | |
Holloway et al. | Virtual environments: A survey of the technology | |
WO1999035633A2 (en) | Human motion following computer mouse and game controller | |
AU7736694A (en) | Virtual reality network | |
CN111930223A (en) | Movable display for viewing and interacting with computer-generated environments | |
JP2000350860A (en) | Composite reality feeling device and method for generating composite real space picture | |
US6407762B2 (en) | Camera-based interface to a virtual reality application | |
US20040041828A1 (en) | Adaptive non-contact computer user-interface system and method | |
US20180095532A1 (en) | Virtual Reality Head-Mounted Device | |
US6232989B1 (en) | Data augmentation system and method | |
WO2003003185A1 (en) | System for establishing a user interface | |
CN110461427A (en) | Zoom facility and correlation technique |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MODERN CARTOONS, LTD., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WALKER, CHRISTOPHER;BEHESHTI, BABAK;REEL/FRAME:011479/0181;SIGNING DATES FROM 20001227 TO 20001228 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |