EP2092518A1 - Audio interface for controlling a motion signal - Google Patents
Audio interface for controlling a motion signalInfo
- Publication number
- EP2092518A1 EP2092518A1 EP07816041A EP07816041A EP2092518A1 EP 2092518 A1 EP2092518 A1 EP 2092518A1 EP 07816041 A EP07816041 A EP 07816041A EP 07816041 A EP07816041 A EP 07816041A EP 2092518 A1 EP2092518 A1 EP 2092518A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- motion
- audio
- computer
- samples
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000033001 locomotion Effects 0.000 title claims abstract description 319
- 230000002093 peripheral effect Effects 0.000 claims abstract description 50
- 238000000034 method Methods 0.000 claims description 15
- 230000009466 transformation Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 238000000844 transformation Methods 0.000 claims description 3
- 239000008186 active pharmaceutical agent Substances 0.000 description 17
- 230000001276 controlling effect Effects 0.000 description 16
- 230000005236 sound signal Effects 0.000 description 15
- 230000001133 acceleration Effects 0.000 description 7
- 238000013507 mapping Methods 0.000 description 7
- 238000001914 filtration Methods 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000005070 sampling Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000033228 biological regulation Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 230000009849 deactivation Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 229910000078 germane Inorganic materials 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/209—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform characterized by low level software layer, relating to hardware management, e.g. Operating System, Application Programming Interface
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
- A63F2300/302—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device specially adapted for receiving control signals not targeted to a display device or game input means, e.g. vibrating driver's seat, scent dispenser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
Definitions
- the present description relates to entertainment motion devices and more particularly to controlling of entertainment motion devices.
- the motion data In order to maximize the perceived effect of motion, the motion data must be delivered to the motion platform in synchrony with the audio and/or video program also being delivered via the audio and video interfaces of the same computer platform.
- the rate of delivery of the motion stream must be regulated or locked to precisely match the rate of delivery of the audio and/or video streams.
- USB Universal Serial Bus
- the USB provides a user- transparent interface for computer peripherals such as mouse devices, keyboards, digital cameras, printers, external storage, sound cards, etc.
- the USB lmplementers Forum advantageously provides a specification for generic USB audio-class devices, such as a USB sound card, thereby encouraging the development of generic audio drivers on many computer platforms, to allow the control of USB sound devices from different manufacturers. There is currently no such USB specification for interfacing with a motion platform controller.
- USB Audio-Class properly and intrinsically addresses the problems of low playback latency and rate of delivery regulation in digital audio interfacing because these problems are germane to the field of computer audio. It results that solutions to these two problems are built-in in generic or custom audio drivers and APIs.
- the present description relates to the interfacing of a computer with a motion platform using a USB audio-class computer peripheral.
- the computer peripheral receives a digital audio-format signal according to the USB specification and provides a motion signal simultaneously to a plurality of motion platforms.
- the peripheral locally manages each motion platform using the appropriate communication and control protocol, with minimal computer intervention.
- USB audio-class peripheral As the computer peripheral is a USB audio-class peripheral, a generic driver is often provided for the specific computer platform by the manufacturer of the operating system, which is advantageous to the manufacturer of the USB audio-class peripheral. When no generic driver is provided for a given computer platform, the task of developing a custom driver is facilitated by the fact that USB audio-class devices are common and well known devices in the software development community.
- the computer peripheral is seen by the platform as a typical USB sound card. Most of its parameters are adjustable through the audio configuration user- interfaces of the computer platform, when they exist. It can be accessed through any of the audio APIs provided by the platform. In most instances, it can be accessed by existing sound applications. This is limited only by the capabilities of the applications.
- an audio-class computer peripheral to be connected to a computer having a general-purpose audio driver and for providing a motion signal from a digital audio-format signal in order to control a motion platform using the computer.
- the computer peripheral comprises a computer interface and a motion platform interface.
- the computer interface is for receiving the digital audio- format signal to be provided using the general-purpose audio driver, the digital audio- format signal comprising motion samples, and for extracting the motion samples from the digital audio-format signal.
- the motion platform interface is for producing, from the motion samples, the motion signal for controlling movements of the motion platform, thereby controlling the motion platform.
- a method for providing a motion signal from a digital audio-format signal comprising motion samples and provided by a computer having a general-purpose audio driver, in order to control a motion platform.
- the digital audio-format signal produced using the general-purpose audio driver and comprising a stream of motion samples is received.
- the stream of motion samples is extracted from the digital audio-format signal.
- the motion signal adapted for controlling movements of the motion platform using the stream of motion samples is then outputted.
- a method for controlling a motion platform using a computer having a general-purpose audio driver Motion samples representative of movements to be performed by the motion platform are provided.
- a digital audio-format signal is provided using the general-purpose audio driver, the digital audio-format signal comprising the motion samples.
- a motion signal is outputted for controlling the motion platform, from the motion samples and using the digital audio-format signal.
- a computer system for controlling a motion platform comprising: a motion sample source for providing motion samples; a general-purpose audio driver receiving the motion samples and for producing a digital audio-format signal comprising the motion samples; and an interface for producing a motion signal for controlling the motion platform, from the motion samples and using the digital audio-format signal.
- a method for providing an audio-format motion signal to be used in controlling a motion platform A stream of motion samples representative of movements to be performed by the motion platform is provided.
- the stream of motion samples is formatted in the audio-format motion signal according to a USB audio-class format specification.
- the audio-format motion signal is outputted.
- the movements produced by the motion platform is meant to comprise a motion component (low frequencies) and may also comprise a vibration component (high frequencies).
- FIG. 1 is a schematic illustrating an example use of a motion platform for providing a user with motions synchronized with an audio/video stream;
- FIG. 2 is a block diagram illustrating the main components of an example computer peripheral for interfacing between a computer and a motion platform by providing a motion signal from a digital audio-format signal;
- FIG. 3 is a block diagram illustrating an example computer peripheral interfacing between a computer and a motion platform wherein the computer peripheral is a USB audio-class peripheral and the computer provides a USB audio signal;
- Fig. 4 is an image showing of an example audio configuration user-interface
- Fig. 5 is an image showing advanced controls of the audio configuration user-interface of Fig. 4;
- Fig. 6 is a graph illustrating a bass-boost filter
- Fig. 7 is a graph illustrating a low-pass anti-aliasing filter.
- Fig. 1 illustrates the use of a motion platform for providing a user A with motion synchronized with a video/audio program, video game or the like.
- the interfacing device 100 is an audio-class USB peripheral that can play motion on a motion platform 114.
- the interfacing device 100 may actually manage up to four motion platforms. It does not require a specific driver to play motion on most computers and operating systems. Instead it uses the generic USB audio driver of the computer 110 to which it is connected. Examples of platforms providing a generic audio driver include Windows 2000, Windows XP or Mac OSX.
- the interfacing device 100 is seen by the computer platform as a typical USB sound card. Most of its parameters are adjustable through the audio configuration user-interfaces of the computer platform, when they exist. It can be accessed through any of the audio APIs provided by the platform. On Windows, these include the Wave API and the DirectSound API.
- the user A watches a movie or plays a video game using a computer 110, typically a personal computer (PC). Accordingly, a video is being displayed on a video monitor 111 and sound effects are produced by speakers 112.
- the computer 110 also provides a stream of motion samples synchronized with the video display and the sound play and representative of a motion to be provided to the user A using a motion platform 114.
- the stream of motion samples is outputted as a digital audio-format signal.
- An interfacing device 100 is connected to the computer 110 using any interface standard.
- One suitable standard is the USB standard, the interfacing device 100 then being a USB audio-class peripheral, external to the computer.
- the interfacing device 100 may be provided as an expansion card communicating with the computer using the Peripheral Component Interconnect (PCI) standard.
- PCI Peripheral Component Interconnect
- the interfacing device 100 is a computer peripheral for the computer 110 to interface with the motion platform 114.
- the interfacing device 100 receives the audio- format signal comprising streams of motion samples provided as channels in the audio- format signal, and provides a motion signal for controlling movements of the motion platform 114.
- the interfacing device 100 is capable of providing a motion signal adapted to various types of motion platforms 114.
- One possible motion platform 114 comprises four motion actuators 116 for imparting movements to a chair, each motion actuator being located under one of the four corners of the chair, i.e., each leg.
- the imparted motion includes a heave motion, a roll motion, a pitch motion and any combinations thereof.
- the audio-format signal comprises at least three channels, each channel having one stream of motion samples representative of the respective motion to be provided to the user A.
- another motion platform 114 can comprise one motion actuators 116.
- the imparted motion is limited to one of a heave motion, a roll motion or a pitch motion.
- Another suitable motion platform comprises two rear actuators and a front-center swivel.
- the interfacing device 100 is capable of adapting an audio-format signal comprising more or less channels than the ones supported by the connected motion platform 114 by eliminating motions unsupported by the motion platform 114 or by extrapolating actuator positions not provided in the channels.
- the motion provided to the user may be only synchronized with the video display independently of the sound effect if, for example, the movie or the video game is silent.
- Fig. 2 illustrates the main components of the interfacing device 100 for interfacing between a computer 110 and a motion platform 114 by providing a motion signal from a digital audio-format signal.
- the interfacing device 100 comprises a computer interface 128 and a motion platform interface 130.
- the computer interface 128 receives the digital audio-format signal provided by the computer.
- the digital audio- format signal has channels each comprising a stream of motion samples.
- each channel corresponds to one motion actuator of the motion platform 114 and each stream of motion samples corresponds to a stream of actuator samples for controlling one actuator.
- the computer interface 128 extracts the streams of motion samples from the digital audio-format signal.
- the motion platform interface 130 produces a motion signal from the extracted streams of motion samples.
- the motion signal is provided to the motion platform 114 for controlling movements of motion platform 114.
- the motion signal comprises a stream of actuator samples for each actuators of the motion platform 114.
- FIG. 3 illustrates an interfacing device 210 interfacing a computer 212 with up to four motion platforms 214, according to another embodiment.
- the interfacing device 210 is seen by the computer 212 as a USB audio-class peripheral and the computer 212, typically a PC, provides a USB audio signal to the interfacing device 210 which produces a motion signal accordingly, for controlling up to four motion platforms 214.
- the USB audio signal may optionally be formatted according to any suitable compression standard such as, for instance, Dolby or DTS standards.
- the motion signal is the same for each motion platform which performs the movements.
- each motion platform 214 has four motion actuators but it should be appreciated that more or less motion actuators could be used in an alternative motion platform.
- the USB audio signal has two to four channels each comprising a stream of motion samples, which the computer 212 regards as typical channels of streams of audio samples, without making any difference in the way it handles it.
- a plurality of platforms could each perform a different motion if the USB audio signal comprised a group of channels for each platform to be controlled.
- the computer 212 comprises an operating system 216 such as Windows 2000, Windows XP, Mac OSX or any operating system having a general purpose audio driver 220 for interfacing with any sound device, a general purpose audio API 218 and a USB driver 222.
- the audio signal produced by the audio driver 220 is provided to the interfacing device 210 though a host USB controller 224 controlled by the computer using the USB driver 222 according to the USB specification.
- Streams of motion samples are provided by a user-mode application 226 such as a media player for playing a prerecorded video, a video game or any other application which provides synchronized video display, sound effect and motion sequence for a multi-media experience.
- a video track, a sound track and a motion track may all be provided as a recorded file.
- the video track is played on the video monitor and the sound track is played on the speakers as known in the art.
- the motion track is considered as a second sound track that is to be played using the interfacing device 210.
- the video track, the sound track and the motion track are all provided by the video game application as a function of the user input and events in the game.
- the user-mode application 226 uses the general purpose audio API 218 provided with the operating system 216 to play the read or produced stream of motion samples as if it was a stream of audio samples.
- the computer 212 provides a USB audio signal comprising the motion samples, according to the USB specification.
- the USB audio signal comprises two to four streams of motion samples that are to be decoded by the interfacing device 210 to generate the corresponding motion using a motion platform 214 as will be discussed hereinbelow.
- All functionalities related to the motion platforms 214 may not be supported by the general purpose audio driver 220 and the general purpose audio API 216. Unsupported functions may be functions related to the monitoring of the motion platforms and the fault management. Accordingly, an expansion of the general purpose audio driver, i.e., a mini-driver 234, and/or an expansion of the general purpose API may be provided to expand the general audio functionalities.
- the interfacing device 210 comprises a computer interface, i.e., the device USB controller 228 for receiving the USB audio signal according to the USB standard and a motion platform interface 230 for producing a motion signal comprising streams of actuator samples for controlling each actuator of the motion platforms 214.
- a signal splitter (not shown) splits the motion signal to provide it to each of the four motion platforms 214.
- the interfacing device 210 also comprises a management unit 236 for providing control commands to each motion platform 214 and for monitoring and managing the motion platforms 214 according to actuator feedback received from each motion platforms 214.
- the device USB controller 228 extracts the channels comprising streams of motion samples from the USB audio signal and communicates them to the motion platform interface 230.
- the motion platform interface 230 comprises a mixing module 232 for mixing channels of stream of motion samples to provide four streams of actuator samples for controlling each actuator of a motion platform 214.
- each channel may not correspond to one motion actuator.
- the mixing module provides various mappings between the channels of the USB audio signal and the four actuators of each motion platforms 214.
- One of such mapping is a direct mapping wherein each channel corresponds to one actuator (rear-right, rear-left, front-right and front-left) of a motion platform 214.
- three channels are received, respectively corresponding to heave, pitch and roll.
- the mixing module 232 mixes the channels to convert the received heave, pitch and roll motion samples into actuators positions.
- the mixing function is implemented according to the up/down mix unit as defined by the USB audio class specification. As will be discussed in more details below, other mapping schemes are provided where a combination of the channels is converted into a number of streams of actuator samples corresponding to the number of actuators.
- the mixing function is controlled using a mixing control signal.
- the motion platform interface 230 also comprises a feature unit 238 receiving streams of actuator samples outputted by the mixing unit for applying some feature functions such as bass-boost, volume and muting functionalities as will also be described hereinbelow, to the streams of actuator samples. These functions are controlled according to a feature control signal.
- Each motion platform 214 returns a feedback signal through the motion platform interface 230, to the management unit 236 for monitoring and management purposes.
- the motion platforms 214 are mostly managed at the interfacing unit 210 but feedback data is also returned to the computer 212 for fault monitoring, for instance.
- the device USB controller 228 receives configuration controls (such as mixing and feature controls) from the computer 212 and also communicates feedback data, such as fault flags or vital signs of the actuators, to the computer 212 using the generic audio driver 220 and the USB protocol.
- configuration controls such as mixing and feature controls
- feedback data such as fault flags or vital signs of the actuators
- the interfacing device 210 is seen by the computer 212 as a typical sound card, most of its parameters are adjustable through the generic audio configuration user-interfaces of the operating system 216, if they exist. The parameters can also be accessed through any of the audio APIs provided by the operating system 216.
- Fig. 4 shows a typical audio configuration user-interface from WindowsTM that can be used to adjust the volume of audio speakers.
- the same audio configuration user-interface is used by the user A, according to an embodiment, to adjust the amplitude of the motion provided by the motion platform 214.
- the motion platform can also be put on standby manually using the mute functionality as defined by the generic audio driver 220 and accessible using the mute check box.
- Fig. 5 shows advanced controls of a typical audio configuration user- interface that is used to adjust bass/treble settings and to select a bass-boost filter applied by the feature unit 238.
- the motion generated by the motion platform comprises a motion component (low frequencies) and a vibration component (high frequencies).
- the bass/treble settings respectively adjust the relative importance of motions and vibrations of the motion generated by the motion platform.
- the bass/treble settings adjust the filtering parameters of the bass and the treble frequency filters to be applied to the stream of motion samples.
- the interfacing device 210 automatically controls one to four motion platforms 214 without user intervention.
- the interfacing device 210 takes control of a motion platform 214, the platform is normally in a standby state by default.
- the motion platform 214 is only placed in its active traffic state when motion is being played.
- the interfacing device 210 automatically sets the motion platform back in the standby state when no motion is played for a preset length of time (ten minutes for instance).
- the interfacing device 210 does not set the motion platforms 214 into the active traffic state if the mute control is set (see the mute setting described below).
- the interfacing device 210 Whenever a platform experiences a fault, as communicated by the motion platform 214 to the interfacing device 210 using the feedback signal, the interfacing device 210 automatically sets the motion platform 214 in the standby state. The interfacing device 210 then attempts to clear the fault and resume the motion for three consecutive attempts. After three attempts at restarting, if a fault is still detected the motion platform 214 is kept in the standby state and the fault is displayed. The fault can be cleared by activating and deactivating the mute control.
- the mixing module 232 provides various mappings between the channels of the USB audio signal and the four actuators of each motion platforms 214.
- a direct mapping is provided, i.e., each channel corresponds to one of the four actuators (front-left, front-right, rear-left and rear-right) of a motion platform 214.
- the stream of motion samples of each channel is sent directly to the corresponding actuator without any transformation other than a scaling transformation for adjusting the volume or other frequency filtering transformations such as bass/treble adjustment and anti-aliasing filtering, frequency filtering being considered as scaling transformations.
- each of the four actuators of a motion platform 214 is located on one of the four coplanar corners of the motion platform 214, e.g., one under each of the four legs of a chair, and that the position of the contact portions of the four actuators with the supported platform should be coplanar. Should the position of the contact points not be coplanar, the motion platform(s) 214 would twist or would be improperly supported (one or two actuators not supporting the motion platform). Consequently, in this mode, the set of four actuator positions should be checked upstream in software for coplanarity before providing the USB audio signal.
- the mixing function is implemented according to the up/down mix unit as defined by the USB audio class specification.
- the mix-enable setting comprises three mixing modes: the 2-channel mode, the 3-channel mode and the 4-channel mode.
- a first channel corresponds to the rear-left actuator and a second channel corresponds to the rear-right actuator.
- the mixing module 232 provides the actuator samples for the front-right and the front-left actuators by simulating a front-center swivel and insuring the coplanarity of the four actuators. Both channels have a dynamic range of -32 767 to +32 767 with no risk to saturate the actuators of the motion platform 214. In the 2-channel mode, the other two channels, if present in the USB stream, are ignored.
- the mixing module 232 mixes the channels to converts the received heave, pitch and roll motion samples into actuators positions while ensuring the coplanarity of the four actuators.
- the full dynamic range of -32 767 to +32 767 of the roll channel provides the full roll angular range. Positive values roll to the left.
- the full dynamic range of -32 767 to +32 767 of the pitch channel provides the full pitch angular range. Positive values pitch up.
- the full dynamic range of -32 767 to +32 767 of the heave channel provides the full vertical travel range. Positive values raise the motion platform. Although it is the simplest and most intuitive alternate setting, care must be exercised because some combinations of values can create saturations of one or more actuator. For instance a combined full heave and full pitch motion would produce saturations on the front actuators. The forth channel, if present in the USB stream, is ignored.
- each channel corresponds to one of the four actuators, i.e., front-left, front-right, rear-left and rear-right.
- a linear transform is applied to reduce the number of degrees of freedom from four to three and to ensure a coplanarity of the positions of the four actuators. Positions that are already in the same plane are not modified. Positions that would twist the platform are transformed into the closest achievable positions that ensure coplanarity. This is obtained by projecting to zero the "platform-twisting" component of the motion platform vector. Since positions that are in the same plane (positions that do not have a twisting component) are not modified, there is no risk of saturation of the actuators. However, for components that have a nonzero twisting component, the transform may create saturations for positions at the edge of the range.
- the feature unit 238 has a bass boost function to apply a calibrated low-pass bass-boost filter to the streams of actuator samples.
- the transfer function of the actuators is typically flat in position from 0 to 100Hz, which causes the following difficulties.
- a full amplitude wave requires large accelerations from the actuators.
- the actuators are limited to accelerations lower than the acceleration of gravity (+/-1g), and such full-amplitude motion profiles, which would require larger accelerations, create distortions.
- the impression of vibration intensity of an arbitrary frequency signal is much more related to acceleration than it is to position. Therefore to obtain a constant impression of intensity from 10 to 100 Hz, independently of the frequency, it is necessary to progressively lower the motion amplitude as the frequency is increased.
- the bass-boost filter is calibrated in gain and spectral shape to insure that no motion with an acceleration greater than the acceleration due to gravity (1g) is applied to the actuators, which would saturate the actuator response. Furthermore, it scales the actuator samples so that the impression of force perceived by the user is only related to the signal amplitude, rather than a combination of amplitude and frequency. This simplifies the design or real-time synthesis of the motion samples.
- This calibrated filter is selected using the bass-boost feature unit as defined in the USB Audio-Class specification. It facilitates the work of motion designers by allowing them to use a specific amplitude for a specific impression of intensity, regardless of frequency.
- the bass-boost filter is applied by default.
- the function can be defeated, for example, by deselecting the Bass-Boost control in the advanced controls of a typical audio configuration user-interface. Defeating the Bass-Boost function provides a flat frequency response in position from 0 to 100Hz.
- a fade-in function is applied by the mixing module 232 when motion is started, and a fade-out function is applied when motion is stopped.
- the fade-in function progressively increases the play-back volume from zero to the selected volume in a few fractions of a second at the beginning of the motion. Because of the fade-in, motion signal that is present in the first few hundreds of milliseconds of motion may be masked.
- the fade-out function progressively decreases the play-back volume from the selected volume back to zero in few hundreds of milliseconds. If motion was not stopped at zero, this fade-out brings the actuators back to the zero position smoothly. Because the fade-out is only applied after the motion has stopped, it does not mask any motion signal at the end of the sequence.
- a low-pass anti-aliasing filter is applied to every channel by the mixing module 232.
- one of the following six filters is used: filter adjusted for 48 kHz, 32 kHz, 24 kHz, 16 kHz, 12 kHz and 8 kHz.
- the applied filter is not optimally adjusted.
- the cutoff frequency cannot be off by more than 50% of the target frequency.
- the filters are not very sharp to keep the playback delay to a minimum. To obtain a sharper anti-aliasing filter, it may be advantageous to perform a pre-filtering on the audio signal in software before sending it to the interfacing device 210.
- the native sampling frequency of the motion platform is 400 Hz.
- the use of a sampling frequency that is a multiple of 400Hz provides best results.
- Other intermediate sampling frequencies are possible, but result in a slightly degraded signal quality.
- the preferred embodiments may be provided by a combination of hardware and software components, with some components being implemented by a given function or operation of a hardware or software system, and many of the data paths illustrated being implemented by data communication within a computer application or operating system. The structure illustrated is thus provided for efficiency of teaching the present preferred embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Stereophonic System (AREA)
- Pinball Game Machines (AREA)
- Information Transfer Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US85444806P | 2006-10-26 | 2006-10-26 | |
PCT/CA2007/001891 WO2008049217A1 (en) | 2006-10-26 | 2007-10-24 | Audio interface for controlling a motion signal |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2092518A1 true EP2092518A1 (en) | 2009-08-26 |
EP2092518A4 EP2092518A4 (en) | 2011-04-27 |
EP2092518B1 EP2092518B1 (en) | 2012-12-12 |
Family
ID=39324064
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07816041A Active EP2092518B1 (en) | 2006-10-26 | 2007-10-24 | Audio interface for controlling a motion signal |
Country Status (9)
Country | Link |
---|---|
US (1) | US8468280B2 (en) |
EP (1) | EP2092518B1 (en) |
JP (1) | JP2010509650A (en) |
KR (1) | KR101456124B1 (en) |
CN (1) | CN101611443B (en) |
CA (1) | CA2667575C (en) |
HK (1) | HK1135503A1 (en) |
IL (1) | IL198387A (en) |
WO (1) | WO2008049217A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8265941B2 (en) | 2006-12-07 | 2012-09-11 | Lg Electronics Inc. | Method and an apparatus for decoding an audio signal |
WO2018115439A1 (en) * | 2016-12-22 | 2018-06-28 | Marabas Oy | Exergaming arrangement and method thereof |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007030603A2 (en) | 2005-09-08 | 2007-03-15 | Wms Gaming Inc. | Gaming machine having display with sensory feedback |
KR101621267B1 (en) * | 2009-03-25 | 2016-05-31 | 디-박스 테크놀러지스 인코포레이트 | Method and apparatus for distributing motion signals in a multi -seat environment |
CN101566940B (en) * | 2009-05-25 | 2012-02-29 | 中兴通讯股份有限公司 | Method and device for realizing audio transmission of universal serial bus of wireless data terminal |
US8678936B2 (en) | 2009-11-12 | 2014-03-25 | Wms Gaming Inc. | Gaming machine chair and wagering game systems and machines with a gaming chair |
US8663019B2 (en) | 2009-11-12 | 2014-03-04 | Wms Gaming Inc. | Gaming machine chair and wagering game systems and machines with a gaming chair |
CN102202068A (en) * | 2010-03-22 | 2011-09-28 | 陈麟华 | Method and device for realizing secure transfer of audio/video files among computers of different networks |
US8678923B2 (en) | 2010-11-02 | 2014-03-25 | Wms Gaming Inc. | Gaming machine chair and wagering game systems and machines with a gaming chair |
CN102156644A (en) * | 2011-05-20 | 2011-08-17 | 广州中道电子科技有限公司 | Cross-browser cross-operation system control device |
US9058714B2 (en) | 2011-05-23 | 2015-06-16 | Wms Gaming Inc. | Wagering game systems, wagering gaming machines, and wagering gaming chairs having haptic and thermal feedback |
US9449456B2 (en) | 2011-06-13 | 2016-09-20 | Bally Gaming, Inc. | Automated gaming chairs and wagering game systems and machines with an automated gaming chair |
KR101154122B1 (en) * | 2012-02-20 | 2012-06-11 | 씨제이포디플렉스 주식회사 | System and method for controlling motion using time synchronization between picture and motion |
JP6664145B2 (en) * | 2014-03-12 | 2020-03-13 | 任天堂株式会社 | Information processing apparatus, information processing program, information processing system, and information processing method |
CN104091360A (en) * | 2014-07-28 | 2014-10-08 | 周立刚 | Method and device for generating movement data through dynamic cinema |
FR3035780B1 (en) * | 2015-05-06 | 2017-05-26 | Valentin Fage | SYSTEM FOR MAKING SEATS, SOFAS AND BEDS IN MOTION |
CN109782604B (en) * | 2017-07-18 | 2022-05-06 | 北京神州启航科技发展有限公司 | 4D film seat control system based on neural network |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999040504A1 (en) * | 1998-02-03 | 1999-08-12 | Invibro Ltd. | System and method for vibro generations |
US20020154773A1 (en) * | 2001-02-26 | 2002-10-24 | Gary Standard | Systems and methods for encoding a DMX data stream and decoding an AES digital audio stream |
WO2006113999A1 (en) * | 2005-04-26 | 2006-11-02 | D-Box Technologies Inc. | Method and apparatus for providing a motion signal with a sound signal using an existing sound signal encoding format |
WO2007143849A1 (en) * | 2006-06-14 | 2007-12-21 | D-Box Technologies Inc. | Control of a plurality of motion platforms in synchrony with a sequence of images |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06161348A (en) * | 1992-09-22 | 1994-06-07 | Sony Corp | Amusement unit and recording medium |
US6422941B1 (en) * | 1994-09-21 | 2002-07-23 | Craig Thorner | Universal tactile feedback system for computer video games and simulations |
US5684722A (en) * | 1994-09-21 | 1997-11-04 | Thorner; Craig | Apparatus and method for generating a control signal for a tactile sensation generator |
US6542925B2 (en) * | 1995-05-30 | 2003-04-01 | Roy-G-Biv Corporation | Generation and distribution of motion commands over a distributed network |
JP3537238B2 (en) | 1995-09-22 | 2004-06-14 | 株式会社ナムコ | GAME DEVICE AND GAME DEVICE CONTROL METHOD |
US5857986A (en) * | 1996-05-24 | 1999-01-12 | Moriyasu; Hiro | Interactive vibrator for multimedia |
JP3066637B2 (en) * | 1997-08-25 | 2000-07-17 | 株式会社アクーヴ・ラボ | Body sensation swing / vibration device |
JP4144621B2 (en) * | 1997-11-07 | 2008-09-03 | 株式会社セガ | Game device |
US6659773B2 (en) * | 1998-03-04 | 2003-12-09 | D-Box Technology Inc. | Motion transducer system |
JP3836601B2 (en) * | 1998-05-11 | 2006-10-25 | 川田工業株式会社 | Multiple degrees of freedom motion base |
JP2000132494A (en) | 1998-10-26 | 2000-05-12 | Toshiba Corp | Computer system and audio output control method of the system |
CN100387061C (en) * | 1999-11-29 | 2008-05-07 | 索尼公司 | Video/audio signal processing method and video/audio signal processing apparatus |
JP2002085855A (en) * | 2000-09-19 | 2002-03-26 | Mitsubishi Heavy Ind Ltd | System of utilizing game software and method of delivery for the same |
US6733293B2 (en) * | 2001-01-26 | 2004-05-11 | Provision Entertainment, Inc. | Personal simulator |
JP2002224184A (en) * | 2001-02-07 | 2002-08-13 | Family Kk | Massager and massager controlling method |
JP2003150186A (en) * | 2001-11-16 | 2003-05-23 | Nippon Telegr & Teleph Corp <Ntt> | Robot system, robot control method, robot controller and robot control program |
JP3836756B2 (en) | 2002-06-21 | 2006-10-25 | 川田工業株式会社 | Motion base controller |
JP4529360B2 (en) * | 2003-02-28 | 2010-08-25 | 沖電気工業株式会社 | Body sensation apparatus, motion signal generation method and program |
WO2004102506A1 (en) | 2003-05-14 | 2004-11-25 | D-Box Technology Inc. | Flexible interface for controlling a motion platform |
CN1570946B (en) * | 2004-04-28 | 2010-05-26 | 赖银樑 | Interactive network motion simulation system |
US7717711B2 (en) * | 2004-09-02 | 2010-05-18 | Sean MacDonald | Collapsible motion platform |
US20070135967A1 (en) * | 2005-12-08 | 2007-06-14 | Jung Seung W | Apparatus and method of controlling network-based robot |
JP2007324829A (en) * | 2006-05-31 | 2007-12-13 | Toshiba Corp | Device and method for reproducing physical feeling of vibration |
-
2007
- 2007-10-22 US US11/876,471 patent/US8468280B2/en active Active
- 2007-10-24 CA CA2667575A patent/CA2667575C/en active Active
- 2007-10-24 CN CN2007800441534A patent/CN101611443B/en active Active
- 2007-10-24 EP EP07816041A patent/EP2092518B1/en active Active
- 2007-10-24 WO PCT/CA2007/001891 patent/WO2008049217A1/en active Application Filing
- 2007-10-24 KR KR1020097010702A patent/KR101456124B1/en active IP Right Grant
- 2007-10-24 JP JP2009533620A patent/JP2010509650A/en active Pending
-
2009
- 2009-04-26 IL IL198387A patent/IL198387A/en active IP Right Grant
-
2010
- 2010-02-26 HK HK10102051.0A patent/HK1135503A1/en not_active IP Right Cessation
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999040504A1 (en) * | 1998-02-03 | 1999-08-12 | Invibro Ltd. | System and method for vibro generations |
US20020154773A1 (en) * | 2001-02-26 | 2002-10-24 | Gary Standard | Systems and methods for encoding a DMX data stream and decoding an AES digital audio stream |
WO2006113999A1 (en) * | 2005-04-26 | 2006-11-02 | D-Box Technologies Inc. | Method and apparatus for providing a motion signal with a sound signal using an existing sound signal encoding format |
WO2007143849A1 (en) * | 2006-06-14 | 2007-12-21 | D-Box Technologies Inc. | Control of a plurality of motion platforms in synchrony with a sequence of images |
Non-Patent Citations (1)
Title |
---|
See also references of WO2008049217A1 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8265941B2 (en) | 2006-12-07 | 2012-09-11 | Lg Electronics Inc. | Method and an apparatus for decoding an audio signal |
WO2018115439A1 (en) * | 2016-12-22 | 2018-06-28 | Marabas Oy | Exergaming arrangement and method thereof |
Also Published As
Publication number | Publication date |
---|---|
EP2092518A4 (en) | 2011-04-27 |
US20080104289A1 (en) | 2008-05-01 |
EP2092518B1 (en) | 2012-12-12 |
US8468280B2 (en) | 2013-06-18 |
KR101456124B1 (en) | 2014-11-04 |
CN101611443A (en) | 2009-12-23 |
CA2667575C (en) | 2015-12-29 |
CA2667575A1 (en) | 2008-05-02 |
CN101611443B (en) | 2013-06-12 |
IL198387A0 (en) | 2010-02-17 |
KR20090074260A (en) | 2009-07-06 |
HK1135503A1 (en) | 2010-06-04 |
JP2010509650A (en) | 2010-03-25 |
WO2008049217A1 (en) | 2008-05-02 |
IL198387A (en) | 2014-05-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2667575C (en) | Audio interface for controlling a motion signal | |
US6966651B2 (en) | Portable multimedia projection system | |
WO2016136934A1 (en) | Information processing device, information processing method, information processing system | |
US20080311997A1 (en) | Data capture for interactive operation | |
US20150273322A1 (en) | Information processing apparatus, information processing method, and program | |
US20070248235A1 (en) | Information Processor and Controller Device | |
JPH10137445A (en) | Game device, visual sound processing device, and storage medium | |
US11395089B2 (en) | Mixing audio based on a pose of a user | |
JP2005027163A (en) | Audio data processing device, audio data processing method, its program, and recording medium recording program thereon | |
US7110940B2 (en) | Recursive multistage audio processing | |
JP4601255B2 (en) | Manipulating a group of devices | |
CN204090051U (en) | Family's theater and Karaoke integration system | |
CN115206337A (en) | Control method and device of vibration motor, storage medium and electronic equipment | |
JP4494470B2 (en) | Audio signal processing apparatus, audio signal processing method, program thereof, and recording medium recording the program | |
US20060039567A1 (en) | Audio reproducing apparatus | |
CN220208124U (en) | Intelligent home theater | |
US20040002780A1 (en) | Computer system with a preamplifier circuit mounted on a motherboard | |
CN116767055A (en) | Seat vibration control method and device, medium, electronic equipment and vehicle | |
WO2022209317A1 (en) | Information processing device, information processing system, information processing method, and program | |
JPH10174780A (en) | Game machine and information storing medium | |
CN1023052C (en) | Sound imaging system for video game | |
CN116880661A (en) | Intelligent video-audio integrated machine | |
KR100390517B1 (en) | System and method for regenerating front and rear sound simultaneously by integrated sound card | |
CN1442003A (en) | Method and means for receiving digital transmission comprising plurality of digital audio signals and for simultaneous reproduction of these signals as analog audio programmes | |
KR960028500A (en) | Game console with high definition television |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20090525 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
DAX | Request for extension of the european patent (deleted) | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1135503 Country of ref document: HK |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20110324 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 588654 Country of ref document: AT Kind code of ref document: T Effective date: 20121215 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602007027357 Country of ref document: DE Effective date: 20130207 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130323 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 588654 Country of ref document: AT Kind code of ref document: T Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130313 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: GR Ref document number: 1135503 Country of ref document: HK |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130412 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130312 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130412 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
26N | No opposition filed |
Effective date: 20130913 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602007027357 Country of ref document: DE Effective date: 20130913 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20131031 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20131031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20131024 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20071024 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20131024 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121212 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230921 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230921 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230919 Year of fee payment: 17 |