WO1997023075A1 - Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs - Google Patents

Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs Download PDF

Info

Publication number
WO1997023075A1
WO1997023075A1 PCT/US1996/020912 US9620912W WO9723075A1 WO 1997023075 A1 WO1997023075 A1 WO 1997023075A1 US 9620912 W US9620912 W US 9620912W WO 9723075 A1 WO9723075 A1 WO 9723075A1
Authority
WO
WIPO (PCT)
Prior art keywords
signals
sensor
digital
signal
data
Prior art date
Application number
PCT/US1996/020912
Other languages
English (en)
Other versions
WO1997023075A9 (fr
Inventor
Kenneth W. Tait
Brian R. Hill
Original Assignee
Prima Facie, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Prima Facie, Inc. filed Critical Prima Facie, Inc.
Priority to EP96945967A priority Critical patent/EP0868798A4/fr
Priority to CA 2241096 priority patent/CA2241096A1/fr
Publication of WO1997023075A1 publication Critical patent/WO1997023075A1/fr
Publication of WO1997023075A9 publication Critical patent/WO1997023075A9/fr

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
    • G07C5/0841—Registering performance data
    • G07C5/0875—Registering performance data using magnetic data carriers
    • G07C5/0891—Video recorder in combination with video camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/781—Television signal recording using magnetic recording on disks or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/782—Television signal recording using magnetic recording on tape
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal

Definitions

  • the present invention relates to methods and apparatus for recording and reproducing signals and data and, more particularly, to methods and apparatus for recording and reproducing sensor data and video signals.
  • Motor vehicles including personal automobiles, transit buses and transit trains
  • Motor vehicles are an integral part of modern societies. Beside providing the facility of transporting goods in the market place, they also transport millions of people on a daily basis and are used to provide general services, such as public safety services.
  • general services such as public safety services.
  • the burgeoning use of motor vehicles has given rise to a complex and expensive liability system concerning vehicular transportation. In nearly all states of the United States, for example, automobile insurance is required. Accordingly, much expensive litigation ensues in connection with motor vehicle accidents and other incidents.
  • the documentary data can include video data (and accompanying audio data) concerning occurrences exterior to and/or within the automotive transportation unit, as well as data related to operation of the unit such as dynamic variables (for example, position, velocity and acceleration) and data provided by other analog and digital sensors.
  • Examples of alternative transportation systems include transit buses and trolleys, subway and rail cars, air- and water-borne craft and elevators.
  • Other, non-transportation systems include stationary- systems, such as bank, other building, and location (such as ATM location) security systems.
  • the increasingly litigious societal environment has led to an increased need for a transportable way to document the circumstances of other (i.e., other than motor vehicle) incidents. Examples of such incidents include incidents that should be documented by police and other public safety officers as well as non-governmental persons such as insurance and security agents and other technicians. Such documentation is typically accomplished through the use of recorded still and moving images as well as outputs of other analog and digital sensors.
  • an additional level of data security can be provided by transmitting (or transporting) the data to a remote location. Aside from the additional security provided, transmitting the data to a remote location allows the data to be processed as it is being collected. In some circumstances, this processing can be used to assure system managers that the video sources and/or sensors are operating properly. In other circumstances, remote processing of data can be used to determine whether the data should be collected in some other manner or form, such as by repositioning the video sources (possibly by means of control signals transmitted through a reverse transmission link) .
  • the invention is a method for recording sensor data with a resultant video signal to protect the sensor data and the resultant video signal.
  • the method includes the steps of a) selecting one or more sensors that produce the sensor data and b) transforming the signals from the one or more sensors to digital signals .
  • the method further includes the steps of c) selecting one or more video signal sources from a set of two or more video signal sources producing respective video signals and d) producing the resultant video signal from the respective video signals produced by the selected one or more video signal sources.
  • the method includes the steps of e) encrypting at least one of the digital sensor signal and the resultant video signal in accordance with a digital encryption procedure to produce a respective digital output sensor signal and a respective digital output video signal, f) combining the respective digital output sensor signal and the respective digital output video signal to produce a digital output signal and g) recording the digital output signal on a recording medium.
  • Step a) includes digitizing analog signals produced by some of the sensors and combining the digitized analog signals with digital signals produced by the remaining sensors to produce a digital sensor signal.
  • the invention is an apparatus for recording sensor data with a resultant video signal to protect the sensor data and the resultant video signal .
  • the apparatus comprises a selection circuit to select one or more sensors that produce the sensor data and a digitization circuit to transform the signals from the one or more sensors to digital signals .
  • the digitization circuit digitizes analog signals produced by some of the sensors and combines the digitized analog signals with digital signals produced by the remaining sensors to produce a digital sensor signal.
  • the invention further includes a selection circuit to select one or more video signal sources from a set of two or more video signal sources producing respective video signals and a video production circuit to produce the resultant video signal from the respective video signals produced by the selected one or more video signal sources .
  • the invention includes an encryption circuit to encrypt at least one of the digital sensor signal and the resultant video signal in accordance with a digital encryption procedure and to produce a respective digital output sensor signal and a respective digital output video signal, a combination circuit to combine the respective digital output sensor signal and the respective digital output video signal to produce a digital output signal and a recorder to record the digital output signal on a recording medium.
  • the invention is a method for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the method comprises the steps of a) encrypting the signals from the one or more sensors, b) combining the video signal and the encrypted signals to produce an output signal, and c) recording the output signal on a recording medium.
  • the invention is a method for retrieving sensor data originally produced by one or more sensors.
  • the sensor data is encrypted with a video signal to produce a recorded signal that protects the sensor data and being contained in signals from one or more sensors.
  • the method comprises the steps of a) playing back the recorded signal to produce a played-back signal, b) decrypting the played-back signal to produce a video signal and one or more sensor signals containing data originally produced by one or more sensors, and c) processing the one or more sensor signals to produce the sensor data.
  • the invention is a method for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the method comprises the steps of a) compressing the video signal to produce a compressed video signal, b) combining the compressed video signal and the signals from the one or more sensors to produce a digital signal, c) encrypting the digital signal to produce an output signal, and d) recording the output signal on a recording medium.
  • the invention is a method for retrieving sensor data originally produced by one or more sensors.
  • the sensor data is encrypted with a video signal to produce a recorded signal that protects the sensor data and being contained in signals from one or more sensors, at least one of the sensors producing an analog signal.
  • the method comprises the steps of a) playing back the recorded signals to produce a played-back signal, b) decrypting the played-back signal to produce a video signals and one or more sensor signals containing data originally produced by one or more sensors, c) determining whether any of the one or more sensor signals are digital signals, and d) processing the one or more sensor signals to produce the sensor data, including converting the one or more sensor signals to produce a corresponding analog signal.
  • the invention is a method for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the method comprises the steps of a) determining which of the signals from the one or more sensors are analog sensor signals and which of the signals from the one or more sensors are digital sensor signals, b) converting the data in the analog sensor signals to one or more first digital signals, c) encrypting the digital sensor signals and the one or more first digital signals to produce second digital signals, d) converting the second digital signals to first analog signals, and e) recording the video signal and the first analog signals on a recording medium.
  • the invention is an apparatus for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the apparatus comprises an encryption circuit, a signal processing circuit and a recorder.
  • the encryption circuit encrypts the signals from the one or more sensors.
  • the signal processing circuit combines the video signal and the encrypted signals to produce an output signal, and the recorder records the output signal on a recording medium.
  • the invention is an apparatus for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the apparatus comprises a compression circuit, a signal processing circuit, an encryption circuit and a recorder.
  • the compression circuit compresses the video signal .
  • the signal processing circuit combines the compressed video signal and the signals from the one or more sensors and produces a digital signal therefrom.
  • the encryption circuit encrypts the digital signal and produces an output signal therefrom.
  • the recorder records the output signal on a recording medium.
  • the invention is an apparatus for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the apparatus comprises a distinction circuit, a first conversion circuit, an encryption circuit, a second conversion circuit, and a recorder.
  • the distinction circuit determines which of the signals from the one or more sensors are analog sensor signals and which of the signals from the one or more sensors are digital sensor signals.
  • the first conversion circuit converts the data in the analog sensor signals to one or more first digital signals .
  • the encryption circuit encrypts the digital sensor signals and the one or more first digital signals to produce second digital signals.
  • the second conversion circuit convert the second digital signals to first analog signals, and the recorder records the video signal and the first analog signals on a recording medium.
  • the invention is an apparatus for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the apparatus comprises means for encrypting, means for combining and means for recording.
  • the means for encrypting encrypts the signals from the one or more sensors.
  • the means for combining combines the video signal and the encrypted signals to produce an output signal.
  • the means for recording records the output signal on a recording medium.
  • the invention is a method for retrieving sensor data originally produced by one or more sensors, the sensor data being encrypted with a video signal to produce a recorded signal that protects the sensor data and being contained in signals from one or more sensors, at least one of the sensors producing an analog signal.
  • the method comprises the steps of a) playing back the recorded signals to produce a played-back signal, b) decrypting the played-back signal to produce a video signals and one or more sensor signals containing data originally produced by one or more sensors, c) determining whether any of the one or more sensor signals are digital signals, and d) processing the one or more sensor signals to produce the sensor data, including converting the one or more sensor signals to produce a corresponding analog signal.
  • the invention is an apparatus for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the apparatus comprises means for compress, means for combining, means for encrypting and means for recording.
  • the means for compressing compresses the video signal to produce a compressed video signal.
  • the means for combining combines the compressed video signal and the signals from the one or more sensors to produce a digital signal.
  • the means for encrypting encrypts the digital signal to produce an output signal, and the means for recording records the output signal on a recording medium.
  • the invention is an apparatus for recording sensor data with a video signal to protect the sensor data.
  • the sensor data is contained in signals from one or more sensors.
  • the apparatus comprises means for determining, first and second means for converting, means for encrypting, and means for recording.
  • the means for determining determines which of the signals from the one or more sensors are analog sensor signals and which of the signals from the one or more sensors are digital sensor signals.
  • the first means for converting converts the data in the analog sensor signals to one or more first digital signals.
  • the means for encrypting encrypts the digital sensor signals and the one or more first digital signals to produce second digital signals.
  • the second means for converting converts the second digital signals to first analog signals, and the means for recording records the video signal and the first analog signals on a recording medium.
  • Figure 1 is a schematic diagram of a first preferred embodiment of an apparatus of the invention.
  • Figure 2 is a schematic diagram of the structure of a data file, as stored by the preferred embodiments of the invention.
  • Figure 3 is a schematic diagram of a second preferred embodiment of an apparatus of the invention.
  • Figure 4 is a flow chart of the program running within the preferred embodiments of the invention.
  • Figure 5 is a representation of a video image, illustrating a method for controlling and assuring the integrity of the image upon processing, storage and playback.
  • Figure 6 is a block diagram of an apparatus for playback of the data stored by the data recorder of the present invention.
  • Figure 7 is a flow chart of the method of playing back the data stored by the data recorder of the present invention.
  • FIG. 1 is a schematic diagram of a preferred embodiment of an apparatus of the invention.
  • the sensor data recorder 10 can be adapted for placement at or near the location where the sensors are located.
  • the data recorder 10 is located in an automobile (not shown) .
  • the data recorder 10 can be placed in a passenger compartment or, for greater security, can be placed in a more secure place such as a trunk.
  • those skilled in the art would provide appropriate protection for the data recorder 10, depending upon the particular task to which the data recorder 10 is applied.
  • a data recorder 10 that is to be installed in an automobile should probably be shielded from accelerations due to impacts, as well as temperature extremes and high humidity. Other applications will obviously have their own particular environmental factors to be considered in the installation.
  • the data recorder 10 includes a number of sensors, such as ignition switch 11, brake sensor 12, accelerator sensor 14, steering column sensor 16, wheel rotation sensor 18, turn signal sensor 20 and ultrasound detection sensor 21.
  • the data recorder 10 also includes a source of video information such as a forward-facing charge-coupled device (CCD) microcamera 22 and a recorder 24.
  • the data recorder 10 may also include one or more optionally additional CCD microcameras, such as CCD microcamera 25 that can be pointed rearward.
  • CCD charge-coupled device
  • the sensors 11, 12, 14, 16, 18, 20 and 21 can be augmented or substituted by other sensors that are dependent upon the application of the data recorder 10.
  • the sensors can include one or more microphones 13 and a sensor 15 (such as a global position satellite, GPS, sensor) capable of measuring dynamic variables such as position and velocity to sufficient accuracy for the task of the data recorder 10.
  • the sensors can also include one or more simple switches 17 (possibly contained in a keyboard) for inputs by a human observer/user.
  • the CCD microcamera 22 can be a conventional camera mounted on a universal mount. Appropriate specifications are that the CCD microcamera 22 should be operable in an operating temperature range from -10 Celsius to +60 Celsius and to a maximum relative humidity of 95%. Further, the CCD microcamera 22 should have automatic shutter sensitivity ranging from 1/60 to 1/32000 second and a resolution of at least 380 by 380 picture element (pixel) rows and columns. In addition, the CCD microcamera 22 should have an illumination sensitivity of 1 lux or less.
  • the CCD microcamera 22 may be desirable to place on a pan/tilt mount m a weatherproof enclosure
  • the CCD microcamera 22 could then be mounted outside of a vehicle and equipped with radio, infrared or ultrasound beacon-following sensors. Implementation of such sensors are well within the skills of those of the relevant electronic arts.
  • beacon-following systems can be used to follow and provide video images of a person carrying an appropriate beacon source.
  • An important example is a microcamera adapted to follow public safety personnel who are wearing a beacon and whose motions and surroundings can then be automatically recorded in video form.
  • a radio or infrared beacon could also provide an audio signal from the vicinity of the person wearing the beacon
  • the audio signal could carry the voice of the person wearing the beacon, and could be compressed, encrypted and recorded with the data from the other sensors, as will be described below.
  • the pan/tilt mount can be controlled by a motor drive that receives control signals from external sources, as will be described further detail subsequently.
  • the recorder 24 can be a conventional JVC time lapse cassette recorder, although other recorders (as described subsequently) could also be used.
  • the sensors 11, 12, 13, 14, 15, 16, 17, 18, 20 and 21, and the CCD microcamera 22 (and CCD microcamera 25, if included) are connected to the recorder 24.
  • a display 23 can be connected to the recorder 24 (for example, to the sensor I/O circuitry 50) for use by a human user/operator.
  • the various sensors 11, 12, 13, 14, 15, 16, 17, 18, 20 and 21 may include a local transducer at the location of the variable being sensed and a remote transducer placed more closely to the recorder 24 than the location of the variable being sensed.
  • the wheel rotation sensor 18 may mclude a local transducer that transforms some of the rotational energy into electrical energy and a remote transducer that converts the electrical energy into an electromagnetic signal that can be recorded by the recorder 24.
  • the local transducer of the wheel rotation sensor 18 may be a segmented ferrous-based cog wheel that rotates with the wheel and the remote transducer can be a reluctance-sensmg transducer that transforms the detected pulses n the magnetic field to an electrical signal that is processed for optimal use by the data recorder 10.
  • the ultrasound detection sensor 21 can have forward- or side-located components that produce signals that are further processed at a remote location.
  • the ultrasound detection sensor 21 can mclude a plurality of ultrasonic transducers mounted at the front and around the sides of the vehicle. From those locations, transducers produce and/or receive ultrasonic (or electromagnetic) signals to sense or determine the immediate surroundings of the vehicle and produce signals that can be processed to produce an alarm signal that will activate the inventive data recorder 10 to record the proximity of other nearby vehicles.
  • such an ultrasound detection sensor 21 can be used to monitor the driving habits or the vehicle's operator(s) .
  • the recorder 24 shown in Figure 1 is a hardware-based implementation of an embodiment of the invention.
  • the recorder 24 includes a mass storage device 30, a bus 32, a signal processing circuit 34, a signal conversion circuit 36 and a sensor input/output (I/O) circuit 50.
  • the mass storage device 30, the signal processing circuit 34, and the signal conversion circuit 36, and the sensors I/O circuit 50 are all connected to the bus 32.
  • the mass storage device 30 can take several forms.
  • the mass storage device 30 is a magnetic tape recorder (specified above) that records on a magnetic tape included in a removable cassette.
  • the mass storage device 30 can be a solid-state flash memory card or other removable memory mediums that store data. Examples are 2.5 and 3.5 inch removable disk drives capable of storing at least 120 megabytes of data.
  • the signal processing circuit 34 includes a central processing unit (CPU) 40, a random access memory (RAM) 42 and a clock 44 that are connected together in conventional fashion. These connected components allow the CPU 40 to process sensor and other signals received from the bus 32 in accordance with clock signals produced by the clock 44 and to record the results of the signal processing operations in the RAM 42.
  • the actual signal processing performed by the CPU 40 is dependent upon a program which is installed in the CPU 40 when the data recorder 10 is first turned on. Such programming is conventional to those skilled in the art of computer programming. Two aspects of the necessary programming are worthy of specific note, however. The first is that the CPU 40 is programmed to convert digital signals from one format to another. The second is that the CPU 40 is also programmed to encrypt the information in the signals.
  • the actual encryption method can be any one of many available possibilities. The preferred form, however, is a public key encryption method chosen from the many known public key encryption methods.
  • the signal conversion circuit 36 is used to convert the video signal from the CCD microcamera(s) 22 (and 25) . At a minimum, the signal conversion circuit 36 must convert the analog video signal to digital data. Further, the signal conversion circuit 36 can control the sequencing of the video signals if there is more than one microcamera.
  • the signal conversion circuit 36 can include a multiplexer that controls which CCD microcamera is being recorded at a given time. As will be described below, the rate at which the video signals are switched can be made a function of the state of alarm of the recorder 10. Accordingly, the signal conversion circuit 36 can be made to respond to alarm signals produced by the signal processing circuit 34.
  • the signal conversion circuit 36 can take video signals from all of the CCD microcameras in operation and produce a concurrently composite video signal, such as a split screen video signal.
  • the signal conversion circuit 36 can also receive date and time signals from the signal processing circuit 34 and produce video representations of those date and time signals in the analog video signal before digitizing the video signal.
  • the signal processing circuit 34 can advantageously be responsive to the outputs of one or more of the sensors 11, 12, 13, 14, 15, 16, 17, 18, 19, or 20.
  • the recorder 10 is installed in a transit bus, it may be advantageous to have four microcameras (such as microcameras 22 and 26) connected, all directed toward the interior of the transit bus. Two of the microcameras can be located at the front and rear ends of the bus and the other two microcameras can be located to monitor the transit bus' entry/exit doors.
  • the signal processing circuit 34 can be caused to switch from the fore- and aftward pointing microcameras to the door-monitoring microcameras as a function of the position of switches 17 which can be connected to the entry/exit doors in such a way that determines whether the doors are closed.
  • the signal processing circuit 34 causes the video signals from the fore-and aftward pointing microcameras to be used, while the door monitoring microcameras are used when the doors are open.
  • the microcameras whose signals are being recorded at any time can be a function of time or location (via the GFS sensor 15) .
  • such a system can be used to monitor events exterior to the transit bus when the bus is passing through a high crime area. Also such a system can be used to monitor specific areas with the microcameras in response to an emergency event signified by actuation of a switch 17 (by the transit bus operator, for example) or by actuation of the accelerator sensor 14. It is possible to use the accelerator sensor 14 to sense the occurrence of a collision when the acceleration levels sensed exceed a predetermined threshold.
  • the transit bus operator may want to record events that occur within and/or exterior to the transit bus and to preserve those events without fear that they will subsequently be written over inadvertently.
  • a recording will include a fixed predetermined period of time, including periods of time before and after the switch 17 is actuated.
  • the first actuation of the switch 17 can specify that a recordable event has occurred and the next subsequent actuation of the switch 17 can specify the end of the event.
  • the recorder 24 can then adjust the portion of the video and sensor signals that it preserves.
  • the signal conversion circuit 36 compresses the highly redundant video signals from the CCD microcamera 22 and produces therefrom a compressed digital signal that it tra.nsfers to the bus 32.
  • the compression operation is performed by hardware in the signal conversion circuit 36.
  • This hardware convent.ionally takes the form of an application-specific integrated circuit (ASIC) that performs JPEG compression.
  • ASIC application-specific integrated circuit
  • the compression portion of the conversion circuit 36 compresses data received from the CCD microcamera 22, as well as any of the optional additional CCD microcameras 25 that may be in use in the specific preferred embodiment that is suitable for a particular application. It is also possible to perform a simultaneous compression and encryption operation at this stage of the signal conversion process.
  • the recorder 24 receives signals from the sensors 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 and 21, through the sensor I/O circuit 50 and the bus 32.
  • the recorder 24 also receives signals from the CCD microcamera 22 (and any possible optional additional microcameras 25) through the signal conversion circuit 36.
  • the signal processing circuit 34 receives the sensor and digital video signals through the bus 32, processes the signals, and sends the resulting processed digital signals to the mass storage 30 for recording. Since the data recorded in the mass storage is encrypted, its security during playback can be given a very high degree of assurance. If a party wished to alter the data recorded in the mass storage, the encryption system applied would have to be defeated and the recorded data recorded over with counterfeit data that make contextual sense. In general, it would be very difficult to do so.
  • the signals from the CCD microcamera 22 can be compressed by the compression circuit (such as a JPEG circuit) . Then the compressed data, along with the sensor data can be mixed with clock data before encryption, so that the encrypted data includes contemporaneous recordings of the date and time ( ⁇ lock signal) , the sensor positions (sensor data) and the visual scene (video data) . If desired, the date and time information can be inserted into the visual scene (through conventional circuitry and processing, not shown) .
  • the compression circuit such as a JPEG circuit
  • the recorder 10 can also include a controller 200, a transceiver 202, and an antenna 206 that communicates with a remote transceiving system/computer 208.
  • the controller 200 is connected to the bus 32, the transceiver 204 is connected to the controller 200, and the antenna 206 is connected to the transceiver 204.
  • the data are prepared by the recorder 10 and then sent to the controller 200 over the bus 32.
  • the signals representing the data to be transmitted are augmented by appropriate control signals, to which the controller 2C0 responds.
  • the controller 200 then controls the transceiver 204 and causes it to transmit the data to the remote location through the antenna 206.
  • the remote transceiv g system/computer 208 can be configured to record and process the data.
  • control signals are transmitted to the antenna 206 by the remote transceivmg system/computer 208, the received signals being demodulated by the transceiver 204 and passed on to the controller 200 for further processing. Any data included with the data signals can be separated by the controller 200, which then responds to the control signals and causes the data to be transmitted to the appropriate portion of the recorder 10.
  • the remote transceivmg system/computer 208 may produce control signals to activate a sensor or to cause one or the other of the microcameras 22 and 25 to be repomted to collect video data from a desired direction.
  • FIG 2 is a schematic diagram of the structure of a data file, as stored by the preferred embodiment of the invention
  • the data file 60 is represented as a rectangular area containing digital data which are stored m a memory such as the RAM 42 of the signal processmg circuit 34 in Figure 1.
  • the data have a format which is useful when readmg and playing back the data
  • the data file contams header data 62, video data 64 and sensor data 66, m that order.
  • the header data 62 includes an indication of the file format that is used m the storage of the data in the file, the version of the recorder on which the data were recorded, a customer identification number, and additional portions reserved for future use.
  • the video data 64 is 8-bit gray scale data, representing 256 different levels of gray.
  • the video data 64 can represent a color video image.
  • the video data 64 can be postprocessed, after the analog video signals have been digitized, by the insertion of a special digital data portion 68 that contains documentary data.
  • the documentary data will be the date and time at which the images in the video data were imaged by the microcamera(s) 22 and 25.
  • the documentary data could be expanded to include digitized representations of the outputs of some or all of the sensors 11, 12, 14, 16, 18, 20 and 21.
  • the sensor data 66 includes digital representations cf the value of the variable(s) for each of the sensors 11, 12, 14, 16, 18, 20 and 21. Typically, it is desirable to encode the digital sensor data 66 to discourage tampering.
  • the primary security for the sensor and other data in the file format is provided by encryption that is applied after the data in the file are compressed.
  • FIG. 3 is a schematic diagram of a second preferred embodiment of an apparatus of the invention.
  • the recorder 24 shown in Figure 3 is a software-based implementation of an embodiment of the invention. In this schematic diagram, components which serve the same purpose as those described in Figure 1 are given the same reference numerals as their counterparts in Figure 1.
  • ignition switch sensor 11 may take the form of a conventional ignition switch that can be accessed so that it is possible to determine whether the ignition switch is turned on. Turning on the ignition is generally a good signal that the vehicle is about to be operated and may, in some system, signify that the data recording process should begin.
  • the brake sensor 12 may take the form of a brake pressure sensor
  • the accelerator sensor 14 may take the form of a throttle position sensor
  • the steering column sensor 16 may take the form of a wheel position sensor.
  • the sensors can also include a speed input sensor 23 including a toothed wheel that rotates as the vehicle moves and produces pulsed signals in accordance with the rotational speed of the wheel.
  • a speed input sensor 23 including a toothed wheel that rotates as the vehicle moves and produces pulsed signals in accordance with the rotational speed of the wheel.
  • Another optional sensor is a Global Positioning
  • Satellite receiver 52 which receives positional signals through its roof-mounted antenna 54 and produces sensor signals that are used by the sensor data recorder 10 to indicate the global location of the vehicle in which it is installed (within 30 meters) .
  • a further optional sensor is a door open sensor 56.
  • the door open sensor 56 can be useful in identifying situations in which it is desirable to start recording data, even if the vehicle is not started. It can also be useful in identifying situations in which a public safety officer has left the vehicle, signifying that a beacon-following system controlling the pointing direction of the CCD microcamera(s) 22 and 25 should be activated.
  • the mass storage device 30 of the recorder 24 can be a removable hard disk having 500 megabytes of storage capacity.
  • the recording time for the mass storage device is dependent upon the sampling rate of the signals which are to be stored.
  • the signal conversion circuit 36 is connected to one or both of the CCD microcameras 22 and 25 and includes flash converter circuitry to quickly transform the analog video signals from the microcameras to digital form.
  • a frame buffer circuit produces framed digitized video data that are transferred to the bus 32 for transport to other hardware components of the data recorder 10, such as the signal processing circuit 34.
  • the signal processing circuit 34 includes a CPU, such as an Intel 80386 microprocessor, which is connected to a dynamic RAM and to a real-time clock in accordance with the good engir.eering practices well-known to those skilled in the electronics hardware arts.
  • the data produced by the microprocessor are transmitted to the bus 32 , which transfers them to the appropriate hardw ⁇ .re component of the sensor data recorder 10, such as the mass, storage device 30.
  • the microprocessor of the signal processing circuit 34 receives the data containing header, video and sensor data according to the file format 60 (see Figure 2) .
  • the microprocessor applies compression algorithm, such as the LWZ algorithm, to the received data and stores the data in compressed form in the dynamic: RAM.
  • the microprocessor then applies an encryption algorithm to the stored data and transfers the resulting encrypted and compressed data to the mass storage device 30 through the bus 32.
  • the data are stored in a hard disk that: is removable from the mass storage device 30.
  • the removable hard disk containing the encrypted compressed data can be stored in a convenient location for later retrieval and replay of the data.
  • the power supply 70 of the data recorder 10 shown in Figure 3 is an integral part of the data recorder.
  • the power supply 70 is normally connected to the vehicle's battery.
  • the power supply 70 includes a backup battery 72.
  • the backup battery 70 will supply power to the data recorder 10 in the event that the connection between the power supply 70 and the vehicle's battery is broken.
  • the power supply 70 can be used to extend the time that the data recorder 10 can record data for a period of time after the automobile's ignition switch has been turned off.
  • Figure 4 is a flow chart of the program running within the preferred embodiment of the invention shown in Figure 1. The program is simultaneously accomplishing two tasks.
  • One task is to receive and process data from the sensors.
  • the other task is to receive and process data from the video camera(s) 22 (25) and to combine the video data with the sensor data.
  • the combined data is then compressed, encrypted and stored to disk for later retrieval and replay in accordance with methods known in the prior art.
  • the replay methods comprise the inverse steps to those described below in carrying out the encoding, encryption, compression and recording steps.
  • the video data task starts (block 102) and digitizes a frame of video data produced by one or both of the microcameras (block 104) .
  • the system clock signals control when the readings from the sensors and the video camera(s) are taken. Typically, the sensor signals are sampled four times per second and the video camera data are sampled once per minute. However, the data can be sampled at different controllable rates as described below.
  • the digitized video data is transferred to the dynamic RAM (block 106) and interspersed with time/date signals produced by the system clock, the time/date signals characterizing the time and date at which the signals are produced (block 108) .
  • the sensor data are also appended to the stored video and time/date signal data (block 110) in the file format described above, compressed (block 112) , encrypted (block 114) , and stored to disk (block 116) for :.ater retrieval and replay. Then this task of the computer program awaits a further signal from the system clock, at which tine it will begin again at block 102.
  • the program reads the sensors when the appropriate signal is produced by the system clock (block :.18) .
  • the sensor readings are taken frequently, allowing them to be processed digitally and/or statistically before they are made available as sensor data by the step represented by block :.18.
  • This program task compares the sensor data to trip po:.nts or thresholds (block 120) and determines whether an alarm should be produced (block 122) .
  • the alarm condition when the CCD microcameras are normally inactive, they are activated to ::ecord the events that caused, and the sensor data that resulted ::rom the alarm condition. However, if the CCD video microcameras are normally active, their signals may be sampled more frequently in the case of an alarm to increase the chance that the event prompting the alarm condition will be completely recorded.
  • the step of block 120 can detect when the vehicle speed exceeds the trip point, and the step of block 122 can determine that an alarm should be produced.
  • the data recorder analyzes the magnitude and frequency of the steering motio s to establish when the trip point has been exceeded. If an alarm is to be produced, the alarm signal is processed (block 124) , causing adjustment in the sampling rate, an alarm timeout and reset condition are established (block 126) and the program returns to block 118 to read the sensors again. To save storage space in the mass storage device 30, the alarm timeout is established to allow the system to collect possibly relevant data without requiring an undesirably large amount of the recording medium.
  • the duration of the alarm timeout is a function of the reason for the alarm. For example, if the alarm is caused by the vehicle's speed exceeding a desired threshold, the data recorder 10 should be activated only as long as the speed is above the desired threshold. On the other hand, if the alarm is caused by erratic steering movements, the alarm condition should last beyond the time when the erratic steering movements cease. If the alarm is not to be produced, the sensor data are stored in an array in memory (block 128) for use by the append sensor data step (represented by block 110) of the other task of the program, and the present task of the program returns to block 118 to read the sensors again.
  • Figure 5 is a representation of a video image, illustrating a method for controlling and assuring the integrity of the image upon processing, storage and playback.
  • the video image 80 can include an image area 82 and generally an area 84 in which the date, time and status of various sensors (SI, S2 and S3) are displayed.
  • SI, S2 and S3 the date, time and status of various sensors
  • the entire video image 80 need not be encrypted before storage, since the subportion 86 of the video image 80 is encrypted and preserved for decryption and comparison to the stored image 70 to assure that the stored image is valid. Instead the entire video image 80 is converted to the file format but not combined with any sensor data. Rather, the subportion 86 is compressed and combined with the sensor data and then enciypted. Parameters giving the location of the subportion 86 are incorporated into the header data so that it will be possible to correctly compare the decrypted and decompressed subportion 80 with the appropriate part of the decompressed entire video image 80. The subportion 86 can be placed at any desired location in the entire video image 80.
  • FIG. 6 is a block diagram of an apparatus for playback of the data stored by the data recorder of the present invention.
  • the playback apparatus 140 includes a playback unit 142, a decryption circuit 144, a decompression circuit 146, a playback signal processing circuit 148, a video display unit (VDU) 150, a speaker 152 and a sensor display 154.
  • VDU video display unit
  • the playback unit 142 includes a control panel 155 from which a user of the playback apparatus 140 can control the playback process, including entry of any data needed to facilitate the decryption process, such as entry of the second (unpublished) component of any public key encryption system that may be in use.
  • the playback unit 142 accepts the removable hard disk that was removed from the mass storage device 3D, and plays back the removable hard disk to reproduce the digital data stored on the removable hard disk.
  • the signals representing the digital data are transmitted to the decryption circuit 144 which removes the effect of the encryption performed on the data prior to storage on the removable hard disk drive.
  • the decryption circuit 144 produces a compressed signal and an uncompressed signal, including original sensor signals.
  • the compressed signal is received by the decompression circuit 146 which produces a decompressed video signal and a decompressed sensor signal .
  • the uncompressed signal from the decryption circuit 144 and both of the decompressed signals from the decompression circuit 146 are received by the signal processing circuit 148.
  • the signal processing circuit 148 produces an analog video signal and an audio signal.
  • the analog video signal is received by the VDU 150 which causes the VDU 150 to reproduce the original images.
  • the speaker 152 receives the audio signal and reproduces the original audio signals that accompanied the original images.
  • the sensor display 154 receives the sensor signals and reproduces their original readings.
  • Figure 7 is a flow chart of the method of playing back the data stored by the data recorder of the present invention.
  • the digital signals recorded on the removable hard disk are played back (block 160) .
  • the encrypted digital signals among the played-back signals are decrypted (block 162) .
  • Any compressed signals included among those that were originally played back or later decrypted are then decompressed (block 164) and the resulting uncompressed and decompressed signals are processed to produce audio signals, video signals and sensor signals that were originally concurrent (block 166) .
  • the audio signals are then played, and the concurrent video and sensor signals are displayed (block 168) , thereby reproducing the original video, audio and sensor signals.
  • the signal processing circuit 148 also compares the decompressed decrypted subportion 86 of the entire video image 82 with the proper' portion of the decompressed entire video image 82 before displaying the decompressed entire video image 82. If there are discrepancies, the signal processing circuit 148 will alert the user to the type and location of the discrepancies.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

L'invention concerne un procédé et un dispositif pour l'enregistrement des données de capteurs (11-21). Les signaux analogiques et numériques qui renferment les données (11-21) en question sont accompagnés par un signal vidéo analogique simultané (22, 25). On procède à une conversion analogique-numérique des signaux et à une compression des signaux très redondants selon les techniques de compression classiques (36). Les signaux comprimés qui résultent de l'opération et les signaux non comprimés sont ensuite codés et mis en mémoire dans un disque dur amovible (30). On peut ensuite reproduire les données ainsi mémorisées pour reconstituer les signaux d'origine tout en s'assurant que les signaux reproduits sont une reconstitution fidèle des signaux d'origine. Le cas échéant, on peut structurer les données recueillies en fonction d'un ou de plusieurs capteurs (11-21). Enfin, il est possible de transmettre les données vers un emplacement lointain ou de recevoir depuis un tel emplacement des signaux de commande.
PCT/US1996/020912 1995-12-21 1996-12-20 Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs WO1997023075A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP96945967A EP0868798A4 (fr) 1995-12-21 1996-12-20 Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs
CA 2241096 CA2241096A1 (fr) 1995-12-21 1996-12-20 Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US901895P 1995-12-21 1995-12-21
US60/009,018 1995-12-21

Publications (2)

Publication Number Publication Date
WO1997023075A1 true WO1997023075A1 (fr) 1997-06-26
WO1997023075A9 WO1997023075A9 (fr) 1997-11-13

Family

ID=21735105

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1996/020912 WO1997023075A1 (fr) 1995-12-21 1996-12-20 Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs

Country Status (2)

Country Link
EP (1) EP0868798A4 (fr)
WO (1) WO1997023075A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001028239A1 (fr) * 1999-10-08 2001-04-19 Raytheon Company Systeme d'enregistrement video resistant aux catastrophes
US7027719B1 (en) 1999-10-08 2006-04-11 Raytheon Company Catastrophic event-survivable video recorder system
US20180183769A1 (en) * 2016-12-23 2018-06-28 Industrial Technology Research Institute Control system and control method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4831438A (en) * 1987-02-25 1989-05-16 Household Data Services Electronic surveillance system
US5361326A (en) * 1991-12-31 1994-11-01 International Business Machines Corporation Enhanced interface for a neural network engine
US5408217A (en) * 1994-03-21 1995-04-18 Sanconix, Inc. Secure fire/security/sensor transmitter system
US5497419A (en) * 1994-04-19 1996-03-05 Prima Facie, Inc. Method and apparatus for recording sensor data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4831438A (en) * 1987-02-25 1989-05-16 Household Data Services Electronic surveillance system
US5361326A (en) * 1991-12-31 1994-11-01 International Business Machines Corporation Enhanced interface for a neural network engine
US5408217A (en) * 1994-03-21 1995-04-18 Sanconix, Inc. Secure fire/security/sensor transmitter system
US5497419A (en) * 1994-04-19 1996-03-05 Prima Facie, Inc. Method and apparatus for recording sensor data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP0868798A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001028239A1 (fr) * 1999-10-08 2001-04-19 Raytheon Company Systeme d'enregistrement video resistant aux catastrophes
US7027719B1 (en) 1999-10-08 2006-04-11 Raytheon Company Catastrophic event-survivable video recorder system
US20180183769A1 (en) * 2016-12-23 2018-06-28 Industrial Technology Research Institute Control system and control method

Also Published As

Publication number Publication date
EP0868798A4 (fr) 2000-11-08
EP0868798A1 (fr) 1998-10-07

Similar Documents

Publication Publication Date Title
US5497419A (en) Method and apparatus for recording sensor data
US6141611A (en) Mobile vehicle accident data system
CA2331481C (fr) Systeme de donnees pour les accidents de vehicules en mouvement
US7190882B2 (en) In-car digital video recording with MPEG-4 compression for police cruisers and other vehicles
US7386376B2 (en) Vehicle visual and non-visual data recording system
US6624611B2 (en) Sensing vehicle battery charging and/or engine block heating to trigger pre-heating of a mobile electronic device
US6211907B1 (en) Secure, vehicle mounted, surveillance system
US6163338A (en) Apparatus and method for recapture of realtime events
US20030081128A1 (en) Heating and cooling of a mobile video recorder
US20030081935A1 (en) Storage of mobile video recorder content
US20030081934A1 (en) Mobile video recorder control and interface
US20030081122A1 (en) Transmitter-based mobile video locating
US20030080878A1 (en) Event-based vehicle image capture
US20030081127A1 (en) Mobile digital video recording with pre-event recording
EP0947963B1 (fr) Système automatique pour enregistrer les évènements précédant et/ou suivant un évènement typique dans lequel un véhicule est impliqué
US20010005804A1 (en) Vehicle event data recorder including validation of output
EP1312217A1 (fr) Systeme de surveillance de securite monte sur vehicule
EP0868798A1 (fr) Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs
WO1997023075A9 (fr) Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs
MXPA98004896A (en) Method and apparatus to register and reproduce sen data
MXPA96004900A (es) Metodo y aparato para grabar datos de detector
CA2241096A1 (fr) Procede et dispositif pour l'enregistrement et la reproduction des donnees de capteurs
KR100567920B1 (ko) 차량용 다기능 디지탈 비디오 레코더 및 그 운영방법
JP2000011156A (ja) 情報記録装置、情報記録解析装置及びその情報記録装置を搭載する自動車

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): BR CA IL JP MX US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
COP Corrected version of pamphlet

Free format text: PAGE 1/4,DRAWINGS,REPLACED BY A NEW PAGE BEARING THE SAME NUMBER;DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

WWE Wipo information: entry into national phase

Ref document number: PA/a/1998/004896

Country of ref document: MX

ENP Entry into the national phase

Ref document number: 2241096

Country of ref document: CA

Ref country code: CA

Ref document number: 2241096

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1996945967

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 97523104

Format of ref document f/p: F

WWP Wipo information: published in national office

Ref document number: 1996945967

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1996945967

Country of ref document: EP