US20110163862A1

US20110163862A1 - Imminent collision warning system and method

Info

Publication number: US20110163862A1
Application number: US13/048,070
Authority: US
Inventors: Sanjeev Nath; Rajesh Patel
Original assignee: Nattel Group Inc
Current assignee: Nattel Group Inc
Priority date: 2004-04-29
Filing date: 2011-03-15
Publication date: 2011-07-07
Also published as: EP1807817A2; US20090134988A1; WO2005109373A2; US20050246100A1; US7451046B2; WO2005109373A3

Abstract

The invention is directed to methods and systems for sensing the presence of objects in the intended path of an automobile with a system to warn both the operator of the vehicle and the object of regard.

Description

This is a continuation of U.S. patent application Ser. No. 10/834,735, filed Apr. 29, 2004. The disclosure of which is hereby incorporated by reference herein its entirety where appropriate for teachings of additional or alternative details, features, and/or technical background, and priority is asserted from each.

FIELD OF INVENTION

The invention is generally related to automatic sensing devices. In particular, the invention is related to a system and method for automatically sensing the distance between objects that are converging to or diverging from each other. More specifically, the present invention involves a system and a method that provide both audible and visual warning of an imminent impact of a moving object with an individual using a personal device.

BACKGROUND OF INVENTION

Present state of the art provides numerous devices and methods for locating, tracking and monitoring the movement of objects in relation to each other. These devices range from determining the relative trajectories of subatomic particles to the plotting the relationship between global positioning satellites to traffic collision avoidance systems used in aviation, such as those described in U.S. Pat. No. 6,690,296, U.S. Pat. No. 6,690,295, U.S. Pat. No. 6,636,752, U.S. Pat. No. 6,525,674 and U.S. Pat. No. 6,356,855, which are incorporated herein in their entirety . However, they are usually complicated and cumbersome to be useful in ordinary daily endeavors.
Monitoring and tracking a moving object is important in many applications. In certain applications, it is desirable to have a tracking device not only to locate the position of the object but also to monitor the movement of the object in real time without any significant delay.
For example, many tracking devices have been developed recently to locate objects that are not in close proximity. Many scanning devices scan for remote objects using radio frequency technology. Any of a number of techniques for locating objects can be readily adapted to locate moving objects. While these devices fulfill their respective particular objectives and requirements, the prior art does not suggest the novel imminent collision warning system disclosed herein.

SUMMARY OF INVENTION

The present invention advantageously uses state of the art electronic devices in new ways to improve the safety of individuals in their mobile lives. The electronic devices are easily portable and mobile, such as cellular phones, smart phones, personal digital assistants (PDA) and mobile computers. The present invention provides a system that recognizes any one of these popular devices, hereafter referred to as client devices, as carried by individuals or other objects, from a distance in such a manner that when the closure rate of the recognizing safety device and the client device exceed a predetermined set of criteria, the system automatically warns audibly and visually, preferably both parties, of the impending closure, to enable action to be taken to possibly avoid a collision. The system is flexible to meet the needs of the operators of vehicles using the present invention in that a main controller of the system can be configured to set different sizes of safety zones that would set off an alarm when violated, or that the running condition of the engine of the vehicle can be monitored, and also appropriate authorities automatically informed of an event that may require immediate assistance.
An embodiment of the present invention involves an Imminent collision warning system comprising a safety device, the safety device further comprising a main controller, and a display controller. A plurality of client devices communicate with the main controller. Another set of monitoring devices are also capable of communicating with the main controller and the plurality of client devices. The main controller keeps track of the proximity of the plurality of client devices, including other safety devices, and issues timely warnings of an impending collision between the safety device and the plurality of client devices.
An aspect of an embodiment of the present invention comprises a system for: determining the distance between the moving and stationary and/or moving object;: using a communication device to transmit a rate of change of the distance between the moving and stationary and/or moving object. The system further provides sensing: the presence of objects in the pedestrian crossing; the presence of objects in the intended path of a vehicle; the movement of objects in an incorrect direction; the movement of objects in an incorrect location; the passing of moving objects through a traffic control device; determining whether the velocity of the vehicle exceeds zero velocity (in any direction); informing the objects if the velocity of the approaching vehicle is greater than zero. The system also provides sensing whether the said objects are not following the appropriate control functions of the traffic control devices; and uses emergency designations for reporting the impending collision.
In another aspect of an embodiment of the present invention, a method is provided for monitoring and supplying a warning of an impending collision between a moving and a stationary and/or moving object. The method provides sensing the presence of an object in the path of a vehicle whether stationary or moving; determining the distance of separation between the vehicle and the said object, determining that the vehicle is moving along a collision path; determining the speed of reduction of distance between the vehicle and said object, the distance approaching a defined zone; generating a warning to an operator of the vehicle as well as to the object on a collision course; sensing an impending event, including an accident; summoning appropriate authorities, including police to the event; and summoning immediate emergency care.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1( a) depicts an exemplary lateral view of an imminent collision warning system with an arrangement to ensure wireless communications among it's components, according to the first embodiment of the present invention;

FIG. 1( b) an exemplary systematic diagram of communication interface between ICWS modules, according to a first embodiment of the present invention;

FIG. 1( c) is a flowchart of an exemplary process, in which an ICWS interacts with a intelligent monitoring device (IMD), according to at least one embodiment of the present invention;

FIG. 1( d) is a flowchart of an exemplary process, in which an ICWS interacts with an automobile registry communication system (ARCS), according to at least one embodiment of the present invention;

FIG. 2( a) depicts an exemplary functional block diagram of an ICWS, according to at least one embodiment of the present invention;

FIG. 2( b) depicts an exemplary functional block diagram of a main controller device;

FIG. 2( c) depicts an exemplary functional block diagram of a display device;

FIG. 2( d) depicts an exemplary functional block diagram of a communication device;

FIG. 3 depicts an exemplary functional block diagram of an client module of ICWS, according to at least one embodiment of the present invention;

FIG. 4 depicts an exemplary flow diagram of an ICWS defining the steps involved;

DETAILED DESCRIPTION

The present invention imminent collision warning system (ICWS) is described in detail below. Figures illustrate the systematic arrangement for providing and maintaining communications between the Main ICWS and the client ICWS, including the use of Intelligent Monitoring Devices (IMD) or Automobile Registry Communication System (ARCS).
Structures of an exemplary IMD. and ARCS are disclosed in pending U.S. patent application Ser. No. 10/704,456 flied on 7 Nov. 2003, and U.S. patent application Ser. No. 10/741,855 filed on 20 Dec. 2003, which are incorporated by reference in their entirety herein. By receiving a request the system can automatically collect the data and other relevant information pertaining to any particular vehicle (e.g. ownership, insurance, licensing etc.)
As would be understood by one of ordinary skill in the art, ICWS can be used in many different situations, e.g., to determine the rapidity of reduction of distance between two objects, to sense the presence of a pedestrian or another object in the pedestrian crossing or in the intended path of a vehicle, to warn a individual about an imminent collision, to sense the presence of an object in the intended path of a vehicle, to sense the movement of an object in an incorrect location or to a vehicle being operated contrary to the rules and regulations in effect.
FIG. 1.0 depicts one embodiment of the present invention. Shown is a system diagram of a Main controller of the imminent collision warning system (ICWS) interacting with a client controller of the imminent collision warning system (ICWS). The system is designed to provide an early warning of an imminent collision.
FIG. 1.0 depicts an exemplary diagrammatic lateral view of an automobile mounted with the Main ICWS with an arrangement to ensure wireless communications with the client ISWD, according to a first embodiment of the present inventions.
In FIG. 1( a), an operator is in a movable vehicle 10 mounted with the Main ICWS 11. The movable vehicle 10 may correspond to a vehicle that is movable such as an automobile, a truck, a train, a bus, a boat, an airplane, a bicycle or a motorcycle. The client ICWS 17 can operate independently or can be mounted on a portable device. The portable device may be, for example (without limitation) a wireless cellular phone, compact disk (CD) player, portable video player or a personal digital assistant (PDA) with wireless capabilities, or a mobile personal computer.
The front and rear of the movable vehicle 10 is mounted with the sensor beacons 12. The front and rear sensor beacons 12 are connected through connection 14 to the main controller ICWS 11. The main ICWS 11 communicates wirelessly 15 with the client ICWS 17.
The object 18 encompasses individuals with portable devices, children, inattentive or impaired individuals.
FIG. 1( b) depicts an exemplary communication interface of the Main ICWS 11 with the Client ICWS 17, according to the first embodiment of the present invention. The vehicle mounted with the Main ICWS 11 can simultaneously wirelessly 15 communicate with “n” number of client ICWS 17's. The main ICWS 11 and the client ICWS 17 are connected with a pair of sensor beacons 12. This is an emitter which transmits a signal beam around the movable vehicle. In this depicted embodiment, the Sensor beacon 12 can be installed on the front, rear and sides of the vehicle covering the area adjoining the entire circumference of the movable vehicle.
The sensor beacon 15 may correspond to a radio frequency, WLAN IEEE 802.11x & 802.16x standards, a Bluetooth, an IR port, a laser technology or an optical technology.
The signal used for transmission can be accomplished via radio frequency, WLAN IEEE 802.11x & 802.16x standards, Bluetooth an IR port, a laser technology or an optical technology, where the wireless 802.11x covers the area of about 3 block, the wireless 802.16x covers the area of about 7 miles, a blue tooth system covers a diameter range of around 330 feet and an “IrDA” infrared red system generally covers less than 5-10 feet with a proper line of sight. This technology as is described in greater detail below
The Bluetooth's native ad-hoc network property makes it very useful by replacing bulky cables, providing printing support or acting as ID cards. The Bluetooth wireless specification includes both link layer and application layer definitions for product developers, which support data, voice, and content-centric applications. Handheld wireless communication devices that comply with the Bluetooth wireless specification operate in the unlicensed, 2.4 GHz radio spectrum ensuring communication compatibility worldwide. These radios use a spread spectrum, frequency hopping, full-duplex signal at up to 1600 hops/sec. The signal hops among frequencies at 1 MHz intervals to give a high degree of interference immunity. Up to seven simultaneous connections can be established and maintained. Further details can be viewed at www.bluetooth.org or www.bluetooth.com.
The Infrared Wireless Adaptor (IrDA) specifications, on the other hand, is intended for high speed short range, line of sight, point-to-point cordless data transfer—suitable for handheld communication devices. Since 1984, “IrDA Data” defines a standard for an interoperable universal two way cordless infrared light transmission data port. IrDA technology is already in over 300 million electronic devices including PC's, PDA's, cellular phones, cameras, toys, watches and many other mobile devices. Main characteristics of IrDA signaling include:

- Range: Continuous operation between two contacts for at least 1 meter.
- Bi-directional communication is the basis of all specifications.
- Data transmission starting from 9600 kbps primary speed going up to 4.0 mbps.
- Data packets are protected using CRC (from CRC 16 for speeds up to 1.152 mbps to CRC-32 at 4.0 mbps).

Radiofrequency (RF) is another name for radio waves. It is one form of electromagnetic energy that makes up the electromagnetic spectrum. Electromagnetic energy consists of waves of electric and magnetic energy moving together (radiating) through space. The area where these waves are found is called an electromagnetic field.
Radio waves are created due to the movement of electrical charges in antennas. As they are created, these waves radiate away from the antenna. All electromagnetic waves travel at the speed of light. The major differences between the different types of waves are the distances covered by one cycle of the wave and the number of waves that pass a certain point during a set time period. The wavelength is the distance covered by one cycle of a wave. The frequency is the number of waves passing a given point in one second. For any electromagnetic wave, the wavelength multiplied by the frequency equals the speed of light. The frequency of an RF signal is usually expressed in units called hertz (Hz). One Hz equals one wave per second. One kilohertz (kHz) equals one thousand waves per second, one megahertz (MHz) equals one million waves per second, and one gigahertz (GHz) equals one billion waves per second.
RF energy includes waves with frequencies ranging from about 3000 waves per second (3 kHz) to 300 billion waves per second (300 GHz). Microwaves are a subset of radio waves that have frequencies ranging from around 300 million waves per second (300 MHz) to three billion waves per second (3 GHz).
Basically WLAN is an ordinary LAN protocol, which is a modulated carrier of radio frequency waves. WLAN IEEE 801.11 is a natural extension to LAN Ethernet, and the modulated protocol is IEEE 802.3 (Ethernet 3).
Common WLAN Products, which are using IEEE standards, are based on IEEE 802.11 and 802.11b specification. 802.11b is a high rate extension to the original 802.11, and specific 5.5 to 11 Mbps data rate. The next HyperLAN2 generation using IEEE 802.11a, IEEE 802.11g standards, operates in a new band frequency of 5 GHz, and achieves a high data rate as 54 Mbps. The new networking technology WiMax IEEE 802.16x should provide higher speed, and more coverage than existing Wi-Fi standards.
FIG. 1.2 is an exemplary functional block diagram of interfacing ICWS 11 and 17 with an intelligent monitoring device (IMD) 20 which may be located on any roadside installation. The relevant information can be transmitted wirelessly 15 from ICWS 11 and 17 using the sensor beacons 12 to IMD 20.
An intelligent monitoring device (IMD) is located on a roadside installation 20. The device has an onboard central processing unit. The intelligent monitoring device (IMD) has a multi-line liquid crystal display (LCD) panel 22 capable of displaying detailed information related to the process executed, errors and equipment information displayed. The external interface is provided for maintenance purposes, in case equipments need configuration changes or updating the pre-existing applications or their sub modules. The signal processor differentiates between the incoming transmission via signal receiver 21 and outgoing transmission via signal emitter 23.
FIG. 1.3 is an exemplary block diagram of an interfacing ICWS 11 with an Automobile Communication and Registry System (ACARS) 25 installed inside the vehicle. The ICWS 11 can be operated independently or can be harnessed with ACARS 25.
FIG. 2( a) is an exemplary block diagram of major components of ICWS. There are 3 major components of the imminent collision warning system (shown below). All the components are connected to one another via external adapters and connectors or can share the same system bus. Any of these major components can be installed independently or with other external applications e.g. IMD, ACARS.
Main Controller 40;
Communication Controller 44;
Display Controller 45;
The three major components comprised of a Main controller 40: a) Processing Application/Application Processor 41; b) Authentication and Sensing Control 42; c) Power supply and External Interface 43. All the components are connected to one another and share the same system bus.
FIG. 2( b) is an exemplary architectural diagram of the main controller 40. The figure describes a computer control system that functions as a main onboard controller for various types of functions, including the control of the portable device used by other objects. A central processing unit 51 is provided and interconnected to various other components via a system bus 50. An operating program 52 running on the processor 51 provides control and may be used to coordinate the functions of the various components of the control system. The operating system 52 may be stored in Random Access Memory (RAM) 55, deployed in an ICWS and may have sufficient memory such as 64 or 256 megabytes of storage space. Other connectivity application for different control functions may be stored in Read Only Memory (ROM) 54. Such stored application programs may be moved in and out of RAM 55 to be executed so as to perform their respective functions.
Application program 52 deployed on the computer control system may include the ICWS constructed and configured according to different embodiments of the present invention. All the transactions recorded by the ICWS are stored on an internal storage device 53.
An external interface 62 is provided for external connectivity to the automobile onboard control system or with any other onboard application e.g. ACARS, IMD etc The power adapter 63 provides universal connectivity connector 64 which can be easily interfaced with the main power supply or any other type of auxiliary device e.g. battery, solar panel or any other third party device. The display controller and communication controller are controlled through an input/output (I/O) controller 57. The visual Display interface 58 is a universal connectivity controller and provides a universal connector “Connector II” 59. The same I/O Controller 57 also provides universal connectivity via communication interface 60 and provides a universal connector “Connector III” module 61.
According to the present Invention, the control system may detect that the vehicle is in motion through sensors positioned at one or more locations of the vehicle. For example, a motion may be detected because it is sensed that the vehicle velocity is greater than zero (in any direction). Motion may be sensed when it is detected that the park mode of the vehicle is not selected. Motion of vehicle may be sensed when the drive mode is selected or a neutral mode is selected with brakes not fully engaged. Other alternatives to detect the motion of the vehicle may be employed which would be understood by any one of ordinary skill in the art.
The authentication module 56 keeps the authentication track of I/O controller's devices and inters ICWS communication. Also performs the authentication procedure when two of more Main controller or client application is active.
FIG. 2( c) is an exemplary architectural diagram of display controller 45. The referring figure describes a display control system that functions as a sub class event of the main controller to display various types of messages including the error control message, installation or configuration procedures or any relevant information pertaining to the event executed. The display adapter is connected to “Connector II” 78. The output adapter 77 regulates the power supply mechanism and different miscellaneous functions. The auxiliary adapter 76 is designed to provide connectivity of the main controller with other ancillary devices. A visual processing unit 71 is provided and interconnected to various other components via a system bus 70. A location visualiser 73 provides the location of multiple other objects and their spatial relationship to one another. Finally the visual interface 74 feeds the transmission to the onboard screen 75 or to any other third party display units.
FIG. 2( d) is an exemplary architectural diagram of the communication controller 44. The referring figure describes a communication control system that functions as a sub class event of the main controller to sense and authenticate the presence of the client or main ICWS devices. The communication adapter is connected to “Connector III” 91. The Detector Adapter 88 continuously scans via several sensor beacons 89 for the presence of other ICWS's in the immediate vicinity. As soon as the sensor beacon 89 detects the presence of another ICWS the signal processor 81 initiates the communication channel. The ROM 82 is provided to load the application in case the communication controller is installed independently. The transreceiver adapter 83 in conjunction with signal adapter 84 keeps the communication channel live until the proper termination sequence is executed. The signal emitter 85 and signal receiver 86 are connected to the signal adapter 84 to provide an enhanced bandwidth. The signal regulator maintains the quality of the transmission. Based on the information acquired the Alert sensor 90 provides a visual and audio alert message depending on defined scenarios or detection of another ICWS.
FIG. 3 is an exemplary architectural diagram of the client component of ICWS. The three major components are assembled together to make one combined functioning device.
The embodiment describes a client control device that functions as an onboard controller for various sub-functions, including the control of the handheld device used by a stationary or movable object. A microprocessor 101 is provided and interconnected to various other components via a system bus 100. An application program 115 running on the microprocessor 101 provides control and may be used to coordinate the functions of the various components of the control system. The application program 115 is stored in data storage 103. Various application programs for monitoring and control of different functions are stored in read only memory 104. Such stored application programs may be moved in and out of RAM 102 to be executed and to perform their respective functions.
An Output adapter 112 is provided for external connectivity to any other application e.g. CD player, Portable Video player, Cell Phone, PDA, etc . . .The power adapter 113 is provided with a universal connectivity connector 114 which can be easily interfaced with the main power supply or any type of auxiliary device e.g. battery, solar panel or any other third party device. It can have its own redundant power supply in case the main power supply fails or is intentionally disabled.
A location visualiser unit 108 is provided and interconnected to other components via a system bus 100. A location visualiser 108 provides the spatial relationship with other ICWS devices. The visual interface 108 feeds the data to the onboard display panel 110 via display adapter 109.
The sensor beacon 105 continuously scans for the presence of other ICWS devices within immediate vicinity. As soon as the sensor beacon 105 detects the presence of another ICWS, the beam emitter 106 and beam receiver 107 communicate the data and maintain the quality of the transmission. Based on the information acquired the Alert sensor 111 provides a visual and audio alert message.
FIG. 4 represents a flowchart of an exemplary process of imminent collision warning system (ICWS). At step 120 the velocity of the mobile object is initialized to zero. At step 121 the ICWS device scans the rapidity of reduction of the distance between two or more moving and/or stationary objects. At step 122 the device scans for mobile/stationary objects that fall in a predefined range or alert range of the second mobile/stationary object. Step 123 the local alert is executed when the mobile/stationary objects comes in the alert zone of second mobile/stationary object. The alert alarm is activated and transmits the visual and audio signals. At step 125 the Location visualiser is activated and the spatial relationship with other ICWS devices is established. Step 126 the visualized spatial relationship with other ICWS devices is displayed on the display panel. At step 127 the transaction is logged in. In step 128, if necessary the log is transmitted to the appropriate authorities.

Claims

1-20. (canceled)

21. A method comprising:

sensing by a warning system of a vehicle a presence of an individual within a path, or an intended path, of said vehicle by detecting a signal from a transmitter in a client portable electronic device carried by said individual;

determining by said warning system, if necessary, a distance between the vehicle and said individual; and

providing by said warning system a warning to an operator of the vehicle and a further warning to said individual when the distance between the vehicle and said individual is within an alert zone.

22. The method according to claim 21, wherein the individual is on a sidewalk, a road, crossing at a traffic light or a road intersection.

23. The method of claim 21, wherein said warning or said further warning is an audible signal or a visual signal.

24. The method of claim 21, wherein before providing said warning and said further warning, the method further comprises:

determining a relative speed between the vehicle and the individual to adjust a size of said alert zone for providing said warning and said further warning.

25. The method of claim 21, wherein said further warning is a wireless signal provided to said client portable electronic device carried by said individual or to a client warning device comprised in said client portable electronic device carried by said individual.

26. The method of claim 25, wherein a wireless communication between the warning system and said client portable electronic device or said client warning device comprised in said client portable electronic device is provided by utilizing WLAN IEEE 802.11x, IEEE 802.16x standards, Bluetooth standards, or a laser technology.

27. The method of claim 25, wherein said client portable electronic device is one or more of: a mobile phone, a compact disk player, a portable analog/digital video viewer, a smart phone, a personal digital assistant or a mobile personal computer.

28. The method of claim 21, wherein said vehicle is an automobile, a truck, a train, a bus, a boat, an airplane, a bicycle or a motorcycle.

29. The method of claim 21, wherein said distance corresponding to said alert zone is a maximum distance at which said warning system starts to detect signals from said transmitter.

30. The method of claim 21, wherein said transmitter is a part of a client warning device comprised in said client portable electronic device carried by said individual.

31. A warning system in a vehicle, comprising:

one or more sensors, configured to detect a presence of an individual within a path, or an intended path, of said vehicle by detecting a signal from a transmitter in a client portable electronic device carried by said individual; and

a controller, configured to determine a distance between the vehicle and said individual using one or more signals from said one or more sensors comprising information about said presence of said individual, and further configured to provide a warning to an operator of the vehicle and a further warning to said individual when the distance between the vehicle and said individual is within an alert zone.

32. The warning system of claim 31, wherein said controller is configured to determine the distance between the vehicle and said individual using said one or more signals from said one or more sensors when the vehicle is moving along said path or starting to move along said intended path.

33. The warning system of claim 31, wherein said warning or said further warning is an audible signal or a visual signal.

34. The warning system of claim 31, wherein said controller is further configured to determine a relative speed between the vehicle and the individual to adjust a size of said alert zone for providing said warning to the operator of the vehicle and said further warning signal to said object when the distance between the vehicle and said object is within the alert zone.

35. The warning system of claim 31, wherein said further warning is a wireless signal, and said warning system further comprises:

a communication module, configured to provide said wireless signal to said client portable electronic device carried by said individual or to a client warning device comprised in said client portable electronic device carried by said individual.

36. The warning system of claim 35, wherein a wireless communication between the warning system and said client portable electronic device or said client warning device comprised in said client portable electronic device is provided by utilizing WLAN IEEE 802.11x, IEEE 802.16x standards, Bluetooth standards, or a laser technology.

37. The warning system of claim 35, wherein said vehicle is an automobile, a truck, a train, a bus, a boat, an airplane, a bicycle or a motorcycle.

38. The warning system of claim 31, wherein said distance corresponding to said alert zone is a maximum distance at which said warning system starts to detect signals from said transmitter.

39. A non-transitory computer-usable medium encoded with a computer program comprising computer readable instructions recorded thereon for executing a method, which comprises:

40. The non-transitory computer readable medium of claim 39, wherein said warning or said further warning is an audible signal or a visual signal.