US10889240B2 - Method, computer device and storage medium for communicating with a rear vehicle - Google Patents
Method, computer device and storage medium for communicating with a rear vehicle Download PDFInfo
- Publication number
- US10889240B2 US10889240B2 US16/598,525 US201916598525A US10889240B2 US 10889240 B2 US10889240 B2 US 10889240B2 US 201916598525 A US201916598525 A US 201916598525A US 10889240 B2 US10889240 B2 US 10889240B2
- Authority
- US
- United States
- Prior art keywords
- congestion
- vehicle
- mood
- information
- present vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000036651 mood Effects 0.000 claims description 42
- 230000006399 behavior Effects 0.000 claims description 13
- 230000008921 facial expression Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims 3
- 238000004891 communication Methods 0.000 description 16
- 230000003993 interaction Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 8
- 206010039203 Road traffic accident Diseases 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 206010022998 Irritability Diseases 0.000 description 2
- 238000013019 agitation Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/503—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking using luminous text or symbol displays in or on the vehicle, e.g. static text
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/2611—Indicating devices mounted on the roof of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/30—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating rear of vehicle, e.g. by means of reflecting surfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/503—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking using luminous text or symbol displays in or on the vehicle, e.g. static text
- B60Q1/5035—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking using luminous text or symbol displays in or on the vehicle, e.g. static text electronic displays
- B60Q1/5037—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking using luminous text or symbol displays in or on the vehicle, e.g. static text electronic displays the display content changing automatically, e.g. depending on traffic situation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/545—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating other traffic conditions, e.g. fog, heavy traffic
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- G06K9/00302—
-
- G06K9/00845—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/162—Decentralised systems, e.g. inter-vehicle communication event-triggered
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/507—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking specific to autonomous vehicles
Definitions
- the present disclosure relates to computer application technologies, and particularly to a method, computer device and storage medium for communicating with a rear vehicle.
- the present disclosure provides a method, apparatus, computer device and storage medium for communicating with a rear vehicle.
- a method for communicating with a rear vehicle comprising:
- a present vehicle determining that it is currently in a congestion scenario and obtaining congestion condition information
- the present vehicle generating congestion prompt information for the rear vehicle according to the congestion condition information
- the present vehicle displaying the congestion prompt information on a screen at a tail of the present vehicle.
- the present vehicle determining that it is currently in a congestion scenario comprises:
- the present vehicle determines that the present vehicle is currently in the congestion scenario if the present vehicle determines that a duration of the following state exceeds a predetermined duration: the current traffic slowly advances at a speed below a predetermined threshold.
- the obtaining the congestion condition information comprises:
- the present vehicle obtaining the congestion condition information by interacting with an Internet-connected intelligent transportation system.
- the congestion prompt information at least includes: a cause of congestion
- the cause of congestion includes at least one of the following: an accident ahead, heavy traffic ahead, temporary road closures ahead, and congestion caused by weather.
- the method further comprises:
- the present vehicle determining whether the driver of the rear vehicle is in a road rage mood
- the present vehicle determining whether the driver of the rear vehicle is in a road rage mood comprises:
- the present vehicle obtaining facial expressions and/or behaviors of the driver of the rear vehicle through a camera at the tail of the present vehicle, and determining whether the driver of the rear vehicle is in the road rage mood by analyzing the facial expressions and/or behaviors.
- the method further comprises:
- the present vehicle upon determining that the driver of the rear vehicle is in the road rage mood, the present vehicle turning on a streamline type lamp strip on the roof of the present vehicle and/or an annular lamp strip at the tail of the present vehicle to sooth the mood of the driver of the rear vehicle in a flowing pattern of atmosphere lamps.
- An apparatus for communicating with a rear vehicle comprising: an information interaction unit and a first communicating unit;
- the information interaction unit is configured to obtain congestion condition information upon determining that the present vehicle is currently in a congestion scenario
- the first communication unit is configured to generate congestion prompt information for the rear vehicle according to the congestion condition information, and display the congestion prompt information on a screen at a tail of the present vehicle.
- the information interaction unit determines that the present vehicle is currently in the congestion scenario if the information interaction unit determines that a duration of the following state exceeds a predetermined duration: the current traffic slowly advances at a speed below a predetermined threshold.
- the information interaction unit obtains the congestion condition information by interacting with an Internet-connected intelligent transportation system.
- the congestion prompt information at least includes: a cause of congestion
- the cause of congestion includes at least one of the following: an accident ahead, heavy traffic ahead, temporary road closures ahead, and congestion caused by weather.
- the apparatus further comprises: a second communication unit;
- the second communication unit is configured to determine whether the driver of the rear vehicle is in a road rage mood, and if yes, generate mood-soothing information and display the mood-soothing information on the screen.
- the second communication unit obtains facial expressions and/or behaviors of the driver of the rear vehicle through a camera at the tail of the present vehicle, and determines whether the driver of the rear vehicle is in the road rage mood by analyzing the facial expressions and/or behaviors.
- the second communication unit is further configured to, upon determining that the driver of the rear vehicle is in the road rage mood, turn on a streamline type lamp strip on the roof of the present vehicle and/or an annular lamp strip at the tail of the present vehicle to sooth the mood of the driver of the rear vehicle in a flowing pattern of atmosphere lamps.
- a computer device comprising a memory, a processor and a computer program which is stored on the memory and runs on the processor, the processor, upon executing the program, implementing the above-mentioned method.
- a computer-readable storage medium on which a computer program is stored the program, when executed by the processor, implementing the aforesaid method.
- the present vehicle may obtain congestion condition information after determining that the present vehicle is currently in a congestion scenario, and generate congestion prompt information for the rear vehicle according to the congestion condition information, and display the congestion prompt information on a screen at a tail of the present vehicle, so that the rear vehicle can be enabled to learn about the congestion condition ahead in time without querying an APP on the mobile phone, such that the safety of vehicle travel is improved.
- FIG. 1 is a schematic view showing a position of a screen and a camera according to the present disclosure.
- FIG. 2 is a schematic view showing a position of a streamline type lamp strip on a roof of a vehicle according to the present disclosure.
- FIG. 3 is a schematic view showing a position of an annular lamp strip at the tail of the present vehicle according to the present disclosure.
- FIG. 4 is a flow chart of a method of communicating with a rear vehicle according to an embodiment of the present disclosure.
- FIG. 5 is a first schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- FIG. 6 is a second schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- FIG. 7 is a third schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- FIG. 8 is a fourth schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- FIG. 9 is a fifth schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- FIG. 10 is a sixth schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- FIG. 11 is a schematic view showing a flow pattern of a lamp strip of a present vehicle according to the present disclosure.
- FIG. 12 is a block diagram of an apparatus for communicating with a rear vehicle according to an embodiment of the present disclosure.
- FIG. 13 illustrates a block diagram of an example computer system/server 12 adapted to implement an implementation mode of the present disclosure.
- the present disclosure provides a solution of communicating with a rear vehicle, and changing a present vehicle in a congestion scenario into an information source of the rear vehicle, thereby enhancing the travel safety of the rear vehicle.
- the present vehicle is a vehicle having an autonomous driving function.
- the present vehicle in the solution of the present disclosure may be an autonomous vehicle capable of achieving L5 autonomous driving level, namely, capable of autonomously achieving all operations of travel on urban roads and capable of accurately recognizing elements such as ambient environment factors, vehicles on the road surface, electrically-motored vehicles, bicycles and pedestrians, and additionally capable of interacting with an Internet-connected intelligent transportation system.
- L5 autonomous driving level namely, capable of autonomously achieving all operations of travel on urban roads and capable of accurately recognizing elements such as ambient environment factors, vehicles on the road surface, electrically-motored vehicles, bicycles and pedestrians, and additionally capable of interacting with an Internet-connected intelligent transportation system.
- the present vehicle in the solution of the present disclosure may be provided with a screen located at a tail of the present vehicle, a camera located at the tail of the present vehicle, a streamline type lamp strip on a roof of the present vehicle and an annular lamp strip at the tail of the present vehicle.
- FIGS. 1-3 FIG. 1 is a schematic view showing a position of the screen and the camera according to the present disclosure
- FIG. 2 is a schematic view showing a position of a streamline type lamp strip on the roof of the present vehicle according to the present disclosure
- FIG. 3 is a schematic view showing a position of an annular lamp strip at the tail of the present vehicle according to the present disclosure.
- FIG. 4 is a flow chart of a method of communicating with a rear vehicle according to an embodiment of the present disclosure. As shown in FIG. 4 , the embodiment includes the following specific implementation mode.
- a present vehicle determines that it is currently in a congestion scenario and obtains congestion condition information.
- the present vehicle generates congestion prompt information for the rear vehicle according to the congestion condition information.
- the present vehicle displays the congestion prompt information on a screen at a tail of the present vehicle.
- the present vehicle When the present vehicle is driving on the road, it may determine whether it is currently in a congestion scenario in real time, and if it is in a congestion scenario, it may trigger a function of communicating with the rear vehicle.
- the present vehicle may determine that it is currently in the congestion scenario.
- the predetermined duration and the predetermined threshold may depend on actual needs.
- the predetermined duration may be 10 mins
- the predetermined threshold may be 10 km/h. That is to say, if the current traffic slowly advances at a speed lower than 10 km/h, and this state lasts for more than 10 mins, it may be determined that the present vehicle is currently in the congestion scenario.
- the present vehicle may obtain the congestion condition information. Specifically, the present vehicle may interact with the Internet-connected intelligent transportation system to obtain the congestion condition information.
- the present vehicle may generate congestion prompt information for the rear vehicle according to the obtained congestion condition information.
- the congestion prompt information may at least include: a cause of congestion.
- the cause of congestion may include, but is not limited to, an accident ahead, heavy traffic ahead, temporary road closures ahead, and congestion caused by weather.
- the congestion prompt information may further include some other information, such as a duration before the road becomes clear again. Specific content included is not limited here.
- the present vehicle may know that the congestion is caused by a traffic accident happening ahead, by interacting with the Internet-connected intelligent transportation system, and may know a distance of the traffic accident site from the present vehicle and happening time of the traffic accident by interacting with the Internet-connected intelligent transportation system, and furthermore may determine an average vehicle-removing time of a corresponding type of accidents by querying a pre-generated historical accident library, and thereby infer how long the road will become clear again.
- FIG. 5 is a first schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- the displayed content may be that a traffic accident happens ahead and the traffic is predicted to become clear again in 20 mins.
- various forms of display such as text, graphics or the like may be employed, and are not limited to those shown in the figures.
- the present vehicle may know that the congestion is caused by heavy traffic ahead by interacting with the Internet-connected intelligent transportation system, and know a traffic index of the road segment in the same time period in the past and then determine whether the traffic is currently in the normal daily situation by interacting with the Internet-connected intelligent transportation system, and if the traffic is abnormal, may further query the Internet-connected intelligent transportation system to find out whether there is special road closure information on the current day.
- FIG. 6 is a second schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure. As shown in FIG. 6 , the displayed content may be that the traffic is heavy during rush hour and the road segment is congested in 90% cases.
- FIG. 7 is a third schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure. As shown in FIG. 7 , the displayed content may be that heavy traffic is caused ahead because the highway to ** is closed today.
- the present vehicle may acquire weather information and weather changes which are happening in a range of 10 km around on the current day by interacting with the Internet-connected intelligent transportation system, and then perform synchronization of weather information and/or provide early warning of weather ahead through the screen.
- FIG. 8 is a fourth schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure. As shown in FIG. 8 , the displayed content may be heavy rain, congestion 1 km ahead, drive carefully.
- FIG. 9 is a fifth schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure. As shown in FIG. 9 , the displayed content may be that it is raining 5 km ahead in the direction to ** and continued congestion might be caused.
- the rear vehicle can be enabled to learn about the congestion condition ahead in time without querying an APP on the mobile phone, so that the safety of vehicle travel is improved.
- the present vehicle may detect the mood of the driver of the rear vehicle, namely, determine whether the driver of the rear vehicle is in a road rage mood. Once determining that the driver of the rear vehicle is in the road rage mood, the present vehicle may generate mood-soothing information and display the mood-soothing information on the screen.
- the present vehicle may obtain facial expressions and/or behaviors of the driver of the rear vehicle through the camera at the tail of the present vehicle, and determine whether the driver of the rear vehicle is in the road rage mood by analyzing the obtained facial expressions and/or behaviors.
- the driver of the rear vehicle is in the road rage mood if it is found after analysis that the facial expressions of the driver of the rear vehicle show negative moods such as agitation and anger and the driver of the rear vehicle exhibits behaviors such as constantly looking out of the window to see situations ahead, patting the steering wheel, and opening and closing mouth (e.g., swearing).
- negative moods such as agitation and anger
- the driver of the rear vehicle exhibits behaviors such as constantly looking out of the window to see situations ahead, patting the steering wheel, and opening and closing mouth (e.g., swearing).
- the present vehicle may generate mood-soothing information and display the mood-soothing information on the screen.
- the mood-soothing information and congestion prompt information may be displayed on the screen alternatingly.
- FIG. 10 is a sixth schematic view of information displayed on a screen at a tail of a present vehicle according to the present disclosure.
- the displayed content may be: bad weather, please take it easy, sing a song and relax.
- the content displayed in FIG. 10 and the content displayed in FIG. 8 are displayed on the screen alternatingly.
- FIG. 11 is a schematic view showing a flow pattern of a lamp strip of the present vehicle according to the present disclosure.
- the present vehicle can become information source of the rear vehicle in a congestion scenario, and recognize the road rage mood of the driver of the rear vehicle and sooth him in time, so that the present vehicle really becomes a smart terminal travelling on the road, and the present vehicle becomes a smart transportation carrier which is trusted more and provides better safety.
- FIG. 12 is a block diagram of an apparatus for communicating with a rear vehicle according to an embodiment of the present disclosure. As shown in FIG. 12 , the apparatus comprises: an information interaction unit 121 and a first communicating unit 122 .
- the apparatus of the present application is applied in the present vehicle.
- the information interaction unit 121 is configured to obtain congestion condition information upon determining that a present vehicle is currently in a congestion scenario.
- the first communication unit 122 is configured to generate congestion prompt information for the rear vehicle according to the congestion condition information, and display the congestion prompt information on a screen at a tail of the present vehicle.
- the information interaction unit 121 determines that a duration of the following state exceeds a predetermined duration: the current traffic slowly advances at a speed below a predetermined threshold, and then determines that the present vehicle is currently in the congestion scenario.
- the predetermined duration and the predetermined threshold may depend on actual needs.
- the predetermined duration may be 10 mins
- the predetermined threshold may be 10 km/h. That is to say, if the current traffic slowly advances at a speed lower than 10 km/h, and this state lasts for more than 10 mins, it may be determined that the present vehicle is currently in the congestion scenario.
- the information interaction unit 121 may obtain the congestion condition information. Specifically, the information interaction unit 121 may interact with the Internet-connected intelligent transportation system to obtain the congestion condition information.
- the first communication unit 122 may generate congestion prompt information for the rear vehicle according to the obtained congestion condition information.
- the congestion prompt information may at least include: a cause of congestion.
- the cause of congestion may include, but is not limited to, an accident ahead, heavy traffic ahead, temporary road closures ahead, and congestion caused by weather.
- the congestion prompt information may further include some other information, such as a duration before the road becomes clear again. Specific content included is not limited here.
- the rear vehicle can be enabled to learn about the congestion condition ahead without querying an APP on the mobile phone, so that the safety of vehicle travel is improved.
- the apparatus may further comprise: a second communication unit 123 configured to determine whether the driver of the rear vehicle is in a road rage mood when in the congestion scenario, and if yes, generate mood-soothing information and display the mood-soothing information on the screen. That is to say, the second communication unit 123 may detect the mood of the driver of the rear vehicle, namely, determine whether the driver of the rear vehicle is in a road rage mood. Once determining that the driver of the rear vehicle is in the road rage mood, the second communication unit 123 may generate mood-soothing information and display the mood-soothing information on the screen.
- the second communication unit 123 may obtain facial expressions and/or behaviors of the driver of the rear vehicle through a camera at the tail of the present vehicle, and thereby determine whether the driver of the rear vehicle is in the road rage mood by analyzing the obtained facial expressions and/or behaviors.
- the driver of the rear vehicle is in the road rage mood if it is found after analysis that the facial expressions of the driver of the rear vehicle show negative moods such as agitation and anger and the driver of the rear vehicle exhibits behaviors such as constantly looking out of the window to see situations ahead, patting the steering wheel, and opening and closing mouth (e.g., swearing).
- negative moods such as agitation and anger
- the driver of the rear vehicle exhibits behaviors such as constantly looking out of the window to see situations ahead, patting the steering wheel, and opening and closing mouth (e.g., swearing).
- the second communication unit 123 may generate mood-soothing information and display the mood-soothing information on the screen.
- the mood-soothing information and congestion prompt information generated by the first communication unit 122 may be displayed on the screen alternatingly.
- the second communication unit 123 may further turn on the streamline type lamp strip on the roof of the present vehicle and/or the annular lamp strip at the tail of the present vehicle to sooth the mood of the driver of the rear vehicle in a flowing manner of atmosphere lamps.
- the present vehicle can become information source of the rear vehicle in a congestion scenario, and recognize the road rage mood of the driver of the rear vehicle and sooth him in time, so that the present vehicle really becomes a smart terminal travelling on the road, and the present vehicle becomes a smart transportation carrier which is trusted more and provides better safety.
- FIG. 13 illustrates a block diagram of an example computer system/server 12 adapted to implement an implementation mode of the present disclosure.
- the computer system/server 12 shown in FIG. 13 is only an example and should not bring about any limitation to the function and scope of use of the embodiments of the present disclosure.
- the computer system/server 12 is shown in the form of a general-purpose computing device.
- the components of computer system/server 12 may include, but are not limited to, one or more processors (processing units) 16 , a memory 28 , and a bus 18 that couples various system components including system memory 28 and the processor 16 .
- Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures.
- bus architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
- Computer system/server 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer system/server 12 , and it includes both volatile and non-volatile media, removable and non-removable media.
- Memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32 .
- Computer system/server 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media.
- storage system 34 may be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown in FIG. 13 and typically called a “hard drive”).
- a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a “floppy disk”), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a CD-ROM, DVD-ROM or other optical media
- each drive may be connected to bus 18 by one or more data media interfaces.
- the memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the present disclosure.
- Program/utility 40 having a set (at least one) of program modules 42 , may be stored in the system memory 28 by way of example, and not limitation, as well as an operating system, one or more disclosure programs, other program modules, and program data. Each of these examples or a certain combination thereof might include an implementation of a networking environment.
- Program modules 42 generally carry out the functions and/or methodologies of embodiments of the present disclosure.
- Computer system/server 12 may also communicate with one or more external devices 14 such as a keyboard, a pointing device, a display 24 , etc.; with one or more devices that enable a user to interact with computer system/server 12 ; and/or with any devices (e.g., network card, modem, etc.) that enable computer system/server 12 to communicate with one or more other computing devices. Such communication may occur via Input/Output (I/O) interfaces 22 . Still yet, computer system/server 12 may communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and/or a public network (e.g., the Internet) via network adapter 20 . As depicted in FIG.
- LAN local area network
- WAN wide area network
- public network e.g., the Internet
- network adapter 20 communicates with the other communication modules of computer system/server 12 via bus 18 .
- bus 18 It should be understood that although not shown, other hardware and/or software modules could be used in conjunction with computer system/server 12 . Examples, include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.
- the processor 16 executes various function applications and data processing by running programs stored in the memory 28 , for example, implement the method in the embodiment shown in FIG. 4 .
- the present disclosure meanwhile provides a computer-readable storage medium on which a computer program is stored, the program, when executed by the processor, implementing the method stated in the embodiment shown in FIG. 4 .
- the computer-readable medium of the present embodiment may employ any combinations of one or more computer-readable media.
- the machine readable medium may be a machine readable signal medium or a machine readable storage medium.
- a machine readable medium may include, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.
- the machine readable storage medium may be any tangible medium that include or store programs for use by an instruction execution system, apparatus or device or a combination thereof.
- the computer-readable signal medium may be included in a baseband or serve as a data signal propagated by part of a carrier, and it carries a computer-readable program code therein. Such propagated data signal may take many forms, including, but not limited to, electromagnetic signal, optical signal or any suitable combinations thereof.
- the computer-readable signal medium may further be any computer-readable medium besides the computer-readable storage medium, and the computer-readable medium may send, propagate or transmit a program for use by an instruction execution system, apparatus or device or a combination thereof.
- the program codes included by the computer-readable medium may be transmitted with any suitable medium, including, but not limited to radio, electric wire, optical cable, RF or the like, or any suitable combination thereof.
- Computer program code for carrying out operations disclosed herein may be written in one or more programming languages or any combination thereof. These programming languages include an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- LAN local area network
- WAN wide area network
- Internet Service Provider for example, AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
- the revealed apparatus and method may be implemented in other ways.
- the above-described embodiments for the apparatus are only exemplary, e.g., the division of the units is merely logical one, and, in reality, they may be divided in other ways upon implementation.
- the units described as separate parts may be or may not be physically separated, the parts shown as units may be or may not be physical units, i.e., they may be located in one place, or distributed in a plurality of network units. One may select some or all the units to achieve the purpose of the embodiment according to the actual needs.
- functional units may be integrated in one processing unit, or they may be separate physical presences; or two or more units may be integrated in one unit.
- the integrated unit described above may be implemented in the form of hardware, or they may be implemented with hardware plus software functional units.
- the aforementioned integrated unit in the form of software function units may be stored in a computer readable storage medium.
- the aforementioned software function units are stored in a storage medium, including several instructions to instruct a computer device (a personal computer, server, or network equipment, etc.) or processor to perform some steps of the method described in the various embodiments of the present disclosure.
- the aforementioned storage medium includes various media that may store program codes, such as U disk, removable hard disk, Read-Only Memory (ROM), a Random Access Memory (RAM), magnetic disk, or an optical disk.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Claims (7)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811184764.5A CN109532653B (en) | 2018-10-11 | 2018-10-11 | Method, device, computer equipment and storage medium for communicating with rear vehicle |
CN2018111847645 | 2018-10-11 | ||
CN201811184764 | 2018-10-11 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200114814A1 US20200114814A1 (en) | 2020-04-16 |
US10889240B2 true US10889240B2 (en) | 2021-01-12 |
Family
ID=65843837
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/598,525 Active US10889240B2 (en) | 2018-10-11 | 2019-10-10 | Method, computer device and storage medium for communicating with a rear vehicle |
Country Status (3)
Country | Link |
---|---|
US (1) | US10889240B2 (en) |
EP (1) | EP3636493B1 (en) |
CN (1) | CN109532653B (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110155065B (en) * | 2019-05-23 | 2020-12-01 | 浙江吉利控股集团有限公司 | Energy consumption control method and system based on vehicle-road cooperation and automobile |
CN111681432B (en) * | 2020-04-30 | 2022-03-29 | 大连理工大学 | Method and device for determining congestion source of intersection containing signal lamp |
CN111605556B (en) * | 2020-06-05 | 2022-06-07 | 吉林大学 | Road rage prevention recognition and control system |
CN111806340B (en) * | 2020-07-10 | 2024-03-15 | 华人运通(上海)云计算科技有限公司 | Intelligent interaction control system and method for vehicle, vehicle and storage medium |
CN112550309B (en) * | 2020-12-21 | 2022-05-10 | 阿波罗智联(北京)科技有限公司 | Autonomous vehicle, information display method, information display apparatus, device, and storage medium |
CN115278588A (en) * | 2021-04-30 | 2022-11-01 | 上海博泰悦臻网络技术服务有限公司 | Information processing method and related device |
CN113709703B (en) * | 2021-07-28 | 2024-08-13 | 东风柳州汽车有限公司 | Vehicle-to-vehicle communication data simplifying method, device, equipment and storage medium |
US20230099464A1 (en) * | 2021-09-29 | 2023-03-30 | Loc Van Nguyen | Systems and methods for transmitting inter-vehicle communications to facilitate traffic flow |
CN114379585A (en) * | 2021-12-24 | 2022-04-22 | 阿波罗智联(北京)科技有限公司 | Method, apparatus, device and storage medium for displaying vehicle information |
CN114619953A (en) * | 2022-03-16 | 2022-06-14 | 中国第一汽车股份有限公司 | Dynamic display system and method for large vehicle |
CN115158154A (en) * | 2022-07-25 | 2022-10-11 | 重庆长安汽车股份有限公司 | Vehicle tail LED screen interaction system, method, vehicle and storage medium |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6300870B1 (en) | 1999-10-04 | 2001-10-09 | Warren F. Nelson | Automotive digital rear window display unit |
DE202009016272U1 (en) | 2009-10-01 | 2010-06-24 | Kistner, Peter | Traffic jam and information devices |
CN104021673A (en) | 2014-06-17 | 2014-09-03 | 北京易华录信息技术股份有限公司 | System and method for rapidly finding congestion causing reasons by utilizing radar tracking technology |
US20160089954A1 (en) | 2014-09-30 | 2016-03-31 | Continental Automotive Systems Inc. | System and method for setting an environmental condition in or around a vehicle in response to a determined mood |
CN105667387A (en) | 2016-01-13 | 2016-06-15 | 京东方科技集团股份有限公司 | Vehicle-mounted communication device and method and vehicle |
CN105946701A (en) | 2016-04-20 | 2016-09-21 | 钱晓松 | Information interaction system with display screens installed on front part and tail part of automobile body |
EP3093192A1 (en) | 2015-05-11 | 2016-11-16 | Lg Electronics Inc. | Rear combination lamp for vehicle comprising a display |
CN106627351A (en) | 2015-11-04 | 2017-05-10 | 上海通铭信息科技股份有限公司 | Information display system used for automobile tail and automobile |
CN106803423A (en) | 2016-12-27 | 2017-06-06 | 智车优行科技(北京)有限公司 | Man-machine interaction sound control method, device and vehicle based on user emotion state |
US20170190286A1 (en) | 2016-01-03 | 2017-07-06 | Edward Yavitz | GPS Vehicle Speed and Velocity Change Indicator |
KR20170098666A (en) | 2016-02-22 | 2017-08-30 | 김정주 | Vehicle rear screen guiding device |
US20180174457A1 (en) | 2016-12-16 | 2018-06-21 | Wheego Electric Cars, Inc. | Method and system using machine learning to determine an automotive driver's emotional state |
US20180173237A1 (en) * | 2016-12-19 | 2018-06-21 | drive.ai Inc. | Methods for communicating state, intent, and context of an autonomous vehicle |
US20190389487A1 (en) * | 2018-06-22 | 2019-12-26 | Byton North America Corporation | Tailgating alert system in vehicles |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN206287926U (en) * | 2016-12-27 | 2017-06-30 | 广州市联奥信息科技有限公司 | Possesses the interactive crane device of emotion expression service ability |
CN107054208A (en) * | 2017-04-28 | 2017-08-18 | 深圳市车之友电子科技有限公司 | The method that vehicle mounted multimedia laser display apparatus is controlled using intelligent terminal |
CN107798860B (en) * | 2017-11-29 | 2019-05-14 | 爱驰汽车(上海)有限公司 | Vehicle-mounted real-time imaging share system, method, equipment and storage medium |
CN108099768B (en) * | 2017-12-06 | 2020-08-28 | 天长市天新电子实业有限公司 | LED intelligent regulation and control method with multi-information analysis function |
-
2018
- 2018-10-11 CN CN201811184764.5A patent/CN109532653B/en active Active
-
2019
- 2019-10-10 US US16/598,525 patent/US10889240B2/en active Active
- 2019-10-10 EP EP19202565.8A patent/EP3636493B1/en active Active
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6300870B1 (en) | 1999-10-04 | 2001-10-09 | Warren F. Nelson | Automotive digital rear window display unit |
DE202009016272U1 (en) | 2009-10-01 | 2010-06-24 | Kistner, Peter | Traffic jam and information devices |
CN104021673A (en) | 2014-06-17 | 2014-09-03 | 北京易华录信息技术股份有限公司 | System and method for rapidly finding congestion causing reasons by utilizing radar tracking technology |
US20160089954A1 (en) | 2014-09-30 | 2016-03-31 | Continental Automotive Systems Inc. | System and method for setting an environmental condition in or around a vehicle in response to a determined mood |
EP3093192A1 (en) | 2015-05-11 | 2016-11-16 | Lg Electronics Inc. | Rear combination lamp for vehicle comprising a display |
CN106627351A (en) | 2015-11-04 | 2017-05-10 | 上海通铭信息科技股份有限公司 | Information display system used for automobile tail and automobile |
US20170190286A1 (en) | 2016-01-03 | 2017-07-06 | Edward Yavitz | GPS Vehicle Speed and Velocity Change Indicator |
CN105667387A (en) | 2016-01-13 | 2016-06-15 | 京东方科技集团股份有限公司 | Vehicle-mounted communication device and method and vehicle |
US20170197544A1 (en) | 2016-01-13 | 2017-07-13 | Boe Technology Group Co., Ltd. | Vehicle Communication Device, Vehicle Communication Method, and Vehicle |
KR20170098666A (en) | 2016-02-22 | 2017-08-30 | 김정주 | Vehicle rear screen guiding device |
CN105946701A (en) | 2016-04-20 | 2016-09-21 | 钱晓松 | Information interaction system with display screens installed on front part and tail part of automobile body |
US20180174457A1 (en) | 2016-12-16 | 2018-06-21 | Wheego Electric Cars, Inc. | Method and system using machine learning to determine an automotive driver's emotional state |
US20180173237A1 (en) * | 2016-12-19 | 2018-06-21 | drive.ai Inc. | Methods for communicating state, intent, and context of an autonomous vehicle |
CN106803423A (en) | 2016-12-27 | 2017-06-06 | 智车优行科技(北京)有限公司 | Man-machine interaction sound control method, device and vehicle based on user emotion state |
US20190389487A1 (en) * | 2018-06-22 | 2019-12-26 | Byton North America Corporation | Tailgating alert system in vehicles |
Non-Patent Citations (4)
Title |
---|
Chinese Search Report for Application No. CN 201811184764.5, dated Jul. 19, 2019, 3 Pages. |
Communication under Rules 70(2) and 70a(2) EPC and reference to Rule 39(1) EPC from corresponding European Application No. 19202565.8 dated Apr. 20, 2020. |
Extended European Search Report from corresponding European Application No. 192025665.8 dated Feb. 27, 2020. |
First Office Action for Chinese Application No. 201811184764.5, dated Jul. 29, 2019, 8 Pages. |
Also Published As
Publication number | Publication date |
---|---|
CN109532653A (en) | 2019-03-29 |
EP3636493B1 (en) | 2023-04-12 |
EP3636493A1 (en) | 2020-04-15 |
CN109532653B (en) | 2020-01-21 |
US20200114814A1 (en) | 2020-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10889240B2 (en) | Method, computer device and storage medium for communicating with a rear vehicle | |
US11173927B2 (en) | Method, apparatus, computer device and storage medium for autonomous driving determination | |
US20190009789A1 (en) | Autonomous vehicle site test method and apparatus, device and readable medium | |
US11548516B2 (en) | Data acquisition method, apparatus, device and computer-readable storage medium | |
US11034361B2 (en) | Route determination for switching between autonomous and manual driving modes | |
US11377025B2 (en) | Blocked information displaying method and system for use in autonomous vehicle | |
US11453407B2 (en) | Method and apparatus of monitoring sensor of driverless vehicle, device and storage medium | |
CN110525451B (en) | Driving safety assisting method and device, vehicle and readable storage medium | |
CN111739344B (en) | Early warning method and device and electronic equipment | |
CN109391668B (en) | Traffic information pushing method and device, server and storage medium | |
CN110304066B (en) | Route selection method, system, device and storage medium in automatic driving mode | |
US20140324329A1 (en) | Safe distance determination | |
US20220219729A1 (en) | Autonomous driving prediction method based on big data and computer device | |
CN112793581B (en) | Steering wheel hands-off detection method and system, computer equipment and storage medium | |
US20180208203A1 (en) | System, method and computer program product for braking control when approaching a traffic signal | |
JP2022526735A (en) | Systems and methods for evaluating vehicle technology | |
WO2023025007A1 (en) | Vehicle avoidance method and apparatus, vehicle-mounted device, and storage medium | |
CN110175218B (en) | Method, device and equipment for generating navigation broadcast content and computer storage medium | |
KR20240097879A (en) | Method, device, and vehicle for detecting body parts of vehicle occupants taken out of window | |
CN115009292A (en) | Risk prompting method and device for automatic driving vehicle and automatic driving vehicle | |
CN111341131A (en) | Road information sending method, device, equipment and storage medium | |
CN114379587A (en) | Method and device for avoiding pedestrian in automatic driving | |
CN117195065A (en) | Driving assistance method, driving assistance device, vehicle, electronic device and storage medium | |
CN114619949A (en) | Expressway lane change prompting method and device, vehicle, electronic equipment and medium | |
CN109885392B (en) | Method and device for allocating vehicle-mounted computing resources |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WANG, YA;NING, WEIYI;REEL/FRAME:050682/0598 Effective date: 20191009 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECHNOLOGY CO., LTD., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.;REEL/FRAME:057779/0075 Effective date: 20210923 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |