EP4361986A1 - Rear seat passenger notification device and a method therefor - Google Patents
Rear seat passenger notification device and a method therefor Download PDFInfo
- Publication number
- EP4361986A1 EP4361986A1 EP23173103.5A EP23173103A EP4361986A1 EP 4361986 A1 EP4361986 A1 EP 4361986A1 EP 23173103 A EP23173103 A EP 23173103A EP 4361986 A1 EP4361986 A1 EP 4361986A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- host vehicle
- information
- control
- user
- passenger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/22—Status alarms responsive to presence or absence of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
- B60H1/00742—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/52—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating emergencies
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
- B60Q1/543—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating other states or conditions of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q5/00—Arrangement or adaptation of acoustic signal devices
- B60Q5/005—Arrangement or adaptation of acoustic signal devices automatically actuated
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/24—Means to switch the anti-theft system on or off using electronic identifiers containing a code not memorised by the user
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/305—Detection related to theft or to other events relevant to anti-theft systems using a camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- E—FIXED CONSTRUCTIONS
- E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
- E05F—DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
- E05F15/00—Power-operated mechanisms for wings
- E05F15/70—Power-operated mechanisms for wings with automatic actuation
- E05F15/73—Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/593—Recognising seat occupancy
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0881—Seat occupation; Driver or passenger presence
-
- E—FIXED CONSTRUCTIONS
- E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
- E05F—DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
- E05F15/00—Power-operated mechanisms for wings
- E05F15/70—Power-operated mechanisms for wings with automatic actuation
- E05F15/73—Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects
- E05F2015/767—Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects using cameras
Definitions
- the present disclosure relates to a rear seat passenger notification device and a method therefor.
- An aspect of the present disclosure provides a rear seat passenger notification device for identifying information about an interior and/or exterior environment of a host vehicle using a sensor device and adaptively identifying an action item for safety of a passenger based on the identified result, and a method therefor.
- Another aspect of the present disclosure provides a rear seat passenger notification device for visually and/or audibly providing an alarm function for a remaining situation of a passenger using an alarm device and further considering a separation distance between the host vehicle and the user to provide an alarm function in various manners, and a method therefor.
- Another aspect of the present disclosure provides a rear seat passenger notification device for collecting at least one of information about the host vehicle, information of the user of the host vehicle, or a combination thereof in a complex manner using an information collection device and suitably identifying and providing an action item using the collected information, and a method therefor.
- a rear seat passenger notification device may include a sensor device configured to identify information about at least one passenger who is present in a host vehicle when the host vehicle enters a locked state.
- the information includes at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof.
- the rear seat passenger notification device may also include an alarm device configured to perform a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition, and an information collection device configured to collect information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition.
- the rear seat passenger notification device may further include an action determination and control device configured to identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, and the action determination and control device provide the user with the at least one action item.
- an action determination and control device configured to identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, and the action determination and control device provide the user with the at least one action item.
- the alarm device may be configured to perform the visual and audible alarm function when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child.
- the information collection device may be configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child.
- the alarm device may be configured to gradually strengthen and repeatedly perform the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
- the information collection device may be configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child.
- the action determination and control device may be configured to transmit a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
- the at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- the action determination and control device may be configured to execute one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature.
- the action determination and control device may also be configured to execute one of the control of air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
- the action determination and control device may be configured to transmit a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle, when presence of the external user is identified by means of adjacent information of the host vehicle.
- the adjacent information is included in the information of the host vehicle.
- the sensor device may divide the interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and identifies information of the at least one passenger with respect to each of the plurality of areas.
- the action determination and control device may identify the location where the at least one passenger is seated among the plurality of areas and may provide the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- the sensor device may be configured to identify that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera.
- the action determination and control device may be configured to continue setting all doors of the host vehicle to the lock state and transmits information about the external user to a terminal of the user.
- the sensor device may include at least one camera that captures an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle and at least one rear occupant alert (ROA) sensor that divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- ROI rear occupant alert
- a rear seat passenger notification method may include identifying, by a sensor device, information about at least one passenger who exists in the host vehicle, the information including at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof, when the host vehicle enters a lock state.
- the rear seat passenger notification method may also include performing, by an alarm device, a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition, and collecting, by an information collection device, information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition.
- the rear seat passenger notification method may further include identifying, by an action determination and control device, at least one action item for control of the host vehicle based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof.
- the rear seat passenger notification method may further include providing, by the action determination and control device, the user with the at least one action item.
- performing the visual and audible alarm function by the alarm device may include performing the visual and audible alarm function when it is identified that the at least one passenger includes a child based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met.
- collecting the information by the information collection device may include collecting a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child.
- performing the visual and audible alarm function by the alarm device may include gradually strengthening and repeatedly performing, by the alarm device, the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
- collecting the information by the information collection device may include collecting a separation distance between the user and the host vehicle when it is identified that the at least one passenger includes a child based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met.
- providing the at least one action item to the user by the action determination and control device may include transmitting, by the action determination and control device, a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
- the at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- providing the at least one action item to the user by the action determination and control device may include executing, by the action determination and control device, one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature.
- Providing the at least one action item to the user by the action determination and control device may also include executing, by the action determination and control device, one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
- providing the at least one action item to the user by the action determination and control device may include transmitting, by the action determination and control device, a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle, when presence of the external user is identified by means of adjacent information of the host vehicle.
- the adjacent information is included in the information of the host vehicle.
- identifying the information about the at least one passenger by the sensor device may include dividing, by the sensor device, the interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and identifying, by the sensor device, information of the at least one passenger with respect to each of the plurality of areas.
- providing the at least one action item to the user by the action determination and control device may include identifying, by the action determination and control device, the location where the at least one passenger is seated among the plurality of areas, and providing, by the action determination and control device, the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- identifying the information about the at least one passenger by the sensor device may include identifying, by the sensor device, that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera.
- providing the at least one action item to the user by the action determination and control device may include continuing, by the action determination and control device, setting all doors of the host vehicle to the lock state, and transmitting, by the action determination and control device, information about the external user to a terminal of the user.
- the sensor device may include at least one camera that captures an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle and at least one rear occupant alert (ROA) sensor that divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- ROI rear occupant alert
- FIGS. 1 to 9 embodiments of the present disclosure are described in detail with reference to FIGS. 1 to 9 .
- FIG. 1 is a block diagram illustrating components of a rear seat passenger notification device according to an embodiment of the present disclosure.
- a rear seat passenger notification device 100 may be implemented in a vehicle.
- the rear seat passenger notification device 100 may be integrally configured with control units in the vehicle or may be implemented as a separate device to be connected with the control units of the vehicle by a separate connection means.
- the rear seat passenger notification device 100 may include a sensor device 110, an alarm device 120, an information collection device 130, and an action determination and control device 140.
- the components of the rear seat passenger notification device 100, which are shown in FIG. 1 are illustrative, and embodiments of the present disclosure are not limited thereto.
- the rear seat passenger notification device 100 may further include components not shown in FIG. 1 .
- the sensor device 110 may include a plurality of sensors which obtain various pieces of information about the interior and/or exterior of a host vehicle.
- the sensor device 110 may obtain various pieces of interior information of the host vehicle. For example, when the host vehicle enters a lock state, the sensor device 110 may identify information about at least one passenger who is present in the host vehicle. The information about the at least on passenger who is present in the host vehicle may include at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof.
- the sensor device 110 may separately identify each of a plurality of areas logically divided in the interior of the host vehicle.
- the sensor device 110 may include at least one rear occupant alert (ROA) sensor that divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- the sensor device 110 may divide the interior of the host vehicle into the plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device 110 and may identify information about the at least one passenger with respect to each of the plurality of areas.
- ROI rear occupant alert
- the sensor device 110 may include at least one camera that obtains exterior information of the host vehicle.
- the at least one camera may capture an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle to obtain exterior information about the host vehicle.
- the sensor device 110 may identify that an external user adjacent to the host vehicle approaches the host vehicle using the at least one camera.
- the alarm device 120 may perform various types of alarm functions.
- the alarm device 120 may perform a visual alarm function using headlights of the host vehicle.
- the alarm device 120 may perform an audible alarm function using a speaker of the host vehicle.
- the alarm device 120 may perform a visual and audible alarm function.
- the specified condition may include at least one of a detection area, a detection intensity, a detection height, or a combination thereof.
- the visual and audible alarm function may be defined as an alarm function including at least one of a visual alarm function, an audible alarm function, or a combination thereof.
- the alarm device 120 may perform the visual and audible alarm function when it is identified that the at least one passenger includes a child based on whether at least one of the detection area, the detection intensity, the detection height, or the combination thereof included in the specified condition is met.
- child may include an infant, a toddler, or a kid who is a little older (e.g., age between 5 and 66 months).
- the alarm device 120 may gradually strengthen and repeatedly perform the visual and audible alarm function.
- the rear seat passenger notification device 100 may identify the separation distance between the user and the host vehicle based on wireless communication with a terminal of the user.
- the specified distance may be a predetermined distance or a setting value changeable by control of the user. For example, when the separation distance is less than 10 m, the rear seat passenger notification device 100 may gradually strengthen and repeatedly perform the visual and audible alarm function using the alarm device 120.
- the above-mentioned separation distance is a numerical example, and embodiments of the present disclosure are not limited thereto.
- the information collection device 130 may collect various pieces of information about the host vehicle and/or the user.
- the information collection device 130 may collect information about the host vehicle and/or information about the user of the host vehicle.
- the information collection device 130 may collect the separation distance between the user and the host vehicle. As an example, the information collection device 130 may collect the separation distance between the host vehicle and the user based on wireless communication with the user. As another embodiment, the information collection device 130 may collect location information of the user based on wireless communication with the user. As yet another embodiment, the information collection device 130 may collect interior temperature information of the host vehicle using at least one sensor included in the sensor device 110. As still another embodiment, the information collection device 130 may collect location information of the host vehicle using a global positioning system (GPS).
- GPS global positioning system
- the action determination and control device 140 may identify and provide an action item to the user.
- the action determination and control device 140 may identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or the combination thereof, at least one action item for control of the host vehicle, and may provide the user with the at least one action item.
- the at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- the action determination and control device 140 may transmit a user interface including at least one action item for control of the host vehicle to the terminal of the user.
- the user interface may include, for example, application screen information to execute at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, digital key transmission, or a combination thereof.
- the action determination and control device 140 may provide the user with a function for adjusting the interior temperature.
- the action determination and control device 140 may execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof, and may provide the user with a control function, such that the interior temperature decreases.
- the action determination and control device 140 may execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof and may provide the user with the control function, such that the interior temperature increases.
- the action determination and control device 140 may transmit a digital key of the host vehicle to the terminal of the external user.
- the identified external user may be an outsider who may provide cooperation for at least one passenger left in the host vehicle.
- the action determination and control device 140 may transmit the digital key of the host vehicle to the terminal of the external user and may hand over control authority of the host vehicle to the external user.
- the action determination and control device 140 may identify a location where the at least one passenger is seated among the plurality of areas in the interior of the host vehicle and may provide the user with at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- the action determination and control device 140 may preemptively continue setting all doors of the host vehicle to a lock state and may transmit information about the external user to the terminal of the user
- the external user identified as approaching the host vehicle may be, for example, a trespasser on the host vehicle.
- the action determination and control device 140 may identify the external user as the trespasser, may strengthen security of the host vehicle (e.g., set all the doors to the lock state), and may transmit information about the external user to the terminal of the user of the host vehicle.
- FIG. 2 is a conceptual diagram of an operation of a rear seat passenger notification device according to an embodiment of the present disclosure.
- a rear seat passenger notification device may include a sensor device 210 (e.g., the sensor device 110 of FIG. 1 ), an information collection device 220 (e.g., the information collection device 130 of FIG. 1 ), and an action determination and control device 230 (e.g., the action determination and control device 140 of FIG. 1 ).
- the action determination and control device 230 may control the sensor device 210 and the information collection device 220.
- the action determination and control device 230 may obtain various pieces of information about the interior of the host vehicle using the sensor device 210.
- the sensor device 210 may identify at least one passenger who is present in the interior of the host vehicle based on control of the action determination and control device 230.
- the sensor device 210 may include, for example, at least one sensor (e.g., an ROA sensor) included in the interior of the host vehicle.
- the sensor device 210 may identify whether at least one passenger is an adult or a child using the ROA sensor. As an example, the sensor device 210 may identify whether the at least one passenger is the adult or the child using at least one of an area where the detected passenger is detected, intensity (e.g., a signal to noise ratio (SNR)) where the detected passenger is detected, a height where the detected passenger is detected, a location where breathing of the detected passenger occurs, or a combination thereof.
- intensity e.g., a signal to noise ratio (SNR)
- the sensor device 210 may identify at least one passenger for each of a plurality of areas logically divided in the interior of the host vehicle.
- the action determination and control device 230 may obtain various pieces of information about the host vehicle, a user, and/or an outsider using the information collection device 220.
- the information collection device 220 may include a user location information collection device 222.
- the user location information collection device 222 may collect a location of the user based on wireless communication with a user terminal.
- the information collection device 220 may include an outsider detection device 224.
- the outsider detection device 224 may identify an outsider adjacent to the host vehicle using at least one of a biometric sensor, a motion sensor, an acceleration sensor, or a combination thereof. In an embodiment, the outsider detection device 224 may separately identify an outsider adjacent to the host vehicle and/or an outsider who gradually approaches the host vehicle.
- the information collection device 220 may collect an interior temperature of the host vehicle using a temperature information collection device 226.
- the temperature information collection device 226 may identify the interior temperature of the host vehicle.
- the temperature information collection device 226 may identify whether the interior temperature of the host vehicle is greater than or equal to a specified value or is less than the specified value.
- the temperature information collection device 226 may deliver a signal that it is required to decrease the interior temperature to the action determination and control device 230.
- the temperature information collection device 226 may deliver a signal that it is required to increase the interior temperature to the action determination and control device 230.
- the action determination and control device 230 may identify at least one of action items 250 based on the various pieces of information obtained by means of the sensor device 210 and/or the information collection device 220.
- the action items 250 may include air conditioning control 251, window control 253, door control 255, terminal communication 257, and/or digital key transmission 259.
- the air conditioning control 251 may include a control function of at least one air conditioning device (e.g., at least one of an air conditioner, a heater, an inner air circulation device, a dehumidifier, or a combination thereof) in the interior of the host vehicle.
- at least one air conditioning device e.g., at least one of an air conditioner, a heater, an inner air circulation device, a dehumidifier, or a combination thereof
- the window control 253 may include an opening and closing control function of at least one window of the host vehicle.
- the user may control an opening and closing state of the window by means of the window control 253.
- the user may completely close or open a window of the host vehicle by means of the window control 253 or may open the window of the host vehicle by a specified degree (e.g., 30%) by means of the window control 253.
- the door control 255 may include an opening and closing control function of at least one door of the host vehicle.
- the user may selectively set at least one door of the host vehicle to a lock state by means of the door control 255.
- the terminal communication 257 may include various data transmission and reception functions through communication with an external device (e.g., a terminal).
- the user may transmit and receive pieces of data associated with the action items 250 of the host vehicle to a terminal of the user and/or a terminal of the external user by means of the terminal communication 257.
- the digital key transmission 259 may include a function of transmitting a digital key including control authority of the host vehicle to the external device (e.g., the terminal).
- the external device e.g., the terminal.
- the user may transmit a digital key to a terminal of the external user who is adjacent to the host vehicle and is capable of cooperating with a passenger of the host vehicle.
- FIG. 3 is a flowchart depicting operation of a rear seat passenger notification device according to an embodiment of the present disclosure.
- a rear seat passenger notification device may perform operations depicted in FIG. 3 .
- components e.g., the sensor device 110, the alarm device 120, the information collection device 130, and the action determination and control device 140 included in the rear seat passenger notification device may be configured to perform the operations of FIG. 3 .
- Operations S310 to S360 in an embodiment below may be sequentially performed, but are not necessarily sequentially performed. For example, an order of the respective operations may be changed, and at least two operations may be performed in parallel. Furthermore, contents, which correspond to or are duplicated with the contents described above in conjunction with FIG. 3 , may be briefly described or omitted.
- the rear seat passenger notification device may identify whether doors are locked.
- the rear seat passenger notification device may identify whether doors of a host vehicle correspond to a lock state.
- the rear seat passenger notification device may identify whether there is at least one passenger in the interior of the host vehicle.
- the rear seat passenger notification device may identify whether there is at least one passenger in the interior (e.g., rear seat) of the host vehicle.
- the rear seat passenger notification device may identify whether there is at least one passenger in one of a plurality of areas logically divided in the interior of the host vehicle, using a sensor device.
- the rear seat passenger notification device may perform operation S330.
- the rear seat passenger notification device may end the operation.
- the rear seat passenger notification device may identify a location of the passenger.
- the rear seat passenger notification device may identify a location (e.g., the driver's seat, a passenger seat, or a rear seat corresponding to the driver's seat or the passenger seat) using a plurality of sensors included in the interior of the host vehicle.
- the rear seat passenger notification device may identify whether there is a child among the at least one passenger in the host vehicle.
- the rear seat passenger notification device may identify whether there are adults or children using at least one of an area where at least one passenger is detected, intensity where the at least one passenger is detected, a height where the at least one passenger is detected, or a combination thereof.
- the rear seat passenger notification device may perform operation S350.
- the rear seat passenger notification device may end the operation.
- the rear seat passenger notification device may operate an alarm function.
- the rear seat passenger notification device may perform a visual alarm function using headlights of the host vehicle or may perform an audible alarm function using a speaker of the host vehicle.
- the rear seat passenger notification device may perform the visual and audible alarm function.
- the specified condition may include at least one of a detection area, a detection intensity, a detection height, or a combination thereof.
- the visual and audible alarm function may be defined as an alarm function including at least one of a visual alarm function, an audible alarm function, or a combination thereof.
- the rear seat passenger notification device may perform the visual and audible alarm function.
- the rear seat passenger notification device may determine an action item.
- the rear seat passenger notification device may identify at least one action item for control of the host vehicle.
- the at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- the rear seat passenger notification device may identify at least one action item and may provide the user with the at least one action item.
- FIG. 4 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to another embodiment of the present disclosure.
- a rear seat passenger notification device may perform operations depicted in FIG. 4 .
- components e.g., the sensor device 110, the alarm device 120, the information collection device 130, and the action determination and control device 140 of FIG. 1
- the rear seat passenger notification device may perform the operations of FIG. 4 .
- Operations S410 to S440 in an embodiment below may be sequentially performed, but are not necessarily sequentially performed. For example, an order of the respective operations may be changed, and at least two operations may be performed in parallel. Furthermore, contents, which correspond to or are duplicated with the contents described above in conjunction with FIG. 4 , may be briefly described or omitted.
- the rear seat passenger notification device may collect information.
- the rear seat passenger notification device may collect information associated with at least one of a user, an outsider, or a combination thereof.
- the rear seat passenger notification device may collect location information of the user, information about the outsider who is adjacent to the host vehicle or approaches the host vehicle, and/or information about an interior temperature of the host vehicle.
- the rear seat passenger notification device may identify whether the user is within a specified distance from the host vehicle.
- the rear seat passenger notification device may identify location information of the user, and/or a separation distance between the user and the host vehicle, based on wireless communication with a terminal of the user.
- the rear seat passenger notification device may perform an operation S430.
- the rear seat passenger notification device may perform an operation S440.
- the rear seat passenger notification device may additionally operate an alarm function in the operation S430.
- the rear seat passenger notification device may gradually strengthen and repeatedly perform the visual and audible alarm function.
- the rear seat passenger notification device may identify the separation distance between the user and the host vehicle based on wireless communication with the terminal of the user.
- the specified distance may be a predetermined distance or a setting value changeable by control of the user.
- the rear seat passenger notification device may gradually strengthen and repeatedly perform the visual and audible alarm function using an alarm device.
- the above-mentioned separation distance is a numerical example, and embodiments of the present disclosure are not limited thereto.
- the rear seat passenger notification device may transmit information for vehicle control to the terminal of the user.
- the rear seat passenger notification device may transmit a user interface including at least one action item for control of the host vehicle to the terminal of the user.
- the user interface may include application screen information to execute at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, digital key transmission, or a combination thereof.
- FIG. 5 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to an embodiment of the present disclosure.
- a host vehicle 500 may include a plurality of seats and zones in the interior.
- the host vehicle 500 may include front seats including a driver's seat 501 and a passenger seat 503 in the interior.
- the host vehicle 500 may include rear seats including a first zone 591 and a second zone 592 in the interior.
- a rear seat passenger notification device may include a plurality of sensors (e.g., ROA sensors) which separately identify each of a plurality of areas.
- sensors e.g., ROA sensors
- the rear seat passenger notification device may include a first sensor 511 disposed in an area adjacent to the first zone 591.
- the first sensor 511 may separately identify information about at least one passenger who exists in each of a first area 561 and a second area 562 of the first zone 591.
- the rear seat passenger notification device may include also a second sensor 513 disposed in an area adjacent to the second zone 592.
- the second sensor 513 may separately identify information about at least one passenger who exists in each of a third area 563 and a fourth area 564 of the second zone 592.
- the rear seat passenger notification device may provide a user with a function to selectively control components of the host vehicle 500 using the information about the at least one passenger that is obtained by the plurality of sensors.
- the rear seat passenger notification device may provide the user with a function to control a window adjacent to an area identified as including a child, among a first window 551, a second window 552, a third window 553, and a fourth window 554.
- the rear seat passenger notification device may provide the user (or a terminal of the user) with a function to control opening and closing of the first window 551 adjacent to the first area 561.
- the rear seat passenger notification device may provide the user with a function to control opening and closing of a door adjacent to an area identified as including a child.
- the rear seat passenger notification device may provide the user with a function to control air conditioning of an area identified as including a child.
- FIG. 6 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to another embodiment of the present disclosure.
- a host vehicle 600 may include a plurality of seats and zones in the interior.
- the host vehicle 600 may include front seats including a driver's seat 601 and a passenger seat 603 in the interior.
- the host vehicle 600 may include rear seats including a 1-lst zone 691, a 1-2nd zone 692, a 2-1st zone 693, and a 2-2nd zone 694 in the interior.
- a rear seat passenger notification device may include a plurality of sensors (e.g., ROA sensors) which separately identify each of a plurality of areas.
- sensors e.g., ROA sensors
- the rear seat passenger notification device may include a first sensor 611 disposed in an area adjacent to the 1-lst zone 691 and the 1-2nd zone 692.
- the first sensor 611 may separately identify information about at least one passenger who exists in each of a first area 661 included in the 1-1st zone 691 and a second area 662 included in 1-2nd zone 692.
- the rear seat passenger notification device may also include a second sensor 613 disposed in an area adjacent to the 2-1st zone 693 and the 2-2 zone 694.
- the second sensor 613 may separately identify information about at least one passenger who exists in each of a third area 663 of the 2-1st zone 693 and a fourth area 664 of the 2-2nd zone 694.
- the rear seat passenger notification device may provide a user with a function to selectively control components of the host vehicle 600 using the information about the at least one passenger, which is obtained by the plurality of sensors.
- the rear seat passenger notification device may provide the user with a function to control a window adjacent to an area identified as including a child is, among a first window 651, a second window 652, a third window 653, and a fourth window 654.
- the rear seat passenger notification device may provide the user (or a terminal of the user) with a function to control opening and closing of the first window 651 adjacent to the first area 661.
- the rear seat passenger notification device may provide the user with a function to control opening and closing of a door adjacent to an area identified as including a child.
- the rear seat passenger notification device may provide the user with a function to control air conditioning of an area identified as including a child.
- FIG. 7 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to yet another embodiment of the present disclosure.
- a host vehicle 700 may include front seats including a driver's seat 701, a passenger seat 703, and rear seats including a 1-1st zone 791, a 1-2nd zone 792, a 2-1st zone 793, and a 2-2nd zone 794 in the interior.
- a rear seat passenger notification device (e.g., the rear seat passenger notification device 100 of FIG. 1 ) may include a first sensor 711 and a second sensor 713, which separately identify each of a plurality of areas.
- the rear seat passenger notification device may include at least one camera which identifies information about a front, a side, and a rear of the host vehicle 700.
- the rear seat passenger notification device may include a front view camera 781, a side view camera 783, and a rear view camera 785.
- the rear seat passenger notification device may provide a user with a function to selectively control components of the host vehicle 700 using exterior information of the host vehicle 700, which is obtained by the at least one camera.
- the rear seat passenger notification device may provide the user with a function to control a window corresponding to an external user adjacent to the host vehicle 700, among a first window 751, a second window 752, a third window 753, and a fourth window 754.
- the rear seat passenger notification device may close the first window 751 and may maintain a door corresponding to the first window 751 in a lock state.
- the rear seat passenger notification device may open the first window 751 and may release the lock state of the door corresponding to the first window 751.
- the rear seat passenger notification device may transmit information about the external user, which is obtained using the at least one camera, to the user terminal based on a specified period.
- FIG. 8 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to an embodiment of the present disclosure.
- a rear seat passenger notification device may perform operations illustrated in FIG. 8 .
- components e.g., the sensor device 110, the alarm device 120, the information collection device 130, and the action determination and control device 140 of FIG. 1
- the rear seat passenger notification device may perform the operations of FIG. 8 .
- Operations S810 to S840 in an embodiment below may be sequentially performed, but are not necessarily sequentially performed. For example, an order of the respective operations may be changed, and at least two operations may be performed in parallel. Furthermore, contents, which correspond to or are duplicated with the contents described above in conjunction with FIG. 8 , may be briefly described or omitted.
- a sensor device may identify information about at least one passenger in the host vehicle.
- the sensor device may divide the interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and may identify information of at least one passenger with respect to each of the plurality of areas.
- FOV field of view
- the sensor device may identify that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera.
- the sensor device may include at least one camera that captures an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle and at least one rear occupant alert (ROA) sensor which divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- ROI rear occupant alert
- an alarm device may perform a visual and audible alarm function.
- the alarm device may perform the visual and audible alarm function.
- the alarm device may gradually strengthen and repeatedly perform the visual and audible alarm function.
- an information collection device may collect information about the host vehicle and information about the user of the host vehicle.
- the information collection device may collect the separation distance between the user and the host vehicle.
- an action determination and control device may identify at least one action item for control of the host vehicle, based on at least one of information about the at least one passenger, information about the host vehicle, information about the user, or a combination thereof, and may provide the user with the at least one action item.
- the action determination and control device may transmit a user interface including the at least one action item for the control of the host vehicle to a terminal of the user.
- the at least one action item may include, for example, at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with the terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- the action determination and control device may provide the user with a user interface to execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature decreases.
- the action determination and control device may provide the user with a user interface to execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature increases.
- the action determination and control device may transmit a digital key of the host vehicle to the terminal of the external user.
- the action determination and control device may identify a location where the at least one passenger is seated among the plurality of areas and may provide the user with at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- the action determination and control device may continue setting all doors of the host vehicle to a lock state and may transmit information about the external user to the terminal of the user.
- FIG. 9 illustrates a computing system that may perform a rear seat passenger notification method according to an embodiment of the present disclosure.
- a computing system 1000 that may perform the rear seat passenger notification method may include at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, storage 1600, and a network interface 1700, which are connected with each other via a bus 1200.
- the processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and/or the storage 1600.
- the memory 1300 and the storage 1600 may include various types of volatile or non-volatile storage media.
- the memory 1300 may include a ROM (Read Only Memory) 1310 and a RAM (Random Access Memory) 1320.
- the operations of the method or algorithm described in connection with the embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or a combination of the hardware module and the software module, which is executed by the processor 1100.
- the software module may reside on a storage medium (e.g., the memory 1300 and/or the storage 1600) such as a RAM, a flash memory, a ROM, an EPROM, an EEPROM, a register, a hard disc, a removable disk, and a CD-ROM.
- the storage medium may be coupled to the processor 1100.
- the processor 1100 may read out information from the storage medium and may write information in the storage medium.
- the storage medium may be integrated with the processor 1100.
- the processor and the storage medium may reside in an application specific integrated circuit (ASIC) .
- the ASIC may reside within a user terminal.
- the processor and the storage medium may reside in the user terminal as separate components.
- a rear seat passenger notification device may selectively identify an action item required for a host vehicle using a plurality of sensors (e.g., at least one of a rear occupant alert (ROA) sensor, a camera, a combination thereof) included in a sensor device.
- a plurality of sensors e.g., at least one of a rear occupant alert (ROA) sensor, a camera, a combination thereof
- the rear seat passenger notification device may provide an efficient and safe rear seat passenger notification function as a user of the host vehicle selectively execute a visual and audible alarm function or executes the visual and audible alarm function in various modes, depending on a distance separated from the host vehicle.
- the rear seat passenger notification device may collect an exterior and/or interior environment of the host vehicle in real time, when there is the user of the host vehicle at a distance relatively away from the host vehicle, and may provide a user interface about a control function of the host vehicle, which is suitable for the terminal of the user, thus increasing availability.
- the rear seat passenger notification device may control the host vehicle such that an optimal control function is able to be executed for each area as the sensor device divides and senses the interior of the host vehicle into a plurality of areas depending on a sitting location or a sitting state.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Automation & Control Theory (AREA)
- Acoustics & Sound (AREA)
- Thermal Sciences (AREA)
- Transportation (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Emergency Alarm Devices (AREA)
Abstract
Description
- This application claims the benefit of and priority to
, the entire contents of which are incorporated herein by reference.Korean Patent Application No. 10-2022-0142989, filed on October 31, 2022 - The present disclosure relates to a rear seat passenger notification device and a method therefor.
- Situations in which a user of a host vehicle leaves children in the host vehicle due to lack of attention or unavoidable circumstances often occur. Such situations may cause major problems, especially during summer months.
- For example, children and the like may suffocate due to an increase in the interior temperature of the host vehicle if the children are left in the interior of the host vehicle for a long time. Because accidents of this type are not intended by the user of the host vehicle and are generally caused by momentary negligence and a moment of carelessness, most accidents may be prevented when an alarm is provided under certain conditions.
- Many technologies have been proposed to cope with dangerous accidents in the parked host vehicle. For example, technologies of measuring the interior temperature of the host vehicle to open a window of a door of the host vehicle, operate an air conditioner of the host vehicle, or generate an alarm are provided in the host vehicle when the host vehicle is manufactured.
- However, because the functions uniformly control the interior environment without considering the location of the user of the host vehicle or information about the exterior environment, there may be a risk of malfunction. Furthermore, because the accuracy of an interior detection process for providing a function may be degraded or it may be difficult to determine whether to execute various functions to be adaptive to the user, availability is slightly reduced.
- The present disclosure has been made to solve the above-mentioned problems occurring in the prior art while advantages achieved by the prior art are maintained intact.
- An aspect of the present disclosure provides a rear seat passenger notification device for identifying information about an interior and/or exterior environment of a host vehicle using a sensor device and adaptively identifying an action item for safety of a passenger based on the identified result, and a method therefor.
- Another aspect of the present disclosure provides a rear seat passenger notification device for visually and/or audibly providing an alarm function for a remaining situation of a passenger using an alarm device and further considering a separation distance between the host vehicle and the user to provide an alarm function in various manners, and a method therefor.
- Another aspect of the present disclosure provides a rear seat passenger notification device for collecting at least one of information about the host vehicle, information of the user of the host vehicle, or a combination thereof in a complex manner using an information collection device and suitably identifying and providing an action item using the collected information, and a method therefor.
- The technical problems to be solved by the present disclosure are not limited to the aforementioned problems, and any other technical problems not mentioned herein will be clearly understood from the following description by those having ordinary skill in the art to which the present disclosure pertains.
- According to an embodiment of the present disclosure, a rear seat passenger notification device may include a sensor device configured to identify information about at least one passenger who is present in a host vehicle when the host vehicle enters a locked state. In particular, the information includes at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof. The rear seat passenger notification device may also include an alarm device configured to perform a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition, and an information collection device configured to collect information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition. The rear seat passenger notification device may further include an action determination and control device configured to identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, and the action determination and control device provide the user with the at least one action item.
- In an aspect, the alarm device may be configured to perform the visual and audible alarm function when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child.
- In an aspect, the information collection device may be configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child. In an example, the alarm device may be configured to gradually strengthen and repeatedly perform the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
- In an aspect, the information collection device may be configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child. In an example, the action determination and control device may be configured to transmit a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
- In an aspect, the at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- In an aspect, the action determination and control device may be configured to execute one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature. The action determination and control device may also be configured to execute one of the control of air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
- In an aspect, the action determination and control device may be configured to transmit a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle, when presence of the external user is identified by means of adjacent information of the host vehicle. The adjacent information is included in the information of the host vehicle.
- In an aspect, the sensor device may divide the interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and identifies information of the at least one passenger with respect to each of the plurality of areas. In an example, the action determination and control device may identify the location where the at least one passenger is seated among the plurality of areas and may provide the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- In an aspect, the sensor device may be configured to identify that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera. In an example, the action determination and control device may be configured to continue setting all doors of the host vehicle to the lock state and transmits information about the external user to a terminal of the user.
- In an aspect, the sensor device may include at least one camera that captures an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle and at least one rear occupant alert (ROA) sensor that divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- According to another embodiment of the present disclosure, a rear seat passenger notification method may include identifying, by a sensor device, information about at least one passenger who exists in the host vehicle, the information including at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof, when the host vehicle enters a lock state. The rear seat passenger notification method may also include performing, by an alarm device, a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition, and collecting, by an information collection device, information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition. The rear seat passenger notification method may further include identifying, by an action determination and control device, at least one action item for control of the host vehicle based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof. The rear seat passenger notification method may further include providing, by the action determination and control device, the user with the at least one action item.
- In an aspect, performing the visual and audible alarm function by the alarm device may include performing the visual and audible alarm function when it is identified that the at least one passenger includes a child based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met.
- In an aspect, collecting the information by the information collection device may include collecting a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child. In another embodiment, performing the visual and audible alarm function by the alarm device may include gradually strengthening and repeatedly performing, by the alarm device, the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
- In an aspect, collecting the information by the information collection device may include collecting a separation distance between the user and the host vehicle when it is identified that the at least one passenger includes a child based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met. In an embodiment, providing the at least one action item to the user by the action determination and control device may include transmitting, by the action determination and control device, a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
- In an aspect, the at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- In an aspect, providing the at least one action item to the user by the action determination and control device may include executing, by the action determination and control device, one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature. Providing the at least one action item to the user by the action determination and control device may also include executing, by the action determination and control device, one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
- In an aspect, providing the at least one action item to the user by the action determination and control device may include transmitting, by the action determination and control device, a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle, when presence of the external user is identified by means of adjacent information of the host vehicle. The adjacent information is included in the information of the host vehicle.
- In an aspect, identifying the information about the at least one passenger by the sensor device may include dividing, by the sensor device, the interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and identifying, by the sensor device, information of the at least one passenger with respect to each of the plurality of areas. In an embodiment, providing the at least one action item to the user by the action determination and control device may include identifying, by the action determination and control device, the location where the at least one passenger is seated among the plurality of areas, and providing, by the action determination and control device, the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- In an aspect, identifying the information about the at least one passenger by the sensor device may include identifying, by the sensor device, that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera. In an embodiment, providing the at least one action item to the user by the action determination and control device may include continuing, by the action determination and control device, setting all doors of the host vehicle to the lock state, and transmitting, by the action determination and control device, information about the external user to a terminal of the user.
- In an aspect, the sensor device may include at least one camera that captures an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle and at least one rear occupant alert (ROA) sensor that divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- The above and other objects, features and advantages of the present disclosure may be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a block diagram illustrating components of a rear seat passenger notification device according to an embodiment of the present disclosure; -
FIG. 2 is a conceptual diagram of an operation of a rear seat passenger notification device according to an embodiment of the present disclosure; -
FIG. 3 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to an embodiment of the present disclosure; -
FIG. 4 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to another embodiment of the present disclosure; -
FIG. 5 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to an embodiment of the present disclosure; -
FIG. 6 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to another embodiment of the present disclosure; -
FIG. 7 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to yet another embodiment of the present disclosure; -
FIG. 8 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to an embodiment of the present disclosure; and -
FIG. 9 is a block diagram illustrating a computing system according to an embodiment of the present disclosure. - With regard to description of drawings, the same or similar denotations may be used for the same or similar components.
- Hereinafter, embodiments of the present disclosure are described in detail with reference to the accompanying drawings. In the accompanying drawings, the same reference numerals are used throughout to designate the same or similar elements. In addition, a detailed description of well-known features or functions may be omitted in order not to unnecessarily obscure the gist of the present disclosure.
- In describing the components of the embodiment according to the present disclosure, terms such as first, second, "A", "B", (a), (b), and the like may be used. These terms are only used to distinguish one element from another element, but do not limit the corresponding elements irrespective of the order or priority of the corresponding elements. Furthermore, unless otherwise defined, all terms including technical and scientific terms used herein are to be interpreted as is customary in the art to which the present disclosure belongs. Such terms as those defined in a generally used dictionary are to be interpreted as having meanings equal to the contextual meanings in the relevant field of art, and are not to be interpreted as having ideal or excessively formal meanings unless clearly defined as having such in the present application.
- When a component, device, element, or the like of the present disclosure is described as having a purpose or performing an operation, function, or the like, the component, device, or element should be considered herein as being "configured to" meet that purpose or perform that operation or function.
- Hereinafter, embodiments of the present disclosure are described in detail with reference to
FIGS. 1 to 9 . -
FIG. 1 is a block diagram illustrating components of a rear seat passenger notification device according to an embodiment of the present disclosure. - Referring to
FIG. 1 , a rear seatpassenger notification device 100 according to an embodiment of the present disclosure may be implemented in a vehicle. For example, the rear seatpassenger notification device 100 may be integrally configured with control units in the vehicle or may be implemented as a separate device to be connected with the control units of the vehicle by a separate connection means. - According to an embodiment, the rear seat
passenger notification device 100 may include asensor device 110, analarm device 120, aninformation collection device 130, and an action determination andcontrol device 140. The components of the rear seatpassenger notification device 100, which are shown inFIG. 1 , are illustrative, and embodiments of the present disclosure are not limited thereto. For example, the rear seatpassenger notification device 100 may further include components not shown inFIG. 1 . - According to an embodiment, the
sensor device 110 may include a plurality of sensors which obtain various pieces of information about the interior and/or exterior of a host vehicle. - The
sensor device 110 may obtain various pieces of interior information of the host vehicle. For example, when the host vehicle enters a lock state, thesensor device 110 may identify information about at least one passenger who is present in the host vehicle. The information about the at least on passenger who is present in the host vehicle may include at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof. - The
sensor device 110 may separately identify each of a plurality of areas logically divided in the interior of the host vehicle. For example, thesensor device 110 may include at least one rear occupant alert (ROA) sensor that divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat. Thesensor device 110 may divide the interior of the host vehicle into the plurality of areas based on a field of view (FOV) of at least one sensor included in thesensor device 110 and may identify information about the at least one passenger with respect to each of the plurality of areas. - In an embodiment, the
sensor device 110 may include at least one camera that obtains exterior information of the host vehicle. The at least one camera may capture an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle to obtain exterior information about the host vehicle. For example, thesensor device 110 may identify that an external user adjacent to the host vehicle approaches the host vehicle using the at least one camera. - According to an embodiment, the
alarm device 120 may perform various types of alarm functions. - For example, the
alarm device 120 may perform a visual alarm function using headlights of the host vehicle. - As another example, the
alarm device 120 may perform an audible alarm function using a speaker of the host vehicle. - In an example, when it is identified that the information about the at least one passenger meets a specified condition, the
alarm device 120 may perform a visual and audible alarm function. The specified condition may include at least one of a detection area, a detection intensity, a detection height, or a combination thereof. The visual and audible alarm function may be defined as an alarm function including at least one of a visual alarm function, an audible alarm function, or a combination thereof. - For example, the
alarm device 120 may perform the visual and audible alarm function when it is identified that the at least one passenger includes a child based on whether at least one of the detection area, the detection intensity, the detection height, or the combination thereof included in the specified condition is met.. As used herein, "child" may include an infant, a toddler, or a kid who is a little older (e.g., age between 5 and 66 months). - In an example, when it is identified that a separation distance between the user and the host vehicle is less than a specified distance, the
alarm device 120 may gradually strengthen and repeatedly perform the visual and audible alarm function. The rear seatpassenger notification device 100 may identify the separation distance between the user and the host vehicle based on wireless communication with a terminal of the user. The specified distance may be a predetermined distance or a setting value changeable by control of the user. For example, when the separation distance is less than 10 m, the rear seatpassenger notification device 100 may gradually strengthen and repeatedly perform the visual and audible alarm function using thealarm device 120. The above-mentioned separation distance is a numerical example, and embodiments of the present disclosure are not limited thereto. - According to an embodiment, the
information collection device 130 may collect various pieces of information about the host vehicle and/or the user. - For example, when it is identified that the information about the at least one passenger meets the specified condition, the
information collection device 130 may collect information about the host vehicle and/or information about the user of the host vehicle. - In an embodiment, when it is identified that the at least one passenger includes a child based on whether at least one of the detection area, the detection intensity, the detection height, or the combination thereof included in the specified condition is met, the
information collection device 130 may collect the separation distance between the user and the host vehicle. As an example, theinformation collection device 130 may collect the separation distance between the host vehicle and the user based on wireless communication with the user. As another embodiment, theinformation collection device 130 may collect location information of the user based on wireless communication with the user. As yet another embodiment, theinformation collection device 130 may collect interior temperature information of the host vehicle using at least one sensor included in thesensor device 110. As still another embodiment, theinformation collection device 130 may collect location information of the host vehicle using a global positioning system (GPS). - According to an embodiment, the action determination and
control device 140 may identify and provide an action item to the user. - For example, the action determination and
control device 140 may identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or the combination thereof, at least one action item for control of the host vehicle, and may provide the user with the at least one action item. The at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof. - In an embodiment, when it is identified that the separation distance between the user and the host vehicle is greater than the specified distance (e.g., 10 m), the action determination and
control device 140 may transmit a user interface including at least one action item for control of the host vehicle to the terminal of the user. The user interface may include, for example, application screen information to execute at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, digital key transmission, or a combination thereof. - In an embodiment, when the interior temperature of the host vehicle is greater than or equal to or is less than a specified value, the action determination and
control device 140 may provide the user with a function for adjusting the interior temperature. - In an embodiment, when it is identified that the interior temperature included in the information of the host vehicle is greater than or equal to a first temperature, the action determination and
control device 140 may execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof, and may provide the user with a control function, such that the interior temperature decreases. - On the other hand, when it is identified that the interior temperature included in the information of the host vehicle is less than a second temperature lower than the first temperature, the action determination and
control device 140 may execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof and may provide the user with the control function, such that the interior temperature increases. - In an embodiment, when it is identified, by means of adjacent information that is included in the information about the host vehicle, that an external user is present adjacent to the host vehicle, the action determination and
control device 140 may transmit a digital key of the host vehicle to the terminal of the external user. The identified external user may be an outsider who may provide cooperation for at least one passenger left in the host vehicle. Thus, the action determination andcontrol device 140 may transmit the digital key of the host vehicle to the terminal of the external user and may hand over control authority of the host vehicle to the external user. - In an embodiment, the action determination and
control device 140 may identify a location where the at least one passenger is seated among the plurality of areas in the interior of the host vehicle and may provide the user with at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location. - In an embodiment, when it is identified that the external user adjacent to the host vehicle approaches the host vehicle, the action determination and
control device 140 may preemptively continue setting all doors of the host vehicle to a lock state and may transmit information about the external user to the terminal of the user The external user identified as approaching the host vehicle may be, for example, a trespasser on the host vehicle. Thus, the action determination andcontrol device 140 may identify the external user as the trespasser, may strengthen security of the host vehicle (e.g., set all the doors to the lock state), and may transmit information about the external user to the terminal of the user of the host vehicle. -
FIG. 2 is a conceptual diagram of an operation of a rear seat passenger notification device according to an embodiment of the present disclosure. - According to an embodiment, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may include a sensor device 210 (e.g., thesensor device 110 ofFIG. 1 ), an information collection device 220 (e.g., theinformation collection device 130 ofFIG. 1 ), and an action determination and control device 230 (e.g., the action determination andcontrol device 140 ofFIG. 1 ). The action determination andcontrol device 230 may control thesensor device 210 and theinformation collection device 220. - In an embodiment, the action determination and
control device 230 may obtain various pieces of information about the interior of the host vehicle using thesensor device 210. - In an embodiment, the
sensor device 210 may identify at least one passenger who is present in the interior of the host vehicle based on control of the action determination andcontrol device 230. Thesensor device 210 may include, for example, at least one sensor (e.g., an ROA sensor) included in the interior of the host vehicle. - The
sensor device 210 may identify whether at least one passenger is an adult or a child using the ROA sensor. As an example, thesensor device 210 may identify whether the at least one passenger is the adult or the child using at least one of an area where the detected passenger is detected, intensity (e.g., a signal to noise ratio (SNR)) where the detected passenger is detected, a height where the detected passenger is detected, a location where breathing of the detected passenger occurs, or a combination thereof. - In an embodiment, the
sensor device 210 may identify at least one passenger for each of a plurality of areas logically divided in the interior of the host vehicle. - In an embodiment, the action determination and
control device 230 may obtain various pieces of information about the host vehicle, a user, and/or an outsider using theinformation collection device 220. - In an embodiment, the
information collection device 220 may include a user location information collection device 222. The user location information collection device 222 may collect a location of the user based on wireless communication with a user terminal. - The
information collection device 220 may include anoutsider detection device 224. Theoutsider detection device 224 may identify an outsider adjacent to the host vehicle using at least one of a biometric sensor, a motion sensor, an acceleration sensor, or a combination thereof. In an embodiment, theoutsider detection device 224 may separately identify an outsider adjacent to the host vehicle and/or an outsider who gradually approaches the host vehicle. - In an embodiment, the
information collection device 220 may collect an interior temperature of the host vehicle using a temperature information collection device 226. The temperature information collection device 226 may identify the interior temperature of the host vehicle. The temperature information collection device 226 may identify whether the interior temperature of the host vehicle is greater than or equal to a specified value or is less than the specified value. In an embodiment, when it is identified that the interior temperature of the host vehicle is greater than or equal to a first temperature, the temperature information collection device 226 may deliver a signal that it is required to decrease the interior temperature to the action determination andcontrol device 230. On the other hand, when it is identified that the interior temperature of the host vehicle is less than a second temperature lower than the first temperature, the temperature information collection device 226 may deliver a signal that it is required to increase the interior temperature to the action determination andcontrol device 230. - According to an embodiment, the action determination and
control device 230 may identify at least one ofaction items 250 based on the various pieces of information obtained by means of thesensor device 210 and/or theinformation collection device 220. - The
action items 250 may includeair conditioning control 251,window control 253,door control 255,terminal communication 257, and/or digitalkey transmission 259. - The
air conditioning control 251 may include a control function of at least one air conditioning device (e.g., at least one of an air conditioner, a heater, an inner air circulation device, a dehumidifier, or a combination thereof) in the interior of the host vehicle. - The
window control 253 may include an opening and closing control function of at least one window of the host vehicle. The user may control an opening and closing state of the window by means of thewindow control 253. For example, the user may completely close or open a window of the host vehicle by means of thewindow control 253 or may open the window of the host vehicle by a specified degree (e.g., 30%) by means of thewindow control 253. - The
door control 255 may include an opening and closing control function of at least one door of the host vehicle. The user may selectively set at least one door of the host vehicle to a lock state by means of thedoor control 255. - The
terminal communication 257 may include various data transmission and reception functions through communication with an external device (e.g., a terminal). The user may transmit and receive pieces of data associated with theaction items 250 of the host vehicle to a terminal of the user and/or a terminal of the external user by means of theterminal communication 257. - The digital
key transmission 259 may include a function of transmitting a digital key including control authority of the host vehicle to the external device (e.g., the terminal). When it is difficult for the user to immediately approach the host vehicle, the user may transmit a digital key to a terminal of the external user who is adjacent to the host vehicle and is capable of cooperating with a passenger of the host vehicle. -
FIG. 3 is a flowchart depicting operation of a rear seat passenger notification device according to an embodiment of the present disclosure. - According to an embodiment, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may perform operations depicted inFIG. 3 . For example, at least some of components (e.g., thesensor device 110, thealarm device 120, theinformation collection device 130, and the action determination and control device 140) included in the rear seat passenger notification device may be configured to perform the operations ofFIG. 3 . - Operations S310 to S360 in an embodiment below may be sequentially performed, but are not necessarily sequentially performed. For example, an order of the respective operations may be changed, and at least two operations may be performed in parallel. Furthermore, contents, which correspond to or are duplicated with the contents described above in conjunction with
FIG. 3 , may be briefly described or omitted. - In an operation S310, the rear seat passenger notification device may identify whether doors are locked.
- For example, the rear seat passenger notification device may identify whether doors of a host vehicle correspond to a lock state.
- In an operation S320, the rear seat passenger notification device may identify whether there is at least one passenger in the interior of the host vehicle.
- For example, the rear seat passenger notification device may identify whether there is at least one passenger in the interior (e.g., rear seat) of the host vehicle. In an example, the rear seat passenger notification device may identify whether there is at least one passenger in one of a plurality of areas logically divided in the interior of the host vehicle, using a sensor device.
- In an embodiment, when it is identified that there is the passenger (e.g., -"Yes" in the operation S320), the rear seat passenger notification device may perform operation S330.
- On the other hand, when it is identified that there is no passenger (e.g., -"No" in the operation S320), the rear seat passenger notification device may end the operation.
- In an operation S330, the rear seat passenger notification device may identify a location of the passenger.
- In an embodiment, the rear seat passenger notification device may identify a location (e.g., the driver's seat, a passenger seat, or a rear seat corresponding to the driver's seat or the passenger seat) using a plurality of sensors included in the interior of the host vehicle.
- In an operation S340, the rear seat passenger notification device may identify whether there is a child among the at least one passenger in the host vehicle.
- For example, the rear seat passenger notification device may identify whether there are adults or children using at least one of an area where at least one passenger is detected, intensity where the at least one passenger is detected, a height where the at least one passenger is detected, or a combination thereof.
- In an embodiment, when it is identified that there is a child among the at least one passenger (e.g., -"Yes" in the operation S340), the rear seat passenger notification device may perform operation S350.
- On the other hand, when it is identified that there are no children among the at least one passenger (e.g., -"No" in the operation S340), the rear seat passenger notification device may end the operation.
- In an operation S350, the rear seat passenger notification device may operate an alarm function.
- For example, the rear seat passenger notification device may perform a visual alarm function using headlights of the host vehicle or may perform an audible alarm function using a speaker of the host vehicle.
- In an example, when it is identified that the information about the at least one passenger meets a specified condition, the rear seat passenger notification device may perform the visual and audible alarm function. The specified condition may include at least one of a detection area, a detection intensity, a detection height, or a combination thereof. As an example, the visual and audible alarm function may be defined as an alarm function including at least one of a visual alarm function, an audible alarm function, or a combination thereof.
- For example, when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or the combination thereof included in the specified condition is met, that the at least one passenger includes a child, the rear seat passenger notification device may perform the visual and audible alarm function.
- In an operation S360, the rear seat passenger notification device may determine an action item.
- For example, after operating the alarm function, the rear seat passenger notification device may identify at least one action item for control of the host vehicle.
- The at least one action item may include at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- In an example, the rear seat passenger notification device may identify at least one action item and may provide the user with the at least one action item.
-
FIG. 4 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to another embodiment of the present disclosure. - According to an embodiment, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may perform operations depicted inFIG. 4 . For example, at least some of components (e.g., thesensor device 110, thealarm device 120, theinformation collection device 130, and the action determination andcontrol device 140 ofFIG. 1 ) included in the rear seat passenger notification device may be configured to perform the operations ofFIG. 4 . - Operations S410 to S440 in an embodiment below may be sequentially performed, but are not necessarily sequentially performed. For example, an order of the respective operations may be changed, and at least two operations may be performed in parallel. Furthermore, contents, which correspond to or are duplicated with the contents described above in conjunction with
FIG. 4 , may be briefly described or omitted. - In an operation S410, the rear seat passenger notification device may collect information.
- For example, the rear seat passenger notification device may collect information associated with at least one of a user, an outsider, or a combination thereof.
- In various examples, the rear seat passenger notification device may collect location information of the user, information about the outsider who is adjacent to the host vehicle or approaches the host vehicle, and/or information about an interior temperature of the host vehicle.
- In an operation S420, the rear seat passenger notification device may identify whether the user is within a specified distance from the host vehicle.
- For example, the rear seat passenger notification device may identify location information of the user, and/or a separation distance between the user and the host vehicle, based on wireless communication with a terminal of the user.
- In an embodiment, when it is identified that the separation distance between the user and the host vehicle is less than the specified distance (e.g., "Yes" in the operation S420), the rear seat passenger notification device may perform an operation S430.
- On the other hand, when it is identified that the separation distance between the user and the host vehicle is greater than the specified distance (e.g., -"No" in the operation S420), the rear seat passenger notification device may perform an operation S440.
- According to an embodiment, when it is identified that the separation distance between the user and the host vehicle is less than the specified distance, the rear seat passenger notification device may additionally operate an alarm function in the operation S430.
- For example, the rear seat passenger notification device may gradually strengthen and repeatedly perform the visual and audible alarm function. In an example, the rear seat passenger notification device may identify the separation distance between the user and the host vehicle based on wireless communication with the terminal of the user. The specified distance may be a predetermined distance or a setting value changeable by control of the user. In an example, when the separation distance is less than 10 m, the rear seat passenger notification device may gradually strengthen and repeatedly perform the visual and audible alarm function using an alarm device. The above-mentioned separation distance is a numerical example, and embodiments of the present disclosure are not limited thereto.
- In the operation S440, the rear seat passenger notification device may transmit information for vehicle control to the terminal of the user.
- For example, the rear seat passenger notification device may transmit a user interface including at least one action item for control of the host vehicle to the terminal of the user. As an example, the user interface may include application screen information to execute at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, digital key transmission, or a combination thereof.
-
FIG. 5 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to an embodiment of the present disclosure. - According to an embodiment, a
host vehicle 500 may include a plurality of seats and zones in the interior. - For example, the
host vehicle 500 may include front seats including a driver'sseat 501 and apassenger seat 503 in the interior. - In an example, the
host vehicle 500 may include rear seats including afirst zone 591 and asecond zone 592 in the interior. - In an example, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may include a plurality of sensors (e.g., ROA sensors) which separately identify each of a plurality of areas. - For example, the rear seat passenger notification device may include a
first sensor 511 disposed in an area adjacent to thefirst zone 591. - The
first sensor 511 may separately identify information about at least one passenger who exists in each of afirst area 561 and asecond area 562 of thefirst zone 591. - The rear seat passenger notification device may include also a
second sensor 513 disposed in an area adjacent to thesecond zone 592. - The
second sensor 513 may separately identify information about at least one passenger who exists in each of athird area 563 and afourth area 564 of thesecond zone 592. - According to an embodiment, the rear seat passenger notification device may provide a user with a function to selectively control components of the
host vehicle 500 using the information about the at least one passenger that is obtained by the plurality of sensors. - For example, the rear seat passenger notification device may provide the user with a function to control a window adjacent to an area identified as including a child, among a
first window 551, asecond window 552, athird window 553, and afourth window 554. - For example, when it is identified, by means of the
first sensor 511, that a child is present in thefirst area 561, the rear seat passenger notification device may provide the user (or a terminal of the user) with a function to control opening and closing of thefirst window 551 adjacent to thefirst area 561. - The embodiment of controlling the opening and closing of the window is described in the above-mentioned example, but embodiments of the present disclosure are not limited thereto. For example, the rear seat passenger notification device may provide the user with a function to control opening and closing of a door adjacent to an area identified as including a child. As another example, the rear seat passenger notification device may provide the user with a function to control air conditioning of an area identified as including a child.
-
FIG. 6 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to another embodiment of the present disclosure. - A description duplicated with the description of
FIG. 5 in the description ofFIG. 6 is replaced below with the above-mentioned description ofFIG. 5 . - According to an embodiment, a host vehicle 600 (e.g., the
host vehicle 500 ofFIG. 5 ) may include a plurality of seats and zones in the interior. - For example, the
host vehicle 600 may include front seats including a driver'sseat 601 and apassenger seat 603 in the interior. - In an example, the
host vehicle 600 may include rear seats including a 1-lst zone 691, a 1-2nd zone 692, a 2-1st zone 693, and a 2-2nd zone 694 in the interior. - In an example, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may include a plurality of sensors (e.g., ROA sensors) which separately identify each of a plurality of areas. - For example, the rear seat passenger notification device may include a
first sensor 611 disposed in an area adjacent to the 1-lst zone 691 and the 1-2nd zone 692. - The
first sensor 611 may separately identify information about at least one passenger who exists in each of afirst area 661 included in the 1-1st zone 691 and asecond area 662 included in 1-2nd zone 692. - The rear seat passenger notification device may also include a
second sensor 613 disposed in an area adjacent to the 2-1st zone 693 and the 2-2zone 694. - The
second sensor 613 may separately identify information about at least one passenger who exists in each of athird area 663 of the 2-1st zone 693 and afourth area 664 of the 2-2nd zone 694. - According to an embodiment, the rear seat passenger notification device may provide a user with a function to selectively control components of the
host vehicle 600 using the information about the at least one passenger, which is obtained by the plurality of sensors. - For example, the rear seat passenger notification device may provide the user with a function to control a window adjacent to an area identified as including a child is, among a
first window 651, asecond window 652, athird window 653, and afourth window 654. - In an example, when it is identified by means of the
first sensor 611, that a child is present in thefirst area 661, the rear seat passenger notification device may provide the user (or a terminal of the user) with a function to control opening and closing of thefirst window 651 adjacent to thefirst area 661. - The embodiment of controlling the opening and closing of the window is described in the above-mentioned example, but embodiments of the present disclosure are not limited thereto. For example, the rear seat passenger notification device may provide the user with a function to control opening and closing of a door adjacent to an area identified as including a child. As another example, the rear seat passenger notification device may provide the user with a function to control air conditioning of an area identified as including a child.
-
FIG. 7 is a conceptual diagram for dividing a host vehicle into a plurality of areas sensed by a sensor device, according to yet another embodiment of the present disclosure. - A description duplicated with the description of
FIGS. 5 and6 in the description ofFIG. 7 is replaced below with the above-mentioned description ofFIGS. 5 and6 . - According to an embodiment, a host vehicle 700 (e.g., the
host vehicle 500 ofFig. 5 or thehost vehicle 600 ofFIG. 6 ) may include front seats including a driver'sseat 701, apassenger seat 703, and rear seats including a 1-1st zone 791, a 1-2nd zone 792, a 2-1st zone 793, and a 2-2nd zone 794 in the interior. - In an example, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may include afirst sensor 711 and asecond sensor 713, which separately identify each of a plurality of areas. - In an example, the rear seat passenger notification device may include at least one camera which identifies information about a front, a side, and a rear of the
host vehicle 700. For example, the rear seat passenger notification device may include afront view camera 781, aside view camera 783, and arear view camera 785. - According to an embodiment, the rear seat passenger notification device may provide a user with a function to selectively control components of the
host vehicle 700 using exterior information of thehost vehicle 700, which is obtained by the at least one camera. - For example, the rear seat passenger notification device may provide the user with a function to control a window corresponding to an external user adjacent to the
host vehicle 700, among afirst window 751, asecond window 752, athird window 753, and afourth window 754. - In an example, when it is identified, by means of the
side view camera 783, that the external user (or a trespasser) approaches an area, of thehost vehicle 700, that is adjacent to the 1-1st zone 791, the rear seat passenger notification device may close thefirst window 751 and may maintain a door corresponding to thefirst window 751 in a lock state. - In an example, when it is identified, by means of the
side view camera 783, that the digital key including control authority of thehost vehicle 700 is included in a terminal of the external user who approaches an area, of thehost vehicle 700, that is adjacent to the 1-1st zone 791, the rear seat passenger notification device may open thefirst window 751 and may release the lock state of the door corresponding to thefirst window 751. - In an example, the rear seat passenger notification device may transmit information about the external user, which is obtained using the at least one camera, to the user terminal based on a specified period.
-
FIG. 8 is a flowchart depicting operations that may be performed by a rear seat passenger notification device according to an embodiment of the present disclosure. - According to an embodiment, a rear seat passenger notification device (e.g., the rear seat
passenger notification device 100 ofFIG. 1 ) may perform operations illustrated inFIG. 8 . For example, at least some of components (e.g., thesensor device 110, thealarm device 120, theinformation collection device 130, and the action determination andcontrol device 140 ofFIG. 1 ) included in the rear seat passenger notification device may be configured to perform the operations ofFIG. 8 . - Operations S810 to S840 in an embodiment below may be sequentially performed, but are not necessarily sequentially performed. For example, an order of the respective operations may be changed, and at least two operations may be performed in parallel. Furthermore, contents, which correspond to or are duplicated with the contents described above in conjunction with
FIG. 8 , may be briefly described or omitted. - In an operation S810, when a host vehicle enters a lock state, a sensor device may identify information about at least one passenger in the host vehicle.
- In an example, the sensor device may divide the interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and may identify information of at least one passenger with respect to each of the plurality of areas.
- The sensor device may identify that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera.
- For example, the sensor device may include at least one camera that captures an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle and at least one rear occupant alert (ROA) sensor which divides and identifies the interior of the host vehicle into a plurality of areas for each sitting seat.
- In an operation S820, when it is identified that the information about the at least one passenger meets a specified condition, an alarm device may perform a visual and audible alarm function.
- For example, when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child, the alarm device may perform the visual and audible alarm function.
- In an example, when it is identified that a separation distance between the user and the host vehicle is less than a specified distance, the alarm device may gradually strengthen and repeatedly perform the visual and audible alarm function.
- In an operation S830, when it is identified that the information about the at least one passenger meets the specified condition, an information collection device may collect information about the host vehicle and information about the user of the host vehicle.
- For example, when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or the combination thereof included in the specified condition is met, that the at least one passenger includes a child, the information collection device may collect the separation distance between the user and the host vehicle.
- In an operation S840, an action determination and control device may identify at least one action item for control of the host vehicle, based on at least one of information about the at least one passenger, information about the host vehicle, information about the user, or a combination thereof, and may provide the user with the at least one action item.
- For example, when it is identified that the separation distance is greater than the specified distance, the action determination and control device may transmit a user interface including the at least one action item for the control of the host vehicle to a terminal of the user. The at least one action item may include, for example, at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with the terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- In an example, when it is identified that the interior temperature included in the information of the host vehicle is greater than or equal to a first temperature, the action determination and control device may provide the user with a user interface to execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature decreases. On the other hand, when it is identified that the interior temperature included in the information of the host vehicle is less than a second temperature low than the first temperature, the action determination and control device may provide the user with a user interface to execute one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature increases.
- In an example, when it is identified, by means of adjacent information included in the information of the host vehicle, that there is an external user adjacent to the host vehicle, the action determination and control device may transmit a digital key of the host vehicle to the terminal of the external user.
- In an example, the action determination and control device may identify a location where the at least one passenger is seated among the plurality of areas and may provide the user with at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- In an example, the action determination and control device may continue setting all doors of the host vehicle to a lock state and may transmit information about the external user to the terminal of the user.
-
FIG. 9 illustrates a computing system that may perform a rear seat passenger notification method according to an embodiment of the present disclosure. - Referring to
FIG. 9 , acomputing system 1000 that may perform the rear seat passenger notification method may include at least oneprocessor 1100, amemory 1300, a userinterface input device 1400, a userinterface output device 1500,storage 1600, and anetwork interface 1700, which are connected with each other via abus 1200. - The
processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in thememory 1300 and/or thestorage 1600. Thememory 1300 and thestorage 1600 may include various types of volatile or non-volatile storage media. For example, thememory 1300 may include a ROM (Read Only Memory) 1310 and a RAM (Random Access Memory) 1320. - Accordingly, the operations of the method or algorithm described in connection with the embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or a combination of the hardware module and the software module, which is executed by the
processor 1100. The software module may reside on a storage medium (e.g., thememory 1300 and/or the storage 1600) such as a RAM, a flash memory, a ROM, an EPROM, an EEPROM, a register, a hard disc, a removable disk, and a CD-ROM. - The storage medium may be coupled to the
processor 1100. Theprocessor 1100 may read out information from the storage medium and may write information in the storage medium. Alternatively, the storage medium may be integrated with theprocessor 1100. The processor and the storage medium may reside in an application specific integrated circuit (ASIC) . The ASIC may reside within a user terminal. In another case, the processor and the storage medium may reside in the user terminal as separate components. - Various effects of a rear seat passenger notification device and a method therefor, according to at least some embodiments of the present disclosure, are provided below.
- In at least one of embodiments of the present disclosure, a rear seat passenger notification device may selectively identify an action item required for a host vehicle using a plurality of sensors (e.g., at least one of a rear occupant alert (ROA) sensor, a camera, a combination thereof) included in a sensor device.
- In at least some embodiments of the present disclosure, the rear seat passenger notification device may provide an efficient and safe rear seat passenger notification function as a user of the host vehicle selectively execute a visual and audible alarm function or executes the visual and audible alarm function in various modes, depending on a distance separated from the host vehicle.
- In at least some embodiments of the present disclosure, the rear seat passenger notification device may collect an exterior and/or interior environment of the host vehicle in real time, when there is the user of the host vehicle at a distance relatively away from the host vehicle, and may provide a user interface about a control function of the host vehicle, which is suitable for the terminal of the user, thus increasing availability.
- In at least some embodiments of the present disclosure, the rear seat passenger notification device may control the host vehicle such that an optimal control function is able to be executed for each area as the sensor device divides and senses the interior of the host vehicle into a plurality of areas depending on a sitting location or a sitting state.
- In addition, various effects ascertained directly or indirectly through the present disclosure may be provided.
- Hereinabove, although the present disclosure has been described with reference to example embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and altered by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure claimed in the following claims.
- Therefore, embodiments of the present disclosure are not intended to limit the technical spirit of the present disclosure, but provided only for the illustrative purpose. The scope of the present disclosure should be construed on the basis of the accompanying claims, and all the technical ideas within the scope equivalent to the claims should be included in the scope of the present disclosure.
Claims (15)
- A rear seat passenger notification device, comprising:a sensor device configured to identify information about at least one passenger who is present in a host vehicle when the host vehicle enters a lock state, the information including at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof;an alarm device configured to perform a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition;an information collection device configured to collect information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition; andan action determination and control device configured to:identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, andprovide the user with the at least one action item.
- The rear seat passenger notification device of claim 1, wherein the alarm device is configured to perform the visual and audible alarm function when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child.
- The rear seat passenger notification device of claim 1 or 2, wherein:the information collection device is configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child, andthe alarm device is configured to gradually strengthen and repeatedly perform the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
- The rear seat passenger notification device of one of claims 1-3, wherein:the information collection device is configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child, andthe action determination and control device is configured to transmit a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
- The rear seat passenger notification device of one of claims 1-4, wherein the at least one action item includes at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
- The rear seat passenger notification device of one of claims 1-5, wherein the action determination and control device is configured to:execute one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature, andexecute one of the control of air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
- The rear seat passenger notification device of one of claims 1-6, wherein the action determination and control device is configured to transmit a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle when presence of the external user is identified by means of adjacent information of the host vehicle, the adjacent information being included in the information of the host vehicle.
- The rear seat passenger notification device of one of claims 1-7, wherein:the sensor device is configured to:divide an interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device, andidentify information of the at least one passenger with respect to each of the plurality of areas, andthe action determination and control device is configured to:identify the location where the at least one passenger is seated among the plurality of areas, andprovide the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
- The rear seat passenger notification device of one of claims 1-8, wherein:the sensor device is configured to identify that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera, andthe action determination and control device is configured to:continue setting all doors of the host vehicle to the lock state, andtransmit information about the external user to a terminal of the user.
- The rear seat passenger notification device of one of claims 1-9, wherein the sensor device includes:at least one camera configured to capture an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle, andat least one rear occupant alert (ROA) sensor configured to divide and identify an interior of the host vehicle into a plurality of areas for each sitting seat.
- A rear seat passenger notification method, comprising:identifying, by a sensor device, information about at least one passenger who is present in a host vehicle, the information including at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof, when the host vehicle enters a lock state;performing, by an alarm device, a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition;collecting, by an information collection device, information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition; andidentifying, by an action determination and control device, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, andproviding, by the action determination and control device, the user with the at least one action item.
- The rear seat passenger notification method of claim 11, wherein performing the visual and audible alarm function by the alarm device includes:
performing the visual and audible alarm function when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child. - The rear seat passenger notification method of claim 11 or 12, wherein:collecting the information by the information collection device includes collecting, by the information collection device, a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child, andperforming the visual and audible alarm function by the alarm device includes gradually strengthening and repeatedly performing the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
- The rear seat passenger notification method of one of claims 11-13, wherein:collecting the information by the information collection device includes collecting a separation distance between the user and the host vehicle when it is identified, based on whether at least one of a detection area, a detection intensity, a detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes a child, andproviding the at least one action item to the user by the action determination and control device includes transmitting, by the action determination and control device, a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
- The rear seat passenger notification method of one of claims 11-14, wherein the at least one action item includes at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020220142989A KR20240061377A (en) | 2022-10-31 | 2022-10-31 | Rear seat passenger notification device and method therefor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4361986A1 true EP4361986A1 (en) | 2024-05-01 |
Family
ID=86378357
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23173103.5A Pending EP4361986A1 (en) | 2022-10-31 | 2023-05-12 | Rear seat passenger notification device and a method therefor |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP4361986A1 (en) |
| KR (1) | KR20240061377A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140253314A1 (en) * | 2012-09-24 | 2014-09-11 | Amy Rambadt | Child safety seat mobile alarm and method therefor |
| US20210362673A1 (en) * | 2020-05-20 | 2021-11-25 | Samsung Electronics Co., Ltd. | Method and apparatus with vehicle control |
| US20210370860A1 (en) * | 2020-05-27 | 2021-12-02 | Honda Motor Co., Ltd. | Vehicle control system and vehicle control method |
| DE102020126539A1 (en) * | 2020-10-09 | 2022-04-14 | Huf Hülsbeck & Fürst Gmbh & Co. Kg | UWB surveillance system for a vehicle interior |
-
2022
- 2022-10-31 KR KR1020220142989A patent/KR20240061377A/en active Pending
-
2023
- 2023-05-12 EP EP23173103.5A patent/EP4361986A1/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140253314A1 (en) * | 2012-09-24 | 2014-09-11 | Amy Rambadt | Child safety seat mobile alarm and method therefor |
| US20210362673A1 (en) * | 2020-05-20 | 2021-11-25 | Samsung Electronics Co., Ltd. | Method and apparatus with vehicle control |
| US20210370860A1 (en) * | 2020-05-27 | 2021-12-02 | Honda Motor Co., Ltd. | Vehicle control system and vehicle control method |
| DE102020126539A1 (en) * | 2020-10-09 | 2022-04-14 | Huf Hülsbeck & Fürst Gmbh & Co. Kg | UWB surveillance system for a vehicle interior |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20240061377A (en) | 2024-05-08 |
| US20240144801A1 (en) | 2024-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9855820B2 (en) | Intelligent vehicular occupant safety method | |
| US10077582B2 (en) | Automatic child safety lock release | |
| US20030158644A1 (en) | Artificial passenger with condition sensors | |
| US20170144595A1 (en) | System and method for detecting an unattended living presence in a vehicle | |
| KR102829533B1 (en) | Apparatus for detecting passenger in a vehicle and method thereof | |
| US20040174262A1 (en) | Motor vehicle occupancy and high temperature alarm module | |
| CN207389045U (en) | A kind of school bus children's safety detects guard system | |
| US10919526B2 (en) | Dynamic element protection | |
| CN206031279U (en) | Child riding safety monitoring system | |
| US12441344B2 (en) | Eco-friendly vehicle and method of controlling the same | |
| CN114296082A (en) | Radar controller and radar control method for vehicle | |
| US20060158322A1 (en) | Wireless anti-lockout system | |
| EP4361986A1 (en) | Rear seat passenger notification device and a method therefor | |
| US12620295B2 (en) | Rear seat passenger notification device and a method therefor | |
| US11915574B2 (en) | Alert system to output alert about occupant left in vehicle | |
| ElNashar et al. | Analysis of data from software sensor for smart airbags deployment | |
| CN115841586A (en) | Seat occupancy classification system for a vehicle | |
| US11348346B2 (en) | Control apparatus | |
| KR102297067B1 (en) | method for controlling power sliding doors of vehicles | |
| KR20180136790A (en) | System and method for protecting passenger | |
| CN118728190A (en) | Vehicle door lock control method, device, controller, vehicle and storage medium | |
| US12296646B2 (en) | Vehicle control apparatus for safety of a vehicle occupant, a vehicle system including the same and method thereof | |
| JP7275409B2 (en) | Occupant state determination device and occupant state determination method | |
| CN112744169B (en) | Automobile control device and automobile safety protection method | |
| CN115802933A (en) | Equipment for analyzing the passenger compartment of a vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20241015 |
|
| RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Free format text: CASE NUMBER: APP_3823/2025 Effective date: 20250123 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20250414 |