WO2021010524A1 - Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule - Google Patents

Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule Download PDF

Info

Publication number
WO2021010524A1
WO2021010524A1 PCT/KR2019/008853 KR2019008853W WO2021010524A1 WO 2021010524 A1 WO2021010524 A1 WO 2021010524A1 KR 2019008853 W KR2019008853 W KR 2019008853W WO 2021010524 A1 WO2021010524 A1 WO 2021010524A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
processor
information
display
outsider
Prior art date
Application number
PCT/KR2019/008853
Other languages
English (en)
Korean (ko)
Inventor
이경하
황인영
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to PCT/KR2019/008853 priority Critical patent/WO2021010524A1/fr
Priority to US16/635,897 priority patent/US11584397B2/en
Priority to KR1020190106851A priority patent/KR20190107278A/ko
Publication of WO2021010524A1 publication Critical patent/WO2021010524A1/fr

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18Propelling the vehicle
    • B60W30/18009Propelling the vehicle related to particular drive situations
    • B60W30/181Preparing for stopping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80Arrangements for controlling instruments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/34Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating change of drive direction
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/50Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/50Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
    • B60Q1/507Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking specific to autonomous vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/10Interpretation of driver requests or demands
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/001Planning or execution of driving tasks
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00Drive control systems specially adapted for autonomous road vehicles
    • B60W60/001Planning or execution of driving tasks
    • B60W60/0025Planning or execution of driving tasks specially adapted for specific operations
    • B60W60/00253Taxi operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/133Multidirectional input devices for instruments
    • B60K2360/137Jog-dials
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143Touch sensitive instrument input devices
    • B60K2360/1446Touch switches
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146Instrument input by gesture
    • B60K2360/14643D-gesture
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/168Target or limit values
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55Remote control arrangements
    • B60K2360/56Remote control arrangements using mobile devices
    • B60K2360/566Mobile devices displaying vehicle information
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55Remote control arrangements
    • B60K2360/56Remote control arrangements using mobile devices
    • B60K2360/573Mobile devices controlling vehicle functions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77Instrument locations other than the dashboard
    • B60K2360/797Instrument locations other than the dashboard at the vehicle exterior
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60Instruments characterised by their location or relative disposition in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/30Indexing codes relating to the vehicle environment
    • B60Q2300/33Driving situation
    • B60Q2300/331Driving situation characterised by the driving side, e.g. on the left or right hand side
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2800/00Features related to particular types of vehicles not otherwise provided for
    • B60Q2800/10Autonomous vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2800/00Features related to particular types of vehicles not otherwise provided for
    • B60Q2800/30Mass transport vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics
    • B60W2520/04Vehicle stop
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/041Potential occupants
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/223Posture, e.g. hand, foot, or seat position, turned or inclined
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60YINDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
    • B60Y2300/00Purposes or special features of road vehicle drive control systems
    • B60Y2300/14Cruise control
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60YINDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
    • B60Y2300/00Purposes or special features of road vehicle drive control systems
    • B60Y2300/18Propelling the vehicle
    • B60Y2300/18008Propelling the vehicle related to particular drive situations
    • B60Y2300/18091Preparing for stopping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person

Definitions

  • the present invention relates to an electronic device for a vehicle and a method of operating the electronic device for a vehicle.
  • a vehicle is a device that moves in a direction desired by a boarding user.
  • a typical example is a car.
  • Autonomous vehicle refers to a vehicle that can be driven automatically without human driving operation.
  • an object of the present invention is to provide an electronic device for a vehicle that generates a control signal for stopping a vehicle by determining the intention to board an outsider detected from image data.
  • Another object of the present invention is to provide a method of operating an electronic device for a vehicle that generates a control signal for stopping a vehicle by determining the intention to board an outsider detected from image data.
  • the electronic device for a vehicle acquires image data acquired by a camera provided in the vehicle, and based on the position, posture, and gesture of an outsider detected from the image data And a processor that determines the intention to board the outsider and generates a control signal for stopping the vehicle based on the intention to board the vehicle.
  • a method of operating an electronic device for a vehicle may include: obtaining, by at least one processor, image data acquired by a camera provided in the vehicle; Determining, by at least one processor, an intention to board the outsider based on the location, posture, and gesture of the outsider detected from the image data; And generating, by at least one processor, a control signal for stopping the vehicle based on the intention to board.
  • FIG. 1 is a view showing a vehicle according to an embodiment of the present invention.
  • FIG. 2 is a view showing the interior of a vehicle according to an embodiment of the present invention.
  • FIG. 3 is a block diagram referenced to explain a vehicle cabin system according to an embodiment of the present invention.
  • 4A to 4C are views referenced for describing an input device according to an embodiment of the present invention.
  • FIG. 5 is a diagram referenced for describing a communication operation between a communication device and a mobile terminal according to an embodiment of the present invention.
  • FIG. 6 is a diagram referenced to describe a display system according to an embodiment of the present invention.
  • FIG. 7 is a diagram referenced to describe a cargo system according to an embodiment of the present invention.
  • FIG. 8 is a view referred to for explaining a seat system according to an embodiment of the present invention.
  • FIG. 9 is a diagram referenced to describe a payment system according to an embodiment of the present invention.
  • FIG. 10 is a diagram referenced to explain a usage scenario of a user according to an embodiment of the present invention.
  • FIG. 11 is a control block diagram of a vehicle according to an embodiment of the present invention.
  • FIG. 12 is a block diagram of a system according to an embodiment of the present invention.
  • FIG. 13 is a control block diagram of an electronic device for a vehicle according to an embodiment of the present invention.
  • FIG. 14 is a flowchart of an electronic device for a vehicle according to an embodiment of the present invention.
  • 15 is a flowchart of an electronic device for a vehicle according to an exemplary embodiment of the present invention.
  • 16 is a diagram referenced to describe an external display provided in a vehicle according to an embodiment of the present invention.
  • 17 is a flow chart of an electronic device for a vehicle according to an embodiment of the present invention.
  • 19 is a diagram referred to for explaining an outsider according to an embodiment of the present invention.
  • 20 is a diagram referenced for describing an operation of an electronic device for a vehicle when there are a plurality of outsiders according to an embodiment of the present invention.
  • 21A to 21B are views referenced for describing a boarding request group according to an embodiment of the present invention.
  • 22 to 23 are views referenced for explaining an operation of an electronic device for a vehicle that controls a plurality of vehicles according to an exemplary embodiment of the present invention.
  • 24 to 27 are views referenced for describing an operation of calling a vehicle using a personal terminal according to an embodiment of the present invention.
  • FIG. 1 is a view showing a vehicle according to an embodiment of the present invention.
  • a vehicle 10 is defined as a means of transport running on a road or track.
  • the vehicle 10 is a concept including a car, a train, and a motorcycle.
  • the vehicle 10 may be a concept including both an internal combustion engine vehicle including an engine as a power source, a hybrid vehicle including an engine and an electric motor as a power source, and an electric vehicle including an electric motor as a power source.
  • the vehicle 10 may be a shared vehicle.
  • the vehicle 10 may be an autonomous vehicle.
  • the electronic device 100 may be included in the vehicle 10.
  • the vehicle 10 may interact with at least one robot.
  • the robot may be an Autonomous Mobile Robot (AMR) capable of driving by magnetic force.
  • AMR Autonomous Mobile Robot
  • the mobile robot is capable of moving by itself and is free to move, and is provided with a plurality of sensors to avoid obstacles while driving, so that it can travel avoiding obstacles.
  • the mobile robot may be a flying robot (eg, a drone) having a flying device.
  • the mobile robot may be a wheel-type robot that includes at least one wheel and is moved through rotation of the wheel.
  • the mobile robot may be a legged robot that has at least one leg and is moved using the leg.
  • the robot may function as a device that complements the user's convenience of the vehicle 10. For example, the robot may perform a function of moving the luggage loaded in the vehicle 10 to the user's final destination. For example, the robot may perform a function of guiding a user who gets off the vehicle 10 to a final destination. For example, the robot may perform a function of transporting a user who gets off the vehicle 10 to a final destination.
  • At least one electronic device included in the vehicle may communicate with the robot through the communication device 220.
  • At least one electronic device included in the vehicle may provide the robot with data processed by at least one electronic device included in the vehicle.
  • at least one electronic device included in the vehicle may provide at least one of object data, HD map data, vehicle state data, vehicle location data, and driving plan data to the robot.
  • At least one electronic device included in the vehicle may receive data processed by the robot from the robot. At least one electronic device included in the vehicle may receive at least one of sensing data, object data, robot state data, robot position data, and movement plan data of the robot generated by the robot.
  • At least one electronic device included in the vehicle may generate a control signal further based on data received from the robot. For example, at least one electronic device included in the vehicle compares the information on the object generated by the object detection device 210 with the information on the object generated by the robot, and based on the comparison result, a control signal Can be created. At least one electronic device included in the vehicle may generate a control signal so that interference between the movement path of the vehicle 10 and the movement path of the robot does not occur.
  • At least one electronic device included in the vehicle may include a software module or a hardware module (hereinafter, referred to as an artificial intelligence module) that implements artificial intelligence (AI). At least one electronic device included in the vehicle may input acquired data to an artificial intelligence module and use data output from the artificial intelligence module.
  • an artificial intelligence module that implements artificial intelligence (AI).
  • At least one electronic device included in the vehicle may input acquired data to an artificial intelligence module and use data output from the artificial intelligence module.
  • the artificial intelligence module may perform machine learning on input data using at least one artificial neural network (ANN).
  • ANN artificial neural network
  • the artificial intelligence module may output driving plan data through machine learning on input data.
  • At least one electronic device included in the vehicle may generate a control signal based on data output from the artificial intelligence module.
  • At least one electronic device included in the vehicle may receive data processed by artificial intelligence from an external device through the communication device 220. At least one electronic device included in the vehicle may generate a control signal based on data processed by artificial intelligence.
  • FIG. 2 is a view showing the interior of a vehicle according to an embodiment of the present invention.
  • FIG. 3 is a block diagram referenced to explain a vehicle cabin system according to an embodiment of the present invention.
  • 4A to 4C are views referenced for describing an input device according to an embodiment of the present invention.
  • FIG. 5 is a diagram referenced for describing a communication operation between a communication device and a mobile terminal according to an embodiment of the present invention.
  • FIG. 6 is a diagram referenced to describe a display system according to an embodiment of the present invention.
  • FIG. 7 is a diagram referenced to describe a cargo system according to an embodiment of the present invention.
  • FIG. 8 is a view referred to for explaining a seat system according to an embodiment of the present invention.
  • FIG. 9 is a diagram referenced to describe a payment system according to an embodiment of the present invention.
  • a vehicle cabin system 100 (hereinafter, a cabin system) may be defined as a convenience system for a user who uses the vehicle 10.
  • the cabin system 100 may be described as a top-level system including a display system 400, a cargo system 500, a seat system 600, and a payment system 700.
  • the cabin system 100 includes a main controller 170, a memory 175, an interface unit 180, a power supply unit 190, an input device 200, an imaging device 250, a communication device 300, and a display system. 400, an audio output unit 490, a cargo system 500, a seat system 600, and a payment system 700.
  • the cabin system 100 may further include other components in addition to the components described herein, or may not include some of the described components.
  • the main controller 170 is electrically connected to the input device 200, the communication device 300, the display system 400, the cargo system 500, the seat system 600, and the payment system 700 to exchange signals. can do.
  • the main controller 170 may control the input device 200, the communication device 300, the display system 400, the cargo system 500, the seat system 600, and the payment system 700.
  • the main controller 170 includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, It may be implemented using at least one of controllers, micro-controllers, microprocessors, and electrical units for performing other functions.
  • the main controller 170 may be configured with at least one sub-controller. Depending on the embodiment, the main controller 170 may include a plurality of sub-controllers. Each of the plurality of sub-controllers may individually control the devices and systems included in the grouped cabin system 100. Devices and systems included in the cabin system 100 may be grouped by function or may be grouped based on seatable seats.
  • the main controller 171 may include at least one processor 171. 3 illustrates that the main controller 171 includes one processor 171, the main controller 171 may also include a plurality of processors.
  • the processor 171 may be classified as one of the above-described sub-controllers.
  • the processor 171 may obtain first information about a first user and second information about a second user through the communication device 300.
  • the first mobile terminal of the first user may transmit the first information to the cabin system 100.
  • the second mobile terminal of the second user may transmit the second information to the cabin system 100.
  • the communication device 300 may receive and provide the first information and the second information to the processor 171.
  • the processor 171 may specify each of the first user and the second user based on image data received from at least one of the internal camera 251 and the external camera 252.
  • the processor 171 may specify a first user and a second user by applying an image processing algorithm to the image data.
  • the processor 171 may compare the first information and the second information with the image data to specify the first user and the second user.
  • the first information may include at least one of route information, body information, passenger information, luggage information, location information, preferred content information, preferred food information, disabled information, and usage history information of the first user.
  • the second information includes at least one of route information, body information, passenger information, luggage information, location information, preferred content information, preferred food information, disabled information, and usage history information of the second user.
  • the processor 171 may provide a control signal to at least one of a display and a speaker so that content is provided to a user based on an electrical signal generated by the input device 200.
  • the processor 171 may determine a first boarding seat of the first user among a plurality of seats according to the first information.
  • the processor 171 may determine the posture of the first boarding seat according to the first information.
  • the processor 171 may determine a second boarding seat of the second user among the plurality of seats according to the second information.
  • the processor 171 may determine the posture of the second boarding seat according to the second information.
  • the processor 171 includes a communication device 300, an internal camera 251, an external camera 252, an input device 200, a display of the display system 400, a speaker of the sound output unit 490, and a cargo system ( 500), a service charge may be determined based on an electrical signal received from at least one of a plurality of seats of the seat system 600.
  • the processor 171 may provide a signal to the payment system 700 so that the determined service charge is charged.
  • the main controller 170 may include an artificial intelligence agent 172.
  • the artificial intelligence agent 172 may perform machine learning based on data acquired through the input device 200.
  • the artificial intelligence agent 172 is based on the machine learning result, at least one of the display system 400, the sound output unit 490, the cargo system 500, the seat system 600, and the payment system 700 Can be controlled.
  • the main controller 170 may be understood as an electronic device for a vehicle.
  • the electronic device 170 may include an interface unit and a processor 171.
  • the interface unit of the electronic device 170 includes a communication device 300 for exchanging signals with an external device, at least one internal camera 251 for photographing an image inside the cabin, and at least one external camera 252 for photographing an image outside the vehicle. ), an input device 200 for converting a user input into an electrical signal, at least one display for outputting visual content, at least one speaker for outputting audio content, and a plurality of seats each of which a plurality of users can sit d You can exchange signals with at least one of them.
  • the processor 171 of the electronic device 170 acquires first information about a first user and second information about a second user through the communication device, and from at least one of the internal camera and the external camera. Based on the received image data, each of the first user and the second user is specified, and content is provided to the user based on an electrical signal generated by the input device to at least one of the display and the speaker. Provides a control signal, determines a first boarding seat of the first user among the plurality of seats according to the first information, and a second boarding seat of the second user among the plurality of seats according to the second information Is determined, a posture of the first boarding seat may be determined according to the first information, and a posture of the second boarding seat may be set according to the second information.
  • the memory 175 is electrically connected to the main controller 170.
  • the memory 175 may store basic data for a unit, control data for operation control of the unit, and input/output data.
  • the memory 175 may store data processed by the main controller 170.
  • the memory 175 may be configured with at least one of ROM, RAM, EPROM, flash drive, and hard drive.
  • the memory 175 may store various data for overall operation of the cabin system 100, such as a program for processing or controlling the main controller 170.
  • the memory 175 may be implemented integrally with the main controller 170.
  • the interface unit 180 may exchange signals with at least one electronic device provided in the vehicle 10 by wire or wirelessly.
  • the interface unit 180 may be configured with at least one of a communication module, a terminal, a pin, a cable, a port, a circuit, an element, and a device.
  • the power supply unit 190 may supply power to the cabin system 100.
  • the power supply unit 190 may receive power from a power source (eg, a battery) included in the vehicle 10 and supply power to each unit of the cabin system 100.
  • the power supply unit 190 may be operated according to a control signal provided from the main controller 170.
  • the power supply unit 190 may be implemented as a switched-mode power supply (SMPS).
  • SMPS switched-mode power supply
  • the cabin system 100 may include at least one printed circuit board (PCB).
  • PCB printed circuit board
  • the main controller 170, the memory 175, the interface unit 180, and the power supply unit 190 may be mounted on at least one printed circuit board.
  • the input device 200 may receive a user input.
  • the input device 200 may convert a user input into an electrical signal.
  • the electrical signal converted by the input device 200 is converted into a control signal, and at least one of the display system 400, the sound output unit 490, the cargo system 500, the seat system 600, and the payment system 700 Can be provided in one.
  • At least one processor included in the main controller 170 or the cabin system 100 may generate a control signal based on an electrical signal received from the input device 200.
  • the input device 200 may include at least one of a touch input unit 210, a gesture input unit 220, a mechanical input unit 230, and a voice input unit 240.
  • the touch input unit 210 may convert a user's touch input into an electrical signal.
  • the touch input unit 210 may include at least one touch sensor 211 to sense a user's touch input.
  • the touch input unit 210 may be integrally formed with at least one display included in the display system 400, thereby implementing a touch screen.
  • Such a touch screen may provide an input interface and an output interface between the cabin system 100 and a user.
  • the gesture input unit 220 may convert a user's gesture input into an electrical signal.
  • the gesture input unit 220 may include at least one of an infrared sensor 221 and an image sensor for detecting a user's gesture input.
  • the gesture input unit 220 may detect a user's 3D gesture input.
  • the gesture input unit 220 may include an optical output unit that outputs a plurality of infrared light or a plurality of image sensors.
  • the gesture input unit 220 may detect a user's 3D gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.
  • TOF time of flight
  • the mechanical input unit 230 may convert a user's physical input (eg, pressing or rotating) through the mechanical device 231 into an electrical signal.
  • the mechanical input unit 230 may include at least one of a button, a dome switch, a jog wheel, and a jog switch.
  • the gesture input unit 220 and the mechanical input unit 230 may be integrally formed.
  • the input device 200 may include a gesture sensor, and may include a jog dial device formed to be in and out of a portion of a surrounding structure (for example, at least one of a seat, an armrest, and a door). .
  • the jog dial device When the jog dial device is in a flat state with the surrounding structure, the jog dial device may function as the gesture input unit 220.
  • the jog dial device When the jog dial device protrudes compared to the surrounding structure, the jog dial device may function as a mechanical input unit 230.
  • the voice input unit 240 may convert a user's voice input into an electrical signal.
  • the voice input unit 240 may include at least one microphone 241.
  • the voice input unit 240 may include a beam foaming microphone.
  • the imaging device 250 may include at least one camera.
  • the imaging device 250 may include at least one of an internal camera 251 and an external camera 252.
  • the internal camera 251 may capture an image in the cabin.
  • the external camera 252 may capture an image outside the vehicle.
  • the internal camera 251 may acquire an image in the cabin.
  • the imaging device 250 may include at least one internal camera 251. It is preferable that the imaging device 250 includes a number of cameras 251 corresponding to the number of passengers allowed to ride.
  • the imaging device 250 may provide an image acquired by the internal camera 251.
  • At least one processor included in the main controller 170 or the cabin system 100 detects a user's motion based on the image acquired by the internal camera 251, and generates a signal based on the detected motion.
  • the external camera 252 may acquire an image outside the vehicle.
  • the imaging device 250 may include at least one internal camera 252.
  • the imaging device 250 includes a number of cameras 252 corresponding to the boarding door.
  • the imaging device 250 may provide an image acquired by the external camera 252.
  • At least one processor included in the main controller 170 or the cabin system 100 may acquire user information based on an image acquired by the external camera 252.
  • At least one processor included in the main controller 170 or the cabin system 100 may authenticate the user based on the user information, or the user's body information (eg, height information, weight information, etc.), Passenger information, user's luggage information, etc. can be obtained.
  • FIG 3 illustrates that the input device 200 is directly connected to the main controller 170, the input device 200 may be connected to the main controller 170 via the interface unit 180.
  • the communication device 300 can wirelessly exchange signals with an external device.
  • the communication device 300 may exchange signals with an external device through a network network or may directly exchange signals with an external device.
  • the external device may include at least one of a server, a mobile terminal, and another vehicle. As illustrated in FIG. 5, the communication device 300 may exchange signals with at least one mobile terminal 390.
  • the communication device 300 may include at least one of an antenna, a radio frequency (RF) circuit capable of implementing at least one communication protocol, and an RF element to perform communication. Depending on the embodiment, the communication device 300 may use a plurality of communication protocols. The communication device 300 may switch a communication protocol according to a distance from the mobile terminal.
  • RF radio frequency
  • the communication device 300 may be connected to the main controller 170 via the interface unit 180.
  • the display system 400 may display a graphic object.
  • the display system 400 may include a first display device 410 and a second display device 420.
  • the first display device 410 may include at least one display 411 that outputs visual content.
  • the display 411 included in the first display device 410 is a flat panel display. It may be implemented as at least one of a curved display, a rollable display, and a flexible display.
  • the first display device 410 may include a first display 411 positioned at the rear of a seat and formed to be in and out of a cabin, and a first mechanism for moving the first display 411.
  • the first display 411 may be disposed in a slot formed in the main frame of the sheet so as to be retractable.
  • the first display device 410 may further include a flexible area control mechanism.
  • the first display may be formed to be flexible, and the flexible area of the first display may be adjusted according to the user's position.
  • the first display device 410 may include a second display positioned on a ceiling in a cabin and formed to be rollable, and a second mechanism for winding or unwinding the second display.
  • the second display may be formed to enable screen output on both sides.
  • the first display device 410 may include a third display positioned on a ceiling in a cabin and formed to be flexible, and a third mechanism for bending or unfolding the third display.
  • the display system 400 may further include at least one processor that provides a control signal to at least one of the first display device 410 and the second display device 420.
  • the processor included in the display system 400 may generate a control signal based on a signal received from at least one of the main controller 170, the input device 200, the imaging device 250, and the communication device 300. I can.
  • the display area of the display included in the first display device 410 may be divided into a first area 411a and a second area 411b.
  • the first area 411a may define content as a display area.
  • the first area 411 may display at least one of entertainment contents (eg, movies, sports, shopping, music, etc.), video conferences, food menus, and graphic objects corresponding to the augmented reality screen. I can.
  • the first area 411a may display a graphic object corresponding to driving situation information of the vehicle 10.
  • the driving situation information may include at least one of object information outside the vehicle, navigation information, and vehicle status information.
  • the object information outside the vehicle may include information on the presence or absence of an object, location information of the object, distance information between the vehicle 100 and the object, and information on a relative speed between the vehicle 100 and the object.
  • the navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on the route, lane information, and current location information of the vehicle.
  • the vehicle status information includes vehicle attitude information, vehicle speed information, vehicle tilt information, vehicle weight information, vehicle direction information, vehicle battery information, vehicle fuel information, vehicle tire pressure information, vehicle steering information , Vehicle interior temperature information, vehicle interior humidity information, pedal position information, vehicle engine temperature information, and the like.
  • the second area 411b may be defined as a user interface area.
  • the second area 411b may output an artificial intelligence agent screen.
  • the second area 411b may be located in an area divided by a sheet frame. In this case, the user can view the content displayed in the second area 411b between the plurality of sheets.
  • the first display device 410 may provide holographic content.
  • the first display device 410 may provide holographic content for each of a plurality of users so that only a user who has requested the content can view the content.
  • the second display device 420 may include at least one display 421.
  • the second display device 420 may provide the display 421 at a location where only individual passengers can check the display contents.
  • the display 421 may be disposed on the arm rest of the seat.
  • the second display device 420 may display a graphic object corresponding to the user's personal information.
  • the second display device 420 may include a number of displays 421 corresponding to the number of persons allowed to ride.
  • the second display device 420 may implement a touch screen by forming a layer structure or integrally with the touch sensor.
  • the second display device 420 may display a graphic object for receiving a user input for seat adjustment or room temperature adjustment.
  • the display system 400 may be connected to the main controller 170 via the interface unit 180.
  • the sound output unit 490 may convert an electrical signal into an audio signal.
  • the sound output unit 490 may include at least one speaker that outputs auditory content.
  • the sound output unit 490 may include a plurality of speakers provided for each seat that can be boarded.
  • the cargo system 500 may provide a product to a user according to a user's request.
  • the cargo system 500 may be operated based on an electrical signal generated by the input device 200 or the communication device 300.
  • the cargo system 500 may include a cargo box.
  • the cargo box may be concealed in a portion of the lower portion of the seat while the goods are loaded.
  • the cargo box may be exposed as a cabin.
  • the user can select a necessary product among the items loaded in the exposed cargo box.
  • the cargo system 500 may include a sliding moving mechanism and a product pop-up mechanism to expose a cargo box according to a user input.
  • the cargo system 500 may include a plurality of cargo boxes to provide various types of goods.
  • a weight sensor for determining whether to be provided for each product may be built into the cargo box.
  • the cargo system 500 is directly connected to the main controller 170, the cargo system 500 may be connected to the main controller 170 via the interface unit 180.
  • the sheet system 600 may provide a user with a customized sheet to the user.
  • the sheet system 600 may be operated based on an electrical signal generated by the input device 200 or the communication device 300.
  • the seat system 600 may adjust at least one element of the seat based on the acquired user body data.
  • the seat system 600 may include a user detection sensor (eg, a pressure sensor) for determining whether the user is seated.
  • the seat system 600 may include a plurality of seats each of which a plurality of users can seat. Any one of the plurality of sheets may be disposed to face at least the other. At least two users inside the cabin may sit facing each other.
  • FIG 3 illustrates that the seat system 600 is directly connected to the main controller 170, the seat system 600 may be connected to the main controller 170 via the interface unit 180.
  • the payment system 700 may provide a payment service to a user.
  • the payment system 700 may be operated based on an electrical signal generated by the input device 200 or the communication device 300.
  • the payment system 700 may calculate a price for at least one service used by the user and request that the calculated price be paid.
  • the payment system 700 may be connected to the main controller 170 via the interface unit 180.
  • the cabin system 100 may further include a mobile terminal 390 as a component.
  • FIG. 10 is a diagram referenced to explain a usage scenario of a user according to an embodiment of the present invention.
  • the first scenario S111 is a user's destination prediction scenario.
  • the mobile terminal 390 may install an application capable of interworking with the cabin system 100.
  • the mobile terminal 390 may predict a user's destination through an application, based on user's contextual information.
  • the mobile terminal 390 may provide information on empty seats in the cabin through an application.
  • the second scenario S112 is a cabin interior layout preparation scenario.
  • the cabin system 100 may further include a scanning device for acquiring data on a user located outside the vehicle 100.
  • the scanning device may scan the user to obtain body data and baggage data of the user.
  • the user's body data and baggage data can be used to set the layout.
  • the user's body data may be used for user authentication.
  • the scanning device may include at least one image sensor.
  • the image sensor may acquire a user image by using light in the visible or infrared band.
  • the seat system 600 may set a layout in the cabin based on at least one of the user's body data and baggage data.
  • the seat system 600 may provide a luggage storage space or a car seat installation space.
  • the third scenario S113 is a user welcome scenario.
  • the cabin system 100 may further include at least one guide light.
  • the guide light may be disposed on the floor in the cabin.
  • the cabin system 100 may output a guide light to allow the user to sit on a preset seat among a plurality of seats.
  • the main controller 170 may implement a moving light by sequentially lighting a plurality of light sources over time from an opened door to a preset user seat.
  • the fourth scenario S114 is a seat adjustment service scenario.
  • the seat system 600 may adjust at least one element of a seat matching the user based on the acquired body information.
  • the fifth scenario S115 is a personal content providing scenario.
  • the display system 400 may receive user personal data through the input device 200 or the communication device 300.
  • the display system 400 may provide content corresponding to user personal data.
  • the sixth scenario S116 is a product provision scenario.
  • the cargo system 500 may receive user data through the input device 200 or the communication device 300.
  • the user data may include user preference data and user destination data.
  • the cargo system 500 may provide products based on user data.
  • the seventh scenario S117 is a payment scenario.
  • the payment system 700 may receive data for price calculation from at least one of the input device 200, the communication device 300, and the cargo system 500.
  • the payment system 700 may calculate a vehicle usage price of the user based on the received data.
  • the payment system 700 may request payment from a user (eg, a user's mobile terminal) at the calculated price.
  • the eighth scenario S118 is a user's display system control scenario.
  • the input device 200 may receive a user input in at least one form and convert it into an electrical signal.
  • the display system 400 may control displayed content based on an electrical signal.
  • the ninth scenario S119 is a multi-channel artificial intelligence (AI) agent scenario for a plurality of users.
  • the artificial intelligence agent 172 may classify a user input for each of a plurality of users.
  • the artificial intelligence agent 172 includes a display system 400, an audio output unit 490, a cargo system 500, a seat system 600, and a payment system based on an electrical signal converted from a plurality of individual user inputs. At least one of 700 can be controlled.
  • a tenth scenario S120 is a scenario for providing multimedia contents targeting a plurality of users.
  • the display system 400 may provide content that all users can watch together.
  • the sound output unit 490 may individually provide the same sound to a plurality of users through speakers provided for each sheet.
  • the display system 400 may provide content that can be individually viewed by a plurality of users.
  • the sound output unit 490 may provide individual sounds through speakers provided for each sheet.
  • the eleventh scenario S121 is a user safety security scenario.
  • the main controller 170 controls to output an alarm for objects around the vehicle through at least one of the display system 400 and the sound output unit 490 can do.
  • a twelfth scenario is a scenario for preventing loss of belongings of a user.
  • the main controller 170 may obtain data on the user's belongings through the input device 200.
  • the main controller 170 may acquire motion data of a user through the input device 200.
  • the main controller 170 may determine whether the user leaves the belongings and alights based on the data and movement data on the belongings.
  • the main controller 170 may control an alarm for belongings to be output based on at least one of the display system 400 and the sound output unit 490.
  • the thirteenth scenario S123 is a getting off report scenario.
  • the main controller 170 may receive a user's getting off data through the input device 200. After getting off the user, the main controller 170 may provide report data according to the getting off to the user's mobile terminal through the communication device 300.
  • the report data may include data on the total usage fee of the vehicle 10.
  • FIG. 11 is a control block diagram of a vehicle according to an embodiment of the present invention.
  • the vehicle 10 includes an electronic device 900 for a vehicle, a user interface device 800, an object detection device 810, a communication device 820, a driving operation device 830, and a main ECU 840. ), a vehicle driving device 850, a driving system 860, a sensing unit 870, and a location data generating device 880.
  • the vehicle electronic device 900 may generate a control signal for stopping the vehicle by determining an intention to board an outsider detected from the image data.
  • the vehicle electronic device 900 may be a component included in the vehicle 10, as illustrated in FIG. 11. In this case, the vehicle electronic device 900 may exchange signals with other electronic devices inside the vehicle 10 using the internal communication system 50.
  • the user interface device 800 is a device for communicating with the vehicle 10 and a user.
  • the user interface device 800 may receive a user input and provide the user with information generated in the vehicle 10.
  • the vehicle 10 may implement a user interface (UI) or a user experience (UX) through the user interface device 800.
  • the user interface device 800 may be implemented as a display device mounted on the vehicle 10, a head up display (HUD) device, a window display device, a cluster device, or the like.
  • the user interface device 800 may include an input device, an output device, and a user monitoring device.
  • the user interface device 800 may include an input device such as a touch input device, a mechanical input device, a voice input device, and a gesture input device.
  • the user interface device 800 may include an output device such as a speaker, a display, and a haptic module.
  • the user interface device 800 may include a user monitoring device such as a driver monitoring system (DMS) and an internal monitoring system (IMS).
  • DMS driver monitoring system
  • the user interface device 800 includes an input device 200, an image device 250, a display system 400, an audio output unit 490, a cargo system 500, a seat system 600, and a payment system ( 700) may include at least one of.
  • the object detection device 810 may detect an object outside the vehicle 10.
  • the object detection apparatus 810 may include at least one sensor capable of detecting an object outside the vehicle 10.
  • the object detection apparatus 810 may include at least one of a camera, a radar, a lidar, an ultrasonic sensor, and an infrared sensor.
  • the object detection device 810 may provide data on an object generated based on a sensing signal generated by a sensor to at least one electronic device included in the vehicle.
  • the camera may generate information on an object outside the vehicle 10 by using the image.
  • the camera may include at least one lens, at least one image sensor, and at least one processor that is electrically connected to the image sensor and processes a received signal, and generates data about an object based on the processed signal.
  • the camera may be at least one of a mono camera, a stereo camera, and an AVM (Around View Monitoring) camera.
  • the camera may use various image processing algorithms to obtain position information of an object, distance information to an object, or information on a relative speed to an object. For example, from the acquired image, the camera may acquire distance information and relative speed information from the object based on a change in the size of the object over time. For example, the camera may obtain distance information and relative speed information with an object through a pin hole model, road surface profiling, or the like. For example, the camera may obtain distance information and relative speed information with an object based on disparity information from a stereo image obtained from a stereo camera.
  • the camera may be mounted in a position where field of view (FOV) can be secured in the vehicle to photograph the outside of the vehicle.
  • the camera may be placed in the interior of the vehicle, close to the front windshield, to acquire an image of the front of the vehicle.
  • the camera can be placed around the front bumper or radiator grille.
  • the camera may be placed in the interior of the vehicle, close to the rear glass, in order to acquire an image of the rear of the vehicle.
  • the camera can be placed around the rear bumper, trunk or tailgate.
  • the camera may be disposed in proximity to at least one of the side windows in the interior of the vehicle in order to acquire an image of the side of the vehicle.
  • the camera may be disposed around a side mirror, a fender, or a door.
  • the radar may generate information on an object outside the vehicle 10 using radio waves.
  • the radar may include at least one processor that is electrically connected to the electromagnetic wave transmitter, the electromagnetic wave receiver, and the electromagnetic wave transmitter and the electromagnetic wave receiver, processes a received signal, and generates data for an object based on the processed signal.
  • the radar may be implemented in a pulse radar method or a continuous wave radar method according to the principle of radio wave emission.
  • the radar may be implemented in a frequency modulated continuous wave (FMCW) method or a frequency shift keyong (FSK) method according to a signal waveform among continuous wave radar methods.
  • FMCW frequency modulated continuous wave
  • FSK frequency shift keyong
  • the radar detects an object by means of an electromagnetic wave, a time of flight (TOF) method or a phase-shift method, and detects the position of the detected object, the distance to the detected object, and the relative speed.
  • TOF time of flight
  • the radar may be placed at a suitable location outside of the vehicle to detect objects located in front, rear or side of the vehicle.
  • the lidar may generate information on an object outside the vehicle 10 using laser light.
  • the radar may include at least one processor that is electrically connected to the optical transmitter, the optical receiver, and the optical transmitter and the optical receiver, processes a received signal, and generates data for an object based on the processed signal. .
  • the rider may be implemented in a TOF (Time of Flight) method or a phase-shift method.
  • the lidar can be implemented either driven or non-driven. When implemented as a drive type, the lidar is rotated by a motor, and objects around the vehicle 10 can be detected. When implemented in a non-driven manner, the lidar can detect an object located within a predetermined range with respect to the vehicle by optical steering.
  • the vehicle 900 may include a plurality of non-driving lidars.
  • the radar detects an object based on a time of flight (TOF) method or a phase-shift method by means of a laser light, and determines the position of the detected object, the distance to the detected object, and the relative speed. Can be detected.
  • the lidar may be placed at an appropriate location outside the vehicle to detect objects located in front, rear or side of the vehicle.
  • the communication device 820 may exchange signals with devices located outside the vehicle 10.
  • the communication device 820 may exchange signals with at least one of an infrastructure (eg, a server, a broadcasting station) and another vehicle.
  • the communication device 820 may include at least one of a transmission antenna, a reception antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.
  • RF radio frequency
  • the communication device 820 may communicate with a device located outside the vehicle 10 using a 5G (for example, new radio (NR)) method.
  • the communication device 820 may implement V2X (V2V, V2D, V2P, V2N) communication using a 5G method.
  • V2X V2V, V2D, V2P, V2N
  • the communication device 820 may include the communication device 300 described with reference to FIGS. 2 to 10.
  • the driving operation device 830 is a device that receives a user input for driving. In the case of the manual mode, the vehicle 10 may be driven based on a signal provided by the driving operation device 830.
  • the driving operation device 830 may include a steering input device (eg, a steering wheel), an acceleration input device (eg, an accelerator pedal), and a brake input device (eg, a brake pedal).
  • the main ECU 840 may control the overall operation of at least one electronic device provided in the vehicle 10.
  • the drive control device 850 is a device that electrically controls various vehicle drive devices in the vehicle 10.
  • the drive control device 850 may include a power train drive control device, a chassis drive control device, a door/window drive control device, a safety device drive control device, a lamp drive control device, and an air conditioning drive control device.
  • the power train drive control device may include a power source drive control device and a transmission drive control device.
  • the chassis drive control device may include a steering drive control device, a brake drive control device, and a suspension drive control device.
  • the safety device driving control device may include a safety belt driving control device for controlling the safety belt.
  • the vehicle drive control device 850 may be referred to as a control Electronic Control Unit (ECU).
  • ECU control Electronic Control Unit
  • the driving system 860 may control the movement of the vehicle 10 or generate a signal for outputting information to a user based on data on an object received by the object detection apparatus 810.
  • the driving system 860 may provide the generated signal to at least one of the user interface device 800, the main ECU 840, and the vehicle driving device 850.
  • the driving system 860 may be a concept including ADAS.
  • ADAS 860 includes an adaptive cruise control system (ACC), an automatic emergency braking system (AEB), a forward collision warning system (FCW), and a lane maintenance assistance system (LKA: Lane Keeping Assist), Lane Change Assist (LCA), Target Following Assist (TFA), Blind Spot Detection (BSD), Adaptive High Beam Control System (HBA: High) Beam Assist), Auto Parking System (APS), PD collision warning system, Traffic Sign Recognition (TSR), Traffic Sign Assist (TSA), At least one of a night vision system (NV: Night Vision), a driver status monitoring system (DSM), and a traffic jam assistance system (TJA) may be implemented.
  • ACC adaptive cruise control system
  • AEB automatic emergency braking system
  • FCW forward collision warning system
  • LKA Lane Keeping Assist
  • Lane Change Assist LCA
  • TFA Target Following Assist
  • BSD Blind Spot Detection
  • the driving system 860 may include an autonomous driving Electronic Control Unit (ECU).
  • the autonomous driving ECU may set an autonomous driving route based on data received from at least one of other electronic devices in the vehicle 10.
  • the autonomous driving ECU is based on data received from at least one of the user interface device 800, the object detection device 810, the communication device 820, the sensing unit 870, and the location data generating device 880, You can set an autonomous driving route.
  • the autonomous driving ECU may generate a control signal so that the vehicle 10 travels along the autonomous driving path.
  • the control signal generated by the autonomous driving ECU may be provided to at least one of the main ECU 840 and the vehicle driving device 850.
  • the sensing unit 870 may sense the state of the vehicle.
  • the sensing unit 870 includes an inertial navigation unit (IMU) sensor, a collision sensor, a wheel sensor, a speed sensor, a tilt sensor, a weight detection sensor, a heading sensor, a position module, and a vehicle.
  • IMU inertial navigation unit
  • a collision sensor a wheel sensor
  • a speed sensor a speed sensor
  • a tilt sensor a weight detection sensor
  • a heading sensor a position module
  • a vehicle At least one of forward/reverse sensor, battery sensor, fuel sensor, tire sensor, steering sensor by steering wheel rotation, vehicle interior temperature sensor, vehicle interior humidity sensor, ultrasonic sensor, illuminance sensor, accelerator pedal position sensor, and brake pedal position sensor It may include.
  • the inertial navigation unit (IMU) sensor may include one or more of an acceleration sensor, a gyro sensor, and a magnetic sensor.
  • the sensing unit 870 may generate state data of the vehicle based on a signal generated by at least one sensor.
  • the sensing unit 870 includes vehicle attitude information, vehicle motion information, vehicle yaw information, vehicle roll information, vehicle pitch information, vehicle collision information, vehicle direction information, vehicle angle information, and vehicle speed.
  • the sensing unit 870 includes an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor. (TPS), a TDC sensor, a crank angle sensor (CAS), and the like may be further included.
  • the sensing unit 870 may generate vehicle state information based on the sensing data.
  • the vehicle status information may be information generated based on data sensed by various sensors provided inside the vehicle.
  • the vehicle status information includes vehicle attitude information, vehicle speed information, vehicle tilt information, vehicle weight information, vehicle direction information, vehicle battery information, vehicle fuel information, vehicle tire pressure information, It may include vehicle steering information, vehicle interior temperature information, vehicle interior humidity information, pedal position information, vehicle engine temperature information, and the like.
  • the sensing unit may include a tension sensor.
  • the tension sensor may generate a sensing signal based on a tension state of the seat belt.
  • the location data generating device 880 may generate location data of the vehicle 10.
  • the location data generating apparatus 880 may include at least one of a Global Positioning System (GPS) and a Differential Global Positioning System (DGPS).
  • GPS Global Positioning System
  • DGPS Differential Global Positioning System
  • the location data generating apparatus 880 may generate location data of the vehicle 10 based on a signal generated by at least one of GPS and DGPS.
  • the location data generating apparatus 880 may correct the location data based on at least one of an IMU (Inertial Measurement Unit) of the sensing unit 870 and a camera of the object detection apparatus 810.
  • IMU Inertial Measurement Unit
  • the location data generating device 880 may be referred to as a location positioning device.
  • the location data generating device 880 may be referred to as a Global Navigation Satellite System (GNSS).
  • GNSS Global Navigation Satellite System
  • Vehicle 10 may include an internal communication system 50.
  • a plurality of electronic devices included in the vehicle 10 may exchange signals through the internal communication system 50.
  • the signal may contain data.
  • the internal communication system 50 may use at least one communication protocol (eg, CAN, LIN, FlexRay, MOST, Ethernet).
  • FIG. 12 is a block diagram of a system according to an embodiment of the present invention.
  • the system may include an electronic device 900 for a vehicle, a plurality of vehicles 10a and 10b, and a traffic information server 910.
  • the system 1 may further include a user terminal 920.
  • the vehicle electronic device 900 may be connected to a plurality of vehicles 10a and 10b, a traffic information server 910, and a user terminal 920 through a network to exchange signals.
  • the vehicle electronic device 900 may be referred to as a control center server.
  • the vehicle electronic device 900 may be located outside the vehicle 10, as illustrated in FIG. 12.
  • the vehicle electronic device 900 may generate a control signal and provide it to the plurality of vehicles 10a and 10b.
  • the vehicle electronic device 900 generates signals for controlling a plurality of vehicles 10a and 10b based on data received from the traffic information server 910 and a plurality of vehicles 10a and 10b, It can be provided to the vehicles 10a and 10b.
  • the vehicle electronic device 900 may generate a control signal for stopping the vehicle by determining an intention to board an outsider detected from the image data.
  • the plurality of vehicles 10a and 10b may be operated based on a signal received from the electronic device 900 for a vehicle.
  • the plurality of vehicles 10a and 10b may move or output information based on a signal received from the electronic device 900 for a vehicle.
  • Each of the plurality of vehicles 10a and 10b may include a vehicle external display, an in-vehicle DB server, and an in-vehicle sensing means.
  • the vehicle exterior display may include a front display, a rear display, a left side display, and a right side display.
  • the in-vehicle sensing means may include a GPS, an external camera and sensor, an occupant monitoring system (OMS) camera (in-vehicle camera), and a seating sensor.
  • OMS occupant monitoring system
  • the in-vehicle DB server may include a destination information DB, an outsider's gesture recognition DB, a vehicle-to-vehicle communication information DB, and a passenger seating-related DB.
  • the traffic information server 910 may collect and provide traffic information.
  • the traffic information server 910 may receive data from a device installed around a road and a plurality of vehicles 10a and 10b, and may generate traffic information by processing the received data.
  • the user terminal 920 may provide user information.
  • the user terminal 920 may provide user reservation information, user personal information, and the like.
  • FIG. 13 is a control block diagram of an electronic device for a vehicle according to an embodiment of the present invention.
  • the vehicle electronic device 900 may include a memory 940, a processor 970, and a power supply unit 990. According to an embodiment, when the vehicle electronic device 900 is located outside the vehicle 10, the vehicle electronic device 900 may include a communication device 960. According to an embodiment, when the vehicle electronic device 900 is located inside the vehicle 10, the vehicle electronic device 900 may include an interface unit 980.
  • the communication device 960 may exchange signals with a traffic information server (910 in FIG. 12), a user terminal (920 in FIG. 12), and a plurality of vehicles 10a and 10b.
  • the communication device 820 may include at least one of a transmission antenna, a reception antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.
  • RF radio frequency
  • the communication device 960 can communicate with an external device using a 5G (for example, new radio (NR)) method.
  • the communication device 820 may implement V2X (V2V, V2D, V2P, V2N) communication using a 5G method.
  • the memory 940 is electrically connected to the processor 970.
  • the memory 940 may store basic data for a unit, control data for operation control of the unit, and input/output data.
  • the memory 940 may store data processed by the processor 970.
  • the memory 940 may be configured with at least one of ROM, RAM, EPROM, flash drive, and hard drive.
  • the memory 940 may store various data for overall operation of the electronic device 900, such as a program for processing or controlling the processor 970.
  • the memory 940 may be implemented integrally with the processor 970. Depending on the embodiment, the memory 940 may be classified as a sub-element of the processor 970.
  • the interface unit 980 may exchange signals with at least one electronic device provided in the vehicle 10 by wire or wirelessly.
  • the interface unit 980 includes a user interface device (800 in FIG. 11), an object detection device (810 in FIG. 11), a communication device (820 in FIG. 11), a driving operation device (830 in FIG. 11), and a main ECU (FIG. 840 of 11), a vehicle driving device (850 of FIG. 11), a driving system (860 of FIG. 11), a sensing unit (870 of FIG. 11), and a location data generating device (880 of FIG. 11) and at least one of You can exchange signals wirelessly.
  • the interface unit 980 may be configured with at least one of a communication module, a terminal, a pin, a cable, a port, a circuit, an element, and a device.
  • the power supply unit 990 may supply power to the electronic device 900.
  • the power supply unit 990 may receive power from a power source (eg, a battery) included in the vehicle 10 and supply power to each unit of the electronic device 900.
  • the power supply unit 990 may be operated according to a control signal provided from the main ECU (840 in FIG. 11).
  • the power supply unit 990 may be implemented as a switched-mode power supply (SMPS).
  • SMPS switched-mode power supply
  • the processor 970 may be electrically connected to the memory 940, the interface unit 980, and the power supply unit 990 to exchange signals.
  • the processor 970 includes application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, and controllers. It may be implemented using at least one of (controllers), micro-controllers, microprocessors, and electrical units for performing other functions.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • processors and controllers. It may be implemented using at least one of (controllers), micro-controllers, microprocessors, and electrical units for performing other functions.
  • the processor 970 may be driven by power provided from the power supply unit 990.
  • the processor 970 may receive data, process data, generate a signal, and provide a signal while power is supplied by the power supply unit 990.
  • the processor 970 may receive information from another electronic device in the vehicle 10 through the interface unit 980.
  • the processor 970 may provide a control signal to another electronic device in the vehicle 10 through the interface unit 980.
  • the processor 970 may receive image data acquired by a camera provided in the vehicle 10. For example, when the vehicle electronic device 900 is located outside the vehicle 10, the processor 970 may receive image data through the communication device 960. For example, when the vehicle electronic device 900 is located inside the vehicle 10, the processor 970 may receive image data through the interface unit 980.
  • the processor 970 may determine the intention to board the outsider based on the location, posture, and gesture of the outsider detected from the image data. For example, the processor 970 may determine the outsider's intention to board based on a combination of the location, posture, and gesture of the outsider detected from the image data.
  • the processor 970 may determine an outsider's intention to board based on the outsider's head posture, arm posture, and trunk posture. For example, the processor 970 may determine an outsider's intention to board based on the direction in which the outsider's head is facing, the angle of the head, the shape of the outsider's arm, and the inclination of the outsider's torso.
  • the processor 970 may determine the waving gesture as a boarding request intention. For example, when the processor 970 detects a gesture waving while an outsider is located around or at the boundary of a roadway and a sidewalk, the processor 970 may determine the waving gesture as a boarding request intention. Meanwhile, the waving gesture may be described as a gesture of shaking the arm in both directions.
  • the processor 970 may generate a control signal for stopping the vehicle 10 based on the determined intention to board the vehicle 10.
  • the processor 970 is a space in which the vehicle 10 can stop around the outsider, based on the data generated by the object detection device 810. You can determine if there is.
  • the processor 970 may generate a control signal so that the vehicle 10 stops in the corresponding space.
  • the processor 970 may provide a control signal to the vehicle 10.
  • the processor 970 may select an information display display according to a driving direction of the vehicle 10 from among a plurality of external displays provided in the vehicle 10.
  • the vehicle 10 may include a plurality of displays that output a screen toward the outside in the front, rear, left and right sides.
  • the processor 970 may select a display positioned in a direction in which a vehicle can be stopped as an information display display.
  • the processor 970 may provide a signal to display information about the situation of the vehicle 10 on the information display display.
  • the information display display may display information on the situation of the vehicle 10 based on a signal received from the vehicle electronic device 900.
  • the processor 970 may provide a signal to display at least one of destination information, route information, available seat information, passenger information, and information on whether a special vehicle is present on the information display display.
  • the information display display may display at least one of destination information, route information, available seat information, passenger information, and information on whether a special vehicle is present.
  • the processor 970 may determine whether or not there is a space in which the vehicle 10 can be stopped on a driving road. When it is determined that there is no space available for stopping, the processor 970 may provide a signal to display unusable information of the vehicle 10 on the information display display.
  • the information display display may display unusable information of the vehicle 10.
  • the processor 970 may provide a signal so that content for interaction with an outsider is displayed on the information display display.
  • the information display display may display content for interaction with an outsider.
  • the processor 970 may give priority to a first outsider closest to the vehicle 10.
  • the processor 970 may select a first outsider as a priority occupant.
  • the processor 970 may generate a signal for outputting light toward a first outsider.
  • the processor 970 may provide a signal for outputting light toward a first outsider to a lamp provided in the vehicle 10.
  • the processor 970 may detect a group consisting of a plurality of outsiders. When it is determined that the interval between the plurality of external persons is less than or equal to the reference value, the processor 970 may determine the group as a boarding request group.
  • the electronic device 900 may include at least one printed circuit board (PCB).
  • the communication device 960, the memory 940, the interface unit 980, the power supply unit 990, and the processor 970 may be electrically connected to a printed circuit board.
  • FIG. 14 is a flowchart of an electronic device for a vehicle according to an embodiment of the present invention.
  • the processor 970 may select an information display display according to a driving direction of the vehicle 10 from among a plurality of external displays provided in the vehicle 10 (S1410 ).
  • the processor 970 may provide a signal to display information on the situation of the vehicle 10 on the information display display (S1420).
  • Providing a signal to display information may include providing, by the at least one processor 970, a signal to display content for interaction with an outsider on the information display display.
  • the at least one processor 970 on the information display display, includes destination information, route information, available seat information, passenger information, and information on whether a special vehicle is present. It may include providing a signal such that at least one of them is displayed.
  • the at least one processor 970 determines whether there is a stopable space of the vehicle 10 on the driving road, and the at least one processor 970 A, when it is determined that there is no space, providing a signal to display unusable information of the vehicle 10 on the information display display may be included.
  • the processor 970 may acquire image data acquired by a camera provided in the vehicle 10 (S1430).
  • the processor 970 may detect an outsider from the image data (S1430).
  • the step of detecting an outsider may include, by the processor 970, giving priority to a first outsider closest to the vehicle 10 when a plurality of outsiders are detected.
  • the step of detecting the outsider may further include generating a signal for outputting light toward the first outsider.
  • the at least one processor 970 detects a group consisting of a plurality of outsiders, and the at least one processor 970 determines that the distance between the plurality of outsiders is less than a reference value If yes, it may include determining the group as a boarding request group.
  • the processor 970 may determine the intention to board the outsider based on the location, posture, and gesture of the outsider detected from the image data (1440 ).
  • the step of determining an outsider's intention to board includes the step of determining, by the at least one processor 970, the outsider's intention to board, based on the outsider's head posture, arm posture, and trunk posture. I can.
  • Determining an outsider's intention to board (S1440), when the at least one processor 970 detects a gesture that the outsider is waving while holding a personal terminal, determining that the waving gesture as a boarding request intention I can.
  • the determining of the waving gesture as a boarding request intention may include, when the at least one processor 970 detects the waving gesture while the outsider is located near the boundary of a roadway and a sidewalk, the waving gesture is performed. It may include the step of determining that the boarding request is intended.
  • the processor 970 may generate a control signal for stopping the vehicle 10 based on the intention to board.
  • 15 is a flowchart of an electronic device for a vehicle according to an exemplary embodiment of the present invention.
  • the processor 970 may determine whether there is a passenger (S1501). For example, the processor 970 may determine whether a passenger is present, based on image data generated by an in-vehicle camera.
  • the processor 970 may generate a signal for outputting information indicating that the boarding is possible on the information output display (S1502).
  • the processor 970 may determine whether the total number of destinations is two or more (1503). When it is determined that the total number of destinations is not two or more, the processor 970 may generate a signal for outputting information indicating the destination on the information output display (S1504).
  • the processor 970 may determine whether the vehicle is full or a reserved vehicle (S1505). When the vehicle 10 is full or reserved, the processor 970 may generate a signal for outputting a full or reservation complete message on the information output display (S1506).
  • the processor 970 may determine whether the vehicle is located on a road where parking is possible (S1507). When it is determined that the vehicle 10 is not located on a road where parking and stopping is possible, the processor 970 may generate a signal for outputting a message that the vehicle 10 is unavailable on the information output display (S1508).
  • the processor 970 may generate a signal so that the vehicle 10 travels toward the destination (S1510).
  • the processor 970 may determine whether the occupant gets off the vehicle while the vehicle 10 is traveling to the destination (S1511). When it is determined that the occupant is getting off the vehicle, the processor 970 may return to step S1501 to perform an operation.
  • step S1507 when it is determined that the vehicle is located on a road where parking is possible, the processor 970 may generate a signal to sequentially output destinations or output a route road on the information display display (S1509).
  • the processor 970 may generate a signal so that the vehicle 10 travels toward the destination (S1520).
  • the processor 970 may determine the intention to board the outsider based on the location, posture, and gesture of the outsider detected from the image data (S1521).
  • the processor 970 may generate a signal to display a message for interaction with the outsider on the information display display (S1522).
  • the processor 970 may generate a signal to inform the passenger of the pickup situation of the additional passenger and the additional passenger (S1523).
  • the processor 970 may generate a signal so that the vehicle 10 approaches an outsider (S1524).
  • the processor 970 may determine whether an outsider continues to exist (S1525).
  • the processor 970 may generate a signal to move the vehicle 10 to a position where the outsider can ride (S1526).
  • the processor 970 may ask an outsider about an intention to board (S1527).
  • the processor 970 may inquire about the number of persons requesting boarding to the outsider (S1529).
  • the processor 970 may compare the number of passengers requested for boarding with the number of passengers available for boarding (S1530), and when power is not available, generate a signal for outputting a message that cannot be boarded (S1531). In this case, the processor 970 may generate a signal for requesting an allocation to another vehicle near an outsider.
  • step S1530 when it is determined that power is available for boarding, the processor 970 may open the door (S1532).
  • the processor 970 may close the door and wait (S1534).
  • the processor 970 may generate a signal to resume driving when it is determined that the passenger requesting the boarding is seated and wearing a seat belt (S1535). In this case, the processor 970 may request a new passenger to input destination information (S1536).
  • the processor 970 may perform the operation after step S1503.
  • 16 is a diagram referenced to describe an external display provided in a vehicle according to an embodiment of the present invention.
  • 17 is a flow chart of an electronic device for a vehicle according to an embodiment of the present invention.
  • the electronic device 900 for a vehicle is external to determine whether an outsider meets his/her destination and whether it is possible to board the vehicle 10 while being parked or stopped on the shoulder or running on the road. Information can be printed on the display.
  • the vehicle 10 may include a plurality of external displays 1610, 1620, 1630, and 1640.
  • the vehicle 10 includes a front display 1610 that outputs a screen toward the front of the vehicle 10, a rear display 1620 that outputs a screen toward the rear of the vehicle 10, and the vehicle 10 It may include a right-side display 1630 outputting a screen toward the right side of and a left-side display 1640 outputting a screen toward the left side of the vehicle 10.
  • the processor 970 may select an information display display from among the plurality of displays 1610, 1620, 1630, and 1640 according to the driving direction of the vehicle 10. For example, when it is determined that the vehicle 10 is moving forward, the processor 970 may select the front display 1610 as an information display display. In this case, the processor 970 may use the rear display 1620 as an advertisement display display. For example, when it is determined that the vehicle 10 is moving backward, the processor 970 may select the rear display 1620 as an information display display. In this case, the processor 970 may use the front display 1610 as an advertisement display display.
  • the processor 970 may select an information display display according to a driving criterion (eg, left traffic or right traffic) determined by laws. For example, when a law is determined for the left traffic, the processor 970 may select the left-hand display 1640 as the information display display. In this case, the processor 970 may use the right-side display 1630 as an advertisement display display. For example, when a law is determined for right-hand traffic, the processor 970 may select the right-side display 1630 as an information display display. At this time, the processor 970 may use the left-hand display 1640 as an advertisement display display display.
  • a driving criterion eg, left traffic or right traffic
  • the processor 970 may output destination information and parking availability information based on a passenger's input and road characteristics.
  • the occupant can input a destination through input using a personal terminal, voice input, and touch input through an internal display.
  • the processor 970 may variably mark a destination according to the number of destinations.
  • the processor 970 may determine whether there is a passenger (S1710). When it is determined that the passenger does not exist, a signal for outputting information indicating that the boarding state is available may be generated on the information output display (S1715).
  • the processor 970 may determine whether there are two or more total destinations (1720). If it is determined that the total number of destinations is not two or more, the processor 970 may generate a signal for outputting information indicating the destination on the information output display (S1725).
  • the processor 970 may determine whether the vehicle is full or a reserved vehicle (S1730). When the vehicle 10 is full or reserved, the processor 970 may generate a signal for outputting a full or reservation complete message on the information output display (S1735).
  • the processor 970 may determine whether the vehicle is located on a road where parking is possible (S1740). When it is determined that the processor 970 is not located on a road where parking is possible, the processor 970 may generate a signal for outputting a message that the vehicle 10 is unavailable on the information output display (S1745).
  • the processor 970 may generate a signal to sequentially output destinations or output a route road on an information output display (S1750).
  • the processor 970 may determine whether an additional ride occurs while driving (S1760). When an additional ride occurs, the processor 970 may return to step S1710.
  • the processor 970 may determine whether alighting occurs while driving (S1770). When additional disembarkation occurs, the processor 970 may return to step S1710.
  • the processor 970 may acquire internal image data from an internal camera that photographs the interior of the vehicle 10.
  • the processor 970 may detect passengers from internal image data.
  • the processor 970 may check the number of passengers and the boarding position based on the internal image data.
  • the processor 970 may generate a signal to display information on the presence or absence of passengers, number of passengers, and boarding location on the information display.
  • the processor 970 may generate a signal such that information on a provided service is output on an information display display. For example, the processor 970 may generate a signal to output information on whether the vehicle 10 is a cafe vehicle, a vehicle capable of riding a disabled person, a child vehicle, or a sports vehicle.
  • 19 is a diagram referred to for explaining an outsider according to an embodiment of the present invention.
  • the electronic device 900 for a vehicle may recognize and determine a boarding requester (an outsider) with respect to a vehicle being parked or stopped on a shoulder or traveling on a road.
  • a boarding requester an outsider
  • the processor 970 may acquire external image data from a camera that photographs the outside of the vehicle 10.
  • the processor 970 may detect an outsider from the external image data.
  • the processor 970 may detect an outsider's face 1910, an outsider's torso 1920, an outsider's arm 1930, and an outsider's gesture from the external image data.
  • the processor 970 may determine the intention to board an outsider based on at least one of an outsider's face 1910, an outsider's torso 1920, an outsider's arm 1930, and an outsider's gesture.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is a willingness to board even when the outsider's arm 1930 is stretched while being bent to a certain extent.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is a willingness to board even when the outsider's arm 1930 is stretched while being bent to a certain extent.
  • the processor 970 may determine that there is a willingness to board.
  • the processor 970 may determine that there is a willingness to board even when the outsider's arm 1930 is stretched while being bent to a certain extent.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is an intention to board.
  • the processor 970 may determine that there is a willingness to board.
  • the processor 970 may determine that there is an intention to board.
  • 20 is a diagram referenced for describing an operation of an electronic device for a vehicle when there are a plurality of outsiders according to an embodiment of the present invention.
  • the vehicle electronic device 900 may recognize and determine a boarding requester (an outsider) with respect to the vehicle 10 while parked or stopped on the shoulder or running on the road.
  • a boarding requester an outsider
  • the processor 970 may detect a plurality of outsiders 2010, 2020, and 2030 from the external image data.
  • the processor 970 may use a vehicle lamp (eg, a head lamp) to generate a signal so that light is output to an available position.
  • a vehicle lamp eg, a head lamp
  • the processor 970 may generate a signal to display information on the number of passengers and destination information on the information display after arriving at the boarding position.
  • the processor 970 may generate a signal to output information about the number of passengers and destination information as a voice.
  • the processor 970 may give priority to a first outsider closest to the vehicle 10 after the vehicle 10 arrives at the rideable position.
  • 21A to 21B are views referenced for describing a boarding request group according to an embodiment of the present invention.
  • the processor 970 may detect a first outsider 2110 from external image data.
  • the processor 970 may determine the intention to board the first outsider 2110.
  • the processor 970 may determine a second outsider 2120 located within a set distance from the first outsider 2110 as the same group as the first outsider 2110.
  • the processor 970 may determine the first outsider 2110 or the third outsider 2130 located within a set distance from the second outsider 2120 as the same group as the first outsider 2110.
  • the processor 970 may determine the first outsider 2110, the second outsider 2120, and the third outsider 2130 as the boarding request group.
  • the processor 970 may check the number of passengers on board (S2110).
  • the processor 970 may check the number of boarding people before boarding the boarding request group. If the number of passengers requested for boarding is less than the number of passengers available for boarding (S2120), the processor 970 may open the door and generate a signal to provide a boarding guide message (S2130). If the number of passengers requesting boarding is greater than the number of passengers available for boarding (S2120), a signal may be generated to provide a message not allowed to board. In this case, the processor 970 may request to place a vehicle that can be boarded nearby (S2140).
  • 22 to 23 are views referenced for explaining an operation of an electronic device for a vehicle that controls a plurality of vehicles according to an exemplary embodiment of the present invention.
  • the processor 970 may acquire external image data from a plurality of vehicles 10a and 10b.
  • the processor 970 may recognize and determine a boarding requester (an outsider) based on a plurality of image data.
  • the processor 970 may share outsider information between a plurality of vehicles.
  • the processor 970 may select any one of the first vehicle 10a and the second vehicle 10b as a boarding vehicle according to a preset criterion.
  • the processor 970 may select a vehicle with easy lane change as the boarding vehicle. Specifically, the processor 970 may select the second vehicle 10b driving in a lane closer to the outsider 2210 as the boarding vehicle.
  • the processor 970 may select a vehicle with a small number of previously boarded as the boarding vehicle.
  • the processor 970 may generate a signal to output different interaction messages for each vehicle. For example, the processor 970 may generate a signal such that the first vehicle 10a outputs an interaction message requesting to perform a first gesture. For example, the processor 970 may generate a signal so that the second vehicle 10b outputs an interaction message requesting the execution of the second gesture.
  • the processor 970 may select the first vehicle 10a as a boarding vehicle.
  • 24 to 27 are views referenced for describing an operation of calling a vehicle using a personal terminal according to an embodiment of the present invention.
  • the vehicle electronic device 900 may receive a ride request from the user terminal 920.
  • the user terminal 920 may provide an augmented reality (AR) user interface (UI).
  • the user terminal 920 may display information on the vehicle condition received from the vehicle electronic device 900 on the image.
  • the user terminal 920 may display destination information, route information, available seat information, passenger information, information on whether a special vehicle, or the like.
  • the user terminal 920 may match and display information on a vehicle situation with a vehicle.
  • the user terminal 920 may display information on the vehicle condition on or around the vehicle.
  • the user may check information on the vehicle situation and request boarding through the user terminal 920.
  • the user terminal 920 may transmit a boarding request signal based on a user input to the vehicle electronic device 900.
  • the user terminal 920 may highlight a vehicle suitable for a user's request among a plurality of vehicles in an image. For example, the user terminal 920 may highlight a vehicle having a remaining seat while matching to a destination input by the user.
  • the user may request a ride by selecting a vehicle that has been highlighted.
  • the user terminal 920 may transmit a boarding request signal based on a user input to the vehicle electronic device 900.
  • the user terminal 920 may display information on a vehicle condition when a vehicle is approaching, even if there is no vehicle in the image. In this case, the user terminal 920 may match and display information on the vehicle situation with the direction the vehicle is approaching.
  • the user when the vehicle is not visible, the user inputs a destination through the user terminal 920 and then performs a gesture of waving the user terminal 920, thereby generating a boarding request signal for the vehicle. Can be generated.
  • the user terminal 920 may transmit a boarding request signal to the vehicle electronic device 900 when a predetermined movement of the user terminal 920 is detected after a destination is input.
  • the present invention described above can be implemented as a computer-readable code in a medium on which a program is recorded.
  • the computer-readable medium includes all types of recording devices storing data that can be read by a computer system. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet).
  • the computer may include a processor or a control unit. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention concerne un dispositif électronique pour un véhicule, le véhicule électronique comprenant un processeur qui acquiert des données d'image acquises par une caméra disposée sur un véhicule, détermine l'intention d'embarquer d'une personne extérieure sur la base de la position, de la posture et des gestes de la personne extérieure qui sont détectés à partir des données d'image, et génère un signal de commande pour arrêter le véhicule en fonction de l'intention d'embarquer.
PCT/KR2019/008853 2019-07-17 2019-07-17 Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule WO2021010524A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/KR2019/008853 WO2021010524A1 (fr) 2019-07-17 2019-07-17 Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule
US16/635,897 US11584397B2 (en) 2019-07-17 2019-07-17 Electronic device for vehicle and method of operating electronic device for vehicle
KR1020190106851A KR20190107278A (ko) 2019-07-17 2019-08-29 차량용 전자 장치 및 차량용 전자 장치의 동작 방법

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2019/008853 WO2021010524A1 (fr) 2019-07-17 2019-07-17 Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule

Publications (1)

Publication Number Publication Date
WO2021010524A1 true WO2021010524A1 (fr) 2021-01-21

Family

ID=68067704

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/008853 WO2021010524A1 (fr) 2019-07-17 2019-07-17 Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule

Country Status (3)

Country Link
US (1) US11584397B2 (fr)
KR (1) KR20190107278A (fr)
WO (1) WO2021010524A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220250657A1 (en) * 2019-08-09 2022-08-11 Harman International Industries, Incorporated Autonomous vehicle interaction system
KR102176188B1 (ko) * 2020-08-07 2020-11-09 정만식 인공지능 기반의 도로 노후화 등급 판단을 위한 전자 장치 및 그 동작 방법
JP2023542753A (ja) * 2020-09-08 2023-10-11 フォーティートゥ ドット インコーポレイテッド 人工神経網を用いた走行映像に対する車両搭乗可能領域判断方法及び装置
KR20220123862A (ko) * 2021-03-02 2022-09-13 현대자동차주식회사 차량 및 그 제어 방법
US20220340176A1 (en) * 2021-04-27 2022-10-27 Ford Global Technologies, Llc Enhanced Ridehail Systems And Methods

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160167648A1 (en) * 2014-12-11 2016-06-16 Toyota Motor Engineering & Manufacturing North America, Inc. Autonomous vehicle interaction with external environment
US20170153714A1 (en) * 2016-03-03 2017-06-01 Cruise Automation, Inc. System and method for intended passenger detection
KR20170061847A (ko) * 2015-11-27 2017-06-07 엘지전자 주식회사 차량 운전 보조장치 및 이의 차량 운전 보조방법
KR20180101079A (ko) * 2017-03-03 2018-09-12 엘지전자 주식회사 자율 주행 시스템
KR20190035009A (ko) * 2017-09-25 2019-04-03 엘지전자 주식회사 보행자에 대한 정보 획득 방법 및 차량용 통신 장치

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11205240B2 (en) * 2015-12-30 2021-12-21 Waymo Llc Autonomous vehicle services
JP6458792B2 (ja) * 2016-11-04 2019-01-30 本田技研工業株式会社 車両制御システム、車両制御方法、および車両制御プログラム
US10740863B2 (en) * 2017-01-09 2020-08-11 nuTonomy Inc. Location signaling with respect to an autonomous vehicle and a rider
US10527428B1 (en) * 2017-07-19 2020-01-07 Uatc, Llc Capacity based vehicle operation
US10579788B2 (en) * 2017-08-17 2020-03-03 Waymo Llc Recognizing assigned passengers for autonomous vehicles
JP6817241B2 (ja) * 2018-02-23 2021-01-20 本田技研工業株式会社 車両乗合支援システム
WO2019165451A1 (fr) * 2018-02-26 2019-08-29 Nvidia Corporation Systèmes et procédés pour navettes, bus, taxis robotisés, covoiturage et véhicules à la demande assistés par ordinateur avec appréciation de la situation
US10604067B2 (en) * 2018-08-29 2020-03-31 Hyundai Motor Company System and method for controlling vehicle seating arrangement

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160167648A1 (en) * 2014-12-11 2016-06-16 Toyota Motor Engineering & Manufacturing North America, Inc. Autonomous vehicle interaction with external environment
KR20170061847A (ko) * 2015-11-27 2017-06-07 엘지전자 주식회사 차량 운전 보조장치 및 이의 차량 운전 보조방법
US20170153714A1 (en) * 2016-03-03 2017-06-01 Cruise Automation, Inc. System and method for intended passenger detection
KR20180101079A (ko) * 2017-03-03 2018-09-12 엘지전자 주식회사 자율 주행 시스템
KR20190035009A (ko) * 2017-09-25 2019-04-03 엘지전자 주식회사 보행자에 대한 정보 획득 방법 및 차량용 통신 장치

Also Published As

Publication number Publication date
US20220135081A1 (en) 2022-05-05
US11584397B2 (en) 2023-02-21
KR20190107278A (ko) 2019-09-19

Similar Documents

Publication Publication Date Title
WO2021010524A1 (fr) Dispositif électronique pour véhicule et procédé de fonctionnement de dispositif électronique pour véhicule
WO2017003052A1 (fr) Procédé d'assistance à la conduite de véhicule et véhicule
WO2018088651A1 (fr) Véhicule autonome et procédé de commande associé
WO2019098434A1 (fr) Dispositif de commande de véhicule embarqué et procédé de commande de véhicule
WO2020204213A1 (fr) Procédé d'interaction vocale et véhicule l'utilisant
WO2020159247A1 (fr) Dispositif de sortie d'image
WO2020105751A1 (fr) Procédé de surveillance d'occupant et dispositif associé
WO2020004767A1 (fr) Système télématique installé dans un véhicule, et procédé de commande associé
WO2019132078A1 (fr) Dispositif d'affichage embarqué
WO2020116694A1 (fr) Appareil de véhicule et procédé de commande
WO2022055006A1 (fr) Appareil de traitement d'images pour un véhicule et procédé d'affichage d'informations visuelles sur un afficheur inclus dans un véhicule
WO2020166749A1 (fr) Procédé et système pour afficher des informations à l'aide d'un véhicule
WO2022154299A1 (fr) Dispositif de fourniture de plateforme de signalisation numérique, son procédé de fonctionnement, et système comprenant un dispositif de fourniture de plateforme de signalisation numérique
WO2020235714A1 (fr) Véhicule autonome et système et procédé de commande de conduite l'utilisant
WO2017104888A1 (fr) Dispositif d'aide à la conduite de véhicule et son procédé d'aide à la conduite de véhicule
WO2021045256A1 (fr) Appareil de fourniture d'itinéraire et son procédé de fourniture d'itinéraire
WO2020213772A1 (fr) Dispositif de commande de véhicule et procédé de commande associé
WO2021040057A1 (fr) Dispositif électronique embarqué et procédé de fonctionnement de dispositif électronique embarqué
WO2020017677A1 (fr) Dispositif de diffusion d'images
WO2020145432A1 (fr) Procédé de commande d'un véhicule par un système multi-système sur puce
WO2016186319A1 (fr) Dispositif d'assistance à la conduite d'un véhicule et véhicule
WO2020159245A1 (fr) Procédé de partage d'images entre des véhicules
WO2020246627A1 (fr) Dispositif de sortie d'image
WO2020226192A1 (fr) Système et procédé de guide d'assurance pour véhicule autonome
WO2017065352A1 (fr) Appareil de fourniture de vision pour véhicule et véhicule

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19937803

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19937803

Country of ref document: EP

Kind code of ref document: A1