WO2020246627A1 - Dispositif de sortie d'image - Google Patents

Dispositif de sortie d'image Download PDF

Info

Publication number
WO2020246627A1
WO2020246627A1 PCT/KR2019/006703 KR2019006703W WO2020246627A1 WO 2020246627 A1 WO2020246627 A1 WO 2020246627A1 KR 2019006703 W KR2019006703 W KR 2019006703W WO 2020246627 A1 WO2020246627 A1 WO 2020246627A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
passenger
processor
screen
image output
Prior art date
Application number
PCT/KR2019/006703
Other languages
English (en)
Korean (ko)
Inventor
김형국
임형진
조재훈
허희정
홍윤정
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to PCT/KR2019/006703 priority Critical patent/WO2020246627A1/fr
Priority to US16/490,106 priority patent/US11383731B2/en
Priority to KR1020197019952A priority patent/KR102212777B1/ko
Publication of WO2020246627A1 publication Critical patent/WO2020246627A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/658—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the instruments being ergonomically adjustable to the user
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
    • B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
    • B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
    • B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
    • B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
    • B60N2/0224—Non-manual adjustments, e.g. with electrical operation
    • B60N2/0244—Non-manual adjustments, e.g. with electrical operation with logic circuits
    • B60N2/0272—Non-manual adjustments, e.g. with electrical operation with logic circuits using sensors or detectors for detecting the position of seat parts
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0229—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/334—Projection means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/40—Hardware adaptations for dashboards or instruments
    • B60K2360/48—Sensors
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/741—Instruments adapted for user detection
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
    • B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
    • B60R2011/0012—Seats or parts thereof
    • B60R2011/0017—Head-rests
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0881—Seat occupation; Driver or passenger presence
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/225—Direction of gaze
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Y—INDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
    • B60Y2400/00—Special features of vehicle units
    • B60Y2400/30—Sensors

Definitions

  • the present invention relates to an image output device, and more particularly, to an image output device that is mounted on a vehicle and capable of providing various types of visual information to passengers.
  • a vehicle refers to a means of transportation that can move people or luggage by using kinetic energy.
  • Representative examples of vehicles include automobiles and motorcycles.
  • the vehicle functions may be divided into a convenience function for promoting the driver's convenience, and a safety function for promoting the safety of the driver and/or pedestrian.
  • the convenience function has a development motivation related to the driver's convenience, such as giving the vehicle an infotainment (information + entertainment) function, supporting a partial autonomous driving function, or helping to secure the driver's vision such as night vision or blind spot .
  • ACC adaptive cruise control
  • SPS smart parking assist system
  • NV night vision
  • HUD head up display
  • AVM adaptive headlight system
  • AHS adaptive headlight system
  • Safety functions are technologies that ensure the safety of drivers and/or pedestrians, such as lane departure warning system (LDWS), lane keeping assist system (LKAS), and automatic emergency braking (autonomous emergency). braking, AEB) functions, etc.
  • LDWS lane departure warning system
  • LKAS lane keeping assist system
  • AEB automatic emergency braking
  • V2I Vehicle to Infrastructure
  • V2V Vehicle to Vehicle
  • V2X Vehicle to Everything
  • the vehicle is equipped with an image output device for visually providing various information to passengers.
  • the image output device includes a head-up display (HUD) that outputs information through a windshield of a vehicle or a separately provided transparent screen, and/or various displays that output information through a panel.
  • HUD head-up display
  • the video output device provides route guidance information to a destination and information on a point of interest (POI), and is developing in a direction of effectively providing various information.
  • POI point of interest
  • research on an image output device optimized for passengers in a specific seat is being conducted.
  • the present invention provides an image output device capable of providing visual information to a place the passenger is looking at, a control method thereof, and a vehicle including the same.
  • the present invention provides an image output device mounted on a vehicle.
  • the image output device may include an image output unit; And a processor configured to set a screen inside the vehicle based on the gaze of a passenger in the vehicle and control the image output unit to output an image corresponding to the screen, wherein at least one of a size and a ratio of the image May vary depending on the screen.
  • the processor may variably set the size of the screen based on an object viewed by the passenger.
  • the image output device further includes a sensor that generates sensing information related to the object, and the processor may set an area satisfying a reference condition as the screen by using the sensing information. .
  • the sensing information includes an object image corresponding to the object
  • the processor uses the object image to search for one or more rectangular areas that can be perceived as a two-dimensional plane by the passenger. And, any one of the one or more rectangular areas may be set as the screen.
  • the image output device further includes a communication unit that is mounted on the vehicle and performs communication with a sensor that generates sensing information related to the object, and the processor further includes a reference condition using the sensing information.
  • An area that satisfies may be set as the screen.
  • the image output device further includes a camera, and searches for an image output area in which the image is output using a camera image received from the camera, and the image output area becomes a rectangle.
  • the output can be controlled.
  • the screen may vary according to the seat position of the seat on which the passenger is boarding.
  • the processor may generate a control command to change a seat position of a seat on which the passenger is boarding based on the screen.
  • the processor may calculate a distance between the image output unit and the screen, and control the image output unit so that a size of a graphic object included in the image varies according to the distance.
  • the image output device further includes a communication unit configured to communicate with a plurality of sensors mounted on the vehicle, and the processor includes at least one of the plurality of sensors to track a gaze of the passenger One sensor is selected, and the at least one sensor may vary according to a seat position of a seat in which the passenger is boarded.
  • the vehicle is equipped with a first sensor and a second sensor installed at different positions to track the gaze of the passenger, and the processor, when the seat position satisfies the first condition, the When the screen is set using the sensing information received from the first sensor and the seat position satisfies the second condition, the screen may be set using the sensing information received from the second sensor.
  • the first condition and the second condition are the position of the seat in the vehicle, and between the first portion of the seat where the passenger's buttocks touch and the second portion of the seat touch the back. It may be defined by at least one of the angles of.
  • the first sensor may be disposed in front of the vehicle, and the second sensor may be disposed in the rear of the vehicle.
  • the vehicle is equipped with a first sensor and a second sensor for tracking the gaze of the passenger, and the processor uses the first sensing information generated by the first sensor to detect the gaze of the passenger.
  • the passenger's gaze may be detected using the second sensing information generated by the second sensor.
  • the image output device further includes a communication unit for receiving vehicle driving information from one or more electronic equipment mounted on the vehicle, wherein the processor displays the screen based on the vehicle driving information. It resets and controls the image output unit to output the image on the reset screen.
  • the processor may generate a control command based on the reset screen so that the seat position of the seat on which the passenger is boarding is changed.
  • it may be installed on a headrest of a seat on which the passenger is boarding.
  • the vehicle includes a first seat on which the passenger is on and a second seat on which the passenger is not on, and the processor, when the screen is formed on the second sheet, You can create a control command to change the seat position of the two seats.
  • the seat position of the second seat may be changed according to the gaze of the passenger.
  • the processor may limit the generation of the control command when a person boards the second seat.
  • variable screen since at least one of a size and shape of a variable screen is set in the area viewed by the boarding passenger, and visual information is provided through the variable screen, when using a physically fixed display Compared to this, user convenience is increased.
  • the image output device provides an optimal screen to the passenger regardless of the seat position, the passenger can receive visual information from a comfortable posture.
  • FIG. 1 is a view showing the exterior of a vehicle according to an embodiment of the present invention
  • FIG. 2 is a view of a vehicle according to an embodiment of the present invention as viewed from various external angles
  • 3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.
  • 5 to 6 are views referenced for describing an object according to an embodiment of the present invention.
  • FIG. 7 is a block diagram referenced to describe a vehicle according to an embodiment of the present invention.
  • FIG. 8 is a conceptual diagram illustrating an image output device according to an embodiment of the present invention
  • FIG. 9 is a flowchart for explaining a method of controlling an image output device
  • 10A, 10B, 11A, and 11B are exemplary views for explaining the control method of FIG. 9
  • FIG. 13 is a flow chart for explaining a method of generating a control command so that the seat position is changed
  • FIG. 14 is a flowchart illustrating a method of selecting a sensor to track a passenger's gaze
  • 15 is a flowchart illustrating a method of resetting a screen according to driving of a vehicle
  • Vehicles described herein may be concepts including automobiles and motorcycles. Hereinafter, the vehicle will be mainly described.
  • the vehicle described in the present specification may be a concept including all of an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle including an engine and an electric motor as a power source, and an electric vehicle including an electric motor as a power source.
  • the left side of the vehicle means the left side in the driving direction of the vehicle
  • the right side of the vehicle means the right side in the driving direction of the vehicle
  • FIG. 1 is a view showing the exterior of a vehicle according to an embodiment of the present invention.
  • FIG. 2 is a view of a vehicle according to an exemplary embodiment of the present invention as viewed from various external angles.
  • 3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.
  • 5 to 6 are views referenced to describe an object according to an embodiment of the present invention.
  • FIG. 7 is a block diagram referenced for describing a vehicle according to an embodiment of the present invention.
  • the vehicle 100 may include a wheel rotating by a power source, and a steering input device 510 for adjusting a traveling direction of the vehicle 100.
  • the vehicle 100 may be an autonomous vehicle.
  • autonomous driving is defined as controlling at least one of acceleration, deceleration, and driving direction based on a preset algorithm. In other words, it means that the driving manipulation device is automatically operated even if no user input is input to the driving manipulation device.
  • the vehicle 100 may be switched to an autonomous driving mode or a manual mode based on a user input.
  • the vehicle 100 may be switched from a manual mode to an autonomous driving mode or may be switched from an autonomous driving mode to a manual mode based on a user input received through the user interface device 200.
  • the vehicle 100 may be switched to an autonomous driving mode or a manual mode based on driving situation information.
  • the driving situation information may be generated based on object information provided by the object detection apparatus 300.
  • the vehicle 100 may be switched from a manual mode to an autonomous driving mode, or may be switched from an autonomous driving mode to a manual mode based on driving situation information generated by the object detection apparatus 300.
  • the vehicle 100 may be switched from a manual mode to an autonomous driving mode or may be switched from an autonomous driving mode to a manual mode, based on driving situation information received through the communication device 400.
  • the vehicle 100 may be switched from a manual mode to an autonomous driving mode or may be switched from an autonomous driving mode to a manual mode based on information, data, and signals provided from an external device.
  • the autonomous driving vehicle 100 may be operated based on the driving system 700.
  • the autonomous vehicle 100 may be driven based on information, data, or signals generated by the driving system 710, the taking-out system 740, and the parking system 750.
  • the autonomous vehicle 100 may receive a user input for driving through the driving operation device 500.
  • the vehicle 100 may be driven based on a user input received through the driving manipulation device 500.
  • the overall length means the length from the front part to the rear part of the vehicle 100
  • the width means the width of the vehicle 100
  • the height means the length from the lower part of the wheel to the roof.
  • the overall length direction (L) is a direction that is a reference for measuring the overall length of the vehicle 100
  • the full width direction (W) is a direction that is a reference for measuring the overall width of the vehicle 100
  • the overall height direction (H) is a vehicle It may mean the direction that is the standard for measuring the total height of (100).
  • the vehicle 100 includes a user interface device 200, an object detection device 300, a communication device 400, a driving operation device 500, a vehicle driving device 600, and a driving system. 700, a navigation system 770, a sensing unit 120, an interface unit 130, a memory 140, a control unit 170, and a power supply unit 190 may be included.
  • the vehicle 100 may further include other constituent elements other than the constituent elements described herein, or may not include some of the described constituent elements.
  • the user interface device 200 is a device for communicating with the vehicle 100 and a user.
  • the user interface device 200 may receive a user input and provide information generated in the vehicle 100 to the user.
  • the vehicle 100 may implement User Interfaces (UI) or User Experience (UX) through the user interface device 200.
  • UI User Interfaces
  • UX User Experience
  • the user interface device 200 may include an input unit 210, an internal camera 220, a biometric sensor 230, an output unit 250, and a processor 270.
  • the user interface device 200 may further include other components in addition to the described components, or may not include some of the described components.
  • the input unit 200 is for receiving information from a user, and data collected by the input unit 200 may be analyzed by the processor 270 and processed as a user's control command.
  • the input unit 200 may be disposed inside the vehicle.
  • the input unit 200 may include one region of a steering wheel, one region of an instrument panel, one region of a seat, one region of each pillar, and a door.
  • One area of (door), one area of center console, one area of head lining, one area of sun visor, one area of windshield or window It may be placed in one area or the like.
  • the input unit 200 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.
  • the voice input unit 211 may convert a user's voice input into an electrical signal.
  • the converted electrical signal may be provided to the processor 270 or the control unit 170.
  • the voice input unit 211 may include one or more microphones.
  • the gesture input unit 212 may convert a user's gesture input into an electrical signal.
  • the converted electrical signal may be provided to the processor 270 or the control unit 170.
  • the gesture input unit 212 may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input.
  • the gesture input unit 212 may detect a user's 3D gesture input.
  • the gesture input unit 212 may include an optical output unit that outputs a plurality of infrared light or a plurality of image sensors.
  • the gesture input unit 212 may detect a user's 3D gesture input through a Time of Flight (TOF) method, a structured light method, or a disparity method.
  • TOF Time of Flight
  • the touch input unit 213 may convert a user's touch input into an electrical signal.
  • the converted electrical signal may be provided to the processor 270 or the control unit 170.
  • the touch input unit 213 may include a touch sensor for sensing a user's touch input.
  • the touch input unit 213 is integrally formed with the display unit 251 to implement a touch screen.
  • a touch screen may provide an input interface and an output interface between the vehicle 100 and a user together.
  • the mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch.
  • the electrical signal generated by the mechanical input unit 214 may be provided to the processor 270 or the control unit 170.
  • the mechanical input unit 214 may be disposed on a steering wheel, a center fascia, a center console, a cock pick module, a door, or the like.
  • the internal camera 220 may acquire an image inside the vehicle.
  • the processor 270 may detect a user's state based on an image inside the vehicle.
  • the processor 270 may obtain gaze information of a user from an image inside the vehicle.
  • the processor 270 may detect a user's gesture from an image inside the vehicle.
  • the biometric detection unit 230 may obtain biometric information of a user.
  • the biometric sensor 230 includes a sensor capable of acquiring the user's biometric information, and by using the sensor, the user's fingerprint information, heart rate information, and the like may be acquired.
  • the biometric information can be used for user authentication.
  • the output unit 250 is for generating an output related to visual, auditory or tactile sense.
  • the output unit 250 may include at least one of the display unit 251, the sound output unit 252, and the haptic output unit 253.
  • the display unit 251 may display graphic objects corresponding to various types of information.
  • the display unit 251 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display), a 3D display, and an e-ink display.
  • LCD liquid crystal display
  • TFT LCD thin film transistor-liquid crystal display
  • OLED organic light-emitting diode
  • the display unit 251 may form a layered structure with the touch input unit 213 or are integrally formed to implement a touch screen.
  • the display unit 251 may be implemented as a head up display (HUD).
  • the display unit 251 may include a projection module to output information through a windshield or an image projected on a window.
  • the display unit 251 may include a transparent display.
  • the transparent display can be attached to a windshield or window.
  • the transparent display can display a predetermined screen while having a predetermined transparency.
  • Transparent display in order to have transparency, transparent display is transparent TFEL (Thin Film Elecroluminescent), transparent OLED (Organic Light-Emitting Diode), transparent LCD (Liquid Crystal Display), transmissive transparent display, transparent LED (Light Emitting Diode) display It may include at least one of. The transparency of the transparent display can be adjusted.
  • the user interface device 200 may include a plurality of display units 251a to 251g.
  • the display unit 251 includes one area of the steering wheel, one area 521a, 251b, and 251e of the instrument panel, one area 251d of the sheet, one area 251f of each pillar, and one area of the door ( 251g), a center console area, a headlining area, a sun visor area, or a windshield area 251c, a window area 251h.
  • the sound output unit 252 converts an electrical signal provided from the processor 270 or the control unit 170 into an audio signal and outputs it. To this end, the sound output unit 252 may include one or more speakers.
  • the haptic output unit 253 generates a tactile output.
  • the haptic output unit 253 may vibrate the steering wheel, seat belt, and seats 110FL, 110FR, 110RL, and 110RR so that the user can recognize the output.
  • the processor 270 may control the overall operation of each unit of the user interface device 200.
  • the user interface device 200 may include a plurality of processors 270 or may not include the processors 270.
  • the user interface device 200 may be operated according to the control of the processor or the controller 170 of another device in the vehicle 100.
  • the user interface device 200 may be referred to as a vehicle display device.
  • the user interface device 200 may be operated under the control of the controller 170.
  • the object detection device 300 is a device for detecting an object located outside the vehicle 100.
  • the objects may be various objects related to the operation of the vehicle 100.
  • an object O is a lane OB10, another vehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, a traffic signal OB14, OB15, a light, a road, a structure, It may include speed bumps, terrain, and animals.
  • the lane OB10 may be a driving lane, a lane next to the driving lane, or a lane in which an opposite vehicle travels.
  • the lane OB10 may be a concept including left and right lines forming a lane.
  • the other vehicle OB11 may be a vehicle running around the vehicle 100.
  • the other vehicle may be a vehicle located within a predetermined distance from the vehicle 100.
  • the other vehicle OB11 may be a vehicle preceding or following the vehicle 100.
  • the pedestrian OB12 may be a person located in the vicinity of the vehicle 100.
  • the pedestrian OB12 may be a person located within a predetermined distance from the vehicle 100.
  • the pedestrian OB12 may be a person located on a sidewalk or roadway.
  • the two-wheeled vehicle OB12 may refer to a vehicle located around the vehicle 100 and moving using two wheels.
  • the two-wheeled vehicle OB12 may be a vehicle having two wheels located within a predetermined distance from the vehicle 100.
  • the two-wheeled vehicle OB13 may be a motorcycle or bicycle positioned on a sidewalk or roadway.
  • the traffic signal may include a traffic light OB15, a traffic sign OB14, and a pattern or text drawn on a road surface.
  • the light may be light generated by a lamp provided in another vehicle.
  • Light can be the light generated from a street lamp.
  • the light can be sunlight.
  • the road may include a road surface, a curve, an uphill, downhill slope, and the like.
  • the structure may be an object located around a road and fixed to the ground.
  • the structure may include street lights, street trees, buildings, power poles, traffic lights, and bridges.
  • the features may include mountains, hills, and the like.
  • objects may be classified into moving objects and fixed objects.
  • the moving object may be a concept including other vehicles and pedestrians.
  • the fixed object may be a concept including a traffic signal, a road, and a structure.
  • the object detection apparatus 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.
  • the object detection apparatus 300 may further include other components other than the described components, or may not include some of the described components.
  • the camera 310 may be positioned at an appropriate place outside the vehicle in order to acquire an image outside the vehicle.
  • the camera 310 may be a mono camera, a stereo camera 310a, an AVM (Around View Monitoring) camera 310b, or a 360 degree camera.
  • the camera 310 may be disposed in the interior of the vehicle in proximity to the front windshield in order to acquire an image of the front of the vehicle.
  • the camera 310 may be disposed around a front bumper or a radiator grill.
  • the camera 310 may be disposed in the interior of the vehicle and close to the rear glass in order to obtain an image of the rear of the vehicle.
  • the camera 310 may be disposed around a rear bumper, a trunk or a tail gate.
  • the camera 310 may be disposed in proximity to at least one of the side windows in the interior of the vehicle in order to acquire an image of the side of the vehicle.
  • the camera 310 may be disposed around a side mirror, a fender, or a door.
  • the camera 310 may provide the acquired image to the processor 370.
  • the radar 320 may include an electromagnetic wave transmitting unit and a receiving unit.
  • the radar 320 may be implemented in a pulse radar method or a continuous wave radar method according to a radio wave emission principle.
  • the radar 320 may be implemented in a frequency modulated continuous wave (FMCW) method or a frequency shift keyong (FSK) method according to a signal waveform among continuous wave radar methods.
  • FMCW frequency modulated continuous wave
  • FSK frequency shift keyong
  • the radar 320 detects an object based on a time of flight (TOF) method or a phase-shift method through an electromagnetic wave, and the position of the detected object, the distance to the detected object, and the relative speed. Can be detected.
  • TOF time of flight
  • phase-shift method through an electromagnetic wave
  • the radar 320 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear or side of the vehicle.
  • the lidar 330 may include a laser transmitter and a receiver.
  • the lidar 330 may be implemented in a Time of Flight (TOF) method or a phase-shift method.
  • TOF Time of Flight
  • the lidar 330 may be implemented as a driven or non-driven.
  • the lidar 330 When implemented as a drive type, the lidar 330 is rotated by a motor, and objects around the vehicle 100 may be detected.
  • the lidar 330 may detect an object located within a predetermined range with respect to the vehicle 100 by optical steering.
  • the vehicle 100 may include a plurality of non-driving lidars 330.
  • the lidar 330 detects an object based on a time of flight (TOF) method or a phase-shift method with a laser light medium, and the position of the detected object, the distance to the detected object, and Relative speed can be detected.
  • TOF time of flight
  • phase-shift method with a laser light medium
  • the lidar 330 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.
  • the ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver.
  • the ultrasonic sensor 340 may detect an object based on ultrasonic waves, and detect a position of the detected object, a distance to the detected object, and a relative speed.
  • the ultrasonic sensor 340 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.
  • the infrared sensor 350 may include an infrared transmitter and a receiver.
  • the infrared sensor 340 may detect an object based on infrared light, and may detect a position of the detected object, a distance to the detected object, and a relative speed.
  • the infrared sensor 350 may be disposed at an appropriate position outside the vehicle to detect an object located in the front, rear, or side of the vehicle.
  • the processor 370 may control the overall operation of each unit of the object detection apparatus 300.
  • the processor 370 may detect and track an object based on the acquired image.
  • the processor 370 may perform an operation such as calculating a distance to an object and calculating a relative speed with the object through an image processing algorithm.
  • the processor 370 may detect and track the object based on the reflected electromagnetic wave that the transmitted electromagnetic wave is reflected on and returned to the object.
  • the processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with the object, based on the electromagnetic wave.
  • the processor 370 may detect and track the object based on the reflected laser light reflected by the transmitted laser and returned to the object.
  • the processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with the object, based on the laser light.
  • the processor 370 may detect and track the object based on the reflected ultrasonic wave reflected by the transmitted ultrasonic wave and returned to the object.
  • the processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with the object, based on ultrasonic waves.
  • the processor 370 may detect and track the object based on the reflected infrared light reflected by the transmitted infrared light and returned to the object.
  • the processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with the object, based on infrared light.
  • the object detection apparatus 300 may include a plurality of processors 370 or may not include the processors 370.
  • each of the camera 310, radar 320, lidar 330, ultrasonic sensor 340, and infrared sensor 350 may individually include a processor.
  • the object detection device 300 may be operated according to the control of the processor or the controller 170 of the device in the vehicle 100.
  • the object detection apparatus 300 may be operated under the control of the controller 170.
  • the communication device 400 is a device for performing communication with an external device.
  • the external device may be another vehicle, a mobile terminal, or a server.
  • the communication device 400 may be referred to as a “wireless communication unit”.
  • the communication device 400 may include at least one of a transmission antenna, a reception antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.
  • RF radio frequency
  • the communication device 400 may include a short-range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transmission/reception unit 450, and a processor 470.
  • the communication device 400 may further include other components in addition to the described components, or may not include some of the described components.
  • the short range communication unit 410 is a unit for short range communication.
  • the near field communication unit 410 includes BluetoothTM, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wireless Frequency Identification (Wi-Fi). -Fidelity), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • NFC Near Field Communication
  • Wi-Fi Wireless Frequency Identification
  • -Fidelity Wireless Frequency Identification
  • Wi-Fi Direct Wireless Universal Serial Bus
  • the short-range communication unit 410 may form short-range wireless communication networks (Wireless Area Networks) to perform short-range communication between the vehicle 100 and at least one external device.
  • short-range wireless communication networks Wireless Area Networks
  • the location information unit 420 is a unit for obtaining location information of the vehicle 100.
  • the location information unit 420 may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.
  • GPS Global Positioning System
  • DGPS Differential Global Positioning System
  • the V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian).
  • the V2X communication unit 430 may include an RF circuit capable of implementing communication with infrastructure (V2I), communication between vehicles (V2V), and communication with pedestrians (V2P).
  • the optical communication unit 440 is a unit for performing communication with an external device through light.
  • the optical communication unit 440 may include an optical transmitter that converts an electrical signal into an optical signal and transmits it to the outside, and an optical receiver that converts the received optical signal into an electrical signal.
  • the light transmitting unit may be integrally formed with a lamp included in the vehicle 100.
  • the broadcast transmission/reception unit 450 is a unit for receiving a broadcast signal from an external broadcast management server through a broadcast channel or transmitting a broadcast signal to the broadcast management server.
  • Broadcast channels may include satellite channels and terrestrial channels.
  • the broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.
  • the processor 470 may control the overall operation of each unit of the communication device 400.
  • the communication device 400 may include a plurality of processors 470 or may not include the processors 470.
  • the communication device 400 may be operated under the control of the processor or the controller 170 of another device in the vehicle 100.
  • the communication device 400 may implement a vehicle display device together with the user interface device 200.
  • the vehicle display device may be referred to as a telematics device or an audio video navigation (AVN) device.
  • APN audio video navigation
  • the communication device 400 may be operated under the control of the controller 170.
  • the driving operation device 500 is a device that receives a user input for driving.
  • the vehicle 100 may be driven based on a signal provided by the driving operation device 500.
  • the driving manipulation device 500 may include a steering input device 510, an acceleration input device 530, and a brake input device 570.
  • the steering input device 510 may receive an input of a traveling direction of the vehicle 100 from a user.
  • the steering input device 510 is preferably formed in a wheel shape to enable steering input by rotation.
  • the steering input device may be formed in the form of a touch screen, a touch pad, or a button.
  • the acceleration input device 530 may receive an input for acceleration of the vehicle 100 from a user.
  • the brake input device 570 may receive an input for deceleration of the vehicle 100 from a user. It is preferable that the acceleration input device 530 and the brake input device 570 are formed in a pedal shape. Depending on the embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad, or a button.
  • the driving manipulation device 500 may be operated under the control of the controller 170.
  • the vehicle drive device 600 is a device that electrically controls driving of various devices in the vehicle 100.
  • the vehicle driving device 600 may include a power train driving unit 610, a chassis driving unit 620, a door/window driving unit 630, a safety device driving unit 640, a lamp driving unit 650, and an air conditioning driving unit 660. I can.
  • the vehicle driving apparatus 600 may further include other components in addition to the described components, or may not include some of the described components.
  • the vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may each individually include a processor.
  • the power train driver 610 may control the operation of the power train device.
  • the power train driving unit 610 may include a power source driving unit 611 and a transmission driving unit 612.
  • the power source driving unit 611 may control the power source of the vehicle 100.
  • the power source driving unit 610 may perform electronic control on the engine. Thereby, it is possible to control the output torque of the engine and the like.
  • the power source drive unit 611 may adjust the engine output torque under control of the control unit 170.
  • the power source driving unit 610 may control the motor.
  • the power source driving unit 610 may adjust the rotational speed and torque of the motor according to the control of the control unit 170.
  • the transmission driving unit 612 may control a transmission.
  • the transmission drive unit 612 can adjust the state of the transmission.
  • the transmission drive unit 612 can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).
  • the transmission drive unit 612 can adjust the gear engagement state in the forward (D) state.
  • the chassis driver 620 may control an operation of the chassis device.
  • the chassis driving unit 620 may include a steering driving unit 621, a brake driving unit 622, and a suspension driving unit 623.
  • the steering driver 621 may perform electronic control on a steering apparatus in the vehicle 100.
  • the steering drive unit 621 can change the traveling direction of the vehicle.
  • the brake driving unit 622 may perform electronic control on a brake apparatus in the vehicle 100. For example, it is possible to reduce the speed of the vehicle 100 by controlling the operation of the brake disposed on the wheel.
  • the brake driving unit 622 can individually control each of the plurality of brakes.
  • the brake driving unit 622 may differently control braking forces applied to a plurality of wheels.
  • the suspension driver 623 may perform electronic control on a suspension apparatus in the vehicle 100.
  • the suspension driving unit 623 may control the suspension device to reduce vibration of the vehicle 100 when there is a curve on the road surface.
  • the suspension driving unit 623 may individually control each of the plurality of suspensions.
  • the door/window driving unit 630 may perform electronic control on a door apparatus or a window apparatus in the vehicle 100.
  • the door/window driving unit 630 may include a door driving unit 631 and a window driving unit 632.
  • the door driving unit 631 may control a door device.
  • the door driver 631 may control opening and closing of a plurality of doors included in the vehicle 100.
  • the door driving unit 631 may control opening or closing of a trunk or a tail gate.
  • the door drive part 631 can control the opening or closing of a sunroof.
  • the window driver 632 may perform electronic control on a window apparatus. Opening or closing of a plurality of windows included in the vehicle 100 may be controlled.
  • the safety device driving unit 640 may perform electronic control on various safety apparatuses in the vehicle 100.
  • the safety device driving unit 640 may include an airbag driving unit 641, a seat belt driving unit 642, and a pedestrian protection device driving unit 643.
  • the airbag driver 641 may perform electronic control on an airbag apparatus in the vehicle 100.
  • the airbag driver 641 may control the airbag to be deployed when a danger is detected.
  • the seat belt driving unit 642 may perform electronic control on a seatbelt appartus in the vehicle 100.
  • the seat belt driving unit 642 may control a passenger to be fixed to the seats 110FL, 110FR, 110RL, and 110RR using a seat belt when a danger is detected.
  • the pedestrian protection device driving unit 643 may perform electronic control for a hood lift and a pedestrian airbag. For example, when detecting a collision with a pedestrian, the pedestrian protection device driving unit 643 may control the hood to be lifted up and the pedestrian airbag deployed.
  • the lamp driving unit 650 may perform electronic control for various lamp apparatuses in the vehicle 100.
  • the air conditioning drive unit 660 may perform electronic control on an air cinditioner in the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning drive unit 660 may control the air conditioning device to operate and supply cold air to the vehicle interior.
  • the vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may each individually include a processor.
  • the vehicle driving apparatus 600 may be operated under the control of the controller 170.
  • the driving system 700 is a system that controls various operations of the vehicle 100.
  • the driving system 700 may be operated in an autonomous driving mode.
  • the driving system 700 may include a driving system 710, a car taking-out system 740, and a parking system 750.
  • the driving system 700 may further include other components in addition to the described components, or may not include some of the described components.
  • the driving system 700 may include a processor. Each unit of the driving system 700 may individually include a processor.
  • the driving system 700 when the driving system 700 is implemented in software, it may be a sub-concept of the control unit 170.
  • the driving system 700 includes at least one of the user interface device 200, the object detection device 300, the communication device 400, the vehicle driving device 600, and the control unit 170. It may be a concept to include.
  • the driving system 710 may perform driving of the vehicle 100.
  • the driving system 710 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform driving of the vehicle 100.
  • the driving system 710 may receive object information from the object detection apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to perform driving of the vehicle 100.
  • the driving system 710 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving apparatus 600 to perform driving of the vehicle 100.
  • the car unloading system 740 may unload the vehicle 100.
  • the car unloading system 740 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform unloading of the vehicle 100.
  • the vehicle unloading system 740 may receive object information from the object detection apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to perform unloading of the vehicle 100.
  • the vehicle unloading system 740 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving apparatus 600 to perform unloading of the vehicle 100.
  • the parking system 750 may park the vehicle 100.
  • the parking system 750 may receive navigation information from the navigation system 770 and provide a control signal to the vehicle driving apparatus 600 to perform parking of the vehicle 100.
  • the parking system 750 may receive object information from the object detection apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to perform parking of the vehicle 100.
  • the parking system 750 may receive a signal from an external device through the communication device 400 and provide a control signal to the vehicle driving device 600 to perform parking of the vehicle 100.
  • the navigation system 770 may provide navigation information.
  • the navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on the route, lane information, and current location information of the vehicle.
  • the navigation system 770 may include a memory and a processor.
  • the memory can store navigation information.
  • the processor may control the operation of the navigation system 770.
  • the navigation system 770 may receive information from an external device through the communication device 400 and update the previously stored information.
  • the navigation system 770 may be classified as a sub-element of the user interface device 200.
  • the sensing unit 120 may sense the state of the vehicle.
  • the sensing unit 120 includes a posture sensor (for example, a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, and a tilt sensor.
  • the sensing unit 120 includes vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward/reverse information, and battery Information, fuel information, tire information, vehicle ramp information, vehicle interior temperature information, vehicle interior humidity information, steering wheel rotation angle, vehicle exterior illuminance, pressure applied to the accelerator pedal, and pressure applied to the brake pedal are acquired. can do.
  • the sensing unit 120 includes an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake air temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor. (TPS), a TDC sensor, a crank angle sensor (CAS), and the like may be further included.
  • the interface unit 130 may serve as a passage for various types of external devices connected to the vehicle 100.
  • the interface unit 130 may include a port connectable to a mobile terminal, and may connect to a mobile terminal through the port. In this case, the interface unit 130 may exchange data with the mobile terminal.
  • the interface unit 130 may serve as a passage for supplying electric energy to a connected mobile terminal.
  • the interface unit 130 may provide electric energy supplied from the power supply unit 190 to the mobile terminal.
  • the memory 140 is electrically connected to the control unit 170.
  • the memory 140 may store basic data for a unit, control data for controlling the operation of the unit, and input/output data.
  • the memory 140 may be various storage devices such as ROM, RAM, EPROM, flash drive, and hard drive.
  • the memory 140 may store various data for the overall operation of the vehicle 100, such as a program for processing or controlling the controller 170.
  • the memory 140 may be formed integrally with the control unit 170 or may be implemented as a sub-element of the control unit 170.
  • the controller 170 may control the overall operation of each unit in the vehicle 100.
  • the control unit 170 may be referred to as an ECU (Electronic Control Unit).
  • the power supply unit 190 may supply power required for operation of each component under the control of the controller 170.
  • the power supply unit 190 may receive power from a battery inside a vehicle.
  • processors and control units 170 included in the vehicle 100 include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs ( Field programmable gate arrays), processors, controllers, micro-controllers, microprocessors, and electric units for performing other functions may be used.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs Field programmable gate arrays
  • processors controllers, micro-controllers, microprocessors, and electric units for performing other functions may be used.
  • the image output device 800 is provided in the vehicle 100 and may be formed as an independent device that can be attached or detached to the vehicle 100, or may be installed integrally with the vehicle 100 to be a part of the vehicle 100. have.
  • the operation and control method of the image output device 800 described herein may be performed by the controller 170 of the vehicle 100. That is, an operation and/or a control method performed by the processor 870 of the image output device 800 may be performed by the controller 170 of the vehicle 800.
  • the image output device 800 includes a communication unit 810, a memory 830, an image output unit 850, and a processor 830.
  • the communication unit 810 is configured to perform communication with various components described in FIG. 7.
  • the communication unit 810 may receive various types of information provided through a controller are network (CAN).
  • the communication unit 810 may communicate with all communication devices such as a vehicle, a mobile terminal and a server, and other vehicles. This may be referred to as V2X (Vehicle to everything) communication.
  • V2X communication can be defined as a technology that exchanges or shares information such as traffic conditions while communicating with road infrastructure and other vehicles while driving.
  • the communication unit 810 is configured to communicate with one or more devices included in the vehicle 100.
  • the communication unit 810 may receive information related to driving of the vehicle from most devices provided in the vehicle 100.
  • Information transmitted from the vehicle 100 to the image output device 800 is referred to as “vehicle driving information”.
  • the vehicle driving information includes vehicle information and surrounding information of the vehicle. Based on the frame of the vehicle 100, information related to the interior of the vehicle may be defined as vehicle information, and information related to the exterior of the vehicle may be defined as surrounding information.
  • Vehicle information means information about the vehicle itself.
  • vehicle information includes vehicle driving speed, driving direction, acceleration, angular velocity, position (GPS), weight, number of passengers in the vehicle, vehicle braking force, vehicle maximum braking force, air pressure of each wheel, centrifugal force applied to the vehicle.
  • Vehicle driving mode autonomous driving mode or manual driving mode
  • vehicle parking mode autonomous parking mode, automatic parking mode, manual parking mode
  • whether a user is in the vehicle and information related to the user, etc.
  • the surrounding information refers to information about other objects located within a predetermined range around the vehicle and information related to the outside of the vehicle. For example, the condition of the road surface on which the vehicle is driving (friction force), weather, the distance to the vehicle in front (or rear), the relative speed of the vehicle in front (or rear), the curvature of the curve when the driving lane is a curve, vehicle Ambient brightness, information related to an object existing in a reference area (a certain area) based on the vehicle, whether an object enters/departs from the certain area, whether a user exists around the vehicle, and information related to the user (e.g. For example, whether the user is an authenticated user) or the like.
  • the condition of the road surface on which the vehicle is driving for example, the condition of the road surface on which the vehicle is driving (friction force), weather, the distance to the vehicle in front (or rear), the relative speed of the vehicle in front (or rear), the curvature of the curve when the driving lane is a curve, vehicle Ambient brightness, information related
  • the surrounding information includes ambient brightness, temperature, location of the sun, information on objects located in the vicinity (people, other vehicles, signs, etc.), type of road surface being driven, terrain features, line information, and lane information.
  • Information, and information necessary for autonomous driving/autonomous parking/automatic parking/manual parking mode can be included.
  • the surrounding information is an object (object) existing around the vehicle and the distance between the vehicle 100, the possibility of a collision, the type of the object, a parking space in which the vehicle can be parked, and an object for identifying the parking space (for example, , Parking lines, twine, other vehicles, walls, etc.), etc. may be further included.
  • the vehicle driving information is not limited to the example described above, and may include all information generated from components included in the vehicle 100.
  • the memory 830 may store an operating system, middleware, applications, etc. necessary to drive an image output device.
  • the memory 830 may be replaced with a server (or cloud) that performs communication through the communication unit 810.
  • the image output unit 850 outputs various visual information under control of the processor 870.
  • the image output unit 850 may output visual information to a windshield of a vehicle or a separately provided screen, or may output visual information through a panel.
  • the image output unit 850 may correspond to the display unit 251 described with reference to FIGS. 1 to 7.
  • the processor 830 performs various operations of the image output device 800 to be described later and controls the communication unit 810, the memory 830, and the image output unit 850.
  • the processor 830 may be configured to control one or more devices included in the vehicle 100 using the communication unit 810.
  • the processor 830 may determine whether at least one condition is satisfied among a plurality of preset conditions based on vehicle driving information received through the communication unit 810. Depending on the satisfied condition, the processor 807 may control the one or more displays in different ways.
  • the processor 870 may detect that an event has occurred in an electronic device and/or application provided in the vehicle 100 and determine whether the detected event satisfies a preset condition. In this case, the processor 870 may detect that an event has occurred from information received through the communication unit 810.
  • the application is a concept including a widget or a home launcher, and refers to all types of programs that can be driven by the vehicle 100. Accordingly, the application may be a program that performs functions of a web browser, video playback, message transmission and reception, schedule management, and application update.
  • FCW Forward Collision Warning
  • BSD Blind Spot Detection
  • LWD Lane Departure Warning
  • PD Pedestrian Detection
  • Curve Speed Warning It may include at least one of (Curve Speed Warning, CSW) and turn by turn navigation (TBT).
  • an event occurs when there is a missed call, an application to be updated, a message arrives, start on, start off, autonomous driving on/off, and display activation key pressed.
  • LCD awake key alarm (alarm)
  • call connection Incoming call
  • it may be a missed notification (missed notification).
  • the occurrence of an event may be the occurrence of an alert set in an advanced driver assistance system (ADAS) or a case in which a function set in ADAS is performed.
  • ADAS advanced driver assistance system
  • a forward collision warning occurs
  • a blind spot detection occurs
  • a lane departure warning occurs
  • a lane keeping When assist warning it may be considered that an event has occurred when an automatic emergency braking function is performed.
  • a power unit when changing from a forward gear to a reverse gear, an acceleration greater than a predetermined value occurs, a deceleration greater than a predetermined value occurs, a power unit is changed from an internal combustion engine to a motor, or in a motor. It can be seen that an event has occurred even when it is changed to an internal combustion engine.
  • the processor 870 controls the communication unit 810 to display information corresponding to the satisfied condition on the one or more displays.
  • the processor 870 may transmit an autonomous driving message to at least one of a plurality of devices provided in the vehicle 100 so that autonomous driving is performed in the vehicle 100.
  • an autonomous driving message may be transmitted to a brake to perform deceleration, or an autonomous driving message may be transmitted to a steering device to change a driving direction.
  • FIG. 9 is a flowchart illustrating a control method of an image output device
  • FIGS. 10A, 10B, 11A, and 11B are exemplary diagrams for explaining the control method of FIG. 9.
  • FIG. 12 is a diagram for explaining a method of changing the angle of the screen.
  • the processor 870 may set a screen inside the vehicle 100 based on the gaze of a passenger on board the vehicle (S910).
  • the processor 870 may track the gaze of a passenger who boards the vehicle 100 using a sensor provided in the image output device 800 and/or a sensor provided in the vehicle 100.
  • the processor 870 may set a screen inside the vehicle 100 based on the passenger's gaze.
  • the screen refers to an area in which an image is output by the image output unit 850. At least one of the size, position, and shape of the screen varies according to the passenger's gaze.
  • the processor 870 sets the screen on the object that the passenger is looking at.
  • the processor 870 may variably set the size of the screen based on the object viewed by the passenger.
  • a screen 1000a is set on the backrest.
  • a screen with a size that can be maximized is set on the backrest.
  • a screen is set on the headrest. Since the size of the headrest is smaller than that of the backrest, a smaller screen is set on the headrest when the passenger looks at the backrest.
  • a screen 1000b may be set on the ceiling.
  • a distance between the image output unit 800 and the screen 1000b is calculated, and a screen 1000b having a size optimized for the passenger may be set based on the distance.
  • the object viewed by the passenger that is, the passenger's gaze, is bound to vary depending on the seat position of the seat on which the passenger is boarding.
  • the screen may vary depending on the seat position of the seat on which the passenger is boarding.
  • the screen 1000a when the seat position of the seat 1030 is in the first state, the screen 1000a is set on the back of the front seat, but as shown in FIG. 11B, the seat ( When the seat position 1030 is in the second state, the screen 1000b may be set on the vehicle ceiling.
  • the seat may move back and forth of the vehicle, rotate based on the direction of gravity, or the backrest of the seat may rotate back and forth.
  • the state of the backrest constituting the seat may be defined as a seat position.
  • the seat position is a seat position based on at least one of the position of the center point of the seat, the angle between the first portion of the seat where the passenger's hips touch and the second portion of the seat that the back touches, and the direction in which the backrest of the seat faces. Can be defined.
  • the processor 870 may receive sensing information related to an object viewed by the passenger from a sensor, and set an area that satisfies a reference condition as the screen by using the sensing information.
  • the sensing information may include an object image corresponding to the object.
  • the processor 870 may use the object image to search for one or more rectangular areas that can be recognized as a two-dimensional plane by the passenger, and set any one of the one or more rectangular areas as the screen. have.
  • the processor 870 may search a 2D plane and set any one rectangular area that satisfies the reference condition as a screen.
  • the sensor for generating the sensing information may be provided in the image output device 800 or may be provided in the vehicle 100 as a separate device independent from the image output device 800.
  • the processor 870 may control the image output unit 850 to output an image corresponding to the screen (S930).
  • the screen is set in the area viewed by the passenger.
  • the image output device 800 may be installed on a headrest of a seat on which the passenger is on board, facing the same direction as the passenger's gaze so that an image can be displayed on the screen.
  • a part of the image output device 800, for example, the image output unit 850 may be installed on the headrest of the seat on which the passenger is boarding.
  • the size of a graphic object included in the screen may vary according to the size of the screen. Further, the processor 870 calculates a distance between the image output unit 850 and the screen, and controls the image output unit 850 to vary the size of a graphic object included in the image according to the distance. can do.
  • the processor 870 may control the image output unit 850 so that the image output area in which the image is output becomes a rectangle (S950).
  • the processor 870 may receive a camera image captured by the camera from a camera photographing the screen, and use the camera image to search an image output area, that is, a screen, in which the image is being output. .
  • the processor 870 may control the image output unit so that the image output area has a rectangular shape.
  • a screen may be created on the backrest of the front seat.
  • the angle of the screen to the ground varies according to the seat position of the front seat.
  • the processor 870 may calculate an angle of the screen with respect to the ground, or may calculate an angle between the screen and the line of sight in consideration of the direction the screen faces and the line of sight of the passenger.
  • the processor 870 may control the image output unit so that the image output area becomes a rectangle using the camera image. For example, by correcting the tweak of the image, the image viewed by the passenger may be recognized by the passenger in a rectangular shape.
  • the processor 870 may set a screen in which at least one of a size and a shape is variable in an area viewed by a passenger in the vehicle 100, and provide visual information through the variable screen. .
  • User convenience is increased compared to the case of using a physically fixed display.
  • the image output device provides an optimal screen to the passenger regardless of the seat position, the passenger can receive visual information from a comfortable posture.
  • FIG. 13 is a flowchart for explaining a method of generating a control command so that the seat position is changed.
  • the processor 870 may determine a seat position of at least one seat mounted on the vehicle based on the screen (S1310).
  • An optimal screen and an optimal seat position corresponding thereto may be stored in the memory 830 according to an object viewed by the passenger. For example, when the object is a backrest, a first seat position optimized for the backrest may be preset, and when the object is a ceiling, a second seat position optimized for the ceiling may be preset.
  • the processor 870 may search for a pre-set seat position corresponding to the object and determine the searched seat position.
  • the processor 870 may determine at least one of a seat position of a seat on which the passenger is boarded and/or a seat position of a seat on which the screen is set.
  • the vehicle may include a first seat on which the passenger is on board and a second seat on which the passenger is not on board.
  • the processor 870 may generate a control command to change the seat position of the second sheet.
  • the seat position of the second seat is changed according to the gaze of the passenger. This is because at least one of the size, position, and shape of the screen varies according to the gaze.
  • the processor 870 may determine whether a person is aboard the second sheet based on information received through the communication unit 810. As a result of the determination, when a person boards the second sheet, generation of the control command may be restricted. In other words, the control command may be generated only when a person does not board the second seat. This is to avoid harming the convenience of the passengers on the second seat.
  • the processor 870 may generate a control command to change to the determined seat position (S1330).
  • the control command is transmitted to an actuator that generates an external force so that the seat position of the seat is changed through the communication unit 810, and the actuator generates an external force according to the control command.
  • the seat has a seat position determined by the processor 870.
  • FIG. 14 is a flowchart illustrating a method of selecting a sensor to track a passenger's gaze.
  • the processor 870 may select at least one sensor for tracking the passenger's gaze from among a plurality of sensors (S1410). Furthermore, the processor 870 may track the line of sight with the selected sensor (S1430).
  • the at least one sensor may vary according to the seat position of the seat on which the passenger is boarded.
  • the vehicle may be equipped with a first sensor and a second sensor installed at different locations to track the gaze of the passenger.
  • the processor 870 sets the screen using sensing information received from the first sensor when the seat position satisfies the first condition, and when the seat position satisfies the second condition, the The screen may be set using sensing information received from the second sensor.
  • the first condition and the second condition are at least one of a position of the seat in the vehicle and an angle between the first portion of the seat that the passenger's hips touch and the second portion of the seat that the back touches.
  • the first sensor may be disposed in front of the vehicle, and the second sensor may be disposed in the rear of the vehicle.
  • the processor 870 may detect the gaze of the passenger using the first sensing information generated by the first sensor. When the gaze of the passenger is not detected from the first sensing information, the processor 870 may detect the gaze of the passenger using the second sensing information generated by the second sensor. In other words, the processor 870 may selectively use any one of a plurality of sensors according to whether a passenger's gaze is detected.
  • 15 is a flowchart illustrating a method of resetting the screen according to the driving of the vehicle.
  • the processor 870 receives vehicle driving information through the communication unit 810 (S1510).
  • the communication unit 810 receives vehicle driving information from one or more electronic equipment mounted on the vehicle.
  • the vehicle driving information includes vehicle information and surrounding information of the vehicle. Based on the frame of the vehicle 100, information related to the interior of the vehicle may be defined as vehicle information, and information related to the exterior of the vehicle may be defined as surrounding information. Since the vehicle driving information has been described above with reference to FIG. 8, detailed descriptions are omitted.
  • the processor 870 resets the screen based on the vehicle driving information (S1530).
  • the screen may be reset regardless of the passenger's gaze for safety of the passenger.
  • the passenger's head may be inclined with respect to the direction of gravity by centrifugal force.
  • the processor 870 may reset at least one of the size, position, and shape of the screen according to the degree of inclination of the head or the degree to which the head is expected to be inclined.
  • the processor 870 may generate a control command to change the seat position based on the reset screen (S1550). Specifically, the processor 870 may generate a control command based on the reset screen so that the seat position of the seat on which the passenger is boarding is changed. This is to direct the passenger's gaze to the reset screen, and to correct the passenger's posture.
  • 16 is a block diagram illustrating a communication system that communicates with a plurality of vehicles, a server, and a base station.
  • the image output device 800 may communicate with the vehicle control device 1600 that controls the vehicle 100.
  • the vehicle control device 1600 may be mounted on a vehicle to control the vehicle, or may remotely control the vehicle using a wireless network when not mounted on the vehicle.
  • the vehicle control device 1600 may control a 5G network-to-vehicle autonomous driving operation using 5G communication.
  • the vehicle control device 1600 determines whether to remotely control the vehicle in the 5G network, and transmits information (or signals) related to the remote control through the 5G network. Can be transferred to the vehicle.
  • At least one component (hereinafter, simply referred to as'video output device') described above in FIG. 7 including the image output device 800 performs an initial access process or random access to a 5G network ( Random Access) can be performed.
  • the image output device 800 may perform a cell search for obtaining a downlink (DL) and a process such as obtaining system information. Thereafter, various types of information to be output by the image output device 800 may be received from the vehicle control device 1600 using the downlink. For example, content to be output on the screen, a position at which the content is to be output, and a seat position to be changed when the content is output may be transmitted from the vehicle control device 1600 to the image output device 800.
  • DL downlink
  • a process such as obtaining system information.
  • various types of information to be output by the image output device 800 may be received from the vehicle control device 1600 using the downlink. For example, content to be output on the screen, a position at which the content is to be output, and a seat position to be changed when the content is output may be transmitted from the vehicle control device 1600 to the image output device 800.
  • the image output device 800 receives an uplink grant (UL Grant) from a 5G network, and transmits various types of information based on an uplink (UL) to the vehicle control device ( 1600).
  • the video output device 800 may receive an uplink grant (UL Grant) through a physical downlink control channel (PDCCH).
  • UL Grant uplink grant
  • PDCCH physical downlink control channel
  • the vehicle control device 1600 may correspond to a server, a base station, or an infrastructure of V2I, and may communicate with one or more vehicles 1610a-1610c and generate a control message for controlling each vehicle. have.
  • the vehicle control device 1600 receives first vehicle driving information generated by the first vehicle 1610a from the first vehicle 1610a, and based on the first vehicle driving information, the first vehicle A control message for controlling (1610a) can be generated.
  • the control message includes various controls such as setting a destination of the first vehicle 1610a, changing a driving mode, controlling a brake, engine/motor, etc. to change a speed, or controlling a steering device to change the driving direction.
  • the image output device according to the present invention provides an optimal user interface to passengers using 5G communication in a vehicle capable of autonomous driving.
  • the image output device may be a robot with artificial intelligence.
  • the present invention described above can be implemented as computer-readable code (or application or software) on a medium in which a program is recorded.
  • the above-described method of controlling an autonomous vehicle may be realized by a code stored in a memory or the like.
  • the computer-readable medium includes all types of recording devices that store data that can be read by a computer system.
  • Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
  • the computer may include a processor or a control unit. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Automation & Control Theory (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

L'invention concerne un dispositif de sortie d'image monté sur un véhicule. En particulier, un dispositif de sortie d'image selon la présente invention utilise une communication 5G pour fournir une interface utilisateur optimale à un passager dans un véhicule à conduite autonome. Le dispositif de sortie d'image peut être un robot ayant une intelligence artificielle. Spécifiquement, le dispositif de sortie d'image est caractérisé en ce qu'il comprend : une unité de sortie d'image ; et un processeur qui définit un écran à l'intérieur du véhicule sur la base de la ligne de visée d'un passager à bord du véhicule et commande l'unité de sortie d'image de sorte qu'une image correspondant à l'écran soit sortie, la taille et/ou le rapport de l'image variant en fonction de l'écran.
PCT/KR2019/006703 2019-06-04 2019-06-04 Dispositif de sortie d'image WO2020246627A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/KR2019/006703 WO2020246627A1 (fr) 2019-06-04 2019-06-04 Dispositif de sortie d'image
US16/490,106 US11383731B2 (en) 2019-06-04 2019-06-04 Image output device
KR1020197019952A KR102212777B1 (ko) 2019-06-04 2019-06-04 영상 출력 장치

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2019/006703 WO2020246627A1 (fr) 2019-06-04 2019-06-04 Dispositif de sortie d'image

Publications (1)

Publication Number Publication Date
WO2020246627A1 true WO2020246627A1 (fr) 2020-12-10

Family

ID=73652806

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/006703 WO2020246627A1 (fr) 2019-06-04 2019-06-04 Dispositif de sortie d'image

Country Status (3)

Country Link
US (1) US11383731B2 (fr)
KR (1) KR102212777B1 (fr)
WO (1) WO2020246627A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210044348A (ko) * 2019-10-14 2021-04-23 현대자동차주식회사 이동체의 디스플레이 방법 및 장치
CN114730238A (zh) * 2019-11-29 2022-07-08 索尼集团公司 信息处理装置、信息处理方法和程序
CN114771434A (zh) * 2022-05-12 2022-07-22 岚图汽车科技有限公司 吸顶屏与座椅的联动控制方法、装置及控制器

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005067509A (ja) * 2003-08-27 2005-03-17 Matsushita Electric Ind Co Ltd 車載映像投射表示システムおよびそれを搭載した自動車
KR20090083988A (ko) * 2008-01-31 2009-08-05 현대자동차주식회사 각도조절형 헤드레스트 모니터
JP5992130B2 (ja) * 2014-04-25 2016-09-14 三菱電機株式会社 自動調整装置、自動調整システムおよび自動調整方法
KR20170048781A (ko) * 2015-10-27 2017-05-10 엘지전자 주식회사 차량용 증강현실 제공 장치 및 그 제어방법
JP2018106052A (ja) * 2016-12-27 2018-07-05 パイオニア株式会社 表示装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4096151B2 (ja) * 2001-10-17 2008-06-04 ソニー株式会社 ズームレンズ
TWI413979B (zh) * 2009-07-02 2013-11-01 Inventec Appliances Corp 調整顯示畫面的方法、電子裝置，與電腦程式產品
US20140049462A1 (en) * 2012-08-20 2014-02-20 Google Inc. User interface element focus based on user's gaze
KR20150062317A (ko) 2013-11-29 2015-06-08 현대모비스 주식회사 자동차의 통합 멀티미디어 장치
US9720496B2 (en) * 2014-03-20 2017-08-01 Intel Corporation Techniques for stabilizing a display scene output
WO2016188545A1 (fr) 2015-05-22 2016-12-01 Bayerische Motoren Werke Aktiengesellschaft Ensemble d'affichage de véhicule et procédé pour réduire le mal des transports chez le passager d'un véhicule
JP6512016B2 (ja) * 2015-07-27 2019-05-15 日本精機株式会社 車両用表示装置
KR20170015112A (ko) 2015-07-30 2017-02-08 삼성전자주식회사 자율 주행 차량 및 그의 동작 방법
KR101895485B1 (ko) * 2015-08-26 2018-09-05 엘지전자 주식회사 운전 보조 장치 및 그 제어 방법
US10668857B2 (en) * 2016-09-30 2020-06-02 Sony Corporation Reflector, information display apparatus, and movable body
JP6520905B2 (ja) * 2016-12-19 2019-05-29 トヨタ自動車株式会社 車両用運転支援装置
CN110679147B (zh) * 2017-03-22 2022-03-08 奇跃公司 用于显示系统的基于深度的凹式渲染
US11106274B2 (en) * 2017-04-10 2021-08-31 Intel Corporation Adjusting graphics rendering based on facial expression
KR102339522B1 (ko) * 2017-04-12 2021-12-16 현대모비스 주식회사 차량/운행정보 통합 디스플레이 방법 및 장치
CN109212753B (zh) * 2017-07-06 2021-01-29 京东方科技集团股份有限公司 可变显示距离的抬头显示系统、抬头显示方法、驾驶设备
US10155166B1 (en) * 2017-09-08 2018-12-18 Sony Interactive Entertainment Inc. Spatially and user aware second screen projection from a companion robot or device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005067509A (ja) * 2003-08-27 2005-03-17 Matsushita Electric Ind Co Ltd 車載映像投射表示システムおよびそれを搭載した自動車
KR20090083988A (ko) * 2008-01-31 2009-08-05 현대자동차주식회사 각도조절형 헤드레스트 모니터
JP5992130B2 (ja) * 2014-04-25 2016-09-14 三菱電機株式会社 自動調整装置、自動調整システムおよび自動調整方法
KR20170048781A (ko) * 2015-10-27 2017-05-10 엘지전자 주식회사 차량용 증강현실 제공 장치 및 그 제어방법
JP2018106052A (ja) * 2016-12-27 2018-07-05 パイオニア株式会社 表示装置

Also Published As

Publication number Publication date
US11383731B2 (en) 2022-07-12
KR20200142443A (ko) 2020-12-22
KR102212777B1 (ko) 2021-02-05
US20210354711A1 (en) 2021-11-18

Similar Documents

Publication Publication Date Title
WO2017155219A1 (fr) Dispositif de commande de véhicule monté dans un véhicule, et procédé de commande correspondant
WO2017138702A1 (fr) Dispositif d'interface utilisateur de véhicule et véhicule
WO2019098434A1 (fr) Dispositif de commande de véhicule embarqué et procédé de commande de véhicule
WO2018056536A1 (fr) Affichage de tableau de bord et véhicule le comportant
WO2018070646A1 (fr) Dispositif de commande de véhicule embarqué et procédé de commande du véhicule
WO2018088647A1 (fr) Dispositif de commande de véhicule monté sur véhicule et procédé permettant de commander le véhicule
WO2018097465A1 (fr) Dispositif embarqué de commande de véhicule et procédé de commande du véhicule
WO2018169162A1 (fr) Véhicule comportant un dispositif de commande de véhicule et procédé de commande de véhicule
WO2018097423A1 (fr) Véhicule autonome et son procédé de fonctionnement
WO2018110789A1 (fr) Technologie de commande de véhicule
WO2019132078A1 (fr) Dispositif d'affichage embarqué
WO2018110762A1 (fr) Dispositif de commande de véhicule inclus dans un véhicule et et procédé de commande pour véhicule
WO2019198998A1 (fr) Dispositif de commande de véhicule et véhicule comprenant ledit dispositif
WO2020080566A1 (fr) Dispositif de commande électronique et dispositif de communication
WO2021045256A1 (fr) Appareil de fourniture d'itinéraire et son procédé de fourniture d'itinéraire
EP3545380A1 (fr) Dispositif embarqué de commande de véhicule et procédé de commande du véhicule
WO2017155199A1 (fr) Dispositif de commande de véhicule disposé dans un véhicule, et procédé de commande de véhicule
WO2022154323A1 (fr) Dispositif d'affichage en liaison avec un véhicule et son procédé de fonctionnement
WO2021141145A1 (fr) Dispositif de sortie vidéo et son procédé de commande
WO2020017677A1 (fr) Dispositif de diffusion d'images
WO2019054719A1 (fr) Dispositif d'aide à la conduite de véhicule et véhicule
EP3426536A1 (fr) Dispositif de commande de véhicule monté dans un véhicule, et procédé de commande correspondant
WO2018235979A1 (fr) Dispositif de commande de véhicule disposé dans un véhicule et procédé de commande de véhicule
WO2020149431A1 (fr) Dispositif de fourniture d'itinéraire et procédé de commande associé
WO2020213772A1 (fr) Dispositif de commande de véhicule et procédé de commande associé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19932052

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19932052

Country of ref document: EP

Kind code of ref document: A1