WO2022181903A1 - 차량용 디스플레이 장치 - Google Patents
차량용 디스플레이 장치 Download PDFInfo
- Publication number
- WO2022181903A1 WO2022181903A1 PCT/KR2021/010772 KR2021010772W WO2022181903A1 WO 2022181903 A1 WO2022181903 A1 WO 2022181903A1 KR 2021010772 W KR2021010772 W KR 2021010772W WO 2022181903 A1 WO2022181903 A1 WO 2022181903A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal processing
- processing device
- virtual machine
- processor
- data
- Prior art date
Links
- 238000012545 processing Methods 0.000 claims abstract description 825
- 230000015654 memory Effects 0.000 claims description 137
- 238000000034 method Methods 0.000 claims description 61
- 239000000872 buffer Substances 0.000 claims description 27
- 238000001514 detection method Methods 0.000 claims description 18
- 238000012546 transfer Methods 0.000 claims description 12
- 238000004891 communication Methods 0.000 description 59
- 238000010586 diagram Methods 0.000 description 32
- 230000001360 synchronised effect Effects 0.000 description 11
- 230000004044 response Effects 0.000 description 6
- 238000009877 rendering Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 3
- 239000008186 active pharmaceutical agent Substances 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000446 fuel Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 101100311260 Caenorhabditis elegans sti-1 gene Proteins 0.000 description 1
- 101100115709 Mus musculus Stfa2 gene Proteins 0.000 description 1
- 101100115713 Mus musculus Stfa3 gene Proteins 0.000 description 1
- 101150081243 STA1 gene Proteins 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 210000004185 liver Anatomy 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/213—Virtual instruments
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/544—Buffers; Shared memory; Pipes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45579—I/O management, e.g. providing access to device drivers or storage
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45583—Memory management, e.g. access or allocation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Definitions
- the present invention relates to a display device for a vehicle, and more particularly, to a display device for a vehicle capable of processing data by sharing data in a plurality of signal processing devices for a plurality of displays in a vehicle.
- a vehicle is a device that moves a user in a desired direction.
- a typical example is a car.
- a vehicle display device is mounted inside the vehicle.
- a display is arranged on a cluster or the like to display various types of information.
- various displays such as an AVN (Audio Video Navigation) display and a rear seat entertainment display are being installed in the vehicle separately from the cluster.
- AVN Audio Video Navigation
- a plurality of signal processing apparatuses are used for the plurality of displays.
- An object of the present invention is to provide a display apparatus for a vehicle capable of processing data by sharing data in a plurality of signal processing apparatuses for a plurality of displays in a vehicle.
- another object of the present invention is to provide a display device for a vehicle that can efficiently perform data processing by setting any one of a plurality of signal processing devices for a plurality of displays in a vehicle as a master signal processing device. .
- another object of the present invention is to provide a vehicle display device capable of performing high-speed data communication between a plurality of virtual machines or a plurality of signal processing devices.
- another object of the present invention is to provide a vehicle display device capable of performing high-speed data communication even when a plurality of virtual machines or a plurality of signal processing devices are driven by different operating systems.
- a vehicle display apparatus for achieving the above object includes a first display and a second display mounted on a vehicle, and a processor for performing signal processing for the first display and the second display a second signal processing device including a signal processing device and a second processor that performs signal processing for a third display, wherein the processor in the signal processing device is configured to include, on a hypervisor in the processor, the first virtual machine to the third A virtual machine is executed, and the first virtual machine in the processor shares at least a portion of data with the second signal processing device for data sharing processing when the signal processing device operates as a master signal processing device.
- the server virtualization machine in the second processor may share at least a portion of data with the signal processing device for data sharing processing when the second signal processing device operates as the master signal processing device.
- the first virtual machine in the processor checks the performance information or resource information of the second signal processing device, and based on the performance information or resource information of the second signal processing device, one of the second signal processing device and the signal processing device. Any one can be controlled to operate as a master signal processing device.
- the processor in the signal processing device on a hypervisor in the processor, executes the first virtual machine to the third virtual machine, the second virtual machine operates for the first display, the third virtual machine, the second display can work for
- the first virtual machine in the processor receives, processes the wheel speed sensor data of the vehicle, and transmits the processed wheel speed sensor data to at least one of the second virtual machine or the third virtual machine or to the second signal processing device. can be transmitted
- the first virtual machine in the processor transmits a connection message for connection to the serial-parallel network to the second signal processing device, and when the connectable message from the second signal processing device to the serial-parallel network is not received , it is possible to control the signal processing device to operate as a master signal processing device.
- the first virtual machine in the processor sends, to the second signal processing device, a connection message for connection to the serial-parallel network, and when a connectable message from the second signal processing device to the serial-parallel network is received,
- One of the second signal processing apparatus and the signal processing apparatus may be controlled to operate as a master signal processing apparatus based on the performance information or resource information of the second signal processing apparatus.
- the first virtual machine in the processor based on the protocol information received from the outside, checks whether the server virtual machine in the second signal processing device is driven, if the server virtual machine is not driven in the second signal processing device , it is possible to control the signal processing device to operate as a master signal processing device.
- the first virtual machine in the processor based on the performance information or resource information of the second signal processing device, checks whether the resource sharing of the second signal processing device is possible, and if the resource sharing is possible, the second signal processing device Thus, at least a portion of the processing data may be shared.
- the first virtual machine in the processor during the operation of the signal processing device to the master signal processing device, transmits a transfer of authority message to the server virtualization machine in the second processor, and receives an acknowledgment message from the server virtualization machine in the second processor In this case, it is possible to control the second signal processing device to be changed to the master signal processing device.
- the first virtual machine in the processor receives performance information or resource information for a plurality of virtual machines driven by the second signal processing device, and based on the performance information or resource information for the plurality of virtual machines, the second Any one of a plurality of virtual machines driven by the signal processing device may be controlled.
- the first virtual machine in the processor controls to write the camera data to the first shared memory, and transmits a part of the camera data to the second signal processing device, the server virtual machine in the second processor, the received camera data control to write a portion of the data to the second shared memory, and the guest virtual machine in the second processor processes at least a portion of the data written to the second shared memory, and controls the processed data to be written to the second shared memory can do.
- the second virtual machine in the processor may control to display an image on the display.
- the first virtual machine in the processor may generate a command queue for distributed processing of data.
- the command queue may include command type information, buffer ID information, and buffer address information.
- the first virtual machine in the processor may generate a command queue corresponding to the number of virtual machines for distributed processing of data.
- the first virtual machine in the processor writes a portion of the camera data to the first shared memory to be transferred to the second processor, and the guest virtual machine in the second processor performs object detection on the received camera data, It is possible to control the object detected data to be written to the second shared memory.
- a vehicle display apparatus includes a first display and a second display mounted on a vehicle, and a signal processing apparatus including a processor performing signal processing for the first display and the second display; 3 A second signal processing apparatus including a second processor that performs signal processing for a display, wherein the processor in the signal processing apparatus executes, on a hypervisor in the processor, the first virtualization machine to the third virtualization machine, The first virtual machine in the processor examines the performance information or resource information of the second signal processing device, and based on the performance information or resource information of the second signal processing device, any one of the second signal processing device and the signal processing device to operate as a master signal processing device.
- a display apparatus for a vehicle includes a first display and a second display mounted on a vehicle, and a signal processing apparatus including a processor performing signal processing for the first display and the second display; 3 A second signal processing apparatus including a second processor that performs signal processing for a display, wherein the processor in the signal processing apparatus executes, on a hypervisor in the processor, the first virtualization machine to the third virtualization machine, The first virtual machine in the processor shares at least a portion of data with the second signal processing device for data sharing processing when the signal processing device operates as the master signal processing device. Accordingly, it is possible to divide and process data in a plurality of signal processing devices for a plurality of displays in the vehicle. In addition, it is possible to efficiently manage resources in a plurality of signal processing apparatuses.
- the server virtualization machine in the second processor may share at least a portion of data with the signal processing device for data sharing processing when the second signal processing device operates as the master signal processing device. Accordingly, it is possible to efficiently perform data processing by setting any one of the plurality of signal processing apparatuses as a master signal processing apparatus.
- the first virtual machine in the processor checks the performance information or resource information of the second signal processing device, and based on the performance information or resource information of the second signal processing device, one of the second signal processing device and the signal processing device. Any one can be controlled to operate as a master signal processing device. Accordingly, it is possible to efficiently perform data processing by setting any one of the plurality of signal processing apparatuses as a master signal processing apparatus.
- the processor in the signal processing device on a hypervisor in the processor, executes the first virtual machine to the third virtual machine, the second virtual machine operates for the first display, the third virtual machine, the second display can work for Accordingly, it is possible to divide and process data in a plurality of signal processing devices for a plurality of displays in the vehicle.
- the first virtual machine in the processor receives, processes the wheel speed sensor data of the vehicle, and transmits the processed wheel speed sensor data to at least one of the second virtual machine or the third virtual machine or to the second signal processing device. can be transmitted Accordingly, the vehicle wheel speed sensor data can be shared with at least one virtual machine or a second signal processing device.
- the first virtual machine in the processor transmits a connection message for connection to the serial-parallel network to the second signal processing device, and when the connectable message from the second signal processing device to the serial-parallel network is not received , it is possible to control the signal processing device to operate as a master signal processing device. Accordingly, it is possible to efficiently perform data processing by setting any one of the plurality of signal processing apparatuses as a master signal processing apparatus.
- the first virtual machine in the processor sends, to the second signal processing device, a connection message for connection to the serial-parallel network, and when a connectable message from the second signal processing device to the serial-parallel network is received,
- One of the second signal processing apparatus and the signal processing apparatus may be controlled to operate as a master signal processing apparatus based on the performance information or resource information of the second signal processing apparatus. Accordingly, it is possible to efficiently perform data processing by setting any one of the plurality of signal processing apparatuses as a master signal processing apparatus.
- the first virtual machine in the processor based on the protocol information received from the outside, checks whether the server virtual machine in the second signal processing device is driven, if the server virtual machine is not driven in the second signal processing device , it is possible to control the signal processing device to operate as a master signal processing device. Accordingly, it is possible to efficiently perform data processing by setting any one of the plurality of signal processing apparatuses as a master signal processing apparatus.
- the first virtual machine in the processor based on the performance information or resource information of the second signal processing device, checks whether the resource sharing of the second signal processing device is possible, and if the resource sharing is possible, the second signal processing device Thus, at least a portion of the processing data may be shared. Accordingly, it is possible to efficiently manage resources in a plurality of signal processing apparatuses.
- the first virtual machine in the processor during the operation of the signal processing device to the master signal processing device, transmits a transfer of authority message to the server virtualization machine in the second processor, and receives an acknowledgment message from the server virtualization machine in the second processor
- the first virtual machine in the processor receives performance information or resource information for a plurality of virtual machines driven by the second signal processing device, and based on the performance information or resource information for the plurality of virtual machines, the second Any one of a plurality of virtual machines driven by the signal processing device may be controlled. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- the first virtual machine in the processor controls to write the camera data to the first shared memory, and transmits a part of the camera data to the second signal processing device
- the server virtual machine in the second processor controls to write a portion of the data to the second shared memory
- the guest virtual machine in the second processor processes at least a portion of the data written to the second shared memory, and controls the processed data to be written to the second shared memory can do. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- the second virtual machine in the processor may control to display an image on the display. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- the first virtual machine in the processor may generate a command queue for distributed processing of data. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- the command queue may include command type information, buffer ID information, and buffer address information. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- the first virtual machine in the processor may generate a command queue corresponding to the number of virtual machines for distributed processing of data. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- the first virtual machine in the processor writes a portion of the camera data to the first shared memory to be transferred to the second processor, and the guest virtual machine in the second processor performs object detection on the received camera data, It is possible to control the object detected data to be written to the second shared memory. Accordingly, it is possible to efficiently perform data processing in the plurality of signal processing apparatuses.
- a vehicle display apparatus includes a first display and a second display mounted on a vehicle, and a signal processing apparatus including a processor performing signal processing for the first display and the second display; 3 A second signal processing apparatus including a second processor that performs signal processing for a display, wherein the processor in the signal processing apparatus executes, on a hypervisor in the processor, the first virtualization machine to the third virtualization machine, The first virtual machine in the processor examines the performance information or resource information of the second signal processing device, and based on the performance information or resource information of the second signal processing device, any one of the second signal processing device and the signal processing device to operate as a master signal processing device. Accordingly, it is possible to efficiently perform data processing by setting any one of the plurality of signal processing apparatuses as a master signal processing apparatus.
- 1A is a diagram illustrating an example of the exterior of a vehicle and the interior of the vehicle.
- 1B is a diagram illustrating another example of the interior of a vehicle.
- FIG. 2 is a view illustrating an exterior of a vehicle display device according to an embodiment of the present invention.
- FIG. 3 illustrates an example of an internal block diagram of the vehicle display device of FIG. 2 .
- FIG. 4 is a diagram illustrating a system driven in a signal processing apparatus according to the present invention.
- FIG. 5 is a diagram illustrating an example of a system driven in a signal processing apparatus according to an embodiment of the present invention.
- FIG. 6 is a diagram referenced in explaining the operation of a system driven in a signal processing apparatus according to an embodiment of the present invention.
- FIG. 7 is a diagram illustrating an example of a system driven in a vehicle display device according to an embodiment of the present invention.
- FIG. 8 is a flowchart illustrating a method of operating a display apparatus for a vehicle according to an embodiment of the present invention.
- 9A to 19 are diagrams referred to in the description of FIG. 8 .
- module and “part” for the components used in the following description are given simply in consideration of the ease of writing the present specification, and do not impart a particularly important meaning or role by themselves. Accordingly, the terms “module” and “unit” may be used interchangeably.
- 1A is a diagram illustrating an example of the exterior of a vehicle and the interior of the vehicle.
- the vehicle 200 is operated by a plurality of wheels 103FR, 103FL, 103RL,... .
- the vehicle 200 may further include a camera 195 for acquiring an image in front of the vehicle.
- the vehicle 200 may include a plurality of displays 180a and 180b for displaying images and information therein.
- a cluster display 180a and an Audio Video Navigation (AVN) display 180b are exemplified as a plurality of displays 180a and 180b.
- APN Audio Video Navigation
- HUD Head Up Display
- the AVN (Audio Video Navigation) display 180b may be referred to as a center information display (Center Information Dislpay).
- An embodiment of the present invention proposes a method of sharing data processing in the vehicle display apparatus 100 including a plurality of displays 180a and 180b.
- the vehicle 200 described herein may be a concept including all of a vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source. have.
- 1B is a diagram illustrating another example of the interior of a vehicle.
- a cluster display 180a inside the vehicle, a cluster display 180a, an AVN (Audio Video Navigation) display 180b, a rear seat entertainment display 180c, 180d, a rearview mirror display (not shown), etc. are provided. can be mounted
- An embodiment of the present invention proposes a method of sharing data processing in the vehicle display apparatus 100 having a plurality of displays 180a to 180d. This will be described with reference to FIG. 12 and below.
- FIG. 2 is a view illustrating an exterior of a vehicle display device according to an embodiment of the present invention.
- the vehicle display apparatus 100 is a signal processing apparatus that performs signal processing for displaying images, information, etc. on a plurality of displays 180a to 180b and the plurality of displays 180a to 180b. (170), at least one display (180c to 180d), and a second signal processing device (170b) for performing signal processing for displaying images, information, etc. on the at least one display (180c to 180d); can do.
- the signal processing apparatus 170 and the second signal processing apparatus 170b may be disposed to be spaced apart from each other.
- the second signal processing apparatus 170b may be driven according to an operating system (OS) different from that of the signal processing apparatus 170 .
- OS operating system
- the first display 180a is a cluster display 180a for displaying driving state and operation information
- the second display 180b is, vehicle driving information, a navigation map, various It may be an AVN (Audio Video Navigation) display 180b for displaying entertainment information or an image.
- AVN Audio Video Navigation
- the third display 180c among the at least one display 180c to 180d may be a display for entertainment in a right rear seat of a vehicle, and the fourth display 180d may be a display for entertainment in a left rear seat of a vehicle.
- the at least one display 180c to 180d may display driving state information, simple navigation information, various entertainment information, or an image.
- the signal processing apparatus 170 includes a processor 175 therein, and may execute the first virtual machine to the third virtual machine 520 to 540 on the hypervisor 505 in the processor 175 .
- the first virtual machine 520 may correspond to a server virtual machine (Server virtual maschine), and the second to third virtual machines may correspond to a guest virtual machine (guest virtual maschine).
- Server virtual maschine server virtual machine
- guest virtual maschine guest virtual machine
- data communication may be performed between the first virtual machine 520 and the second or third virtual machines 530 and 50 according to a server interface and a client interface.
- the second virtual machine 530 may operate for the first display 180a, and the third virtual machine 540 may operate for the second display 180b.
- the first virtual machine 520 in the processor 175 shares at least a portion of data with the second virtual machine 530 and the third virtual machine 540 for data sharing processing. Accordingly, it is possible to divide and process data in a plurality of signal processing devices for a plurality of displays in the vehicle.
- the first virtual machine 520 in the processor 175 receives, and processes the wheel speed sensor data of the vehicle, at least one of the second virtual machine 530 or the third virtual machine 540 or the second
- the processed wheel speed sensor data may be transmitted to the signal processing device 170b. Accordingly, the vehicle wheel speed sensor data can be shared with at least one virtual machine or a second signal processing device.
- the first virtual machine 520 in the processor 175 writes a portion of the data to the first shared memory 508a to be transferred to the second virtual machine 530, and writes another portion of the data to the third virtual machine is written to the first shared memory 508a to be transferred to the control to be recorded in Accordingly, it is possible to divide and process data in a plurality of signal processing devices for a plurality of displays in the vehicle.
- the first virtual machine 520 in the processor 175, the second virtual machine 530 and the third virtual machine 540, for the same data transfer, the hypervisor 505 based shared memory 508 ) can be controlled to be set. Accordingly, it is possible to synchronize and display the same information or the same image on the first display 180a and the second display 180b in the vehicle.
- the signal processing apparatus 170 includes a processor 175 therein, and may execute the first virtual machine to the third virtual machine 520 to 540 on the hypervisor 505 in the processor 175 .
- the first virtual machine 520 may correspond to a server virtual machine (Server virtual maschine), and the second to third virtual machines may correspond to a guest virtual machine (guest virtual maschine).
- Server virtual maschine server virtual machine
- guest virtual maschine guest virtual machine
- data communication may be performed between the first virtual machine 520 and the second or third virtual machines 530 and 50 according to a server interface and a client interface.
- the second signal processing device 170b has a second processor 175b therein, and on the hypervisor 505b in the second processor 175b, a server virtual machine (Server virtual maschine) 520b, a guest virtual machine 530b, or the like.
- server virtual machine Server virtual maschine
- some of the plurality of displays 180a to 180d may operate under the Linux OS, and others may operate under the web OS.
- the signal processing apparatus 170 and the second signal processing apparatus 170b share data and process data in the displays 180a to 180d operating under various operating systems (OS).
- OS operating systems
- the signal processing apparatus 170 and the second signal processing apparatus 170b according to the embodiment of the present invention have the same information or the same information in the displays 180a to 180d operating under various operating systems (OS). You can control the display to synchronize the image.
- OS operating systems
- the signal processing apparatus 170 and the second signal processing apparatus 170b share at least a portion of data for data sharing processing. Accordingly, the plurality of signal processing apparatuses 170 for a plurality of displays in the vehicle can divide and process data. In addition, it is possible to efficiently manage resources in the plurality of signal processing devices 170 .
- FIG. 3 illustrates an example of an internal block diagram of a vehicle display apparatus according to an embodiment of the present invention.
- the vehicle display apparatus 100 includes an input unit 110 , a communication unit 120 , an interface 130 , a second interface 130b , a memory 140 , and a signal processing device. 170 , a second signal processing device 170b , a plurality of displays 180a to 180d , an audio output unit 185 , and a power supply unit 190 may be provided.
- the input unit 110 may include a physical button, a pad, and the like for button input, touch input, and the like.
- the input unit 110 may include a microphone (not shown) for inputting a user's voice.
- the communication unit 120 may exchange data with the mobile terminal 800 or the server 900 in a wireless manner.
- the communication unit 120 may wirelessly exchange data with the mobile terminal of the vehicle driver.
- various data communication methods such as Bluetooth, WiFi, WiFi Direct, and APiX are possible.
- the communication unit 120 may receive weather information, road traffic condition information, for example, Transport Protocol Expert Group (TPEG) information from the mobile terminal 800 or the server 900 . To this end, the communication unit 120 may include a mobile communication module (not shown).
- TPEG Transport Protocol Expert Group
- the interface 130 may receive sensor information or the like from the ECU 770 or the sensor device 760 , and transmit the received information to the signal processing device 170 .
- the second interface 130b may receive sensor information or the like from the ECU 770 or the sensor device 760 and transmit the received information to the second signal processing device 170b.
- the sensor information includes vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward/reverse information, battery information, fuel information, tire information, vehicle It may include at least one of lamp information, vehicle internal temperature information, and vehicle internal humidity information.
- Such sensor information includes a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward/reverse sensor, a wheel sensor, a vehicle speed sensor, It may be obtained from a vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, and the like.
- the position module may include a GPS module for receiving GPS information.
- the interface 130 receives the vehicle front image data, the vehicle side image data, the vehicle rear image data, the obstacle distance information around the vehicle, etc. from the camera 195 or the rider (not shown), and the received information
- the signal may be transmitted to the signal processing device 170 .
- the memory 140 may store various data for the overall operation of the vehicle display apparatus 100 , such as a program for processing or controlling the signal processing apparatus 170 .
- the memory 140 may store data related to the hypervisor, the first virtual machine to the third virtual machine, for execution in the processor 175 .
- the audio output unit 185 converts the electrical signal from the signal processing device 170 into an audio signal and outputs it.
- a speaker or the like may be provided.
- the power supply unit 190 may supply power required for the operation of each component under the control of the signal processing device 170 .
- the power supply unit 190 may receive power from a battery inside the vehicle.
- the signal processing apparatus 170 controls the overall operation of each unit in the vehicle display apparatus 100 .
- the processor 175 for performing signal processing for the vehicle displays 180a and 180b may be included.
- the processor 175 may execute the first to third virtualization machines 520 to 540 on a hypervisor ( 505 in FIG. 5 ) in the processor 175 .
- the first virtual machine 520 among the first to third virtual machines may be called a Server Virtual Machine, and the second to third virtual machines Reference numerals 530 to 540 may be referred to as guest virtual machines.
- the second virtual machine 530 may operate for the first display 180a
- the third virtual machine 540 may operate for the second display 180b.
- the first virtual machine 520 in the processor 175 may receive, process or process and output vehicle sensor data, location information data, camera image data, audio data, or touch input data.
- vehicle sensor data location information data
- camera image data location information data
- audio data audio data
- touch input data location information data
- touch input data location information data
- data processing can be efficiently performed.
- by performing most of the data processing in the first virtual machine 520 it is possible to share data in a 1:N manner.
- the first virtual machine 520 directly receives and processes CAN communication data, audio data, radio data, USB data, and wireless communication data for the second virtual machine to the third virtual machine 530 to 540 . can do.
- the first virtual machine 520 may transmit the processed data to the second to third virtual machines 530 to 540 .
- the first virtual machine 520 of the first to third virtual machines 520 to 540 receives communication data and external input data and performs signal processing, thereby processing signals in other virtual machines.
- the burden is reduced, and 1:N data communication becomes possible, and synchronization at the time of data sharing becomes possible.
- the first virtual machine 520 writes a portion of the data to the first shared memory 508a to be transferred to the second virtual machine 530, and the first to transfer the other portion of the data to the third virtual machine.
- writes to the shared memory 508a, the second virtual machine 530 and the third virtual machine 540 process the received data, respectively, and control so that the processed data is written to the second shared memory 508b . Accordingly, it is possible to divide and process data in a plurality of signal processing devices for a plurality of displays in the vehicle.
- the data may be any one of image data, audio data, navigation data, and voice recognition data.
- the first virtual machine 520 by processing another part of the data, the second shared memory 508b may control the processed data to be written. That is, in addition to the second virtual machine 530 and the third virtual machine, the first virtual machine 520 may perform data processing.
- the first virtual machine 520, the second virtual machine to the third virtual machine may generate each command queue for the distributed processing of the data. Accordingly, data can be shared and processed by a plurality of virtual machines.
- the first virtual machine 520 may generate a command queue corresponding to the number of virtual machines for distributed processing of data.
- the first virtual machine 520 for data distribution processing, at least a portion of the data, at least one of the second virtual machine 530 or the third virtual machine 540 or the second signal processing device (170b) can be controlled to be transmitted to
- the first virtual machine 520 is configured to transmit at least a portion of the data to at least one of the second virtual machine 530 or the third virtual machine 540 or to the second signal processing device 170b.
- the first shared memory 508a is allocated, and image data processed by the second virtual machine 530 or the third virtual machine 540 may be recorded in the second shared memory 508b.
- the first virtual machine 520 by writing the data to the shared memory 508, the second virtual machine 530 and the third virtual machine 540 can be controlled to share the same data.
- the first virtual machine 520 writes radio data or wireless communication data to the shared memory 508 so as to share the same data with the second virtual machine 530 and the third virtual machine 540 .
- the hypervisor 505 based shared memory 508 can be controlled to be set.
- the first virtual machine 520 in the processor 175 is the same as the second virtual machine 530 and the third virtual machine 540 using the hypervisor 505-based shared memory 508 .
- Data can be synchronized and transmitted. Accordingly, it is possible to synchronize and display the same image on the plurality of displays 180a to 180b in the vehicle.
- the signal processing apparatus 170 may process various signals such as an audio signal, an image signal, and a data signal.
- the signal processing apparatus 170 may be implemented in the form of a system on chip (SOC).
- the second signal processing apparatus 170b performs signal processing for the vehicle displays 180c and 180d, and may include a second processor 175b for this purpose.
- the second processor 175b may execute a server virtualization machine 520b and guest virtualization machines 530b to 540b on a hypervisor ( 505b in FIG. 7 ) in the second processor 175b .
- the server virtualization machine 520b in the second processor 175b may perform vehicle sensor data, location information data, and a camera image from the first virtual machine 520 in the processor 175 in the signal processing device 170 .
- Data, audio data, or touch input data may be received, processed or processed and output.
- the server virtualization machine 520b for the guest virtualization machines 530b - 540b, from the first virtual machine 520 in the processor 175 in the signal processing device 170, CAN communication data, audio data, It can receive and process radio data, USB data, and wireless communication data.
- server virtualization machine 520b may transmit the processed data to the guest virtualization machines 530b to 540b.
- the server virtualization machine 520b among the server virtualization machine 520b and the guest virtualization machines 530b to 540b receives communication data and external input data, and performs signal processing, thereby performing signal processing, so that the guest virtualization machine 530b ⁇ 540b), the burden of signal processing is reduced, and 1:N data communication becomes possible, and synchronization at the time of data sharing becomes possible.
- the server virtualization machine 520b records a portion of the data in the shared memory 508b to be transferred to the guest virtualization machine 530b, and the guest virtualization machines 530b to 540b process the received data, respectively, Controlled so that the processed data is written to the shared memory 508b. Accordingly, it is possible to divide and process data in a plurality of signal processing devices for a plurality of displays in the vehicle.
- the data may be any one of image data, audio data, navigation data, and voice recognition data.
- the server virtualization machine 520b, the second virtual machine to the third virtual machine may generate each command queue for the distributed processing of the data. Accordingly, data can be shared and processed by a plurality of virtual machines.
- server virtualization machine 520b in the second processor 175b shares the same data in the second to third virtualization machines 530 and 540, one and the same command queue may be generated. Accordingly, the same data can be synchronized and shared.
- server virtualization machine 520b may generate a command queue corresponding to the number of virtualization machines for distributed processing of data.
- the server virtualization machine 520b for data distribution processing, at least a portion of the data may be controlled to be transmitted to at least one of the guest virtualization machine 530b or the guest virtualization machine 540b.
- the server virtualization machine 520b allocates a shared memory 508b for transferring at least a portion of the data to at least one of the guest virtualization machine 530b or the guest virtualization machine 540b, and the guest virtualization machine ( 530b) or image data processed by the guest virtualization machine 540b may be written to the shared memory 508b.
- the server virtualization machine 520b by writing data to the shared memory 508b, can be controlled to share the same data with the guest virtualization machines (530b ⁇ 540b).
- the server virtualization machine 520b may write radio data or wireless communication data to the shared memory 508b, and control to share the same data with the guest virtualization machines 530b - 540b. Accordingly, it is possible to share data in a 1:N scheme.
- the server virtualization machine 520b in the second processor 175b may synchronize and transmit the same data to the guest virtualization machines 530b to 540b using the hypervisor 505b-based shared memory 508b. have. Accordingly, it is possible to synchronize and display the same image on the plurality of displays 180c to 180d in the vehicle.
- the second signal processing apparatus 170b may process various signals such as an audio signal, an image signal, and a data signal.
- the second signal processing device 170b may be implemented in the form of a system on chip (SOC).
- FIG. 4 is a diagram illustrating a system driven in a signal processing apparatus according to the present invention.
- FIG. 4 is a diagram illustrating that a virtual machine is used for a cluster display 180a and an AVN display 180b, respectively.
- the system 400 driven in the signal processing apparatus of FIG. 4 is a cluster virtualization machine 430 and an AVN virtualization machine 440 running on a hypervisor 405 in the processor 175 in the signal processing apparatus 170 . exemplify that
- the system 400 driven in the signal processing apparatus of FIG. 4 exemplifies that the legacy virtualization machine 410 is also executed on the hypervisor 405 in the processor 175 .
- the legacy virtual machine 410 includes an interface 412 for data communication with the memory 140 and an interface 413 for Ethernet communication.
- the cluster virtualization machine 430 may be provided with an interface 433 for communication with the interface 413 .
- the AVN virtual machine 440 is an interface 441 for input/output of audio data, radio data, USB data, and wireless communication data, and an interface for communication with the interface 412 of the legacy virtual machine 410 . 442 , an interface 443 for communication with an interface 413 of the legacy virtualization machine 410 .
- audio data, radio data, USB data, and wireless communication data are input/output only from the AVN virtualization machine 440 , so the cluster virtualization machine 430 cannot utilize these data. There is this.
- the cluster virtualization machine 430 and the cluster virtualization machine 430 must have separate interfaces 431,432,441,442, respectively. have.
- the present invention proposes a method for improving the system of FIG. 4 . That is, unlike FIG. 4, the virtual machine is divided into a server virtual machine and a guest virtual machine, and various types of memory data, communication data, etc. are input/output from the server virtual machine without input/output from the guest virtual machine. This will be described with reference to FIG. 5 or less.
- FIG. 5 is a diagram illustrating an example of a system driven in a signal processing apparatus according to an embodiment of the present invention.
- the system 500 of FIG. 5 is a first virtual machine 520 that is a server virtualization machine, and a second virtual machine that is a guest virtual machine, on a hypervisor 505 in a processor 175 in a signal processing device 170 .
- the second virtual machine 530 and the guest virtual machine exemplifies that the third virtual machine 540 is executed.
- the second virtual machine 530 may be a virtual machine for the cluster display 180a
- the third virtual machine 540 may be a virtual machine for the AVN display 180b.
- the second virtual machine 530 and the third virtual machine 540 may operate for image rendering of the cluster display 180a and the AVN display 180b, respectively.
- the system 500 driven by the signal processing device 170 of FIG. 5 exemplifies that the legacy virtualization machine 510 is also executed on the hypervisor 505 in the processor 175 .
- the legacy virtual machine 510 includes an interface 511 for data communication with the memory 140 and Ethernet communication.
- the legacy virtual machine 510 may further include an interface (virtio-backend interface) 512 for data communication with the second to third virtual machines 530 and 540 .
- an interface virtual-backend interface
- the first virtual machine 520 may include an interface 521 for input/output of audio data, radio data, USB data, and wireless communication data, and an input/output server interface 522 for data communication with the guest virtual machine. .
- the first virtual machine 520 which is a server virtualization machine, uses I/O that is difficult to be virtualized by standard virtualization technology (VirtIO) to a plurality of guest virtual machines, for example, the second to third virtual machines 530 and 540. etc. can be provided.
- VirtualIO virtualization technology
- the first virtual machine 520 which is a server virtualization machine, controls radio data, audio data, etc. at the supervisor level, and provides a plurality of guest virtual machines, for example, the second to third virtual machines 530 and 540, etc. can do.
- the first virtual machine 520 which is a server virtualization machine, processes vehicle data, sensor data, vehicle surrounding information, and the like, and transfers the processed data or information to a plurality of guest virtual machines, for example, the second to second 3 may be provided to virtual machines (530, 540) and the like.
- the first virtual machine 520 may provide services (Supervisory Services), such as vehicle data processing and audio routing management.
- Supervisory Services such as vehicle data processing and audio routing management.
- the second virtual machine 530 may include an input/output client interface 532 for data communication with the first virtual machine 520 and APIs 533 for controlling the input/output client interface 532 . .
- the second virtual machine 530 may include an interface (virtio-backend interface) for data communication with the legacy virtual machine 510 .
- the second virtual machine 530 is, through an interface (virtio-backend interface), memory data by communication with the memory 140 from the interface (virtio-backend interface) 512 of the legacy virtual machine 510 (virtio-backend interface) , Ethernet data can be received by Ethernet communication.
- the third virtual machine 540 may include an input/output client interface 542 for data communication with the first virtual machine 520 and APIs 543 for controlling the input/output client interface 542 .
- the third virtual machine 540 may include an interface (virtio-backend interface) for data communication with the legacy virtual machine 510 .
- the third virtual machine 540 is, through an interface (virtio-backend interface), memory data by communication with the memory 140 from the interface (virtio-backend interface) 512 of the legacy virtual machine 510 (virtio-backend interface) , Ethernet data can be received by Ethernet communication.
- the legacy virtual machine 510 may be provided in the first virtual machine 520 , unlike FIG. 5 .
- CAN communication data is input and output only in the first virtual machine 520, but through data processing in the first virtual machine 520, a plurality of guest virtual machines, for example, the second to third virtual machines 530 and 540 may be provided. Accordingly, 1:N data communication by the processing of the first virtual machine 520 is enabled.
- audio data, radio data, USB data, and wireless communication data are input and output only in the first virtual machine 520 , but through data processing in the first virtual machine 520 .
- a plurality of guest virtualization machines for example, the second to third virtualization machines 530 and 540, etc. may be provided. Accordingly, 1:N data communication by the processing of the first virtual machine 520 is enabled.
- the second to third virtual machines 530 and 540 may operate based on different OSs.
- the second virtual machine 540 may operate under a Linux OS, and the third virtual machine 540 may operate under a web OS.
- the hypervisor 505-based shared memory 508 is set. Accordingly, even if the second to third virtual machines 530 and 540 operate under different operating systems (OS), the same data or the same image can be synchronized and shared. As a result, the same data or the same image can be synchronized and displayed on the plurality of displays 180a and 180b.
- OS operating systems
- FIG. 6 is a diagram referenced in explaining the operation of a system driven in a signal processing apparatus according to an embodiment of the present invention.
- the same image data may be exemplified as the same data. Accordingly, it is possible to synchronize and display the same image on the plurality of displays 180a to 180b in the vehicle.
- CAN communication data audio data, radio data, USB data, wireless communication data, location information data, or touch data
- CAN communication data audio data
- radio data radio data
- USB data USB data
- wireless communication data location information data
- touch data touch data
- the legacy virtualization machine 510 uses the memory data from the memory 140, Ethernet data by Ethernet communication, and the shared memory 508 based on the hypervisor 505,
- the second virtual machine 530 and the third virtual machine 540 may be transmitted in synchronization. That is, 1:N data communication for memory data or Ethernet data can be performed. Accordingly, the same data can be synchronized and transmitted.
- FIG. 7 is a diagram illustrating an example of a system driven in a vehicle display device according to an embodiment of the present invention.
- the vehicle display apparatus 100 is a signal processing apparatus including a processor 175 that performs signal processing for a first display 180a and a second display 180b. and a second signal processing device 170b including a 170 and a second processor 175b that performs signal processing for the third display 180c.
- the processor 175 in the signal processing device 170 executes the first virtual machine to the third virtual machine 520 to 540 on the hypervisor 505 in the processor 175 .
- the second virtual machine 530 as a guest virtual machine, operates for the first display 180a
- the third virtual machine 540 as a guest virtual machine, operates for the second display 180b and the first virtual machine 520 operates as a server virtualization machine.
- the first virtual machine 520 in the processor 175 receives, and processes the wheel speed sensor data of the vehicle, at least one of the second virtual machine 520 or the third virtual machine 540 or the second
- the processed wheel speed sensor data may be transmitted to the signal processing device 170b. Accordingly, the wheel speed sensor data of the vehicle may be shared with at least one virtual machine or the second signal processing device 170b.
- the signal processing apparatus 170 is illustrated as a host signal processing apparatus and the second signal processing apparatus 170b is illustrated as a remote signal processing apparatus, but the present invention is not limited thereto.
- the first virtual machine 520 in the processor 175 may drive the input/output server interface 522 .
- the plurality of signal processing apparatuses 170 for a plurality of displays in the vehicle can divide and process data.
- the first virtual machine 520 in the processor 175 checks the performance information or resource information of the second signal processing device 170b, and the performance information or resource information of the second signal processing device 170b Based on , any one of the second signal processing apparatus 170b and the signal processing apparatus 170 may be controlled to operate as the master signal processing apparatus 170 . Accordingly, by setting the master signal processing device 170 in the plurality of signal processing devices 170, it is possible to efficiently perform data processing.
- the hypervisor 505b drives, and the server virtualization machine 520b and the guest virtualization machine 530b on the hypervisor 505b ) is driven, and it has been exemplified that the input/output server interface 522b is driven in the server virtualization machine 520b, but unlike this, the virtualization machine may not be driven.
- the first virtual machine 520 in the processor 175 operates the signal processing device 170 among the second signal processing device 170b and the signal processing device 170 as the master signal processing device 170 . can be controlled Accordingly, it is possible to efficiently perform data processing.
- the second signal processing device 170b may operate as a master signal processing device, and the signal processing device 170 may operate as a slave signal processing device.
- the server virtualization machine 520b in the second processor 175b when the second signal processing unit 170b operates as the master signal processing unit 170, for data sharing processing, the signal processing unit ( 170) may share at least a portion of the data. Accordingly, by setting the master signal processing device 170 in the plurality of signal processing devices 170, it is possible to efficiently perform data processing.
- the vehicle display apparatus 100 includes a signal processing apparatus 170 including a processor 175 that performs signal processing for a first display 180a and a second display 180b. ) and a second signal processing device 170b including a second processor 175b that performs signal processing for the third display 180c.
- the processor 175 in the signal processing device 170 on the hypervisor 505 in the processor 175, the first virtual machine to the third virtual machine (520 ⁇ 540) run
- the first virtual machine 520 in the processor 175 checks the performance information or resource information of the second signal processing device 170b, and the second signal processing device ( One of the second signal processing apparatus 170b and the signal processing apparatus 170 is controlled to operate as the master signal processing apparatus 170 based on the performance information or resource information of 170b). Accordingly, by setting any one of the plurality of signal processing apparatuses 170 and 175b as the signal processing apparatus, it is possible to efficiently perform data processing.
- FIG. 8 is a flowchart illustrating a method of operating a display apparatus for a vehicle according to an embodiment of the present invention
- FIGS. 9A to 19 are views referenced in the description of FIG. 8 .
- the signal processing apparatus 170 may check the second signal processing apparatus 170b ( S810 ).
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may check the second signal processing device 170b.
- the signal processing apparatus 170 and the second signal processing apparatus 170b may be connected by wire or wirelessly.
- the interface method between the signal processing device 170 and the second signal processing device 170b is based on ethernet, USB, or PCI Express (PCIe) based CCIX, NvLink, It may be a high-speed interface method such as CXL.
- PCIe PCI Express
- the processor 175 in the signal processing device 170 may check the interface protocol of the second signal processing device 170b ( S820 ).
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may check the interface protocol of the second signal processing device 170b.
- 9B is a diagram illustrating an example of an interface protocol 950 between the signal processing device 170 and the second signal processing device 170b.
- the interface protocol 950 is an SOA interworking protocol, and may include SOME/IP, SOME/IP SD, and an interface header.
- the extension bit 964 in the information 960 may be enabled.
- reserved information 952 is [0x00], it indicates Find Server VM, if it is [0x01], indicates Offer Server VM, if it is [0x02], indicates Request capability, and is [0x03]. In this case, it indicates Request capability ACK.
- Type information 954 is [0x00], it indicates Find Service, if it is [0x01], it indicates Offer Service, if it is [0x02], it indicates Request Service, and if it is [0x03], it indicates Request Service.
- Indicates ACK [0x04] indicates Find EVENT group, [0x05] indicates Publish Event group, [0x06] indicates Subscribe Event group, and [0x07] indicates Subscribe Event group ACK indicates
- extension bit 964 when the extension bit 964 is [0x00], it indicates only IxF, and when it is [0x01], it indicates IxF with SOME/IP.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 through the received interface protocol 950, whether the virtual machine exists in the second signal processing device 170b and is driven It is determined whether or not (S825).
- the second signal processing device 170b (S825), the first virtual machine 520 in the processor 175 in the signal processing device 170, the second signal processing device 170b It is possible to check the performance information or resource information of the virtual machine within (S830).
- the second signal processing apparatus 170b may transmit, to the signal processing apparatus 170 , performance information or resource information of a virtual machine within the signal processing apparatus 170b.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 based on the performance information or resource information of the virtual machine in the received second signal processing device 170b, the signal processing device ( 170) and a master signal processing device among the second signal processing devices 170b is determined (S835).
- the signal processing device 170 is the master signal processing device. can be decided.
- the second signal processing device 170b is the master signal processing device can be determined as
- the signal processing device 170 is the master It may be determined by a signal processing device.
- the second signal processing device 170b may be determined as the master signal processing device.
- the signal processing device 170 is the master signal processing device (S840)
- the first virtual machine 520 in the processor 175 in the signal processing device 170 the data to the second signal processing device (170b) share at least a part of (S845).
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may reduce the level difference between the available information of the signal processing device 170 and the second signal processing device 170 , Resources in the signal processing device 170 and the second signal processing device 170 may be reallocated. Accordingly, it is possible to efficiently manage resources in the plurality of signal processing devices 170 and 175b.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 based on the performance information or resource information of the second signal processing device 170b, the second signal processing device (170b) It is checked whether resource sharing is possible, and when resource sharing is possible, at least a portion of the processed data may be shared with the second signal processing apparatus 170b. Accordingly, it is possible to efficiently manage resources in the plurality of signal processing devices 170 and 175b.
- the first virtual machine 520 in the processor 175 in the signal processing device 170, the second signal processing device 170 determines whether the resource distribution or resource sharing is possible, and if possible, the signal processing Resources in the device 170 and the second signal processing device 170 may be reallocated. Accordingly, it is possible to efficiently manage resources in the plurality of signal processing devices 170 and 175b.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 determines whether resource distribution or resource sharing is possible, and if not possible, signal processing It is possible to reallocate resources only within the guest virtualization machines 530 , 540 within the device 170 . Accordingly, it is possible to efficiently manage resources in the signal processing apparatus 170 except for the second signal processing apparatus 170b.
- 9B is a diagram illustrating exchanging performance information or resource information between the first virtual machine 520 in the signal processing device 170 and the server virtualization machine 520b in the second signal processing device 170b. .
- the first virtual machine 520 in the processor 175 in the signal processing device 170 stores reserved information 952 in the interface protocol 950 transmitted to the second signal processing device 170b [ 0x00] to transmit (S910).
- the server virtualization machine 520b in the second signal processing device 170b may transmit the reserved information 952 in the interface protocol 950 transmitted to the signal processing device 170 by setting it to [0x01]. There is (S912).
- the reserved information 952 in the received interface protocol 950 is [0x01]
- the first virtual machine 520 in the processor 175 in the signal processing device 170, the second signal processing device 170b It can be determined that there is a virtual machine in there.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 the received reserved information 952 in the interface protocol 950, or not, or the interface protocol 950, etc. If this is not received, it may be determined that the virtual machine does not exist in the second signal processing device 170b.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 transmits to the second signal processing device 170b in order to grasp the performance information of the second signal processing device 170b and the like.
- the reserved information 952 in the interface protocol 950 may be set to [0x02] and transmitted (S916).
- the server virtualization machine 520b in the second signal processing device 170b transmits the reserved information 952 in the interface protocol 950 transmitted to the signal processing device 170 to [ 0x03] to transmit (S916).
- the first virtual machine 520 in the processor 175 in the signal processing unit 170 based on the reserved information 952 in the received interface protocol 950 , the server virtualization machine in the second signal processing unit 170b Performance information or resource information of 520b may be identified.
- 9C is a diagram illustrating various performance information and resource information of the first virtual machine 520 in the processor 175 in the signal processing device 170 and the server virtualization machine 520b in the second signal processing device 170b .
- FIG. 9c illustrates that the performance information of the first virtual machine 520 in the processor 175 in the signal processing device 170 is object detection, and 30% of the resources are used.
- the performance information of the server virtualization machine 520b in the second signal processing unit 170b is media decryption (DRM), illustrating that the resource is used by 40%.
- DRM media decryption
- 9c (b) illustrates that the performance information of the first virtual machine 520 in the processor 175 in the signal processing device 170 is object detection and uses 30% of the resources, and the second signal processing device It illustrates that the performance information of the server virtualization machine 520b in 170b is distributed object rendering, and uses 35% of the resources.
- Figure 9c (c) illustrates that the performance information of the first virtual machine 520 in the processor 175 in the signal processing device 170 is media decryption (DRM), and uses 40% of the resources
- DRM media decryption
- 2 illustrates that the performance information of the server virtualization machine 520b in the signal processing unit 170b is distributed object rendering, and uses 35% of the resource.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 as shown in Fig. 9c, based on various performance information or resource information, the signal processing device 170 and the second signal processing device A master signal processing device in (170b) is determined. Accordingly, it is possible to efficiently operate the signal processing apparatus 170 and the second signal processing apparatus 170b.
- FIG. 10A is a diagram illustrating a case in which the serial-parallel network 1000 does not exist in the vehicle display apparatus 100 .
- the signal processing device 170 in the vehicle display device 100 without passing through the serial and parallel network 1000, from the camera 195, the radar 198, the display 180, each image signal, It can receive a sensing signal and an image signal.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 receives image data, sensing data, and image data from the camera 195 , the radar 198 , and the display 180 , respectively. can do.
- the signal processing device 170 is the master signal processing device
- the input/output server interface 522 in the first virtual machine 520, for data processing or data sharing, etc., in the second signal processing device 170b Image data, sensing data, and at least a portion of the image data may be transmitted to the input/output server interface 522b in the server virtualization machine 520b (STb2).
- 10B is a diagram illustrating a case in which the serial-parallel network 1000 exists in the vehicle display apparatus 100b.
- a deserializer network may mean a network in which a plurality of signal processing devices 170 and 170b can perform data input/output with the camera 195, the radar 198, the display 180, and the like, in common. can
- the signal processing device 170 in the vehicle display device 100b through the serial-parallel network 1000, from the camera 195, the radar 198, the display 180, each image signal, A sensing signal and an image signal may be received, or a signal may be transmitted to the camera 195 , the radar 198 , and the display 180 , respectively (STa1).
- the first virtual machine 520 in the processor 175 in the signal processing device 170 via the serial-parallel network 1000, from the camera 195, the radar 198, the display 180, respectively, the image Data, sensing data, and image data may be received, or signals may be transmitted to the camera 195 , the radar 198 , and the display 180 , respectively.
- the signal processing device 170 is the master signal processing device
- the input/output server interface 522 in the first virtual machine 520, for data processing or data sharing, etc., in the second signal processing device 170b Image data, sensing data, and at least a portion of the image data may be transmitted to the input/output server interface 522b in the server virtualization machine 520b (STa2).
- the first virtual machine 520 in the processor 175 may check whether the connection to the serial-parallel network 1000 is connected.
- the first virtual machine 520 in the processor 175 sends a connection message for connection to the serial-parallel network 1000 to the second signal processing device 170b, and the second signal processing device 170b ) from the serial-parallel network 1000 is not received, it is possible to control the signal processing device 170 to operate as the master signal processing device (170). Accordingly, by setting any one of the plurality of signal processing apparatuses 170 and 175b as the signal processing apparatus, it is possible to efficiently perform data processing.
- the first virtual machine 520 in the processor 175 transmits a connection message for connection to the serial-parallel network 1000 to the second signal processing unit 170b, and the second signal processing unit 170b.
- a connection enable message to the serial/parallel network 1000 is received from the Any one may be controlled to operate as the master signal processing device 170 . Accordingly, by setting any one of the plurality of signal processing apparatuses 170 and 175b as the signal processing apparatus, it is possible to efficiently perform data processing.
- the input/output server interface 522b in the second virtual machine 520b is, through the serial-parallel network 1000, the camera 195, the radar ( 198), image data, sensing data, and image data may be respectively received from the display 180 (STa3).
- the input/output server interface 522b in the second virtual machine 520b is, for data processing or data sharing, within the signal processing device 170 .
- Image data, sensing data, and at least a portion of the image data may be transmitted to the input/output server interface 522 in the server virtualization machine 520 . Accordingly, by setting any one of the plurality of signal processing apparatuses 170 and 175b as the signal processing apparatus, it is possible to efficiently perform data processing.
- the first virtual machine 520 in the processor 175 receives the performance information or resource information on a plurality of virtual machines driven by the second signal processing device 170b, and the performance information on the plurality of virtual machines Alternatively, one virtual machine among a plurality of virtual machines driven by the second signal processing apparatus 170b may be controlled based on the resource information. Accordingly, it is possible to efficiently process data in the plurality of signal processing apparatuses 170 and 175b. This will be described with reference to FIG. 10C.
- 10C is a diagram illustrating control of the guest virtualization machine 530b in the second signal processing device 170 when the serial/parallel network 1000 does not exist in the vehicle display device 100 .
- the signal processing apparatus 170 and the second signal processing apparatus 170b in the vehicle display apparatus 100 collect performance information or resource information of the virtual machine, respectively (STc1).
- the input/output server interface 522 in the first virtual machine 520 in the signal processing device 170 is an input/output server interface 522b in the server virtualization machine 520b in the second signal processing device 170b, performance information A request message is transmitted (STc2).
- the input/output server interface 522b in the server virtual machine 520b in the second signal processing unit 170b is connected to the input/output server interface 522 in the first virtual machine 520 in the signal processing unit 170.
- a performance information message is transmitted (STc3).
- the performance information message may include performance information of the server virtualization machine 520b in the second signal processing device 170b, performance information of the guest virtualization machine 530b, and the like.
- the first virtual machine 520 in the signal processing device 170 based on the received performance information message, whether it is possible to directly control at least one of the plurality of virtual machines in the second signal processing device 170b It is determined whether or not (STc4).
- the first virtual machine 520 in the signal processing device 170 can directly control at least one of the plurality of virtual machines in the second signal processing device 170b, it is possible to directly control the corresponding virtual machine. have.
- the first virtual machine 520 in the signal processing device 170 directly controls the guest virtual machine 530b among a plurality of virtual machines in the second signal processing device 170b.
- the first virtual machine 520 in the signal processing device 170 may directly control the media DRM performed by the guest virtual machine 530b in the second signal processing device 170b. Accordingly, it is possible to efficiently perform data processing.
- 10D is a diagram illustrating control of the guest virtualization machine 530b in the second signal processing device 170 when the serial-parallel network 1000 exists in the vehicle display device 100b.
- the signal processing apparatus 170 in the vehicle display apparatus 100 may transmit a master authority transfer message to the second signal processing apparatus 170b (STd1).
- the master authority transfer message may include a command including a mode for each signal processing device, information about an application to be executed or a parameter, and the like.
- the input/output server interface 522 in the first virtual machine 520 in the signal processing device 170 is an input/output server interface 522b in the server virtualization machine 520b in the second signal processing device 170b, A master authority transfer message can be sent.
- the input/output server interface 522b in the server virtual machine 520b in the second signal processing unit 170b is connected to the input/output server interface 522 in the first virtual machine 520 in the signal processing unit 170. , and transmits an acknowledgment (ACK) message (STd2).
- ACK acknowledgment
- the signal processing device 170 operates in the slave mode (STd3).
- the second signal processing device 170b operates in the master mode (STd4).
- the second signal processing apparatus 170b may receive various types of data through the serial/parallel network 1000 according to the master mode.
- the input/output server interface 522b in the second virtual machine 520b through the serial-parallel network 1000, from the camera 195, the radar 198, the display 180, respectively, image data, sensing Data and video data can be received.
- 11A is a diagram illustrating exchanging performance information or resource information between the first virtual machine 520 in the signal processing device 170 and the server virtualization machine 520b in the second signal processing device 170b.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 stores reserved information 952 in the interface protocol 950 transmitted to the second signal processing device 170b [ 0x00] to transmit (S1110).
- the server virtualization machine 520b in the second signal processing device 170b may transmit the reserved information 952 in the interface protocol 950 transmitted to the signal processing device 170 by setting it to [0x01]. There is (S1112).
- the reserved information 952 in the received interface protocol 950 is [0x01]
- the first virtual machine 520 in the processor 175 in the signal processing device 170, the second signal processing device 170b It can be determined that there is a virtual machine in there.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 checks the performance information of the second signal processing device 170b, etc. (S1120).
- the first virtual machine 520 in the processor 175 in the signal processing device 170 checks whether the resource routing of the second signal processing device 170b is possible (S1125).
- reserved information 952 in the interface protocol 950 transmitted to the second signal processing apparatus 170b may be set to [0x02] and transmitted.
- the server virtualization machine 520b in the second signal processing unit 170b sends reserved information 952 in the interface protocol 950 to the signal processing unit 170 to indicate an acknowledgment of receipt of the performance information. can be transmitted by setting [0x03] to [0x03].
- the first virtual machine 520 in the processor 175 in the signal processing unit 170 based on the reserved information 952 in the received interface protocol 950 , the server virtualization machine in the second signal processing unit 170b Performance information or resource information of 520b may be identified.
- the level of the performance information of the server virtualization machine 520b in the second signal processing unit 170b is the level of the performance information of the first virtual machine 520 in the processor 175 in the signal processing unit 170 . If larger than that, the server virtualization machine 520b in the second signal processing unit 170b may operate in a master mode.
- the second 2 The server virtualization machine 520b in the signal processing unit 170b may operate in a master mode.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may transmit a command to the server virtualization machine 520b in the second signal processing device 170b. (S1130).
- the server virtualization machine 520b in the second signal processing device 170b may receive the command (S1132).
- server virtualization machine 520b in the second signal processing device 170b may share data and perform signal processing on the shared data. Accordingly, it is possible to efficiently perform data processing.
- the server virtualization machine 520b in the second signal processing device 170b may transmit a command to the first virtual machine 520 in the signal processing device 170 ( S1140 ).
- the first virtual machine 520 in the signal processing device 170 may receive the command (S1142).
- the first virtual machine 520 in the signal processing device 170 may share data and perform signal processing on the shared data. Accordingly, it is possible to efficiently perform data processing.
- 11B is a diagram illustrating resource information exchange between the first virtual machine 520 in the signal processing device 170 and the second signal processing device 170b without the server virtualization machine 520c, and resource sharing accordingly.
- the first virtual machine 520 in the signal processing device 170 may check the resource of the second signal processing device 170b ( S1150 ).
- the second signal processing apparatus 170b may transmit the resource information to the first virtual machine 520 in the signal processing apparatus 170 ( S1152 ).
- the first virtual machine 520 in the signal processing device 170, the second signal processing device 170b does not have the server virtualization machine 520c, and operates as a master device.
- the first virtual machine 520 in the signal processing device 170 may request to perform distributed data processing (S1162).
- the second signal processing apparatus 170b may perform distributed data processing and transmit result information thereto to the first virtual machine 520 in the signal processing apparatus 170 (S1164).
- the first virtual machine 520 in the signal processing device 170 may control to display the distributed data processing result on the displays 180a and 180b ( S1170 ). Accordingly, it is possible to efficiently process data in the plurality of signal processing apparatuses 170 and 175b.
- the distributed data processing is distributed data processing for object detection of camera image data
- Object detection result data can be displayed.
- the media DRM processing data may be displayed on the displays 180a and 180b, etc., based on the media DRM processing result partially processed by the second signal processing device 170b. have.
- FIG. 12 is a diagram referenced to explain data sharing in the vehicle display apparatus 100 .
- the input/output server interface 522 in the first virtual machine 520 in the signal processing unit 170 transmits a request for allocation of the shared memory 508 to the security manager 526 . do (STe1).
- the security manager 526 may allocate the shared memory 508 using the hypervisor 505 ( STe2 ), and write the shared data to the shared memory 508 .
- the input/output server interface 522b in the server virtualization machine 520b in the second signal processing device 170 may transmit a connection request to the input/output server interface 522 after the shared memory 508 is allocated (STe3).
- the input/output server interface 522 is an input/output server interface 522b in the server virtualization machine 520b in the second signal processing unit 170 after the shared memory 508 is allocated, a shared memory ( 508) is transmitted (STe4).
- the key data may be private key data.
- the input/output server interface 522b in the server virtualization machine 520b in the second signal processing unit 170 sends a request for allocation of the shared memory 508b to the security manager 526b based on the received key data. transmit (STe5).
- the security manager 526b may allocate the second shared memory 508b using the hypervisor 505b (STe6) and write shared data to the second shared memory 508b (STe7).
- the input/output server interface 522b in the server virtualization machine 520b in the second signal processing unit 170 may request data from the input/output server interface 522 for data writing to the second shared memory 508b. have.
- the plurality of guest virtual machines 530b and 530b in the second signal processing apparatus 170 may perform signal processing using data in the second shared memory 508b.
- the plurality of signal processing devices 170 and 175b can divide and process data. In addition, it is possible to efficiently manage resources in the plurality of signal processing devices 170 and 175b.
- FIG. 13 is a diagram referenced to explain the setting of a master signal processing device between the signal processing device and the second signal processing device in the vehicle display device 100 .
- the first virtual machine 520 in the signal processing unit 170 and the server virtualization machine 520b in the second signal processing unit 170 are, after the booting sequence is finished, a benchmark program to store the performance scores of each of the processors 175 and 175b (STf1).
- the performance scores of the first virtual machine 520 and the server virtual machine 520b may be checked.
- the first virtual machine 520 in the signal processing device 170 attempts to connect to the server virtualization machine 520b in the second signal processing device 170 (STf2).
- the server virtualization machine 520b in the second signal processing unit 170 is the first virtual machine 520 in the signal processing unit 170, the benchmark score, current CPU / RAM / GPU resource usage, etc.
- the information is transferred as a result message (STf3).
- the first virtual machine 520 in the signal processing device 170 confirms the result message of the server virtualization machine 520b in the second signal processing device 170, and the signal processing device 170 and the second signal processing It is determined which signal processing device among the devices 170 will become the master device (STf4).
- the difference between the available performance scores of the first virtual machine 520 in the signal processing unit 170 and the server virtualization machine 520b in the second signal processing unit 170 is a first reference value (eg, 10 %) or less, the first virtual machine 520 in the signal processing device 170 may have the master authority.
- the difference between the available performance scores of the first virtual machine 520 in the signal processing device 170 and the server virtualization machine 520b in the second signal processing device 170 is between the first reference value and the second reference value (eg For example, 10% to 70%), a signal processing device having a high available performance score may have master authority, and a signal processing device having a low score may operate as a slave.
- the available performance score of the server virtualization machine 520b in the second signal processing unit 170 is higher than the score of the first virtual machine 520 in the signal processing unit 170 by a second reference value (eg, 70%) or higher, the server virtualization machine 520b in the second signal processing device 170 may have the master authority. Accordingly, all operations may be performed by the server virtualization machine 520b in the second signal processing device 170 .
- a second reference value eg, 70%
- the available performance score of the first virtual machine 520 in the signal processing unit 170 is higher than the score of the server virtual machine 520b in the second signal processing unit 170 by a second reference value (eg, 70 %) or higher, the first virtual machine 520 in the signal processing unit 170 terminates the connection with the server virtualization machine 520b in the second signal processing unit 170, and may not perform distributed processing have.
- a second reference value eg, 70 %
- the first virtual machine 520 in the signal processing apparatus 170 is a server virtualization machine 520b in the second signal processing apparatus 170 , the first virtual machine 520 and the first virtual machine 520 in the signal processing apparatus 170 . 2
- the operation method calculation result between the server virtualization machines 520b in the signal processing unit 170 is transmitted (STf5).
- the server virtualization machine 520b in the second signal processing unit 170 transmits an acknowledgment message (ACK) for the result message to the first virtual machine 520 in the signal processing unit 170 (STf6).
- ACK acknowledgment message
- the first virtual machine 520 in the signal processing apparatus 170 and the server virtualization machine 520b in the second signal processing apparatus 170 change the operation mode according to the operation method calculation result (STf7).
- FIG. 14 is a diagram referenced to explain the setting of a master signal processing device between the signal processing device and the second signal processing device in the vehicle display device 100 .
- FIG. 14 is similar to FIG. 13 , but the difference is that the server virtualization machine 520b is not driven in the second signal processing device 170 .
- the first virtual machine 520 in the signal processing device 170 stores the performance score of the processor 175 by executing a benchmark program after the booting sequence is finished (STg1).
- the input/output server interface 522b in the second signal processing device 170 stores a performance score of the second processor 175b by executing a benchmark program (STg2).
- the first virtual machine 520 in the signal processing device 170 attempts to access the second signal processing device 170 (STg3).
- the second signal processing unit 170 transmits status information such as a benchmark score and current CPU/RAM/GPU resource usage to the first virtual machine 520 in the signal processing unit 170 as a result message. (STg4).
- the first virtual machine 520 in the signal processing unit 170 checks the result message of the second signal processing unit 170 , and any signal between the signal processing unit 170 and the second signal processing unit 170 . Decide whether the processing unit will become the master unit (STg5).
- signal processing The first virtual machine 520 in the device 170 may have master authority.
- the difference between the available performance scores of the first virtual machine 520 and the second signal processing device 170 in the signal processing device 170 is between the first reference value and the second reference value (eg, 10% to 70%). %), a signal processing device having a high available performance score may have master authority, and a signal processing device having a low score may operate as a slave.
- the second signal processing device 170 may have master authority. Accordingly, all operations may be performed by the second signal processing apparatus 170 .
- the signal The first virtual machine 520 in the processing unit 170 may terminate the connection with the second signal processing unit 170 and may not perform distributed processing.
- the first virtual machine 520 in the signal processing device 170 is the second signal processing device 170 , the first virtual machine 520 and the second signal processing device 170 in the signal processing device 170 . Transmits the operation method calculation result of the liver (STg6).
- the input/output server interface 522b in the second signal processing unit 170 transmits an acknowledgment message (ACK) for the result message to the first virtual machine 520 in the signal processing unit 170 (STg7).
- ACK acknowledgment message
- the first virtual machine 520 and the second signal processing device 170 in the signal processing device 170 change the operation mode according to the operation method calculation result (STg8).
- the first virtual machine 520 in the processor 175 may generate a command queue for distributed processing of data. This will be described below with reference to FIG. 15 .
- FIG. 15 is a diagram referenced to explain sharing a memory among a plurality of signal processing devices in the vehicle display apparatus 100 .
- the vehicle display apparatus 100 may include a signal processing device 170 , a second signal processing device 170b , and a third signal processing device 170c .
- the signal processing apparatus 170 may share data with the second signal processing apparatus 170b and the third signal processing apparatus 170c.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may include a camera driver DRc for processing an image from a camera.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 includes a location information driver (not shown) for processing location information, and a touch driver (not shown) for processing a touch input. ) may be further provided.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may configure a hypervisor 505-based shared memory for each driver.
- the first virtual machine 520 in the processor 175 in the signal processing device 170 sets the shared memories 508a1 and 508a2 by using the hypervisor 505 for the camera driver DRc. example of doing
- the shared memory 508a1 may be a shared memory for image data from a plurality of camera devices, and the shared memory 508a2 may be a shared memory for post processing of image data from a plurality of camera devices. .
- the input/output server interface 522 in the first virtual machine 520 may receive image data from the camera driver DRc (STh1).
- the input/output server interface 522 in the first virtual machine 520 may control the image data received to the shared memory 508a1 to be recorded or updated (STh2).
- the input/output server interface 522 in the first virtual machine 520 generates a command queue corresponding to the number of guest virtual machines usable in the second signal processing unit 170b and the third signal processing unit 170c. do (STh3).
- the first virtual machine 520 in the processor 175 may generate a command queue corresponding to the number of virtual machines for distributed processing of data in the second processor 175b or the third processor 175c. have.
- the first The input/output server interface 522 in the virtual machine 520 controls to create four command queues.
- the command queue may include command type information, buffer ID information, buffer address information, and the like.
- the first virtual machine 520 in the signal processing apparatus 170 may transmit the camera related image data and the command queue data to the server virtualization machine 520b in the second signal processing apparatus 170b (STh4). .
- the input/output server interface 522 in the first virtual machine 520 may transmit camera-related image data and command queue data to the input/output client interface 532b in the server virtualization machine 520b.
- the transmitted camera-related image data may be first to second camera-related image data among the first to fourth camera-related image data.
- the input/output client interface 532b in the server virtualization machine 520b may store the received camera-related image data and command queue data in the shared memory 508b1 (STh5).
- the server virtualization machine 520b of the second processor 175b in the second signal processing device 170b may notify the reception date of the camera-related image data to the guest virtualization machine 530b (STh6).
- the input/output client interface 532b1 in the guest virtual machine 530b in the second signal processing unit 170b may read the data written in the shared memory 508b1 with reference to the received command queue (STh8) .
- the processing module PMb in the guest virtual machine 530b performs arithmetic processing on the read image data according to a command command in the command queue (STh8).
- the processing module PMb performs object detection on the read image data.
- the processing module PMb may perform DRM decoding of the read image data.
- the guest virtual machine 530b in the second signal processing unit 170b writes the result data processed by the processing module PMb to the second shared memory 508b2 allocated from the input/output server interface 522 . can (STh9).
- the guest virtual machine 530b in the second signal processing device 170b notifies the server virtualization machine 520b of information related to “complete writing of the operation result to the second shared memory 508b” through the command queue. can (STh10).
- the server virtualization machine 520b of the second processor 175b in the second signal processing unit 170b reads the processing result data recorded in the second shared memory 508b (STh11).
- the server virtualization machine 520b of the second processor 175b in the second signal processing device 170b is the first virtual machine 520 of the processor 175 in the signal processing device 170 to process result data and , the command queue data may be transmitted (STh12).
- the first virtual machine 520 of the processor 175 in the signal processing device 170 may control to store the received processing result data in the shared memory 508a2 (STh13).
- the first virtual machine 520 of the processor 175 in the signal processing device 170 through the fifth command queue (#5), a display command, the input/output client in the second virtual machine 530 It can be transmitted to the interface 532 (STh14).
- the second virtual machine 530 may control to display the related image while reading the processing result data recorded in the second shared memory 508b (STh15).
- step STh4 the steps performed in the second signal processing device 170b from step STh4 to step STh12 may be directly performed in the third signal processing device 170c as well.
- the first virtual machine 520 of the processor 175 in the signal processing device 170 is a server virtualization machine 520c in the third signal processing device 170c, and among the first to fourth camera related image data, The third to fourth camera-related image data and command queue data are transmitted, and the server virtualization machine 520c in the third signal processing unit 170c stores the received image data in the shared memory 508c1, and performs guest virtualization.
- the machine 530c receives and processes the stored image data, and stores the processed result data in the shared memory 508c2, and the server virtualization machine 520c in the third signal processing unit 170c includes the shared memory 508c2.
- the result data stored in the signal processing device 170 may be transmitted to the first virtual machine 520 of the processor 175 in the signal processing device 170 .
- data can be shared and efficiently processed in the signal processing apparatus 170 , the second signal processing apparatus 170b , and the third signal processing apparatus 170c .
- 16 is a diagram referenced to explain memory synchronization between the signal processing apparatus 170 and the second signal processing apparatus 170b.
- the output server interface 522 in the first virtual machine 520 in the signal processing device 170 is a Consumer 543 , a Sender 1050 , and a Producer 1010 that creates a synchronization object for graphic synchronization. ), a recvQueue (1020) that manages, in particular receives, a queue, a WorkThread (1030) that manages a queue and controls an operation, and a SendQueue (1040) that manages, particularly transmits, a queue.
- a recvQueue 1020
- a WorkThread 1030
- a SendQueue 1040
- a plurality of buffers may be set in the shared memory 508 in the signal processing device 170 .
- the input/output client interface 532b in the server virtualization machine 520b in the second signal processing device 170b includes a Consumer 543b, a Receiver 1050b, a Producer 1010b that creates a synchronization object for graphic synchronization, a queue ( queue) management, in particular, a recvQueue (1020b) for receiving, a WorkThread (1030b) for managing and controlling an operation of a queue, and a SendQueue (1040b) for managing, in particular transmitting, a queue.
- a plurality of buffers may be set in the shared memory 508b of the second signal processing device 170b.
- the WorkThread 1030 in the first virtual machine 520 checks whether data change has occurred in the shared memory 508 (STi1).
- the recvQueue 1020 increments the reference count (Extrefcnt) of the shared memory 508 by 1 (STi2).
- the WorkThread 1030 in the first virtual machine 520 transmits information about the buffer index to the Consumer 543 (STi3).
- the Consumer 543 requests the Sender 1050 to read the shared memory 508 (STi4).
- the Sender 1050 reads data from the shared memory 508 (STi5).
- the Sender 1050 may read the changed data in the shared memory 508 (STi5).
- the Sender 1050 may transmit the read data and the buffer index to the server virtualization machine 520b in the second signal processing device 170b (STi6).
- the input/output client interface 532b in the server virtualization machine 520b in the second signal processing unit 170b receives the data received from the signal processing unit 170, and informs the Consumer 543b of the received information. can (STi7).
- the consumer 543b may request access to the corresponding buffer index from the producer 1010b (STi8).
- recvQueue 1020b or WorkThread 1030b increments the reference count (Extrefcnt) of the shared memory 508b by 1 (STi9).
- the WorkThread 1030b in the server virtualization machine 520b transmits information about the buffer index to the Consumer 543b (STi10).
- the Consumer 543b requests the Receiver 1050b to write the shared memory 508b (STi11).
- the receiver 1050b writes the received data to the shared memory 508b (STi12).
- the receiver 1050b may transmit use completion information of the shared memory 508b to the consumer 543b (STi13).
- the Consumer 543b may return the received buffer index back to the WorkThread 1030b (STi14).
- the receiver 1050b may transmit the use completion information of the shared memory 508b to the Sender 1050 in the first virtual machine 520 in the signal processing device 170 (STi16).
- the Sender 1050 in the first virtual machine 520 in the signal processing device 170 may transmit the use completion information of the shared memory 508 to the Consumer 543 (STi17).
- the Consumer 543 in the first virtual machine 520 in the signal processing device 170 returns the received buffer index to the WorkThread 1030 again (STi18).
- the recvQueue 1020 decrements the reference count (Extrefcnt) by 1 (STi19).
- the data in the shared memory 508 in the signal processing device 170 and the data in the shared memory 508b of the second signal processing device 170b can be synchronized and copied.
- synchronization in data sharing can be performed between different signal processing apparatuses.
- the image displayed on the first display 180a controlled by the second virtual machine 530 of the signal processing device 170 and the guest virtual machine Synchronization of the image displayed on the third display 180c controlled by 530b is performed, so that the same image can be displayed.
- 17 is a diagram referenced to describe a rendering process between the signal processing apparatus and the second signal processing apparatus.
- the server virtualization machine 520b in the second processor 175b in the second signal processing device 170b when connected to the first virtual machine 520, the first virtual machine 520 may transmit information about the number of shared memories or the number of buffers of the shared memory to the server virtualization machine 520b (STj1). ).
- the server virtualization machine 520b in the second signal processing unit 170b creates the second shared memory 508b (STj2).
- the server virtualization machine 520b in the second signal processing device 170b may record the received video stream data in the second shared memory 508b based on the received shared memory ID or buffer ID ( STj4).
- the server virtualization machine 520b in the second signal processing unit 170b when the reference count (Extrefcnt) for the second shared memory 508b becomes 0, the first virtual machine ( 520), information on the reference count (Extrefcnt) is transmitted (STj4).
- the first virtual machine 520 in the signal processing unit 170 updates the reference count (Extrefcnt) for the shared memory 508 (STj5).
- the guest virtual machine 530b in the second signal processing device 170b uses the second shared memory 508b to signal-process the video stream data stored in the second shared memory 508b to render an image. to control it to be displayed on the display.
- the video stream data signal-processed by the second signal processing apparatus 170b is displayed on the third display 180c or the fourth display 180d.
- the first virtual machine 520 in the processor 175 controls to write the camera data to the first shared memory 508a, transmits a part of the camera data to the second signal processing device 170b
- the server virtualization machine 520b in the second processor 175b controls to write a portion of the received camera data to the second shared memory 508b
- the guest virtualization machine 530b or 540b in the second processor 175b may process at least a portion of the data written to the second shared memory 508b, and control the processed data to be written to the second shared memory 508b.
- the second virtual machine 530 in the processor 175, based on the data recorded in the second shared memory 508b, may control to display an image on the display.
- the first virtual machine 520 in the processor 175 writes a portion of the camera data to the first shared memory 508a to be transferred to the second processor 175b, and the guest virtualization in the second processor 175b
- the machine 530b or 540b may perform object detection on the received camera data, and control the object detected data to be recorded in the second shared memory 508b. This will be described in detail with reference to FIG. 18 .
- FIG. 18 illustrates that the image data is divided and processed by the signal processing device 170 and the second signal processing device 175 for signal processing of the image data 1010 acquired through the camera 915 .
- the first virtual machine 520 in the processor 175 in the signal processing device 170 stores a portion 1010b of the image data 1010 in the shared memory 508a1. It is possible to write to the first buffer, and write another part 1010c of the image data 1010 to the second buffer of the shared memory 508a1.
- the second virtual machine 530 and the third virtual machine 540 perform object detection on the received image data 1010b and 1010c, respectively, and control so that the detected object image data is recorded in the shared memory 508 . can do.
- the second virtual machine 530 writes the data on which the object detection for the object BG1 is performed to the first buffer in the second shared memory 508a2
- the third virtual machine 540 writes the object Data on which object detection for (BG2) has been performed may be written to a second buffer in the second shared memory 508a2.
- the first virtual machine 520 in the processor 175 is the image data ( Another part 1010d and 1010e of 1010 may be transmitted to the server virtualization machine 520b driven by the second processor 175b in the second signal processing unit 170b.
- the server virtualization machine 520b driven by the second processor 175b in the second signal processing unit 170b stores another portion 1010d of the received image data 1010 in the second shared memory 508b2.
- the first buffer may be written, and the other portion 1010e of the image data 1010 may be written to the second buffer of the shared memory 508b2.
- the guest virtual machines 530b and 540b driven by the second processor 175b in the second signal processing device 170b perform object detection on the received image data 1010d and 1010e, respectively, and the object is detected. It is possible to control image data to be recorded in the second shared memory 508b2.
- the first guest virtualization machine 530b writes data on which object detection for the object BG3 is performed to a first buffer in the second shared memory 508b2, and the second guest virtualization machine 540b is , data on which object detection is performed for the object BG4 may be written to the second buffer in the second shared memory 508b2 .
- the server virtualization machine 520b driven by the second processor 175b in the second signal processing device 170b transmits the data on which the object detection recorded in the second shared memory 508b2 is performed, the signal processing device ( to the first virtual machine 520 in the processor 175 in 170 .
- the first virtual machine 520 in the processor 175 in the signal processing device 170 may control the processed image 1015 to be displayed on the display based on the detected object image data, respectively.
- the display includes at least one of the first to second displays 180a and 180b controlled by the signal processing device 170 , the third to fourth displays 180c controlled by the second signal processing device 170 , 180d) may be at least one.
- 19 is a diagram illustrating that image data processed by the main signal processing apparatus 1700 is transmitted to a plurality of signal processing apparatuses 170, 170b, and 170c, respectively, and displayed on each display.
- the main signal processing device 1700 may be disposed in the vehicle display device 100 or may be disposed in a separately spaced server (not shown).
- the main signal processing device 1700 may be a signal processing device disposed in a server (not shown) in an airplane.
- the main signal processing apparatus 1700 may be a signal processing apparatus disposed in another vehicle.
- the main signal processing unit 1700 drives a hypervisor 5050 on an internal processor 175, and a server virtualization machine 5200, guest virtualization machines 5300 and 5400, etc. on the hypervisor 5050. can be driven
- the main signal processing device 1700 includes a plurality of images (IMGO1, IMGO2, IMGO3) processed through the server virtualization machine 5200, the guest virtualization machines 5300 and 5400, etc., and the main signal processing device ( 1700) may be displayed through a plurality of displays.
- IMGO1, IMGO2, IMGO3 processed through the server virtualization machine 5200, the guest virtualization machines 5300 and 5400, etc.
- image data processed by the main signal processing apparatus 1700 may be synchronized and transmitted to the plurality of signal processing apparatuses 170 , 170b , and 170c , respectively.
- the plurality of signal processing apparatuses 170 , 170b , and 170c may process the received image data from the main signal processing apparatus 1700 , respectively, and control an image to be displayed on each display.
- hypervisors 505, 505b, 505c are driven on the processors 175, 175b, 175c inside each signal processing device 170, 170b, 170c, respectively, and server virtualization on the hypervisors 505, 505b, 505c
- the machines 520 , 520b and 520c , the first guest virtualization machines 530 , 530b and 530c , and the second guest virtualization machines 540 , 540b and 540c may be driven.
- each of the signal processing devices 170, 170b, and 170c transmits the processed images IMGa1, IMGa2, IMGa3, the processed images IMGb1, IMGb2, IMGb3, and the processed images IMGc1, IMGc2, IMGc3 to each display. You can control the display to be synchronized.
- the main signal processing apparatus 1700 and each of the signal processing apparatuses 170 , 170b , and 170c may display an image in synchronization according to the synchronization method described with reference to FIGS. 8 to 18 . Accordingly, the same video can be viewed simultaneously.
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Combustion & Propulsion (AREA)
- Chemical & Material Sciences (AREA)
- Transportation (AREA)
- Human Computer Interaction (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Controls And Circuits For Display Device (AREA)
- Navigation (AREA)
- Digital Computer Display Output (AREA)
- User Interface Of Digital Computer (AREA)
- Traffic Control Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (18)
- 차량에 장착되는 제1 디스플레이 및 제2 디스플레이;상기 제1 디스플레이 및 제2 디스플레이를 위한 신호 처리를 수행하는 프로세서를 포함하는 신호 처리 장치;제3 디스플레이를 위한 신호 처리를 수행하는 제2 프로세서를 포함하는 제2 신호 처리 장치;를 포함하고,상기 신호 처리 장치 내의 프로세서는,상기 프로세서 내의 하이퍼바이저 상에서, 제1 가상화 머신 내지 제3 가상화 머신을 실행하며,상기 프로세서 내의 상기 제1 가상화 머신은,상기 신호 처리 장치가 마스터 신호 처리 장치가 동작하는 경우, 데이터 분담 처리를 위해, 상기 제2 신호 처리 장치에 데이터의 적어도 일부를 공유하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 제2 프로세서 내의 서버 가상화 머신은,상기 제2 신호 처리 장치가 마스터 신호 처리 장치로 동작하는 경우, 데이터 분담 처리를 위해, 상기 신호 처리 장치에 데이터의 적어도 일부를 공유하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 제2 신호 처리 장치의 성능 정보 또는 리소스 정보를 체크하고, 상기 제2 신호 처리 장치의 성능 정보 또는 리소스 정보에 기초하여, 상기 제2 신호 처리 장치와 상기 신호 처리 장치 중 어느 하나를 마스터 신호 처리 장치로 동작하도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 신호 처리 장치 내의 프로세서는,상기 프로세서 내의 하이퍼바이저 상에서, 제1 가상화 머신 내지 제3 가상화 머신을 실행하며,상기 제2 가상화 머신은 제1 디스플레이를 위해 동작하며, 상기 제3 가상화 머신은, 제2 디스플레이를 위해 동작하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제4항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은, 차량의 휠 속도 센서 데이터를 수신하고, 처리하여, 상기 제2 가상화 머신 또는 상기 제3 가상화 머신 중 적어도 하나로 또는 상기 제2 신호 처리 장치로, 처리된 휠 속도 센서 데이터를 전송하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제3항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 제2 신호 처리 장치로, 직병렬 네트워크로의 접속을 위한 접속 메시지를 전송하고, 상기 제2 신호 처리 장치로부터 상기 직병렬 네트워크로의 접속 가능 메시지가 수신되지 않는 경우, 상기 신호 처리 장치를 상기 마스터 신호 처리 장치로 동작하도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제3항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 제2 신호 처리 장치로, 직병렬 네트워크로의 접속을 위한 접속 메시지를 전송하고, 상기 제2 신호 처리 장치로부터 상기 직병렬 네트워크로의 접속 가능 메시지가 수신되는 경우, 상기 제2 신호 처리 장치의 성능 정보 또는 리소스 정보에 기초하여, 상기 제2 신호 처리 장치와 상기 신호 처리 장치 중 어느 하나를 마스터 신호 처리 장치로 동작하도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제3항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,외부로부터 수신되는 프로토콜 정보에 기초하여, 상기 제2 신호 처리 장치 내의 서버 가상화 머신의 구동 여부를 확인하고, 상기 제2 신호 처리 장치 내에 상기 서버 가상화 머신이 구동되지 않는 경우, 상기 신호 처리 장치를 상기 마스터 신호 처리 장치로 동작하도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 제2 신호 처리 장치의 성능 정보 또는 리소스 정보에 기초하여, 상기 제2 신호 처리 장치의 리소스 공유 가능 여부를 확인하고, 상기 리소스 공유가 가능한 경우, 상기 제2 신호 처리 장치로, 처리 데이터의 적어도 일부를 공유하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제3항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 신호 처리 장치의 상기 마스터 신호 처리 장치로의 동작 중에, 상기 제2 프로세서 내의 서버 가상화 머신으로 권한 양도 메시지를 전송하며, 상기 제2 프로세서 내의 상기 서버 가상화 머신으로부터 승인 메시지가 수신되는 경우, 상기 제2 신호 처리 장치가 상기 마스터 신호 처리 장치로 변경되도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 제2 신호 처리 장치에서 구동되는 복수의 가상화 머신에 대한 성능 정보 또는 리소스 정보를 수신하고, 상기 복수의 가상화 머신에 대한 성능 정보 또는 리소스 정보에 기초하여, 상기 제2 신호 처리 장치에서 구동되는 복수의 가상화 머신 중 어느 하나의 가상화 머신을 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,카메라 데이터를 제1 공유 메모리에 기록하도록 제어하고,상기 카메라 데이터의 일부를 상기 제2 신호 처리 장치로 전송하고,상기 제2 프로세서 내의 서버 가상화 머신은,상기 수신된 카메라 데이터의 일부를 제2 공유 메모리에 기록하도록 제어하고,상기 제2 프로세서 내의의 게스트 가상화 머신은,상기 제2 공유 메모리에 기록된 데이터의 적어도 일부를 처리하고, 상기 처리된 데이터가 상기 제2 공유 메모리에 기록되도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제1항에 있어서,상기 프로세서 내의 상기 제2 가상화 머신은,상기 제2 공유 메모리에 기록된 데이터에 기초하여, 상기 디스플레이에 영상을 표시하도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제12항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 데이터의 분산 처리를 위한 커맨드 큐를 생성하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제14항에 있어서,상기 커맨드 큐는,커맨드 타입 정보, 버퍼 아이디 정보, 버퍼 주소 정보를 포함하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제12항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 데이터의 분산 처리를 위한 가상화 머신의 개수에 대응하는 커맨드 큐를 생성하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 제12항에 있어서,상기 프로세서 내의 상기 제1 가상화 머신은,상기 카메라 데이터의 일부를 상기 제2 프로세서로 전달되도록 상기 제1 공유 메모리에 기록하고,상기 제2 프로세서 내의 게스트 가상화 머신은,상기 전달받은 카메라 데이터에 대한 오브젝트 검출을 수행하고, 오브젝트 검출된 데이터가 상기 제2 공유 메모리에 기록되도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
- 차량에 장착되는 제1 디스플레이 및 제2 디스플레이;상기 제1 디스플레이 및 제2 디스플레이를 위한 신호 처리를 수행하는 프로세서를 포함하는 신호 처리 장치;제3 디스플레이를 위한 신호 처리를 수행하는 제2 프로세서를 포함하는 제2 신호 처리 장치;를 포함하고,상기 신호 처리 장치 내의 프로세서는,상기 프로세서 내의 하이퍼바이저 상에서, 제1 가상화 머신 내지 제3 가상화 머신을 실행하며,상기 프로세서 내의 상기 제1 가상화 머신은,상기 제2 신호 처리 장치의 성능 정보 또는 리소스 정보를 검사하고, 상기 제2 신호 처리 장치의 성능 정보 또는 리소스 정보에 기초하여, 상기 제2 신호 처리 장치와 상기 신호 처리 장치 중 어느 하나를 마스터 신호 처리 장치로 동작하도록 제어하는 것을 특징으로 하는 차량용 디스플레이 장치.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21928197.9A EP4300298A1 (en) | 2021-02-26 | 2021-08-13 | Vehicular display device |
US18/278,157 US20240231881A9 (en) | 2021-02-26 | 2021-08-13 | Display apparatus for vehicle |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2021-0026453 | 2021-02-26 | ||
KR20210026453 | 2021-02-26 | ||
KR20210053004 | 2021-04-23 | ||
KR10-2021-0053004 | 2021-04-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022181903A1 true WO2022181903A1 (ko) | 2022-09-01 |
Family
ID=83048267
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2021/009405 WO2022181899A1 (ko) | 2021-02-26 | 2021-07-21 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/009402 WO2022181898A1 (ko) | 2021-02-26 | 2021-07-21 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/010773 WO2022181904A1 (ko) | 2021-02-26 | 2021-08-13 | 차량용 디스플레이 장치 |
PCT/KR2021/010772 WO2022181903A1 (ko) | 2021-02-26 | 2021-08-13 | 차량용 디스플레이 장치 |
PCT/KR2021/014950 WO2022181922A1 (ko) | 2021-02-26 | 2021-10-22 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/020076 WO2022181961A1 (ko) | 2021-02-26 | 2021-12-28 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/020056 WO2022181960A1 (ko) | 2021-02-26 | 2021-12-28 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2022/002595 WO2022182103A1 (ko) | 2021-02-26 | 2022-02-22 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2021/009405 WO2022181899A1 (ko) | 2021-02-26 | 2021-07-21 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/009402 WO2022181898A1 (ko) | 2021-02-26 | 2021-07-21 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/010773 WO2022181904A1 (ko) | 2021-02-26 | 2021-08-13 | 차량용 디스플레이 장치 |
Family Applications After (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2021/014950 WO2022181922A1 (ko) | 2021-02-26 | 2021-10-22 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/020076 WO2022181961A1 (ko) | 2021-02-26 | 2021-12-28 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2021/020056 WO2022181960A1 (ko) | 2021-02-26 | 2021-12-28 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
PCT/KR2022/002595 WO2022182103A1 (ko) | 2021-02-26 | 2022-02-22 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
Country Status (4)
Country | Link |
---|---|
US (8) | US20230168913A1 (ko) |
EP (8) | EP4307112A1 (ko) |
KR (3) | KR20230148341A (ko) |
WO (8) | WO2022181899A1 (ko) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024071944A1 (ko) * | 2022-09-27 | 2024-04-04 | 엘지전자 주식회사 | 신호 처리 장치 및 이를 구비하는 차량용 디스플레이 장치 |
WO2024071476A1 (ko) * | 2022-09-29 | 2024-04-04 | 엘지전자 주식회사 | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20010053431A (ko) * | 1999-05-07 | 2001-06-25 | 야스카와 히데아키 | 미팅 시스템 및 정보 기억 매체 |
KR101639797B1 (ko) * | 2015-10-16 | 2016-07-14 | 주식회사 구버넷 | 가상머신 패킷을 처리하는 네트워크 인터페이스 장치 및 그 방법 |
JP6523298B2 (ja) * | 2014-01-06 | 2019-05-29 | ジョンソン コントロールズ テクノロジー カンパニーJohnson Controls Technology Company | コンピュータシステムと車両インターフェースシステム |
KR20190109021A (ko) * | 2018-03-16 | 2019-09-25 | 현대모비스 주식회사 | 가상 운영체제를 이용한 제어기기의 표시 제어 장치 및 방법 |
KR20200110229A (ko) * | 2019-03-13 | 2020-09-23 | 콘티넨탈 오토모티브 게엠베하 | 차량 시스템, 차량 및 이러한 차량 시스템을 동작시키기 위한 방법 |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8200796B1 (en) * | 2005-05-05 | 2012-06-12 | Digital Display Innovations, Llc | Graphics display system for multiple remote terminals |
US7650603B2 (en) * | 2005-07-08 | 2010-01-19 | Microsoft Corporation | Resource management for virtualization of graphics adapters |
KR101620058B1 (ko) * | 2009-11-23 | 2016-05-24 | 삼성전자주식회사 | 가상 머신 간 화면 전환 장치 및 방법 |
US9524138B2 (en) * | 2009-12-29 | 2016-12-20 | Nvidia Corporation | Load balancing in a system with multi-graphics processors and multi-display systems |
KR101087479B1 (ko) * | 2010-01-29 | 2011-11-25 | 주식회사 팬택 | 멀티 디스플레이 장치 및 그 제어 방법 |
WO2012107975A1 (ja) * | 2011-02-09 | 2012-08-16 | パナソニック株式会社 | 仮想計算機表示装置、仮想計算機表示方法、仮想計算機表示プログラム、記録媒体、及び集積回路 |
US9152373B2 (en) * | 2011-04-12 | 2015-10-06 | Apple Inc. | Gesture visualization and sharing between electronic devices and remote displays |
KR101323858B1 (ko) * | 2011-06-22 | 2013-11-21 | 한국과학기술원 | 가상화 시스템에서 메모리 접근을 제어하는 장치 및 방법 |
US9514507B2 (en) * | 2011-11-29 | 2016-12-06 | Citrix Systems, Inc. | Methods and systems for maintaining state in a virtual machine when disconnected from graphics hardware |
US10430216B1 (en) * | 2012-08-23 | 2019-10-01 | Scale Computing Inc | Virtual machine automated selection |
CN103856547B (zh) * | 2012-12-07 | 2017-07-07 | 华为技术有限公司 | 多虚拟机的映射方法、系统及客户端设备 |
JP6032176B2 (ja) * | 2012-12-19 | 2016-11-24 | 株式会社デンソー | 車両用表示制御装置 |
KR20150142298A (ko) | 2014-06-11 | 2015-12-22 | 현대자동차주식회사 | 차량, 차량의 제어 방법 및 차량 주행음 제어 장치 |
US10552200B2 (en) * | 2018-03-22 | 2020-02-04 | Nutanix, Inc. | System and method for dynamic throttling for live migration of virtual machines |
KR102708109B1 (ko) * | 2018-11-19 | 2024-09-20 | 삼성전자주식회사 | Ivi 서비스를 제공하기 위한 전자 장치 및 방법 |
US20210264559A1 (en) * | 2018-11-30 | 2021-08-26 | Intel Corporation | Apparatus and method for efficient localdisplay sharing for a virtualized graphics processor |
US10957107B2 (en) * | 2019-01-09 | 2021-03-23 | Vmware, Inc. | Snapping, virtual inking, and accessibility in augmented reality |
EP3722947A1 (en) * | 2019-04-12 | 2020-10-14 | Aptiv Technologies Limited | Distributed system for displaying a content |
JP7131481B2 (ja) * | 2019-05-28 | 2022-09-06 | 株式会社デンソー | 車両用装置 |
JP7259571B2 (ja) * | 2019-06-11 | 2023-04-18 | 株式会社デンソー | 車両用制御装置、車両用表示システム、及び車両用表示制御方法 |
US12112189B2 (en) * | 2019-07-10 | 2024-10-08 | Irider | Computing architecture for vehicle hardware and feature virtualization |
-
2021
- 2021-07-21 KR KR1020237031947A patent/KR20230148341A/ko active Search and Examination
- 2021-07-21 WO PCT/KR2021/009405 patent/WO2022181899A1/ko unknown
- 2021-07-21 EP EP21928193.8A patent/EP4307112A1/en active Pending
- 2021-07-21 WO PCT/KR2021/009402 patent/WO2022181898A1/ko active Application Filing
- 2021-07-21 EP EP21878751.3A patent/EP4080359A4/en active Pending
- 2021-07-21 US US17/755,040 patent/US20230168913A1/en active Pending
- 2021-07-21 US US17/770,103 patent/US20240143360A1/en active Pending
- 2021-08-13 EP EP21928197.9A patent/EP4300298A1/en active Pending
- 2021-08-13 US US18/278,157 patent/US20240231881A9/en active Pending
- 2021-08-13 WO PCT/KR2021/010773 patent/WO2022181904A1/ko active Application Filing
- 2021-08-13 WO PCT/KR2021/010772 patent/WO2022181903A1/ko active Application Filing
- 2021-08-13 EP EP21928198.7A patent/EP4300299A1/en active Pending
- 2021-08-13 US US18/278,333 patent/US20240168690A1/en active Pending
- 2021-10-22 US US17/755,046 patent/US20230168914A1/en active Pending
- 2021-10-22 KR KR1020237031948A patent/KR20230150826A/ko unknown
- 2021-10-22 WO PCT/KR2021/014950 patent/WO2022181922A1/ko unknown
- 2021-10-22 EP EP21878752.1A patent/EP4080360A4/en active Pending
- 2021-12-28 EP EP21928252.2A patent/EP4300300A1/en active Pending
- 2021-12-28 WO PCT/KR2021/020076 patent/WO2022181961A1/ko active Application Filing
- 2021-12-28 US US18/278,336 patent/US20240143375A1/en active Pending
- 2021-12-28 WO PCT/KR2021/020056 patent/WO2022181960A1/ko active Application Filing
- 2021-12-28 EP EP21928253.0A patent/EP4300301A1/en active Pending
- 2021-12-28 US US18/278,334 patent/US20240143374A1/en active Pending
-
2022
- 2022-02-22 KR KR1020237031949A patent/KR20230150318A/ko unknown
- 2022-02-22 WO PCT/KR2022/002595 patent/WO2022182103A1/ko active Application Filing
- 2022-02-22 US US17/771,450 patent/US20240152370A1/en active Pending
- 2022-02-22 EP EP22715510.8A patent/EP4075272A4/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20010053431A (ko) * | 1999-05-07 | 2001-06-25 | 야스카와 히데아키 | 미팅 시스템 및 정보 기억 매체 |
JP6523298B2 (ja) * | 2014-01-06 | 2019-05-29 | ジョンソン コントロールズ テクノロジー カンパニーJohnson Controls Technology Company | コンピュータシステムと車両インターフェースシステム |
KR101639797B1 (ko) * | 2015-10-16 | 2016-07-14 | 주식회사 구버넷 | 가상머신 패킷을 처리하는 네트워크 인터페이스 장치 및 그 방법 |
KR20190109021A (ko) * | 2018-03-16 | 2019-09-25 | 현대모비스 주식회사 | 가상 운영체제를 이용한 제어기기의 표시 제어 장치 및 방법 |
KR20200110229A (ko) * | 2019-03-13 | 2020-09-23 | 콘티넨탈 오토모티브 게엠베하 | 차량 시스템, 차량 및 이러한 차량 시스템을 동작시키기 위한 방법 |
Also Published As
Publication number | Publication date |
---|---|
WO2022181904A1 (ko) | 2022-09-01 |
WO2022181899A1 (ko) | 2022-09-01 |
WO2022181922A1 (ko) | 2022-09-01 |
US20240168690A1 (en) | 2024-05-23 |
EP4080359A1 (en) | 2022-10-26 |
KR20230150318A (ko) | 2023-10-30 |
US20230168914A1 (en) | 2023-06-01 |
KR20230150826A (ko) | 2023-10-31 |
EP4300299A1 (en) | 2024-01-03 |
WO2022181961A1 (ko) | 2022-09-01 |
US20230168913A1 (en) | 2023-06-01 |
WO2022181898A1 (ko) | 2022-09-01 |
EP4080359A4 (en) | 2024-04-10 |
EP4080360A4 (en) | 2024-03-06 |
EP4300300A1 (en) | 2024-01-03 |
US20240231881A9 (en) | 2024-07-11 |
WO2022182103A1 (ko) | 2022-09-01 |
EP4080360A1 (en) | 2022-10-26 |
EP4307112A1 (en) | 2024-01-17 |
EP4075272A1 (en) | 2022-10-19 |
EP4300301A1 (en) | 2024-01-03 |
US20240134675A1 (en) | 2024-04-25 |
US20240152370A1 (en) | 2024-05-09 |
WO2022181960A1 (ko) | 2022-09-01 |
EP4075272A4 (en) | 2023-11-29 |
US20240143375A1 (en) | 2024-05-02 |
KR20230148341A (ko) | 2023-10-24 |
US20240143374A1 (en) | 2024-05-02 |
EP4300298A1 (en) | 2024-01-03 |
US20240143360A1 (en) | 2024-05-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022181903A1 (ko) | 차량용 디스플레이 장치 | |
WO2019132344A1 (en) | Method for controlling earpiece and electronic device for supporting the same | |
WO2020246712A1 (en) | Method and apparatus for measuring location of multiple electronic devices based on time scheduling information in connection with ultra-wide band communication | |
WO2013100350A1 (en) | Image processing apparatus, upgrade apparatus, display system including the same, and control method thereof | |
WO2021075910A1 (en) | Electronic device and method for operating screen capturing by electronic device | |
WO2023136374A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024085284A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024071947A1 (ko) | 신호 처리 장치 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024071475A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2022154279A1 (ko) | 프로토콜/서비스 정보를 송신 및/또는 수신하는 전자 장치 및 그 동작 방법 | |
WO2023136376A1 (ko) | 차량용 디스플레이 장치 | |
WO2024071945A1 (ko) | 신호 처리 장치 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024071476A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024071942A1 (ko) | 신호 처리 장치 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2023191223A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2022098103A1 (ko) | 차량용 디스플레이 장치 | |
WO2024034709A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024034752A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 증강현실 장치 | |
WO2023136373A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2023136369A1 (ko) | 차량용 디스플레이 장치 | |
WO2024034708A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024085580A1 (ko) | 신호 처리 장치 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2023195559A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2023113078A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 | |
WO2024085283A1 (ko) | 신호 처리 장치, 및 이를 구비하는 차량용 디스플레이 장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21928197 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18278157 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2021928197 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021928197 Country of ref document: EP Effective date: 20230926 |