CN106489138B - Early stage rear view camera video in multiple processor structure is shown - Google Patents

Abstract

A kind of Infotainment component for vehicle includes the vehicle communication controller connected with universal serial bus with interchip communication bus and multimedia controller, information process unit and the remote message interface with unidirectional protocol.The multimedia controller includes: the display connection for display device, message receiver and the computer-readable memory with the operating system with multiple vectoring phases, wherein the graphics driver for controlling display device of the operating system is loaded in the later vectoring phase of the operating system.During the vectoring phase earlier of operating system, video driver obtains vision signal, generates video image and by transmission of video images to display device.

Description

Early stage rear view camera video in multiple processor structure is shown

Technical field

This application involves a kind of rear view camera videos to show.

Background technique

In order to enhance driver and/or passenger experience, hardware or software product and system has been can be set in passenger car: institute It states hardware or software product and system is built in vehicle or can be added to vehicle.Combined auto radio and Amusement, navigation system, hand free device, driver assistance and other functions Vehicular system be also referred to as " information entertainment (infotainment system) ".In the past, information entertainment was once mainly provided for luxurious and middle-grade vehicle, still These nearest information entertainments also just become increasingly prevalent in low-end vehicle.

Different from having the display function of the health status of instruction automobile and other relevant informations in the display of driver The automobile computer of energy, information entertainment often include big display in the central control board of automobile.To copilot The display can be operated.

Automotive infotainment generally includes the host (head unit) with mainboard, the mainboard have CPU and SDRAM component.In addition, digital signal processor (DSP) or field programmable gate array (FPGA) be commonly used for audio processing, Mp3 image decoding and graphics process.Speedometer and other automobile components are connected to controller local area network (CAN) bus. Other acoustic components (such as compact disc changer or loudspeaker) connect via system transmission (MOST) bus towards media. The other bus systems that may be connected to information entertainment include local interconnect network (LIN) bus and Flexray bus.

Most of information entertainments in the market are designed using more than one controller, are used for real-time operation For system for implementing hard real-time function and feature (such as man-machine interface, media and phone), this requires high-end microprocessors With the system on chip of operating system.

Summary of the invention

An object of the application is to provide a kind of improved rear view camera video and shows.

Especially, subject description discloses a kind of Infotainment component for automobile, the Infotainment component includes The vehicle communication controller (VUC) and multimedia controller (MMU) connected by interchip communication bus.The Infotainment component It can be packaged and be sold together with compact unit, the unit, which has, is used for power supply and the input for CAN bus It connects and is connected with the output for peripheral device (such as display device).

Vehicle communication controller refers to the controller for managing especially power management and CAN communication, and multimedia Controller refers to the controller for managing media play, man-machine interface and other functions.

Vehicle communication controller includes bus connection, especially for connecting the bus connection of universal serial bus, especially vehicle CAN bus and especially low speed CAN bus.In addition, vehicle communication controller includes: message processing unit, it is described to disappear Breath processing unit is also referred to as rear view camera triggering service logic (rear view camera trigger business ) or " RVC trigger BL " logic；And for using unidirectional protocol to send the remote message interface of message, the remote message Interface is also referred to as message distributor.The unidirectional protocol is carried out on interchip communication agreement (such as CAN bus).

Multimedia controller is connected to vehicle communication controller via interchip communication bus.In addition, the multimedia control Device processed further includes the display connection for connecting the display device of vehicle.For example, display connection can be by using The CVBS/S video of Low Voltage Differential Signal (LVDS, low voltage differential signaling) exports to provide.

In addition, multimedia controller further includes the message for receiving message from vehicle communication controller according to unidirectional protocol Receiver.For example, message receiver, which can be configured as, regularly reads private storage locations, controls from vehicle communication The message of device is written to private storage locations.The message receiver can be realized with software, hardware or their combination.

In addition, multimedia controller further includes the computer-readable memory with operating system, such as Windows insertion Formula or Linux embedded OS.The memory can be provided as the part of multimedia controller, or be provided As following memory: the memory is the part of Infotainment component but in the outside of multimedia controller.Latter In the case of kind, during starting multimedia controller, operating system is loaded or is copied to the storage of multimedia controller In device.

The operating system provides multiple vectoring phases for multimedia controller.In the later vectoring phase of operating system In, one or more graphics driver for controlling display device of operating system is loaded into computer-readable storage In device.In particular, the driver may be provided as can via operating system function " LoadLibrary " or " LoadDriver " is come the Windows shared library or DLL that load.

In the environment of Windows OS, driver is divided into local driver and Stream Drivers.It is local Driver is usually supported to output and input peripheral hardware (such as display driver, keyboard driver and touch display screen drive Dynamic program).Figure, window and Event Subsystem (GWES) are loaded directly into and manage these drivers.Local driver is logical It is often provided by original equipment manufacturer and specific function, the GWES is realized according to the purpose of the local driver It can be determined by calling GetProcAddressAPI.On the other hand, Stream Drivers disclose well-known collection of functions, this A little functions similar to file system operation and enable equipment manager to load and manage these drivers.

Multimedia controller includes the video driver loaded in the later vectoring phase by operating system.Label (such as registry entry) shows video driver load in the later vectoring phase to operating system as the first driving journey Sequence.Another mark shows in the kernel spacing that video driver is loaded into operating system to operating system.

In addition, multimedia controller further includes early stage service logic, the early stage service logic can be operated so that video Driver starts rear view camera video.

Video driver is loaded into kernel spacing.At Windows CE OS, pass through figure, window and event (GWES) and FileSys subsystem load driver, be loaded into the example of the kernel-mode driver of kernel spacing Son.

By contrast, user mode driver is loaded into the memory of special consumer process, such as "Udevice.exe".At Windows CE, user's space is restricted compared with kernel spacing, because are as follows:

Inner core and kernel memory are inaccessible,

The major part of core A PI is disabled,

The use of the available part of core A PI is arranged by registration table to be constrained,

Access user buffering area is limited.Which server is loaded kernel or user's space by such as The label of registration table setting or file item determines.So-called universal driver has the ability to be loaded into kernel spacing and use In the two of family space.

Especially, video driver can operate from the video input of multimedia controller and obtain vision signal, root According to vision signal generation video image and by the display buffer of transmission of video images to display device, to make video image It is shown.

In particular, multimedia controller can have multiple processor structure, one of processor/media control unit (MCU) it is exclusively used in operation video driver.The multimedia controller even may include for handling image transformation, for 2D wash with watercolours Dye, individual processor (also referred to as graphics processing unit (GPUs, the Graphics Processing rendered for 3D )), and individual processor (also referred to as video processing unit (VPU, the Video including being handled for video Units Processing Unit)).

Operating system is configured as loading early stage service logic driving journey during the vectoring phase earlier of operating system Sequence, the vectoring phase loads prior to the later vectoring phase, and during the later vectoring phase of operating system earlier Video driver.Early stage service logic driver is especially provided at RVC and drives using the ready video of access before Dynamic program.In addition, the early stage service logic, which is further provided with, receives remote message interface event or message, and especially exists Rear view camera state is updated accordingly during the vectoring phase earlier.

Early stage service logic driver can operate to wait via unidirectional protocol from the remote of vehicle communication controller Journey message event (such as shift event), and detect whether video driver is loaded when receiving shift event.? In this case, if video driver is loaded, the video driver is activated.In the present context, swash It is living to mean that routine program is called, the vision signal for the display screen display rear view camera in display device.

According to one embodiment, early stage service logic wound in the initialization function " Init () " of the early stage service logic Build the thread that (spawn) waits remote message interface event.

In particular, shift event can be indicated from parking gear or the change from neutral gear to reverse gear position.In this situation Under, the display of the video image from rear view camera is particularly helpful driver.

Early stage service logic is provided, in particular for calling video drive using before ready in rear view camera Program.

In another embodiment, handover unit can operate to receive instruction rear view camera using ready and disappear Breath, and stop the communication between early stage service logic and video driver and establish that rear view camera is applied and video drives Communication between dynamic program.Such as compared with early stage service logic driver, rear view camera application provides the function of extension.

For example, handover unit can be provided by early stage service logic driver, and the early stage service logic is driven It is when ready that dynamic program detects the rear view camera application.In another embodiment, handover unit is applied first by RVC Beginningization routine program provides.It for example, can be by indicating that operating system has been loaded with the mark of rear view camera application Know (flag) or signal, detection rear view camera is using ready.When rear view camera by operating system using being loaded, By the rear view camera applicative notifications early stage service logic.

According to further embodiments, vehicle communication controller includes the machine for avoiding losing the message from rear view camera System.For example, may make to disappear due to the requirement of real time of universal serial bus, buffer overflow or by the covering of higher priority message Breath is lost.

In particular, vehicle communication controller includes: CAN application, for sending CAN message with periodic intervals；Disappear with CAN Mailbox unit is ceased, for storing the message of CAN application.The message mailbox unit sends following feedback message: the feedback message Indicate whether CAN message mailbox unit is full.If predetermined memory capacity has been filled so that the message box no longer can Received message, then this is such case.CAN application, which can operate, to be come: if CAN application receives instruction CAN message postal The feedback message that case has been expired then retries transmission message.

According to another embodiment, above-mentioned message processing unit work is to evaluate CAN message and trigger rear view camera thing Part, and vehicle communication controller includes event message mailbox unit.The event message mailbox unit is stored according to claim 1 The event message of the message processing unit, and the feedback message whether indicating mail box unit has expired is sent at message Reason unit is sent to rear view camera trigger service logic.

Come in addition, rear view camera trigger service logic can operate: if the rear view camera trigger business Logic receives the feedback message that instruction event message mailbox has been expired, then retries transmission message.

According to another embodiment, the vehicle communication controller of Infotainment component includes following message distributor: described to disappear Breath distributor is used to event message being sent to multimedia controller via unidirectional protocol from vehicle communication controller.Message distribution Device unit is connected to the output end of event message mailbox.This means that: message distributor unit is received from event message mailbox Or obtain message.

In addition, this specification correspondingly also discloses the information entertainment with above- mentioned information entertainment components of automobile. The information entertainment includes the display device with display screen, and the display screen is connected to display connection, or is connected To the video output terminals of multimedia controller.

In addition, this specification also discloses a kind of automobile with above- mentioned information entertainment systems.The CAN bus quilt of the automobile It is connected to the bus connection of the vehicle communication controller of Infotainment component.

On the other hand, subject description discloses a kind of screens for the display device in automotive infotainment The method for showing rear view camera video image, wherein the multimedia controller includes the operation system with multiple vectoring phases System.

During vectoring phase early stage the operating system, early stage service logic driver is loaded by operating system Kernel spacing, the early stage service logic wait rear view camera state event (such as gear shift from vehicle communication controller Event), and determine whether the kernel mode video driver is loaded.

If the kernel mode video driver is not loaded, rear view camera status indicator is updated. If the kernel mode video driver is loaded, the function of the kernel mode video driver is called, is used In display video and especially for obtaining and showing rear view camera video image.The display can obey such as gear shift thing The condition of part etc.

In addition, the method will be for that will control from multiple vectoring phases subject description discloses a kind of method The early stage service logic run during the vectoring phase earlier of operating system is transferred to draws for later in operating system Lead the kernel spacing video driver that video is shown in the stage.The shifting applied from early stage service logic to rear view camera occurs It hands over.When rear view camera application obtains load, the rear view camera application will inform early stage service logic.After this, Early stage service logic will give rear view camera application function transfer.

According to this specification, in rear view camera using before ready, and even added in other drivers Before load, video driver can be activated in early days in the later stage of operating system.

Preferably, in the later vectoring phase, which is loaded as the first driver.Video drive journey The Init () function of sequence checks whether rear view camera (RVC) status indicator is set.The RVC status indicator determines whether It is required that early stage video is shown.If RVC status indicator is set, which starts to show video.Especially The video driver starts to show the image from rear view camera.Otherwise, Init () function optionally executes other initial Change step and terminate, other drivers are loaded.

In one embodiment, video driver includes instructions that described instruction starting for showing out video The thread of beginning, wherein the thread is assigned higher than common priority, to realize quick beginning that video is shown.According to another Embodiment, the thread are assigned to the dedicated video graphics processor for quickly showing.

When rear view camera using it is ready when, the control of video driver from operating system earlier The early stage service logic being loaded during vectoring phase is hand over or is transferred to rear view camera application.Early stage service logic It is applied with rear view camera so as to use identical video driver.

During transfer, the communication between kernel spacing video driver and the application of early stage service logic stops, and And it is handed over to the RVC application of also referred to as rear view camera service logic.Video driver can be by obtaining the driving The handle of program comes using such as by the way that the pointer for being directed toward the storage location of video driver to be transferred to later guidance rank The rear view camera service logic of section.

Correspondingly, subject description discloses a kind of method, the method is used in the operation system with multiple vectoring phases During the later vectoring phase of system, the control of kernel mode video driver is transferred from kernel mode early stage service logic Give rear view camera application, which comprises

The ready event of rear view camera service logic to be instructed such as early stage service logic, rear view camera application quilt It is loaded into the user's space of operating system.If RVC service logic is ready, in kernel mode or kernel spacing Communication between video driver and the application of early stage service logic stops, and rear view camera is applied and driven with kernel spacing video Communication between dynamic program is established.

Specifically, early stage service logic may be implemented as driver, and especially be implemented as kernel mode drive Dynamic program, and RVC application also may be implemented as driver and especially be implemented as user mode driver.

In addition, this specification also discloses a kind of method for generating rear view camera event according to CAN message.

CAN message is filtered for rear view camera message, and rear view camera is generated according to filtered CAN message Event.The rear view camera event is stored in mailbox, wherein sending feedback message if mailbox is full.One receives The feedback message expired to indicating mail box just retransmits rear view camera event.

Especially it is possible to regularly send CAN message and rear view camera event, the unidirectional protocol via unidirectional protocol Based on interchip communication agreement or it is embodied on interchip communication agreement.

Detailed description of the invention

The theme of this specification is explained referring now to following attached drawing, in the drawing:

Fig. 1 shows the layout of automotive infotainment and vehicle electronics,

Fig. 2 shows other details of the information entertainment of Fig. 1,

Fig. 3 shows the timing during the start-up course of the information entertainment of Fig. 1,

Fig. 4 shows the message between the vehicle communication controller and multimedia controller of the information entertainment of Fig. 1 Message format, and

Fig. 5 shows the mechanism for avoiding losing message in the RMI protocol of Fig. 4,

Fig. 6 was shown in the second vectoring phase of OS of the video driver on the multimedia controller for operating in Fig. 2 The first sequence being loaded,

Fig. 7 shows the second sequence that video driver is loaded in the first vectoring phase of OS,

Fig. 8 shows the transition shown after the sequence of Fig. 6 to the video in the second vectoring phase,

Fig. 9 shows the transition shown after the sequence of Fig. 7 to the video in the second vectoring phase, and

Figure 10 shows the passenger compartment of the information entertainment with Fig. 1.

Specific embodiment

In the following description, it gives particulars to describe the embodiment of this specification.However, it is possible to not such thin Implementing the embodiment in the case where section should be obvious for those skilled in the art.

Fig. 1 shows the layout of the information entertainment 10 for being connected to vehicle electronics 9 of automobile.Infotainment system System 10 includes that master controller 12 and the other components not being shown in Fig. 1, such as display, auto radio, CD are played Device, digital signal processor (DSP), hand free device.

Auto electroincs 9 include that vehicle communication controller 11, CAN bus 13 and others are not shown in Fig. 1 Component (such as control unit of engine, for the control unit and other electronic components and cable connection for warm ventilation). Vehicle communication controller 11 is connected to the CAN bus 13 for the automobile not being shown in Fig. 1.

Vehicle communication controller 11 includes providing Unified Communication mechanism (UCM, Unified Communication Mechanism UCM unit 14, the RM of offer remote message interface (RMI, Remote Messaging Interface)) is mono- Member 15 provides the ICC unit 16 and offer Serial Peripheral Interface (SPI) of communication (ICC, Inter CPU Communication) between CPU The SP unit 17 of (SPI, Serial Peripheral Interface).

Equally, master controller 12 includes for providing the SP unit 27 of Serial Peripheral Interface (SPI), communicating between CPU for providing The RM unit 25 of ICC unit 26 and offer remote message interface.In addition, master controller 12 further includes vehicle sensors driver 18 and for providing early stage service logic (BL, Business Logic) driver 19 of backlight the early stage when.

SP unit 27, ICC unit 26, RM unit 25, vehicle sensors driver 18 and early stage BL driver 19 In the kernel spacing 20 in master controller 12, or, in other words, they run in kernel mode.In kernel mode, Any operation of its framework permission can be performed in CPU；Any instruction can be performed, and any I/O operation can be initiated, memory is appointed What region can be accessed, etc..Under other cpu models, certain constraints to CPU operation are forced by hardware.Processor Start in kernel mode, and runs bootstrap loader in kernel mode.Operating system is loaded, and the operation system System is also run in kernel mode.The process of the os starting is usually run in the user mode.

Master controller 12 is directed to the program run in the user mode and provides user's space 21.This is for example suitable for operating The figure and video that system is run after being guided completely show routine program and most other processes.

Fig. 1 is also shown from CAN bus 13 to vehicle communication controller 11 and from vehicle communication controller 11 to main control The data flow 22 of device 12.Data flow 22 is from CAN unit 13 by UCM unit 14, the RM unit 15, ICC of vehicle communication controller Unit 16 and SP unit 17 extend to the SP unit 27 of master controller 12, and by the ICC unit 26 and RM of master controller 12 Unit 25 extends.

In addition, the data flow 23 for message extends to master controller 12 from the RM unit 15 of vehicle communication controller 11 RM unit 25, bidirectional traffic 24 is between the ICC unit 16 of vehicle communication controller 11 and the ICC unit 26 of master controller 12 Extend.Data frame message is transmitted to master controller 12 from the ICC unit 16 of vehicle communication controller 11 by bidirectional traffic 24 ICC unit 26, and the bidirectional traffic 24 will confirm that frame is transmitted to vehicle communication control from the ICC unit 26 of master controller 12 The ICC unit 16 of device 11.

Another bidirectional traffic 30 drives in the vehicle sensors driver 18 and early stage service logic of master controller 12 Extend between program 19.

Fig. 2 shows another views of the information entertainment 10 of Fig. 1 being generally laid out.

In the example in figure 2, information entertainment 10 includes vehicle communication controller (VCU) 31 and multimedia controller (MMU) 32.Vehicle communication controller 11 of the vehicle communication controller 31 of Fig. 2 corresponding to Fig. 1, and the multimedia controller of Fig. 2 32 correspond to the master controller 12 of Fig. 1.

It for example, can be by Texas Instruments (Texas Instruments) product line " TI TMS 470 " Device is managed to provide vehicle communication controller 31, and can be by Freescale Semiconductor (freescale Semiconductors the multimedia controller of product line " i.MX 53 ") provides multimedia controller.Multimedia control Device 32 includes the first microcontroller of also referred to as " platform " for processing system function, CAN communication and other service functions Unit (MCU) and the second micro controller unit for handling graphing capability.

In other embodiments, multimedia controller 32 also may include several for handling the MCU(of graphing capability such as Image processing unit, video processing unit, 3D rendering processing unit and 2D image processing unit).Multimedia controller 32 is connected It is connected to peripheral device 60(such as DDR RAM, LDC display, video camera, CVBS/S video components, GPS system or audio-frequency electric Management system).In addition, multimedia controller 32 is further attached to following NOR flash memory 59, the NOR flash memory 59 includes to have The erasable image of image head.The NOR flash memory can be on multimedia controller 32 (as illustrated in Figure 2) Or in the outside of the multimedia controller 32.

Vehicle communication controller 31 includes rear view camera (RVC, the Rear View for being connected to low speed CAN unit 34 Camera) unit 33, remote message interface unit 35 and vehicle RB unit 36.RVC unit 33 is directed to the rear view camera of automobile It provides service logic (BL).

In RAM memory, multimedia controller 32 includes that the first kernel mode shared library 37 and the second kernel mode are total Enjoy library 38.Kernel mode library includes start picture (splash screen) shared library 58.First shared library 37 is received including RMI Device module 39, touch screen driver 40 and backlight thread 41.RMI receiver module 39 includes input port, the input terminal Mouth is connected to the output port of the RMI unit 43 of multimedia controller 32.

In addition, multimedia controller 32 further includes human-machine interface unit 42, remote message interface unit 43, CAN driving journey Sequence 44, the platform 45 with registration table handing module 46 and figure module 47, hardware Interrupt Process module 48 and low-voltage differential letter Number (LVDS) module 49.CAN driver 44 is provided for reading and writing CAN signal.

32 first data flow of multimedia controller, be used to activate display backlight, from the long-range of multimedia controller 32 Message interface extends to CAN driver 44 via RMI receiver module 39, backlight thread 41 and touch screen driver.

Second data flow of multimedia controller 32, be used to show start picture image, from man-machine interface 42 by the The start picture shared library of two kernel mode shared libraries 38 extends to the Display processing module 46 and figure module 47 of platform 45, And hardware Interrupt Process module 48 and LVDS module 49 are extended to from figure module 47.

Display processing module 46 is provided for reading start picture calibration (calibration) and for saving currently Shown start picture.Figure module 47 is provided for the initialization of execution graphic hardware, for obtaining frame buffer address With on a display screen draw start picture image.

Shared library or shared object refer to following file: the file is intended to by executable file and shared pair other As file-sharing.It is loaded into load or from each individual shared object and is deposited when operation by module that program uses In reservoir, rather than when chain program is directed to single one chip executable file (the single monolithic of the program creation Executable file) when replicated by the chain program.In particular, shared library can be by dynamic link library (in Microsoft's Window In the environment of (Microsoft Windows) operating system also referred to as " DLL ") provide.

Fig. 3 shows the timing between the system startup of the information entertainment 10 of Fig. 1.Between system startup, vehicle Processor 31 spends time Δ t1 to wake up for CAN bus, and time Δ t2 is spent to manage IC(PMIC to power on) and Time Δ t3 is spent until vehicle processor 31 receives first message from the bootstrap power supply of PMIC.Multimedia processor 32 is spent Time Δ t4 spends time Δ t5 until the multimedia processor 32 is from remote message interface until the OS brings into operation To first message and spends time Δ t6 and connect the backlight of display.

In addition, multimedia processor expends time Δ t7 to load shape library " Gwes.dll " (described shape library " Gwes.dll " is the figure, window and Event Subsystem library of Windows embedded OS), spend time Δ t8 until Early stage backlight (EBL, early back light) routine program connects audio/video from remote message interface to message Receiver (AVR) connects AVR for VHR cost time Δ t9 and spends time Δ t10 to receive the first video from RMI Capturing events.

According to this specification in a first aspect, rear view camera video after backlight is activated be shown, without It needs first by providing the stand-alone solution unrelated with commonly drawing come at the shape library of load operating system or video Manage program.

According to the second aspect of this specification, rear view camera video show from use basic operating system call first Kernel-mode driver is handed over to second driver in the normal video rendering library using operating system.

According to the third aspect of this specification, backlight is switched in early days, allows start picture image in early stage quilt Display.

According to the third aspect of this specification, LCD backlight is during the start-up course of information entertainment 10 in early stage quilt It connects.In order to allow when multimedia controller (MMU) judgement connects backlight, the electricity handled by vehicle communication controller (VUC) Source state is delivered to multimedia controller.

According to this specification, remote message (RMI) agreement be used to realize that the early stage by power supply status from VUC to MMU passes It send.

In general, (some MOST for shaking hands synchronous is such as required to assist before starting two-way communication using bidirectional communication protocol View) communication of the Lai Jinhang between the vehicle communication controller 31 and multimedia controller 32 of Fig. 2.In addition, required MOST Software module is big and requires some times during starting to load.

By contrast, it according to this specification, shows the required information of start picture mark, is for connecting backlight Event, be sent to multimedia controller 32 from vehicle communication controller 31.Depend on for connecting the triggering of the event of backlight In power module, this is also executed by vehicle communication controller 31.

Therefore, it can not needed in vehicle communication controller 31 and multimedia controller 32 for connecting the event of backlight Between two-way communication in the case where be triggered.According to this specification, use as component 35,43 and shown in Fig. 2 39 come implement customization small one-way communication agreement.The one-way communication agreement is provided for controlling message from vehicle communication Device 31 is sent to multimedia controller 32.

In the context of the present specification, which is also referred to as remote message interface (RMI) agreement.According to this theory The RMI protocol of bright book can also be used for time and resource and effectively transmit other message and event.

Fig. 4 shows the message format of remote message interface protocol.Remote message interface (RMI) agreement is by vehicle communication control Device (TI) processed is just used to regularly transmit such as car speed (Vehicle to multimedia processor 32 via CAN bus Speed), steering wheel pulse (Wheel Pulse), gear signal (Gear Signal), Fmux pop-up (Fmux eject) etc. Critical data.RMI message format is structured on interchip communication (ICC) message format.Described two controllers 31, Communication between 32 be always it is unidirectional, wherein vehicle communication controller 31 will serve as transmitter always.RMI protocol and MOST are assisted View is concurrently run.

According in the top of Fig. 4 and the third line shown in the first RMI message format, message include: have length Spend the effective of the label (tag) of the regular length of 1 byte, the length specification symbol of regular length with 1 byte of length and n byte Load patch, wherein the number n of byte is illustrated in length specification symbol.

According to second message format, which only includes label and fixed-length value, and according to third format, which is only wrapped Include label.Therefore, length and codomain are optional.It can also add or connect together each other according to the message of the first format, As illustrated in the bottom position in Fig. 4.It equally, can be with according to the message of first, second or third message format It is coupled together.

In addition, the message can also be according to more advanced communication protocol (such as chip shown in the second row of Fig. 4 Between communication protocol or CAN protocol) be packaged.

According to this specification, a kind of mechanism is provided to track the message of RMI protocol.Rear view camera is safety-critical feature One of.It is therefore important that: the framework provides a kind of mechanism to avoid any message since communication or message are different soft It transmits and loses between part component.

According to the application, following mechanism is provided, the mechanism is suitable for the unidirectional RMI protocol of this specification, described unidirectional Method of the RMI protocol different from the use of the bi-directional MOS T agreement of confirmation message.

The period appropriate is used using the loading procedure of the CPU in view of multimedia controller 32 according to one embodiment Event is regularly sent, which is shown in Fig. 5.

For collecting the first mailbox 66 of message in the communication path from CAN using 65 to RVC triggering service logics 67 It is provided, the event (such as gear shift) that the RVC triggering service logic 67 processing triggering RVC is shown.For collecting the of message Two mailboxes 68 are in backlight triggering 67 and for by the communication path between RMI dispenser modules of the RMI message distribution to recipient In be provided.

During operation, message is regularly sent to the first mailbox 66 from CAN using 65, is sent from the first mailbox 66 To backlight trigger, the second mailbox 68 is sent to from backlight trigger and is sent to RMI distributor from the second mailbox 68 69.The method and step of Fig. 5 is performed on vehicle communication controller 31 and CAN are using 65, and the first mailbox 66 and RMI distributor are stayed It stays on vehicle communication controller 31.

According to Fig. 6 to 9 of this specification, a kind of guidance rank of mechanism after the vectoring phase 1 of operating system is provided The image from rear view camera is shown in section 2.In RVC using before ready, certain graphics driver (such as forms The direct drafting driver (DDRAW, Direct Draw Drivers) of operating system) it may be loaded not yet.Those drive Therefore the function of dynamic program is disabled early stage service logic.On the other hand, RVC is applied and HMI is using can Shape library, and can provide the function of extension.

According to this specification, in rear view camera using before ready, so that for showing the figure of rear view camera The video driver of picture is available.Rear view camera is safety-critical feature.Early stage time and added in other components Rear view camera video is shown before carrying, and provides the safety and users'comfort of enhancing.

On the other hand, when the shape library of operating system (such as DirectDraw interface) and man-machine interface are available When, certain features (such as parking auxiliary and integration of user interaction functionality) only can be in later time during the later vectoring phase It is provided.

According to the application, the architecture of layering is provided, wherein earlier vectoring phase of the video library in operating system Period is called by the phase software layer of early stage, and the phase software layer of the early stage provides the user with less function.

During later time in bootup process, the function of video library by the software layer with more features (such as RVC application or HMI application) it calls.In this way, video driver may be provided in during bootup process only later The function call (such as parking grid (parking grid)) of time service.There is no by early stage service logic tune for these functions With, but only called by RVC application or by HMI application.

Stop grid in terms of driving into or being driven out to parking space pass through instruction distance signal and suggest steering direction come Assist driver.In particular, HMI application allows to show parking grid under interactive mode.According to one embodiment, pass through RVC application parking grid has been available, and according to another embodiment, grid is only stopped when HMI application is loaded It is available.

In the example of Fig. 6 to 9, phase software layer is provided by early stage service logic kernel-mode driver earlier, The early stage service logic kernel-mode driver is loaded in step 70.Later phase software layer is by rear view camera Using providing with human interface applications, the rear view camera is applied to be loaded in step 81, and the man-machine interface is answered It is loaded in step 78'.

Further it is provided that a kind of mechanism transfers the control of video driver to later rank from early stage software layer Section software layer, this is best seen in Fig. 9.

In particular, the vectoring phase of Windows CE7 is characterized by following feature.Windows CE7 is during starting By two vectoring phases.During the first vectoring phase, system loads have the kernel of minimum driver, with access equipment File system and access registry data.After having read registry data, system continued for the second vectoring phase, to be based on Registration table configuration data loads remaining component.

In the step 70 of Fig. 6, is provided in the vectoring phase 1 of operating system and load kernel-mode driver. In step 71, initialization function creates (spawn) thread, which waits the RMI event of RVC state in step 72 Message.

In determination step 73, such as video driver is detected based on corresponding registry value or file value it is It is no to be loaded.If receiving the event before video driver is ready, rear view camera status data exists It is updated in one step, and does not start to video capture.Finally, since video driver in step 75 is initial Change, start video capture in the vectoring phase 2, which is described in more detail in Fig. 8.

If receiving the event in determination step 72 and video driver being ready or be loaded, Control is transferred to video driver.This situation is shown in Fig. 7.For simplicity, in the first phase vectoring phase Between the step of video driver is loaded into kernel spacing, be not shown in Fig. 7.

In the example of fig. 7, RMI event is received in a step 76.In this case, it is sent out according to unidirectional RMI protocol The RMI event instruction sent: gear is changed to reverse gear position from parking stall.In determination step 73, video drive journey is checked Whether sequence is loaded, if video driver is loaded, starts video in step 85 and shows.In the vectoring phase 2, Control is transferred to identical video driver in step 75 and 76.

Video driver is loaded in the vectoring phase 2, and the initialization function " Init () " of video driver checks RVC state.

Fig. 8 shows the sequence of the step of image for leading to video capture from rear view camera.For simplicity, with The identical step of step is not explained again those of in Fig. 6.In the step 76 in the vectoring phase 2, user mode video Driver is loaded as the first driver.Video driver includes following thread: the thread is to be higher than commonly excellent First grade starts video and shows, to realize the quick timing started for triggering video.

What video was shown starts include: the step 78 for starting video capture, set video layer to visible step 79 and The step 80 of vision signal is shown on a video display.

In step 75, the initialization function " Init () " of video driver checks RVC state, and if RVC shape State is set, and is triggered video and is started.The load of other drivers is delayed until that " Init () " function has executed.To, The CPU load of multimedia processor 32 is reduced, and is begun with a small amount of or do not interrupted for what video was shown.

Fig. 9 shows the transfer after the sequence of Fig. 7.When the HMI process of system is ready, and the RVC of standard Using or video driver be available or be loaded in step 73 when, in step 81,82,83,78', 79', 80' In, control is transferred to RVC service logic from early stage BL video driver.In particular, rear view camera is applied in step 81 In be loaded, audio-video process is loaded in step 82.Rear view camera, which is applied, to be loaded with HMI in step 78' and answers With, and HMI application is loaded with HMI process in a step 83.In step 79', HMI layers are arranged to as it can be seen that and in step In 80, video data is shown on a video display.Step 80 also may include the step 84 of display parking grid.

According to the embodiment of Fig. 9, early stage service logic and RVC using identical video driver, this simplifies Transfer task.

In step 81, rear view camera is applied to be loaded during the second vectoring phase.When RVC is using ready When, early stage service logic (BL) is informed in RVC application: the RVC is using ready.At the time point, from early stage BL to video The communication of driver stops in step 85, and further RVC state and control are forwarded to RVC service logic, without It is to be immediately sent to video driver in step 85' and 81.

RVC service logic provides the software for handling video driver and other functions related with rear view camera Layer.Another software layer is provided by HM interface, and the HM interface makes the calling to RVC service logic depending on user's interaction.

Figure 10 shows the passenger compartment 90 of automobile.In intermediate console, information entertainment 10, the letter are provided Ceasing entertainment systems 10 includes display 91 and CD driver 92.HVAC system 93 is provided on information entertainment.Another In one embodiment, HVAC system 93 can be controlled from the display 91 of information entertainment.

Also it can use the list of the subsequent feature for being organized into bulleted list or element to describe the embodiment. The corresponding combination of the feature disclosed in the bulleted list is considered separately as independent theme, and the independent theme can also be with It is combined with other features.

1. being used for the Infotainment component of automobile comprising:

Vehicle communication controller, the vehicle communication controller include:

For connecting the bus connection of universal serial bus,

Message processing unit, and

It is used to send the remote message interface of message using unidirectional protocol, and

Multimedia controller, the multimedia controller are connected to the vehicle via interchip communication bus and lead to Believe that controller, the multimedia controller include:

For connecting the display connection of display,

For receiving the message receiver of the message of unidirectional protocol,

Computer-readable memory with operating system, wherein the operating system includes multiple vectoring phases,

It is used to show the video driver of rear view camera image, and

Early stage service logic, the early stage service logic work is to cause video driver to start rear view camera Video,

Wherein, the operating system is configured as: during the vectoring phase earlier of the operating system described in load Early stage service logic, and load video driver in the later vectoring phase of the operating system, wherein it is described compared with The early vectoring phase is prior to the later vectoring phase.

2. the Infotainment component according to the 1st comes wherein the early stage service logic driver can operate Wait whether the shift event via unidirectional protocol from the vehicle communication controller, the detection video driver are connecing It is loaded when receiving the shift event and activates the video drive if the video driver is loaded Program.

3. the Infotainment component according to the 2nd, wherein shift event instruction is from parking stall to reverse gear position Gear shift or from neutral position to the gear shift of reverse gear position.

4. according to Infotainment component described in the Arbitrary Term in the 1st to 3, wherein the multimedia controller includes:

Rear view camera application/service logic, for calling video driver in later vectoring phase, and

Handover unit, the handover unit can operate to receive instruction rear view camera using ready and disappear Breath, and the communication between early stage service logic and video driver is stopped at, and establish rear view camera and apply and view Communication between frequency driver.

5. according to Infotainment component described in the Arbitrary Term in the 1st to 4, wherein the vehicle communication controller packet It includes:

- CAN application is used to send CAN message with periodic intervals, and

CAN message mailbox unit, for storing the message of CAN application and indicating the CAN message postal for sending The feedback message whether box unit has expired,

Wherein, the CAN application can operate: if CAN application receives what instruction CAN message mailbox had been expired Feedback message then retries transmission message.

6. according to Infotainment component described in the Arbitrary Term in the 1st to 5, wherein the message processing unit can It operates to assess CAN message and trigger rear view camera event,

Wherein the vehicle communication controller includes:

Event message mailbox unit for the event message of message processing unit described in storing the 1st, and is used In sending the feedback message whether expired of indicating mail box unit,

Wherein, the rear view camera triggering service logic can operate: if the rear view camera triggers business Logic receives the feedback message that instruction event message mailbox has been expired, then retries transmission message.

7. the Infotainment component according to the 6th comprising message distributor, for by event message from vehicle Communication controler is sent to multimedia controller via unidirectional protocol, wherein the message distributor unit is connected to event and disappears Cease the output end of mailbox.

8. the information entertainment of automobile comprising according to Infotainment component described in the Arbitrary Term in the 1st to 7, The information entertainment includes the display device with display screen, wherein the display device is connected to multimedia controller Display connection.

9. the automobile with the information entertainment according to the 8th, wherein the CAN bus of automobile is connected to vehicle The bus connection of communication controler.

10. for showing the video from rear view camera on the screen of the display device of automotive infotainment The method of image, wherein multimedia controller includes the operating system with multiple vectoring phases, which comprises

By in the kernel spacing of operating system described in early stage service logic driver loaded ribbon,

The rear view camera state event from vehicle communication controller is waited,

Determine whether to load kernel mode video driver,

If kernel mode video driver is not loaded,

Rear view camera status indicator is updated,

If kernel mode video driver is loaded, and

The function for calling the kernel mode video driver, for obtaining and showing rear view camera video Image.

11. being used for video drive journey during the later vectoring phase of the operating system with multiple vectoring phases The method that rear view camera is applied is transferred in the control of sequence to from kernel mode early stage service logic, which comprises

The ready event of rear view camera service logic to be instructed is waited,

Rear view camera application is loaded into the user's space of operating system,

Stop the communication between video driver and the application of early stage service logic, and

Rear view camera is established using the communication between kernel spacing video driver.

12. the method for generating rear view camera event according to CAN message, which comprises

It is directed to CAN message described in rear view camera message screening,

Rear view camera event is generated according to filtered CAN message,

The rear view camera event is stored in mailbox,

If the mailbox is full, feedback message is sent, and

- one receives the feedback message for indicating that the mailbox has been expired, and just retransmits rear view camera event.

13. the method according to the 12nd, which comprises

Rear view camera event is sent via unidirectional protocol.

Reference listing

9 vehicle electronics

10 information entertainments

11 vehicle communication controllers

12 master controllers

13 CAN bus

14 UCM units

15 RM units

16 ICC units

17 SP units

18 vehicle sensors drivers

19 early stage BL drivers

20 kernel spacings

22 data flows

23 data flows

24 bidirectional traffics

25 RM units

26 ICC units

27 SP units

30 bidirectional traffics

31 vehicle communication controllers

32 multimedia controllers

33 rear view camera units

34 low speed CAN units

35 RMI units

36 vehicle RB units

37 kernel mode shared libraries

38 kernel mode shared libraries

39 RMI receiver modules

40 touch screen drivers

41 backlight threads

42 RMI units

43 RMI units

44 CAN drivers

45 platforms

46 registration table handing modules

47 figure modules

48 hardware Interrupt Process modules

49 Low Voltage Differential Signal modules

50 images

51 steps

52 combination steps

53 save step

58 start picture shared libraries

59 NOR type flash memories

60 peripheral devices

60' peripheral device

61 rear view cameras

65 CAN application

66 first mailboxes

67 RVC triggers

68 second mailboxes

69 RMI dispatchers

70 driver load steps

71 early stage BL init steps

72 RMI waiting steps

73 determination steps

74 RVC states update step

74'RVC state updates step

75 video driver init steps

76 video driver load steps

77 RMI eventing steps

78 videos capture step

78'HMI load step

The visible step of 79 setting layers

The visible step of layer is arranged in 79'

80,80' shows step

81 load RVC app steps

82 load AV proc steps

83 load HMI process steps

84 parking grids show step

85 video starting steps

85' video starting step

90 passenger compartments

91 displays

92 CD drivers

93 HVAC systems

Claims (12)

1. being used for the Infotainment component of automobile comprising vehicle communication controller and multimedia controller, the multimedia control Device processed is connected to the vehicle communication controller via interchip communication bus, and the vehicle communication controller includes:

For connecting the bus connection of universal serial bus,

Message processing unit, and

It is used to send the remote message interface of message using unidirectional protocol, and

The multimedia controller includes:

For connecting the display connection of display,

For receiving the message receiver of the message of unidirectional protocol,

Computer-readable memory with operating system, the operating system includes multiple vectoring phases,

It is used to show the video driver of rear view camera image, and

Early stage service logic, the early stage service logic can operate so that video driver starts rear view camera view Frequently,

Wherein, the operating system is configured as: loading the early stage during the vectoring phase earlier of the operating system Service logic, and video driver is loaded in the later vectoring phase of the operating system, it is described to guide earlier Stage is prior to the later vectoring phase；

The early stage service logic driver can operate to wait via unidirectional protocol from the vehicle communication controller Shift event, detect the video driver and whether be loaded when receiving the shift event and if institute It states video driver to be loaded, activates the video driver.

2. Infotainment component according to claim 1, wherein the shift event instruction is from parking stall to reverse gear position Gear shift or from neutral position to the gear shift of reverse gear position.

3. Infotainment component according to claim 1, wherein the multimedia controller includes:

Rear view camera application/service logic, for calling video driver in later vectoring phase, and

Handover unit, the handover unit can operate to receive instruction rear view camera using ready message, and And stop the communication between early stage service logic and video driver, and establish rear view camera and apply and video drive journey Communication between sequence.

4. Infotainment component according to claim 1, wherein the vehicle communication controller includes:

- CAN application is used to send CAN message with periodic intervals, and

CAN message mailbox unit, for storing the message of CAN application and indicating the CAN message mailbox list for sending The feedback message whether member has expired,

Wherein, the CAN application can operate: if CAN application receives the feedback that instruction CAN message mailbox has been expired Message then retries transmission message.

5. Infotainment component according to claim 1, wherein the message processing unit can operate to assess CAN Message and rear view camera event is triggered,

The vehicle communication controller includes:

Event message mailbox unit, for storing the event message of the message processing unit, and for sending instruction institute The feedback message whether event message mailbox unit has expired is stated,

Wherein, the rear view camera triggering service logic can operate: if the rear view camera triggers service logic The feedback message that instruction event message mailbox has been expired is received, then retries transmission message.

6. Infotainment component according to claim 5 comprising message distributor, for event message to be led to from vehicle Believe that controller is sent to multimedia controller via unidirectional protocol, wherein the message distributor unit is connected to event message The output end of mailbox.

7. the information entertainment of automobile comprising Infotainment component according to claim 1, the Infotainment system System includes the display device with display screen, wherein the display device is connected to the display connection of multimedia controller.

8. the automobile with information entertainment according to claim 7, wherein the CAN bus of automobile is connected to vehicle The bus connection of communication controler.

9. for showing the video image from rear view camera on the screen of the display device of automotive infotainment Method, automotive infotainment include multimedia controller, and wherein multimedia controller includes having multiple vectoring phases Operating system, which comprises

By the load of early stage service logic driver in the kernel spacing of the operating system,

Early stage service logic driver can operate to wait shift event, and whether detection video driver is receiving It is loaded when to the shift event and activates the video drive journey if the video driver is loaded Sequence,

The rear view camera state event from vehicle communication controller is waited,

The function for calling kernel mode video driver, for obtaining and showing rear view camera video image.

10. being used for the control of video driver during the later vectoring phase of the operating system with multiple vectoring phases It makes from kernel mode early stage service logic and transfers the method that rear view camera is applied to, which comprises

The ready event of rear view camera service logic to be instructed is waited,

Rear view camera application is loaded into the user's space of operating system,

Stop the communication between video driver and the application of early stage service logic, wherein early stage service logic driver It can operate to wait shift event, whether detection video driver is loaded and such as when receiving shift event Video driver described in fruit is loaded, and activates the video driver, and

Rear view camera is established using the communication between kernel spacing video driver.

11. according to the method described in claim 10, generating rear view camera event according to CAN message, comprising:

It is directed to CAN message described in rear view camera message screening,

Rear view camera event is generated according to filtered CAN message,

The rear view camera event is stored in mailbox,

If the mailbox is full, feedback message is sent, and

- one receives the feedback message for indicating that the mailbox has been expired, and just retransmits rear view camera event.

12. according to the method for claim 11, which comprises

Rear view camera event is sent via unidirectional protocol.