CN114132175A - Emergency processing system and method for automobile virtual instrument - Google Patents
Emergency processing system and method for automobile virtual instrument Download PDFInfo
- Publication number
- CN114132175A CN114132175A CN202111519173.0A CN202111519173A CN114132175A CN 114132175 A CN114132175 A CN 114132175A CN 202111519173 A CN202111519173 A CN 202111519173A CN 114132175 A CN114132175 A CN 114132175A
- Authority
- CN
- China
- Prior art keywords
- information
- display
- processor
- microprocessor
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 60
- 238000000034 method Methods 0.000 title abstract description 20
- 238000012795 verification Methods 0.000 claims abstract description 82
- 238000009877 rendering Methods 0.000 claims abstract description 42
- 230000010365 information processing Effects 0.000 claims description 10
- 238000003672 processing method Methods 0.000 claims description 7
- 230000001360 synchronised effect Effects 0.000 claims description 5
- 125000004122 cyclic group Chemical group 0.000 claims description 4
- 238000007689 inspection Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 12
- 230000006870 function Effects 0.000 description 12
- 238000011084 recovery Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 4
- 230000003213 activating effect Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 101150114085 soc-2 gene Proteins 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Arrangement of adaptations of instruments
-
- B60K35/213—
-
- B60K35/81—
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B1/00—Systems for signalling characterised solely by the form of transmission of the signal
- G08B1/08—Systems for signalling characterised solely by the form of transmission of the signal using electric transmission ; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
Abstract
The embodiment of the invention discloses an emergency processing system and method for an automobile virtual instrument, wherein a microprocessor is used for sending an alarm signal to a first processor and sending backup information obtained by processing the alarm signal to a second processor when the alarm signal is generated; the first processor is used for determining display information according to the alarm signal and sending the display information to the display control module; the display control module is used for determining a rendering image according to the display information and sending the rendering image to the instrument display screen; the second processor is used for performing pixel read-back on the display information in the display control module to determine the information to be detected, determining a verification result according to the information to be detected and the backup information, and sending the verification result to the microprocessor; and the microprocessor is used for generating a control signal and sending the control signal to the second processor if the verification result is that the verification is not passed and the failure duration of the first processor reaches a first duration threshold value, so that the effects of improving the robustness and meeting the functional safety are achieved.
Description
Technical Field
The embodiment of the invention relates to a virtual instrument technology, in particular to an emergency treatment system and method for an automobile virtual instrument.
Background
The automobile instrument has the functions of displaying conventional vehicle information such as speed, rotating speed, water temperature, a fuel gauge, mileage and the like, and also has the functions of warning system faults, taking over by a driver and other important warning prompts and displaying information, so that the automobile instrument is a source for acquiring vehicle information by the driver in the process of driving the automobile.
The automobile instrument is gradually converted into a virtual instrument from a pointer instrument, but the failure of the electronic and electrical system of the automobile to give an alarm or an alarm error can cause that some important alarm information or display information can not be timely and correctly transmitted to a driver, and even serious traffic accidents can be caused.
At present, most of the problems are that display information of a virtual instrument is detected, and if the display information does not pass the detection, a system is restarted to achieve the effect of resetting the system. However, the system restart can cause the instrument display screen to be black, and frequent screen blacking can cause the problems of difficult acquisition of driver information and poor experience.
Disclosure of Invention
The embodiment of the invention provides an emergency processing system and method for an automobile virtual instrument, which aim to establish a multi-level recovery mechanism to improve the robustness and the user experience of the system and meet the technical effect of vehicle function safety.
In a first aspect, an embodiment of the present invention provides an emergency processing system for a virtual instrument of an automobile, where the system includes: the system comprises a microprocessor, a system-level chip and an instrument display screen; the system-on-chip comprises a first processor, a second processor and a display control module; wherein,
the microprocessor is connected with the first processor and the second processor and used for sending the alarm signal to the first processor and sending backup information obtained by processing the alarm signal to the second processor when the alarm signal is generated;
the first processor is connected with the display control module and used for receiving an alarm signal sent by the microprocessor, determining display information according to the alarm signal and sending the display information to the display control module;
the display control module is connected with the instrument display screen and used for receiving the display information, determining a rendering image according to the display information and sending the rendering image to the instrument display screen so that the instrument display screen displays the rendering image;
the second processor is connected with the display control module and used for receiving the backup information sent by the microprocessor, performing pixel read-back on the display information in the display control module, determining the information to be detected, determining a verification result according to the information to be detected and the backup information, and sending the verification result to the microprocessor;
the microprocessor is further used for receiving the verification result, generating a control signal if the verification result is that the verification is not passed and the failure duration of the first processor reaches a first duration threshold, and sending the control signal to the second processor so as to control the second processor to generate display information according to the backup information, and sending the display information to the display control module.
In a second aspect, an embodiment of the present invention further provides an emergency processing method for an automobile virtual instrument, which is applied to the emergency processing system for the automobile virtual instrument, and the method includes:
when an alarm signal is generated based on a microprocessor, the alarm signal is sent to a first processor, and backup information obtained by processing the alarm signal is sent to a second processor;
receiving an alarm signal sent by the microprocessor based on the first processor, determining display information according to the alarm signal, and sending the display information to a display control module;
the display control module receives the display information, determines a rendering image according to the display information, and sends the rendering image to an instrument display screen so that the instrument display screen displays the rendering image;
receiving backup information sent by the microprocessor based on the second processor, performing pixel read-back on display information in the display control module, determining to-be-detected information, determining a verification result according to the to-be-detected information and the backup information, and sending the verification result to the microprocessor;
and based on the microprocessor receiving the verification result, if the verification result is that the verification is not passed and the failure duration of the first processor reaches a first time duration threshold value, generating a control signal, sending the control signal to the second processor to control the second processor to generate display information according to the backup information, and sending the display information to the display control module.
According to the technical scheme of the embodiment of the invention, when an alarm signal is generated based on a microprocessor, the alarm signal is sent to a first processor, backup information obtained by processing the alarm signal is sent to a second processor, display information is determined according to the alarm signal based on the first processor, and the display information is sent to a display control module; determining a rendering image based on a display control module according to display information, sending the rendering image to an instrument display screen to enable the instrument display screen to display the rendering image, reading back pixels of the display information in the display control module based on a second processor to determine information to be detected, determining a check result according to the information to be detected and backup information, sending the check result to a microprocessor, generating a control signal based on the microprocessor if the check result is that the check fails and the failure duration of the first processor reaches a first time threshold, sending the control signal to the second processor to control the second processor to generate display information according to the backup information, and sending the display information to the display control module The user experience degree and the technical effect of meeting the vehicle function safety are achieved.
Drawings
In order to more clearly illustrate the technical solutions of the exemplary embodiments of the present invention, a brief description is given below of the drawings used in describing the embodiments. It should be clear that the described figures are only views of some of the embodiments of the invention to be described, not all, and that for a person skilled in the art, other figures can be derived from these figures without inventive effort.
Fig. 1 is a schematic structural diagram of an emergency processing system for a virtual instrument of an automobile according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an emergency processing system for a virtual instrument of an automobile according to a second embodiment of the present invention;
fig. 3 is a schematic flow chart of an emergency processing method for a virtual instrument of an automobile according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an emergency processing system for a virtual instrument of an automobile according to a third embodiment of the present invention;
fig. 5 is a schematic flow chart of an emergency processing method for an automobile virtual instrument according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a schematic structural diagram of an emergency processing system for an automobile virtual instrument according to an embodiment of the present invention, where the embodiment is applicable to a situation where a fault occurs during a display process of the automobile virtual instrument, the system may execute an emergency processing method for the automobile virtual instrument, the system may be implemented in the form of software and/or hardware, and the hardware may be an on-board device.
The emergency treatment system for the virtual instrument of the automobile shown in FIG. 1 comprises: the system comprises a microprocessor 1, a system-level chip 2 and an instrument display screen 3; the system-on-chip 2 comprises a first processor 21, a second processor 22 and a display control module 23.
The microprocessor 1 is connected with the first processor 21 and the second processor 22, and is used for sending an alarm signal to the first processor 21 and sending backup information obtained by processing the alarm signal to the second processor 22 when the alarm signal is generated; the first processor 21 is connected with the display control module 23, and is used for receiving the alarm signal sent by the microprocessor 1, determining display information according to the alarm signal, and sending the display information to the display control module 23; the display control module 23 is connected to the instrument display screen 3, and is configured to receive the display information, determine a rendering image according to the display information, and send the rendering image to the instrument display screen 3, so that the instrument display screen 3 displays the rendering image; the second processor 22 is connected with the display control module 23 and is used for receiving the backup information sent by the microprocessor 1, performing pixel read-back on the display information in the display control module 23, determining the information to be detected, determining a verification result according to the information to be detected and the backup information, and sending the verification result to the microprocessor 1; the microprocessor 1 is further configured to receive the verification result, generate a control signal if the verification result is that the verification fails and the failure duration of the first processor 21 reaches the first duration threshold, and send the control signal to the second processor 22, so as to control the second processor 22 to generate display information according to the backup information, and send the display information to the display control module 23.
And the microprocessor 1 is used for sending the alarm signal to the first processor 21 and sending the backup information obtained by processing the alarm signal to the second processor 22 when the alarm signal is generated.
The microprocessor 1 may be a Microcontroller Unit (MCU), and is mainly used for analyzing and processing signals. The System on Chip 2 may be a System on Chip (SoC) and is mainly used for data operation and image rendering and synthesis. In order to realize the functional safety of the virtual instrument system, the microcontroller 1 and the system-on-chip 2 meeting the functional safety requirements are adopted, and a corresponding functional safety mechanism is adopted, wherein the SoC is a multi-core processor and comprises a first processor 21 and a second processor 22. It will be appreciated that both microcontroller 1 and system-on-chip 2 satisfy functional safety. The warning signal may be a signal generated from information of the vehicle for triggering the display. The first processor 21 may be a conventional display core and the second processor may be a functional security implementation core. The alarm signal can be a signal carrying information about the brightness of the alarm lamp. The backup information may be information obtained by the microprocessor 1 by screening the alarm signal according to the function safety, may also be information obtained by screening according to the user requirement, may be information carried by all or part of the alarm signal, and is used for subsequent verification and backup display.
Specifically, when the microprocessor 1 analyzes and generates an alarm signal according to the information of the vehicle itself and the information of the periphery of the vehicle acquired by the sensor, the alarm signal is sent to the first processor 21, the information carried in the alarm signal is screened according to the subsequent verification requirement to obtain backup information, and the backup information is sent to the second processor 22.
The first processor 21 is configured to receive the alarm signal sent by the microprocessor 1, determine display information according to the alarm signal, and send the display information to the display control module 23.
The display information may be information describing the effect of each alarm lamp, such as brightness or flashing.
Specifically, when the first processor 21 receives the alarm signal sent by the microprocessor 1, the alarm signal may be analyzed to obtain display information for controlling the display effect of each alarm lamp in the virtual instrument, and the display information may be sent to the display control module 23.
And the display control module 23 is configured to receive the display information, determine a rendering image according to the display information, and send the rendering image to the meter display screen 3, so that the meter display screen 3 displays the rendering image.
Wherein the rendered image may be a displayed image effect.
Specifically, when the display control module 23 receives the display information, the display information may be processed to obtain a rendered image corresponding to the display information. And sending the rendering image to the instrument display screen 3, so that the instrument display screen 3 receives the rendering image and displays the rendering image.
And the second processor 22 is configured to receive the backup information sent by the microprocessor 1, perform pixel read-back on the display information in the display control module 23, determine information to be detected, determine a verification result according to the information to be detected and the alarm signal, and send the verification result to the microprocessor 1.
The information to be detected may be all display information in the display control module 23, or may be partial display information in the display control module 23, where the partial display information may be information related to an important alarm lamp in the virtual instrument, that is, information to be verified corresponding to the backup information. The checking result may include two types, i.e., a pass check and a fail check, and is used to determine whether the information to be detected corresponds to the backup information, and further, to determine whether the image controlled and displayed by the first processor 21 is correct.
Specifically, the second processor 22 receives the backup information sent by the microprocessor 1, and performs backup processing on the backup information. And performing pixel readback on the display information in the display control module 23, reading the display information contained in the display information, and determining the information to be detected according to the display information. Furthermore, the second processor 22 determines the display information corresponding to the backup information, and verifies the information with the information to be detected, and determines whether the information and the information to be detected are consistent, if so, the verification result is that the verification is passed, and if not, the verification result is that the verification is not passed. The check result is sent to the microprocessor 1 through the second processor 22 so that the microprocessor 1 takes emergency measures when the check fails.
The microprocessor 1 is further configured to receive the verification result, generate a control signal if the verification result is that the verification fails and the failure duration of the first processor 21 reaches the first duration threshold, and send the control signal to the second processor 22, so as to control the second processor 22 to generate display information according to the backup information, and send the display information to the display control module 23.
The expiration time may be a duration of which the verification result is that the verification fails. The first time threshold may be a time threshold for triggering a backup display of the second processor 22. The control signal may be a signal that controls the second processor 22 to perform a backup display.
Specifically, when the microprocessor 1 receives the verification result, if the verification result is that the verification fails and the duration of the non-verification reaches the first time threshold, it indicates that the image displayed on the instrument display screen 3 controlled by the first processor 21 has a persistent error problem, and at this time, the microprocessor 1 may generate a control signal and send the control signal to the second processor 22. When the second processor 22 receives the control signal, display information is generated based on the backup information in the second processor 22, and the display information is sent to the display control module 23, so that the display control module 23 determines a rendering image according to the display information, and controls the instrument display screen 3 to display according to a processing result of the second processor 22.
Optionally, if the check result is a check pass, it indicates that the processing result of the first processor 21 is normal, and no additional processing is needed; if the verification result is failed and the failure duration of the first processor 21 does not reach the first time threshold, it indicates that the first processor 21 controls the display to be temporarily failed or that the pixel read-back has an error, and there is a certain possibility of self-repairing, that is, the next verification result may pass through, and at this time, continuous monitoring is required to perform the verification again.
It should be noted that, when the backup display is performed by the second processor 22, a part of the alarm lamp image in which the first processor 21 has displayed an error is displayed based on the backup information, and compared with the case where the alarm lamp image is directly displayed by the first processor 21, a problem arises in that a part of the alarm lamp image is inferior in display effect and is not suitable for a long time.
On the basis of the foregoing embodiment, optionally, the microprocessor 1 is further configured to generate a restart signal if the check result is that the check fails and the failure duration of the first processor 21 reaches the second duration threshold, and restart the microprocessor 1 and the system on chip 2 according to the restart signal.
Wherein the second duration threshold may be a duration threshold for triggering the microprocessor 1 to restart. The restart signal may be a signal that triggers a restart.
Specifically, if the check result is that the check fails and the failure time of the first processor 21 reaches the second time threshold, it indicates that the first processor 21 controls and displays that the vehicle has failed for a long time and the failure fault-tolerant time interval of the vehicle is exceeded without repair, which causes a serious result, at this time, a restart signal is generated, and the microprocessor 1 and the system-level chip 2 are restarted according to the restart signal.
On the basis of the above embodiment, optionally, the microprocessor 1 is further configured to: determining a first time threshold according to the preset times and the single redundancy read-back check time; and determining a second time length threshold value according to the restart time length of the microprocessor 1 and the system-on-chip 2 and the fault tolerance time interval of the target vehicle.
Wherein, the single redundant read-back check time can be the time required for single pixel read-back and check. The preset number of times may be one or more, for example: 3 times, 5 times, etc. The restart duration may be a duration required for the microprocessor 1 and the soc 2 to be completely restarted. The target vehicle may be a vehicle to which the automotive virtual instrument emergency processing system belongs. A fault tolerance time interval may be defined as the time interval during which one or more faults in the system may exist before a hazard event occurs. Typically, the fault tolerance interval is specified by an Original Equipment Manufacturer (OEM).
Specifically, after the preset times and the single redundancy read-back check time are determined, the product of the preset times and the single redundancy read-back check time is used as a first time length threshold. And after the restart time length and the fault tolerance time interval are determined, the difference value obtained by subtracting the restart time length from the fault tolerance time interval is used as a second time length threshold value. It should be noted that the second duration threshold is greater than the first duration threshold.
On the basis of the above embodiment, optionally, the first processor 21 and the microprocessor 1 are connected by a full-duplex synchronous serial bus; the second processor 22 and the microprocessor 1 are connected by a full duplex asynchronous serial bus.
The full-duplex synchronous Serial bus may be an SPI (Serial Peripheral Interface) bus. The full-duplex Asynchronous serial bus connection may be a UART (Universal Asynchronous Receiver/Transmitter) bus.
It should be noted that, due to the difference between the information requirement and the real-time requirement of the first processor 21 and the second processor 22, different full-duplex serial buses may be used for information transmission.
According to the technical scheme of the embodiment of the invention, when an alarm signal is generated based on a microprocessor, the alarm signal is sent to a first processor, backup information obtained by processing the alarm signal is sent to a second processor, display information is determined according to the alarm signal based on the first processor, and the display information is sent to a display control module; determining a rendering image based on a display control module according to display information, sending the rendering image to an instrument display screen to enable the instrument display screen to display the rendering image, reading back pixels of the display information in the display control module based on a second processor to determine information to be detected, determining a check result according to the information to be detected and backup information, sending the check result to a microprocessor, generating a control signal based on the microprocessor if the check result is that the check fails and the failure duration of the first processor reaches a first time threshold, sending the control signal to the second processor to control the second processor to generate display information according to the backup information, and sending the display information to the display control module The user experience degree and the technical effect of meeting the vehicle function safety are achieved.
Example two
Fig. 2 is a schematic structural diagram of an emergency processing system for a virtual instrument of an automobile according to a second embodiment of the present invention, wherein explanations of terms that are the same as or correspond to the above embodiments are omitted here for brevity.
As shown in fig. 2, the microprocessor 1 includes an information processing module 11; the information processing module 11 is configured to receive a sensor signal and a controller signal of a target vehicle, determine an alarm signal based on the sensor signal and the controller signal, send the alarm signal to the first processor 21, process the alarm signal to obtain backup information, and send the backup information to the second processor 22.
The sensor signal may be a signal acquired by a sensor mounted on the target vehicle. The Controller signal may be a CAN (Controller Area Network) signal, that is, a signal of the target vehicle acquired by the Controller.
Specifically, the signal processing module 11 may receive the sensor signal and the controller signal, process the sensor signal and the controller signal, and analyze the sensor signal and the controller signal to obtain an alarm signal, so as to subsequently turn on or turn off a corresponding alarm lamp on the instrument display screen 3. Further, the alarm signal is sent to the first processor 21. In addition, the signal processing module 11 may screen information carried by the alarm signal to obtain backup information, and send the backup information to the second processor 22.
As shown in fig. 2, the second processor 22 includes a backup display module 211 and a security check module 212; the backup display module 211 is connected to the microprocessor 1 and the display control module 23, and configured to receive backup information sent by the microprocessor 1, store the backup information, generate display information based on the stored backup information when receiving a control signal, and send the display information to the display control module 23; and the safety check module 212 is connected with the microprocessor 1, the backup display module 211 and the display control module 23, and is configured to perform pixel readback on the display information in the display control module 23, determine information to be detected, determine a check result according to the information to be detected and the backup information stored in the backup display module 211, and send the check result to the microprocessor 1.
And a backup display module 211, configured to receive the backup information sent by the microprocessor 1, store the backup information, generate display information based on the stored backup information when receiving the control signal, and send the display information to the display control module 23.
The display information generated based on the stored backup information may be the display information corresponding to the portion where the error is displayed by the first processor 21 when the verification fails.
Specifically, when the backup display module 211 receives the backup information, the backup information is backed up and stored, so that a subsequent call is performed to verify the backup information. And when receiving the control signal sent by the microprocessor 1, determining that the backup display is performed through the second processor 22 at this time, processing the backup information backed up and stored in the backup display module 211 to generate display information, and sending the display information to the display control module 23, so that the display control module 23 can perform subsequent display according to the display information in the second processor 22.
The safety check module 212 is configured to perform pixel readback on the display information in the display control module 23, determine information to be detected, determine a check result according to the information to be detected and the backup information stored in the backup display module 211, and send the check result to the microprocessor 1.
Specifically, the security check module 212 may verify the display signal processed by the first processor 21 to determine whether the display of the warning lamp is normal. The display information in the display control module 23 is read back by the security check module 212, and the information to be detected is determined according to the read-back display information. And then, the second processor 22 processes the backup information, determines the display information corresponding to the backup information, verifies the display information and the information to be detected, determines whether the display information and the information to be detected are consistent, if so, the verification result is that the verification is passed, and if not, the verification result is that the verification is not passed. Further, the check result is sent to the microprocessor 1 so that the microprocessor 1 takes emergency measures when the check fails.
Optionally, the security check module 212 is further configured to: determining information to be displayed according to the backup information stored in the backup display module 211; and determining a check result according to the information to be displayed and the information to be detected through cyclic redundancy check.
The information to be displayed may be a part for verification in the display information obtained by processing the backup information.
Specifically, the display information obtained by processing the backup information stored in the backup display module 211 is determined from the display information to be used as the information to be displayed, and the information to be displayed is checked with the information to be detected, which may be performed by using a Cyclic Redundancy Check (CRC) method to obtain a check result.
It should be noted that the information to be detected may be all display information or part of display information in the display control module 23, or may be information that matches information corresponding to the backup information, specifically determined according to a field or item to be detected. If the information is partially displayed, the importance of the subsequently displayed alarm lamp can be related, and detection is needed when the importance is higher.
Optionally, the security check module 212 further includes a pixel read-back module 2121; the pixel read-back module 2121 is configured to acquire display information in the display control module 23, and determine information to be detected according to the acquired information.
Specifically, the pixel-based read-back module 2121 may acquire the display information sent by the first processor 21 from the display control module 23, and screen the acquired information to obtain to-be-detected information for subsequent verification.
Optionally, the microprocessor 1 includes a failure processing module 12 and a state management module 13; the failure processing module 12 is connected to the second processor 22, and configured to process according to the alarm signal to obtain backup information, and if the verification result is that the verification fails and the failure duration of the first processor 21 reaches a second duration threshold, generate a restart signal, and send the restart signal to the state management module 13; and the state management module 13 is connected to the failure processing module 12, and is configured to restart the microprocessor 1 and the system-on-chip 2 according to the restart signal when receiving the restart signal.
And the failure processing module 12 is configured to process according to the alarm signal to obtain backup information, and if the verification result is that the verification fails and the failure duration of the first processor 21 reaches the second duration threshold, generate a restart signal, and send the restart signal to the state management module 13.
Specifically, the failure processing module 12 may obtain information that needs to be used for subsequent verification from information carried by the alarm signal as backup information. The failure processing module 12 counts the received verification result, and determines that the information displayed on the instrument display screen 3 is continuously in a problem and the system needs to be restarted if the verification result is that the verification fails and the duration of the verification failing reaches the second duration threshold. At this time, a restart signal may be generated and sent to the state management module 13 to control the system to restart.
It should be noted that the backup information may be sent to the second processor 22 by the information processing module 11, or may be sent to the failure processing module 12 by the information processing module 11, and then sent to the second processor 22 by the failure processing module 12.
And the state management module 13 is configured to restart the microprocessor 1 and the system-on-chip 2 according to the restart signal when receiving the restart signal.
Specifically, when the state management module 13 receives the restart signal, it triggers a restart operation to restart the microprocessor 1 and the system on chip 2, so as to recover the normal display.
According to the technical scheme of the embodiment of the invention, when an alarm signal is generated based on a microprocessor, the alarm signal is sent to a first processor, backup information obtained by processing the alarm signal is sent to a second processor, display information is determined according to the alarm signal based on the first processor, and the display information is sent to a display control module; determining a rendering image based on a display control module according to display information, sending the rendering image to an instrument display screen to enable the instrument display screen to display the rendering image, reading back pixels of the display information in the display control module based on a second processor to determine information to be detected, determining a check result according to the information to be detected and backup information, sending the check result to a microprocessor, generating a control signal based on the microprocessor if the check result is that the check fails and the failure duration of the first processor reaches a first time threshold, sending the control signal to the second processor to control the second processor to generate display information according to the backup information, and sending the display information to the display control module The user experience degree and the technical effect of meeting the vehicle function safety are achieved.
EXAMPLE III
Fig. 3 is a schematic flow chart of an emergency processing method for a virtual instrument of an automobile according to a third embodiment of the present invention. The same or corresponding terms as those in the above embodiments are not explained in detail herein.
1. The MCU (microprocessor) acquires and processes an alarm input signal (alarm signal), sends the alarm input signal (alarm signal) to the SOC Core1 (the first processor of the system level chip) through an SPI bus (full-duplex synchronous serial bus connection) for screen display, and simultaneously sends backup information to the SOC Core2 (the second processor of the system level chip) through a UART bus (full-duplex asynchronous serial bus) for alarm lamp check and backup display.
2. The SOC Core2 reads back the display output information (information to be detected).
3. And (4) judging whether the display information is correct or not (checking result) by calculating the CRC value, if so, returning to execute the step (1), and if not, executing the step (4).
4. If the failure time is continuously larger than a first time threshold (a first time threshold) and smaller than a second time threshold (a second time threshold), starting and recovering (activating backup).
5. If the failure time is continuously greater than the second time threshold, secondary recovery (system restart) is initiated.
Wherein, MCU is responsible for the maintenance of alarm lamp list and alarm lamp scintillation function, judges which alarm lamps need to be lighted which needs to be hidden according to alarm signal input promptly, and SoC need realize showing and hiding the control to the alarm lamp according to MCU's information (alarm signal) to finally show by the instrument display screen.
The Core1 is a conventional display Core of the SOC and is responsible for receiving alarm signals from the MCU, transmitting the alarm signals to the SoC through the SPI, and transmitting alarm lamp information to an instrument display screen through the display module for display. Core2 is an SOC function safety realization Core, wherein alarm lamp information (information to be detected) related to function safety can be transferred to the function safety inspection module through UART, and when an error (verification failure) is detected, the backup display module replaces the display module to send image information (display information) to the display control module, so as to realize the display of the alarm lamp.
Fig. 4 is a schematic structural diagram of an emergency processing system for a virtual instrument of an automobile according to a third embodiment of the present invention. The same or corresponding terms as those in the above embodiments are not explained in detail herein.
According to the illustration in fig. 4, the modules for realizing functional safety in the emergency treatment system of the virtual instrument of the automobile are as follows:
1. an information processing module: for receiving and processing sensor signals and CAN signals of the vehicle.
2. A pixel read-back module: and reading back the picture (display information) sent to the instrument display screen.
3. A security check module: and checking the result read by the pixel read-back module, and sending the checking result to the failure processing module.
4. A display module: rendering the display picture of the instrument display screen, and sending the picture information to the display control module.
5. A backup display module: and when an error occurs (the verification fails), the backup display is carried out by replacing the display module.
6. A failure management module: corresponding to a multi-level recovery mechanism, the first level is backup display, and the second level is system restart.
7. MCU state management module: and restarting the system when a serious error occurs to the system.
8. A display control module: and finally synthesizing the display image, and sending the synthesized image to the instrument display screen.
The specific working process is as follows:
when the MCU receives signals from the sensor and/or the CAN line, the information processing module judges whether the signals meet alarm conditions, namely, judges the display or hidden state of an alarm lamp, sends alarm information to the display module of the SOC Core1 for rendering processing, and realizes the illumination of the alarm lamp of the instrument display screen through the display control module. Meanwhile, the signal processing module checks and judges safety-related information (defined by OEM) in the alarm signal, sends alarm information (backup information) related to functional safety to the failure processing module, and sends the alarm information to the SOC Core2 for safety check by the failure processing module.
When the instrument display screen displays the alarm information, the pixel read-back module (for example, ISI of iMX 8) of the SOC Core2 reads the image information (display information) sent to the instrument display screen by the display control module, compares the image information with the information (backup information) of the failure processing module of the MCU, and checks if a display error is found (the check fails), for example: if the alarm lamp is unexpectedly and incorrectly lighted, and the like, judging whether the failure time is continuously greater than a first time threshold and less than a second time threshold; if yes, informing a display backup module to call pixel information (backup information) of a related security component stored in a memory in advance to perform backup display, namely starting primary recovery (activating backup display); if the failure time is continuously greater than the second time threshold, secondary recovery (system restart) is initiated.
The first time threshold is redundant readback check time, that is, time for completing pixel readback and security check for multiple times. In order to reduce the error check judgment and reduce the error check incidence rate so as to avoid the error entering the backup display state, a plurality of times (3 times or more) of redundancy safety check are set, and the check time sum is a first time threshold value. When the first time threshold is met, the results of pixel read-back and security check are considered to be credible, and primary recovery (activating backup display) can be carried out. The second time threshold is a safety recovery time, which is a fault tolerance time interval defined by the OEM minus a system restart time. If the result after the multiple backup checks still does not correctly display the alarm information, at the moment, the first-level recovery cannot be entered or the first-level recovery is wrong, in order to avoid the occurrence of the hazard event in time, a second time threshold is set as the safety recovery time, and if the failure time is greater than the second time threshold, the system is restarted in time.
The technical scheme of the embodiment of the invention obtains and processes the alarm input signal through the MCU, sends the alarm input signal to the SOC Core1 through the SPI bus for screen display, meanwhile, the backup information is sent to SOC Core2 through a UART bus to carry out alarm lamp inspection and backup display, SOC Core2 reads back the display output information, judges whether the display information is correct or not by calculating a CRC value, if so, returning to execute the MCU to acquire and process the alarm input signal, if not, judging whether the failure time is continuously greater than the first time threshold and less than the second time threshold, and starting and recovering, if the failure time is continuously greater than the second time threshold, starting secondary recovery, solving the problem of frequent restart due to display errors of the virtual instrument, realizing establishment of a multi-stage recovery mechanism, improving system robustness and user experience, and meeting the technical effect of vehicle function safety.
Example four
Fig. 5 is a schematic flow chart of an emergency processing method for an automobile virtual instrument according to a fourth embodiment of the present invention, where the method is applied to an emergency processing system for an automobile virtual instrument. The same or corresponding terms as those in the above embodiments are not explained in detail herein.
As shown in fig. 5, the method of this embodiment specifically includes the following steps:
and S510, when an alarm signal is generated based on the microprocessor, sending the alarm signal to the first processor, and sending backup information obtained by processing the alarm signal to the second processor.
Optionally, the microprocessor includes an information processing module, and is based on the sensor signal and the controller signal of the target vehicle are received by the information processing module, and the alarm signal is determined based on the sensor signal and the controller signal, and is sent to the first processor, the alarm signal is processed to obtain backup information, and the backup information is sent to the second processor.
Optionally, the first processor and the microprocessor are connected through a full-duplex synchronous serial bus; the second processor and the microprocessor are connected by a full-duplex asynchronous serial bus.
S520, receiving the alarm signal sent by the microprocessor based on the first processor, determining display information according to the alarm signal, and sending the display information to the display control module.
S530, receiving the display information based on the display control module, determining a rendering image according to the display information, and sending the rendering image to the instrument display screen so that the instrument display screen displays the rendering image.
And S540, receiving the backup information sent by the microprocessor based on the second processor, performing pixel read-back on the display information in the display control module, determining the information to be detected, determining a verification result according to the information to be detected and the backup information, and sending the verification result to the microprocessor.
Optionally, the second processor includes a backup display module and a security check module, and receives backup information sent by the microprocessor based on the backup display module, stores the backup information, generates display information based on the stored backup information when receiving the control signal, and sends the display information to the display control module; and performing pixel readback on the display information in the display control module based on the safety check module, determining the information to be detected, determining a verification result according to the information to be detected and the backup information stored in the backup display module, and sending the verification result to the microprocessor.
Optionally, the information to be displayed is determined based on the backup information stored in the backup display module by the security check module; and determining a check result according to the information to be displayed and the information to be detected through cyclic redundancy check.
Optionally, the security inspection module further includes a pixel read-back module, and acquires the display information in the display control module based on the pixel read-back module, and determines the information to be detected according to the acquired information.
And S550, receiving the verification result based on the microprocessor, if the verification result is that the verification is not passed and the failure duration of the first processor reaches a first time duration threshold value, generating a control signal, sending the control signal to the second processor, controlling the second processor to generate display information according to the backup information, and sending the display information to the display control module.
Optionally, if the check result is that the check fails and the failure duration of the first processor reaches a second duration threshold, a restart signal is generated based on the microprocessor, and the microprocessor and the system-on-chip are restarted according to the restart signal.
Optionally, the microprocessor includes a failure processing module and a state management module; processing according to the alarm signal based on the failure processing module to obtain backup information, generating a restarting signal if the verification result is that the verification is not passed and the failure time of the first processor reaches a second time threshold, and sending the restarting signal to the state management module; and when the state management module receives the restarting signal, restarting the microprocessor and the system level chip according to the restarting signal.
Optionally, a first time threshold is determined based on the microprocessor according to preset times and single redundancy read-back check time; and determining a second time length threshold value according to the restarting time lengths of the microprocessor and the system-on-chip and the fault tolerance time interval of the target vehicle.
According to the technical scheme of the embodiment of the invention, when an alarm signal is generated based on a microprocessor, the alarm signal is sent to a first processor, backup information obtained by processing the alarm signal is sent to a second processor, display information is determined according to the alarm signal based on the first processor, and the display information is sent to a display control module; determining a rendering image based on a display control module according to display information, sending the rendering image to an instrument display screen to enable the instrument display screen to display the rendering image, reading back pixels of the display information in the display control module based on a second processor to determine information to be detected, determining a check result according to the information to be detected and backup information, sending the check result to a microprocessor, generating a control signal based on the microprocessor if the check result is that the check fails and the failure duration of the first processor reaches a first time threshold, sending the control signal to the second processor to control the second processor to generate display information according to the backup information, and sending the display information to the display control module The user experience degree and the technical effect of meeting the vehicle function safety are achieved.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. An automobile virtual instrument emergency processing system, comprising: the system comprises a microprocessor, a system-level chip and an instrument display screen; the system-on-chip comprises a first processor, a second processor and a display control module; wherein,
the microprocessor is connected with the first processor and the second processor and used for sending the alarm signal to the first processor and sending backup information obtained by processing the alarm signal to the second processor when the alarm signal is generated;
the first processor is connected with the display control module and used for receiving an alarm signal sent by the microprocessor, determining display information according to the alarm signal and sending the display information to the display control module;
the display control module is connected with the instrument display screen and used for receiving the display information, determining a rendering image according to the display information and sending the rendering image to the instrument display screen so that the instrument display screen displays the rendering image;
the second processor is connected with the display control module and used for receiving the backup information sent by the microprocessor, performing pixel read-back on the display information in the display control module, determining the information to be detected, determining a verification result according to the information to be detected and the backup information, and sending the verification result to the microprocessor;
the microprocessor is further used for receiving the verification result, generating a control signal if the verification result is that the verification is not passed and the failure duration of the first processor reaches a first duration threshold, and sending the control signal to the second processor so as to control the second processor to generate display information according to the backup information, and sending the display information to the display control module.
2. The system of claim 1, wherein the microprocessor comprises an information processing module; wherein,
the information processing module is used for receiving sensor signals and controller signals of a target vehicle, determining the alarm signals based on the sensor signals and the controller signals, sending the alarm signals to the first processor, processing the alarm signals to obtain backup information, and sending the backup information to the second processor.
3. The system of claim 1, wherein the first processor and the microprocessor are connected by a full-duplex synchronous serial bus; the second processor and the microprocessor are connected by a full-duplex asynchronous serial bus.
4. The system of claim 1, wherein the microprocessor is further configured to:
and if the verification result is that the verification is not passed and the failure time of the first processor reaches a second time length threshold value, generating a restarting signal, and restarting the microprocessor and the system-level chip according to the restarting signal.
5. The system of claim 1, wherein the second processor comprises a backup display module and a security check module; wherein,
the backup display module is connected with the microprocessor and the display control module and used for receiving backup information sent by the microprocessor, storing the backup information, generating display information based on the stored backup information when receiving the control signal, and sending the display information to the display control module;
the safety inspection module is connected with the microprocessor, the backup display module and the display control module, and is used for performing pixel readback on display information in the display control module, determining information to be detected, determining a verification result according to the information to be detected and backup information stored in the backup display module, and sending the verification result to the microprocessor.
6. The system of claim 5, wherein the security check module is further configured to:
determining information to be displayed according to the backup information stored in the backup display module;
and determining a check result according to the information to be displayed and the information to be detected through cyclic redundancy check.
7. The system of claim 5, wherein the security check module further comprises a pixel read-back module; wherein,
and the pixel read-back module is used for acquiring the display information in the display control module and determining the information to be detected according to the acquired information.
8. The system of claim 1, wherein the microprocessor comprises a failure handling module and a state management module; wherein,
the failure processing module is connected with the second processor and used for processing according to the alarm signal to obtain backup information, generating a restarting signal if the verification result is that the verification fails and the failure duration of the first processor reaches a second duration threshold, and sending the restarting signal to the state management module;
and the state management module is connected with the failure processing module and used for restarting the microprocessor and the system-level chip according to the restart signal when receiving the restart signal.
9. The system of claim 1, wherein the microprocessor is further configured to:
determining a first time threshold according to the preset times and the single redundancy read-back check time;
and determining a second time length threshold value according to the restarting time lengths of the microprocessor and the system-on-chip and the fault tolerance time interval of the target vehicle.
10. An emergency processing method for an automobile virtual instrument is applied to an emergency processing system for the automobile virtual instrument, and comprises the following steps:
when an alarm signal is generated based on a microprocessor, the alarm signal is sent to a first processor, and backup information obtained by processing the alarm signal is sent to a second processor;
receiving an alarm signal sent by the microprocessor based on the first processor, determining display information according to the alarm signal, and sending the display information to a display control module;
the display control module receives the display information, determines a rendering image according to the display information, and sends the rendering image to an instrument display screen so that the instrument display screen displays the rendering image;
receiving backup information sent by the microprocessor based on the second processor, performing pixel read-back on display information in the display control module, determining to-be-detected information, determining a verification result according to the to-be-detected information and the backup information, and sending the verification result to the microprocessor;
and based on the microprocessor receiving the verification result, if the verification result is that the verification is not passed and the failure duration of the first processor reaches a first time duration threshold value, generating a control signal, sending the control signal to the second processor to control the second processor to generate display information according to the backup information, and sending the display information to the display control module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111519173.0A CN114132175B (en) | 2021-12-13 | 2021-12-13 | Automobile virtual instrument emergency treatment system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111519173.0A CN114132175B (en) | 2021-12-13 | 2021-12-13 | Automobile virtual instrument emergency treatment system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114132175A true CN114132175A (en) | 2022-03-04 |
| CN114132175B CN114132175B (en) | 2023-10-27 |
Family
ID=80382287
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111519173.0A Active CN114132175B (en) | 2021-12-13 | 2021-12-13 | Automobile virtual instrument emergency treatment system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114132175B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102722171A (en) * | 2012-06-08 | 2012-10-10 | 广东好帮手电子科技股份有限公司 | Method and system for detecting anomaly of automobile instrument |
| JP2014226951A (en) * | 2013-05-20 | 2014-12-08 | 日本精機株式会社 | Display device for vehicle |
| WO2015032731A1 (en) * | 2013-09-03 | 2015-03-12 | Continental Automotive Gmbh | Method for controlling an information display device and device comprising an information display device |
| CN107009901A (en) * | 2017-03-31 | 2017-08-04 | 武汉理工大学 | A kind of SCM Based electric automobile combination electronic instrument |
| CN107097646A (en) * | 2017-04-24 | 2017-08-29 | 大陆汽车投资（上海）有限公司 | The method handled alarm indication |
| CN107117033A (en) * | 2017-04-28 | 2017-09-01 | 北京新能源汽车股份有限公司 | A kind of information display control method, device, instrument controller and electric automobile |
| US20170253181A1 (en) * | 2016-03-07 | 2017-09-07 | Lg Electronics Inc. | Vehicle control device mounted on vehicle and method for controlling the vehicle |
| CN207416554U (en) * | 2017-09-19 | 2018-05-29 | 宝沃汽车（中国）有限公司 | Vehicle alarming system and vehicle |
| US20180277064A1 (en) * | 2017-03-21 | 2018-09-27 | Cnh Industrial America Llc | Vehicle display safety software compliance method and apparatus |
| US20190179587A1 (en) * | 2017-12-07 | 2019-06-13 | Sitronix Technology Corp. | Optical imaging device with backup display |
| CN111038258A (en) * | 2019-11-19 | 2020-04-21 | 上海赫千电子科技有限公司 | Display control method for digital instrument for vehicle |
-
2021
- 2021-12-13 CN CN202111519173.0A patent/CN114132175B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102722171A (en) * | 2012-06-08 | 2012-10-10 | 广东好帮手电子科技股份有限公司 | Method and system for detecting anomaly of automobile instrument |
| JP2014226951A (en) * | 2013-05-20 | 2014-12-08 | 日本精機株式会社 | Display device for vehicle |
| WO2015032731A1 (en) * | 2013-09-03 | 2015-03-12 | Continental Automotive Gmbh | Method for controlling an information display device and device comprising an information display device |
| US20170253181A1 (en) * | 2016-03-07 | 2017-09-07 | Lg Electronics Inc. | Vehicle control device mounted on vehicle and method for controlling the vehicle |
| US20180277064A1 (en) * | 2017-03-21 | 2018-09-27 | Cnh Industrial America Llc | Vehicle display safety software compliance method and apparatus |
| CN107009901A (en) * | 2017-03-31 | 2017-08-04 | 武汉理工大学 | A kind of SCM Based electric automobile combination electronic instrument |
| CN107097646A (en) * | 2017-04-24 | 2017-08-29 | 大陆汽车投资（上海）有限公司 | The method handled alarm indication |
| CN107117033A (en) * | 2017-04-28 | 2017-09-01 | 北京新能源汽车股份有限公司 | A kind of information display control method, device, instrument controller and electric automobile |
| CN207416554U (en) * | 2017-09-19 | 2018-05-29 | 宝沃汽车（中国）有限公司 | Vehicle alarming system and vehicle |
| US20190179587A1 (en) * | 2017-12-07 | 2019-06-13 | Sitronix Technology Corp. | Optical imaging device with backup display |
| CN111038258A (en) * | 2019-11-19 | 2020-04-21 | 上海赫千电子科技有限公司 | Display control method for digital instrument for vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114132175B (en) | 2023-10-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107415690B (en) | Automobile, automobile instrument and its control method | |
| US10848272B2 (en) | Error detection in automobile tell-tales | |
| WO2023246265A1 (en) | Vehicle fault alarm method and system for liquid crystal instrument system | |
| US10395541B2 (en) | Integrated fault-tolerant augmented area viewing system | |
| WO2019137345A1 (en) | Method and apparatus for establishing communication connection with tire pressure monitoring system, and electronic device | |
| CN107097646B (en) | The method that alarm indication is handled | |
| KR20200128627A (en) | Automatic driving processing system, system on chip and method for monitoring processing module | |
| CN113064748A (en) | Process succession method, device, electronic equipment and storage medium | |
| CN113824887A (en) | Master control chip with function safety, all-round looking system and method | |
| CN106547667B (en) | Fault prompting method and system for mobile terminal | |
| CN105015346B (en) | Virtual car instrument system, method of work and automobile with sound prompt function | |
| CN114132175B (en) | Automobile virtual instrument emergency treatment system and method | |
| CN113500913B (en) | Drawing assembly of full liquid crystal instrument | |
| CN108153610A (en) | A kind of safety of image detection method based on hardware heterogeneous polynuclear | |
| CN117111801A (en) | Fault detection and safety display method and system for automobile virtual instrument | |
| JP2022153871A (en) | Video processing device and display device | |
| CN116945900A (en) | Display method of vehicle indicator lamp | |
| CN117647924A (en) | Fault-tolerant control method and system for fault signals | |
| US11895326B2 (en) | Alternating frame processing operation with predicted frame comparisons for high safety level use | |
| CN115002469A (en) | Instrument display backup system and method based on image diagnosis and vehicle | |
| CN117207775A (en) | Automobile instrument display control system, method, vehicle controller and storage medium | |
| CN116135597A (en) | Method and system for transmitting automobile warning information | |
| CN116409265A (en) | Vehicle safety state transmission method and system | |
| CN115543758A (en) | Safety interface display method and device of instrument, vehicle and storage medium | |
| Anisimov et al. | Smart Clusters-Safety Requirements and Concepts |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |