CN116704918A

CN116704918A - Display detection device, display detection system, and display detection method

Info

Publication number: CN116704918A
Application number: CN202210181496.1A
Authority: CN
Inventors: 李华
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-02-25
Filing date: 2022-02-25
Publication date: 2023-09-05
Also published as: WO2023160117A1

Abstract

The application provides a display detection device, a display detection system and a display detection method, relates to the technical field of display, and can determine whether a display is abnormal or not according to a comparison result of first display information and reference display information. The display detection device comprises a display, a light collector and a detection circuit; the display comprises a plurality of display subareas, and at least one display subarea of the display emits display light; the light ray collector is arranged on an emergent light path of the display light, and is used for collecting the display light emergent from at least one display partition, converting the collected display light into first display information in the form of an electric signal and sending the first display information to the detection circuit; and the detection circuit is coupled with the light collector and is used for receiving the first display information and comparing the first display information with the reference display information of the corresponding display partition to indicate whether the display is abnormal.

Description

Display detection device, display detection system, and display detection method

Technical Field

The present application relates to the field of display technologies, and in particular, to a display detection device, a display detection system, and a display detection method.

Background

In recent years, with the continuous development of economy, the amount of automobile maintenance in each place is increasing year by year, and automobiles have become the most favored modern vehicles.

A head up display (hereinafter abbreviated as HUD) is used as a driving assisting tool, which can project driving information such as speed per hour, navigation, oil quantity and the like to the front of a driver in a virtual image form, so that the driver can see the driving information as far as possible without lowering the head or turning the head, and the driving safety of the vehicle is improved.

The HUD includes a display, and if the display fails, a virtual image projected by the HUD will not properly display the driving information.

Disclosure of Invention

The application provides a display detection device, a display detection system and a display detection method, which can determine whether a display is abnormal or not according to a comparison result of first display information and reference display information.

In a first aspect, the present application provides a display detection apparatus comprising an existing HUD, which may include a target processor, a display, and an optical path adjustment assembly. The target processor is coupled with the display and used for controlling the display to display pictures; under the control of the target processor, the display emits display light to display important information related to the terminal; the light path adjusting component is arranged on the emergent light path of the display light, and after the display light is projected to the light path adjusting component, the display light is adjusted by the light path adjusting component to form a virtual image at the target position of the terminal, so that the virtual image is seen by a user when the user uses the terminal.

In some possible implementations, the HUD may include a bridge chip and a display controller supporting security functions in addition to the target processor, the display, and the optical path adjustment component.

The bridge chip can be integrated between the signal transmission paths of the target processor and the display, and is used for enabling the display detection system to enter a safe state when the safety alarm information and the like cannot be displayed correctly, wherein the safe state is expressed as follows: the driver can be informed that the current display detection system is abnormal.

For example, when the driver fails to normally display the related icons such as a belt-fastening alarm, a brake system failure, etc., the bridge chip may send a signal to the display to control the display to display a start icon or other special icon (e.g., a mark) to enter a safe state. Of course, the above-described safety condition may also be embodied in other manners, such as an automobile interior sound alert, vibrating a steering wheel or seat, lighting an automobile interior light, and the like.

The display controller may be integrated between the bridge chip and the signal transmission path of the display for controlling the display to display the picture under the control of the target processor. When the display detection system is in a safe state, the display can be controlled to display a startup icon or other special icons under the control of the bridge chip.

In the HUD, if any one of the target processor, the display and the bridge chip fails, the display may not correctly display the driving information, and the virtual image content seen by the driver may be wrong, so that an unnecessary safety accident may occur. Therefore, whether the target processor, the display, and the bridge chip fail should be detected in time. In the embodiment of the application, the display detection system can detect whether the target processor, the display and the bridge chip have faults or not besides forming a virtual image at the target position of the terminal.

For the target processor, the bridge chip and the display controller, a mode of integrating a first comparison module in the target processor, integrating a second comparison module in the bridge chip and integrating a third comparison module in the display controller can be adopted to detect whether the target processor, the bridge chip and the display controller have faults or not respectively.

Specifically, the target processor may send the first actual data and the first control signal to the first comparison module, and the first comparison module may generate the first ideal data under the control of the first control signal. The first comparison module compares the received first actual data with first ideal data, if the difference value between the first actual data and the first ideal data exceeds a first threshold range, the first comparison module indicates that the target processor fails, and the first comparator sends the first ideal data to the bridge chip; otherwise, the target processor is normal, and the first comparator sends first ideal data or first actual data to the bridge chip.

After the bridge chip receives the first ideal data or the first actual data, second actual data is generated, and the second actual data is sent to the second comparison module. The target processor may also send a second control signal to the second comparison module, which may generate second ideal data under control of the second control signal. The second comparison module compares the received second actual data with the second ideal data, if the difference value between the second actual data and the second ideal data exceeds a second threshold range, the bridging chip is described, and/or the transmission path from the first comparison module to the bridging chip fails, the second comparison module sends the second ideal data to the display controller; otherwise, the transmission paths from the bridge chip and the first comparison module to the bridge chip are normal, and the second comparison module sends second ideal data or second actual data to the display controller.

And after receiving the second ideal data or the second actual data, the display controller generates third actual data and sends the third actual data to the third comparison module. The target processor may also send a third control signal to a third comparison module, which may generate third ideal data under control of the third control signal. The third comparison module compares the received third actual data with the third ideal data, if the difference value between the third actual data and the third ideal data exceeds a third threshold value range, the display controller is indicated, and/or a transmission path from the second comparison module to the display controller fails, and the third comparison module sends the third ideal data to the display; otherwise, the transmission paths from the display controller to the second comparison module are normal, and the third comparison module sends third ideal data or third actual data to the display.

The foregoing describes that any one of the target processor, the display, the bridge chip, and the display controller fails, which may cause the display to fail to properly display the running information. Also, a method of detecting whether a failure has occurred in a target processor, a bridge chip, and a display controller is described. On the one hand, for the display, the parameters of the display provided by each provider are different, and the display cannot be uniformly detected at the digital end as the target processor, the bridge chip and the display controller; on the other hand, the inventors found that no device for extracting display light and no circuit for detecting display light are deployed in the design of the current display detection system. Therefore, the display detection system is still in a state of technical blank for the detection of the display.

Based on the above, the display detection device may further include a light collector and a detection circuit on the basis of the existing HUD. The display comprises a plurality of display partitions, and at least one of the display partitions emits display light. The light ray collector is arranged on an emergent light path of the display light, and is used for collecting the display light emergent from at least one display partition, converting the collected display light into first display information in the form of an electric signal and sending the first display information to the detection circuit. And the light collector is coupled with the detection circuit and is used for receiving the first display information and comparing the first display information with the reference display information of the corresponding display partition so as to indicate whether the display is abnormal.

In the application, the detection circuit receives the reference display information of at least one display partition and the first display information sent by the light collector, and compares the first display information of the same display partition with the reference display information. If the target processor is directly coupled with the display and directly controls the display picture of the display, the display is described and/or a transmission path from the target processor to the display is failed under the condition that the difference value between the first display information and the reference display information exceeds a fourth threshold value range, so that the display is abnormal; otherwise, the transmission paths of the display and the target processor to the display are normal. Or if the target processor is indirectly coupled with the display and controls the display picture of the display through the bridge chip and/or the display controller, the display is described and/or a transmission path from the display controller (or the bridge chip) to the display is failed under the condition that the difference value between the first display information and the reference display information exceeds a fourth threshold value range, so that the display is abnormal; in contrast, the transmission paths of the display and the display controller (or bridge chip) to the display are normal.

In some possible implementations, the display detection apparatus may further include a security processing module. The security processing module is coupled to the detection circuit. The detection circuit may send the comparison result of whether the display is normally displayed to the security processing module. When the comparison result indicates that the display is abnormal, the safety processing module can take a series of measures aiming at the display abnormality so as to remind a user. In addition, any one of the transmission paths from the display controller, the second comparison module to the display controller, the bridge chip, the transmission paths from the first comparison module to the bridge chip and the target processor fails, and the safety processing module can also take the measures to remind the user.

In some possible implementations, the display detection apparatus further includes an optical path adjustment component and a mirror. The light path adjusting component is arranged on an emergent light path of the display light and is used for adjusting the light path of the display light; the light path adjusting component comprises a half-mirror, and the reflecting mirror is arranged on a light path between the half-mirror and the light collector. The reflecting mirror is used for reflecting the display light transmitted through at least one display area of the half-transmitting half-reflecting mirror to the light collector.

After the display light emitted by the display is projected to the lens group, the display light is regulated by the lens group and projected to the semi-transparent and semi-reflective mirror. The display light projected onto the half mirror is reflected by the half mirror, projected onto the human eye, and directly ahead Cheng Xuxiang of the driver; the other part of the display light projected onto the half mirror is transmitted from the half mirror and projected onto the reflecting mirror, and the part of the display light is projected to the light collector after being reflected by the reflecting mirror. The half-mirror can be a front windshield of an automobile.

The light collector can detect the display by collecting the display light which is transmitted through the half mirror and wasted and is used for detecting the display light without affecting the intensity of the display light projected to human eyes.

In some possible implementations, the display detection apparatus further includes a light guide fiber. The optical fiber is arranged on the light emitting side of the display and used for transmitting the display light of at least one display area to the light collector. The application can transmit the display light emitted from at least one display area to the light collector by using the light guide fiber by arranging the light guide fiber on the light emitting side of the display.

In some possible implementations, the detection circuit further includes a first image processing module; each display partition comprises at least one pixel area; the first image processing module is used for converting the first display information into the second display information, and the pixel data size of the second display information of each pixel area is smaller than the pixel data size of the first display information of the pixel area.

The first display information can be subjected to dimension reduction processing by using the first image processing module so as to obtain second display information after dimension reduction. Thus, by reducing the pixel data amount of the second display information, the calculation amount in the comparison process of the detection circuit can be reduced.

In some possible implementations, in a case where the number of sub-pixels corresponding to the first display information is equal to or smaller than the actual data of the sub-pixels in the display, the first display information is converted into the second display information with smaller pixel data size, specifically, the data bit width of each sub-pixel (for example, red sub-pixel, green sub-pixel, and blue sub-pixel) may be reduced.

In other possible implementations, the number of sub-pixels corresponding to the first display information may be reduced, or the gray scale bit width of each sub-pixel (e.g., red sub-pixel, green sub-pixel, and blue sub-pixel) may be reduced, when the first display information is converted into the second display information having a smaller pixel data size than the actual data of the sub-pixels in the display 102.

In some possible implementations, while the light collector collects the display light, some ambient light may be collected by the light collector, thereby affecting the comparison result of the detection circuit. Based on this, the detection circuit further includes a second image processing module. And the second image processing module is used for carrying out filtering processing on the first display information or the second display information so as to obtain third display information. And the third display information after the filtering processing filters the ambient light except the display light, so that the detection accuracy of the detection circuit is improved.

Specifically, the process of filtering the first display information or the second display information by the second image processing module to obtain the third display information specifically includes: the second image processing module is used for acquiring a first characteristic value of the first display information or the second display information; the first characteristic value is used for indicating display data of the display; and the second image processing module is also used for carrying out filtering processing on the first display information or the second display information according to the first characteristic value and the reference display information so as to obtain third display information.

In addition, in some possible implementations, a portion of the color sub-pixels may be color shifted, e.g., a red sub-pixel, before the display light is projected onto the light collector, thereby affecting the comparison result. Based on this, if the display displays a full-color picture, the detection circuit may further perform gray-scale conversion on the first display information (or the second display information and the third display information), and the first display information (or the second display information and the third display information) after the gray-scale conversion may indicate a black-and-white picture, thereby improving accuracy of the comparison result.

In some possible implementations, the target processor is further configured to send reference display information to the detection circuit.

In the first case, when the target processor sends out the first ideal data or the first actual data, the reference display information can be sent to the detection circuit and stored by the detection circuit. The detection circuit receives the first display information sent by the light collector and can directly call the pre-stored reference display information.

In the second case, the target processor may send the reference display information to the detection circuit after sending the first ideal data or the first actual data, before the detection circuit receives the first display information.

In the third case, the detection circuit receives the first display information sent by the light collector, and can acquire the reference display information from the target processor.

In some possible implementations, the detection circuit includes a processing circuit. And the processing circuit is used for receiving the second display information or the third display information. In case the process of comparing the second display information (or the third display information) with the reference display information is implemented by a software code, the processing circuit is further configured to execute the software code and compare the second display information (or the third display information) of the corresponding display section with the reference display information to indicate whether the display is displaying an abnormality.

In some possible implementations, the detection circuit includes a processing circuit and a comparison circuit. The processing circuit is used for receiving the second display information or the third display information; the processing circuit is also used for responding to the second display information or the third display information and sending a control signal to the comparison circuit; and the comparison circuit is used for responding to the control signal, comparing the second display information or the third display information of the corresponding display partition with the reference display information to indicate whether the display is abnormal.

In some possible implementations, detection circuitry is integrated in the target processor to shorten the path between the target processor and the detection circuitry.

The display detection apparatus may further include a memory, and when any one of the first image processing module, the second image processing module, and the comparison module is in the form of a software code, the computer program or the software code may be stored in the memory when any one of the first image processing module, the second image processing module, and the comparison module is in the form of a computer program, and when the computer program or the software code is executed, the display detection apparatus may execute the respective steps to realize the functions.

In a second aspect, the present application provides a display detection system, which includes a terminal and the display detection apparatus of the first aspect; displaying display light emitted by a display of the detection device, and forming a virtual image at a target position of the terminal; and a detection circuit of the display detection device is used for indicating whether the display is abnormal.

In the application, the detection circuit of the display detection device receives the reference display information of at least one display partition and the first display information sent by the light collector, and compares the first display information of the same display partition with the reference display information. If the target processor is directly coupled with the display and directly controls the display picture of the display, the display is described and/or a transmission path from the target processor to the display is failed under the condition that the difference value between the first display information and the reference display information exceeds a fourth threshold value range, so that the display is abnormal; otherwise, the transmission paths of the display and the target processor to the display are normal. Or if the target processor is indirectly coupled with the display and controls the display picture of the display through the bridge chip and/or the display controller, the display is described and/or a transmission path from the display controller (or the bridge chip) to the display is failed under the condition that the difference value between the first display information and the reference display information exceeds a fourth threshold value range, so that the display is abnormal; in contrast, the transmission paths of the display and the display controller (or bridge chip) to the display are normal.

In some possible implementations, the terminal is at least one of an automobile, an airplane, and a head-mounted device.

Taking a terminal as an automobile or an airplane as an example, the virtual image can be arranged right in front of a cab of the automobile or the airplane, and the display content of the virtual image can comprise current speed per hour, oil quantity and other running information of the automobile or the airplane.

Taking the terminal as the head display device as an example, the virtual image may be formed in front of the eyes of the user wearing the head display device, and the display content of the virtual image may be a movie, a game, or the like.

In a third aspect, the present application provides a display detection method, applied to a display detection device, where the display detection device includes a display, a light collector, and a detection circuit; the display comprises a plurality of display partitions, the light collector is positioned on an outgoing light path of display light, and the light collector is coupled with the detection circuit; the display detection method comprises the following steps: emitting display light through at least one display section of the display; the method comprises the steps that display light emitted from at least one display partition is collected through a light collector, the collected display light is converted into first display information in the form of an electric signal, and the first display information is sent to a detection circuit; the first display information is received through the detection circuit and compared with the reference display information of the corresponding display partition to indicate whether the display is abnormal.

In some possible implementations, the display detection apparatus further includes a mirror and an optical path adjustment assembly that adjusts display light, the optical path adjustment assembly including a half mirror; the light collector collects the display light that emerges from at least one display partition, including: and reflecting the display light transmitted through at least one display area of the half-mirror to the light collector by using the mirror.

In some possible implementations, the display detection apparatus further includes a light guide fiber; the light collector collects the display light that emerges from at least one display partition, including: and transmitting the display light of at least one display area to the light collector by utilizing the optical fiber. The application can transmit the display light emitted from at least one display area to the light collector by using the light guide fiber by arranging the light guide fiber on the light emitting side of the display.

In some possible implementations, receiving, by the detection circuit, the first display information and comparing the first display information with reference display information of a corresponding display partition to indicate whether the display is displaying an anomaly, including: receiving the first display information through a detection circuit, and performing image processing on the first display information; and indicating whether the display normally displays or not according to the reference display information through the detection circuit.

In the first case, each display area includes at least one pixel area; receiving the first display information through the detection circuit, and performing image processing on the first display information, including: converting the first display information into second display information through a detection circuit; the pixel data amount of the second display information of each pixel area is smaller than the pixel data amount of the first display information of the pixel area.

In other possible implementations, the number of sub-pixels corresponding to the first display information may be reduced, or the gray-scale bit width of each sub-pixel (e.g., red sub-pixel, green sub-pixel, and blue sub-pixel) may be reduced, when the first display information is converted into the second display information with smaller pixel data than the actual data of the sub-pixel in the display.

In the second case, when the light collector collects the display light, part of the ambient light may be collected by the light collector, so that the comparison result of the detection circuit is affected. Based on this, the first display information or the second display information may also be subjected to filtering processing by the detection circuit to obtain third display information. And the third display information after the filtering processing filters the ambient light except the display light, so that the detection accuracy of the detection circuit is improved.

Specifically, the process of filtering the first display information or the second display information by using the detection circuit to obtain the third display information specifically includes: acquiring a first characteristic value of the first display information or the second display information through detection; the first characteristic value is used for indicating display data of the display; and filtering the first display information or the second display information according to the first characteristic value and the reference display information by a detection circuit to obtain third display information.

In addition, in some possible implementations, a portion of the color sub-pixels may be color shifted, e.g., a red sub-pixel, before the display light is projected onto the light collector, thereby affecting the comparison result. Based on this, if the display displays a full-color picture, the detection circuit may perform gray-scale conversion on the first display information (or the second display information and the third display information), and the first display information (or the second display information and the third display information) after gray-scale conversion may indicate a black-and-white picture, so as to improve accuracy of the comparison result.

In some possible implementations, the display detection apparatus further includes a target processor.

Exiting display light through at least one display section of a display, comprising: the display light is emitted by at least one display section of the display controlled by the target processor. The display detection method further comprises the steps of before comparing the first display information with the reference display information of the corresponding display partition by the detection circuit to indicate whether the display is abnormal or not, and the display detection method comprises the following steps: the reference display information is sent to the detection circuit by the target processor.

In the first case, when the target processor sends out the first ideal data or the first actual data, the target processor sends the reference display information to the detection circuit, and the reference display information is stored in the detection circuit. The first display information sent by the light collector is received through the detection circuit, and the prestored reference display information can be directly called.

In the second case, the reference display information may be transmitted to the detection circuit by the target processor after the first ideal data or the first actual data is transmitted by the target processor, before the first display information is received by the detection circuit.

In the third case, when the detection circuit receives the first display information sent by the light collector, the reference display information can be obtained from the target processor.

In some possible implementations, comparing, by the detection circuit, the second display information of the respective display partition with the reference display information to indicate whether the display is displaying normally, including: receiving the second display information or the third display information through the detection circuit; in response to the second display information or the third display information by the detection circuit, in case the process of comparing the second display information (or the third display information) with the reference display information is implemented by a software code, the processing circuit is further configured to execute the software code to compare the second display information (or the third display information) of the corresponding display section with the reference display information to indicate whether the display is abnormal.

In some possible implementations, the detection circuit includes a processing circuit and a comparison circuit; comparing, by the detection circuit, the second display information of the corresponding display partition with the reference display information to indicate whether the display is displaying normally, including: receiving, by the processing circuit, the second display information or the third display information; transmitting, by the processing circuit, a control signal to the comparing circuit in response to the second display information or the third display information; the second display information or the third display information of the corresponding display partition is compared with the reference display information by the comparison circuit in response to the control signal to indicate whether the display is abnormal.

In a fourth aspect, the present application provides a computer readable storage medium comprising a computer program or software code which, when run on a display detection apparatus, causes the display detection apparatus to perform the steps as described in the first aspect.

In a fifth aspect, the application provides a computer program comprising instructions for performing the steps of any possible implementation of the first aspect.

Drawings

FIG. 1 is a diagram showing the relationship between structures and a diagram showing the light path of light in a detection device according to an embodiment of the present application;

fig. 2 is a display effect diagram of a HUD according to an embodiment of the present application;

FIG. 3 is a diagram showing the relationship between the structures and the light path of the display light in another display detection apparatus according to the embodiment of the present application;

FIG. 4 is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

FIG. 5 is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

FIG. 6a is a block diagram of a plurality of display regions of a display according to an embodiment of the present application;

FIG. 6b is another partition diagram of a plurality of display partitions of a display according to an embodiment of the present application;

FIG. 7 is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

FIG. 8 is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

FIG. 9a is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

FIG. 9b is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

FIG. 10 is a diagram showing an image processing effect according to an embodiment of the present application;

FIG. 11 is a diagram showing the relationship between the structures and the light path of the display light in another detection apparatus according to the embodiment of the present application;

fig. 12 is a flowchart illustrating a detection method according to an embodiment of the present application.

Reference numerals:

101-a target processor; 1011-a first comparison module; 102-a display; 103-an optical path adjustment assembly; 1031-a lens group; 1032—half mirror; 104-bridging the chip; 1041-a second comparison module; 105-a display controller; 1051-a third comparison module; 106, a light ray collector; 107-a detection circuit; 1071-a first image processing module; 1072-a second image processing module; 1073-processing circuitry; 1074-a comparison circuit; 108-a security processing module; 109-a mirror; 11-display partition.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The terms "first," "second," and the like in the description and in the claims and drawings are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or order. "and/or" for describing the association relationship of the association object, the representation may have three relationships, for example, "a and/or B" may represent: only a, only B and both a and B are present, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "mounted," "connected," and the like are to be construed broadly and may be, for example, fixedly connected, detachably connected, or integrally connected; either directly or indirectly through intermediaries, or through communication between two elements. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion, such as a series of steps or elements. The method, system, article, or apparatus is not necessarily limited to those explicitly listed but may include other steps or elements not explicitly listed or inherent to such process, method, article, or apparatus. "upper", "lower", "left", "right", etc. are used merely with respect to the orientation of the components in the drawings, these directional terms are relative terms, which are used for description and clarity with respect thereto, and which may vary accordingly depending on the orientation in which the components are placed in the drawings.

The embodiment of the application provides a display detection system, which comprises a terminal and a display detection device. The display detection apparatus may include an existing HUD, as shown in fig. 1, which may include a target processor 101, a display 102, and an optical path adjustment component 103. The target processor 101 is coupled to the display 102 and is used for controlling the display 102 to display pictures; the display 102 emits display light under the control of the target processor 101 to display important information related to the terminal; the light path adjusting component 103 is disposed on an outgoing light path of the display light, and after the display light is projected to the light path adjusting component 103, the display light is adjusted by the light path adjusting component 103 to form a virtual image at a target position of the terminal, so that the virtual image is seen by a user when the user uses the terminal.

Here, first, the light path adjustment component 103 is disposed on the outgoing light path of the display light, that is, based on the disposed positions of the display 102 and the light path adjustment component 103, and the outgoing direction of the display light, at least part of the display light outgoing from the display 102 may be projected to the light path adjustment component 103. An object appearing hereinafter may be disposed on an outgoing light path of the display light, or an object may be disposed on an optical path between two other objects, which will not be explained in detail.

Second, the target position may be any position with respect to the terminal according to the type of the terminal and the actual requirement. In some possible implementations, the target position may be fixed, i.e. the position of the virtual image relative to the terminal. In this case, the virtual image may present an alarm icon, a status icon, a number, etc. associated with the terminal. In other possible implementations, the target position may also be varied, for example, the position of the display 102 may be randomly varied, the target position relative to the terminal may be varied, and the position of the virtual image relative to the terminal may be varied. In this case, the virtual image may present an icon, a linear icon, a number, or the like, which is related to the terminal and is variable in size and shape.

The terminal can be a device suitable for HUD, such as an automobile, an airplane, a head display device and the like.

Taking the terminal as an automobile or an airplane as an example, as shown in fig. 2, the virtual image may be directly in front of the cab of the automobile or the airplane, and the display content of the virtual image may include current running information such as the speed of the automobile or the airplane, the oil quantity and the like.

Of course, the terminal may be another device, which is not limited in this embodiment of the present application. For convenience of explanation, the following will be exemplified by taking the terminal as an automobile.

As shown in fig. 3, the HUD may include a bridge chip 104 and a display controller 105 supporting a security function, in addition to the target processor 101, the display 102, and the optical path adjusting unit 103.

The bridge chip 104 may be integrated between the signal transmission paths of the target processor 101 and the display 102, and is used to make the display detection system enter a safe state when the safety alarm information cannot be displayed correctly, where the safe state is expressed as: the driver can be informed that the current display detection system is abnormal.

For example, when the driver fails to display the associated icon normally, such as a belt alert, a brake system failure, etc., the bridge chip 104 may send a signal to the display 102 to control the display 102 to display a power-on icon or other special icon (e.g., a sigh) to enter a safe state. Of course, the above-described safety condition may also be embodied in other manners, such as an automobile interior sound alert, vibrating a steering wheel or seat, lighting an automobile interior light, and the like.

The display controller 105 may be integrated between the bridge chip 104 and the signal transmission path of the display 102, for controlling the display 102 to display a picture under the control of the target processor 101. The display 102 may also be controlled to display a power-on icon or other special icon under the control of the bridge chip 104 when the display detection system is in a secure state.

In the HUD, if any one of the target processor 101, the display 102 and the bridge chip 104 fails, the display 102 cannot correctly display the driving information, and the virtual image content seen by the driver is wrong, so that an unnecessary safety accident may occur. Therefore, whether the target processor 101, the display 102, and the bridge chip 104 fail should be detected in time. In the embodiment of the present application, the display detection system may detect whether the target processor 101, the display 102, and the bridge chip 104 have a failure, in addition to forming a virtual image at the target position of the terminal.

As shown in fig. 4, for the target processor 101, the bridge chip 104, and the display controller 105, it is possible to detect whether the target processor 101, the bridge chip 104, and the display controller 105 are malfunctioning, respectively, in such a manner that the first comparison module 1011 is integrated in the target processor 101, the second comparison module 1041 is integrated in the bridge chip 104, and the third comparison module 1051 is integrated in the display controller 105.

Specifically, the target processor 101 may send the first actual data and the first control signal to the first comparison module 1011, and the first comparison module 1011 may generate the first ideal data under the control of the first control signal. The first comparison module 1011 compares the received first actual data with the first ideal data, and if the difference between the first actual data and the first ideal data exceeds the first threshold range, it indicates that the target processor 101 fails, and the first comparator 1011 sends the first ideal data to the bridge chip 104; otherwise, the target processor 101 is normal, and the first comparator 1011 sends the first ideal data or the first actual data to the bridge chip 104.

After receiving the first ideal data or the first actual data, the bridge chip 104 generates second actual data and sends the second actual data to the second comparing module 1041. The target processor 101 may also send a second control signal to the second comparison module 1041, and the second comparison module 1041 may generate second ideal data under the control of the second control signal. The second comparing module 1041 compares the received second actual data with the second ideal data, and if the difference between the second actual data and the second ideal data exceeds the second threshold range, it indicates that the bridge chip 104 and/or the transmission path from the first comparing module 1011 to the bridge chip 104 is faulty, and the second comparing module 1041 sends the second ideal data to the display controller 105; in contrast, the transmission paths from the bridge chip 104 and the first comparing module 1011 to the bridge chip 104 are normal, and the second comparing module 1041 transmits the second ideal data or the second actual data to the display controller 105.

After receiving the second ideal data or the second actual data, the display controller 105 generates third actual data and sends the third actual data to the third comparing module 1051. The target processor 101 may also send a third control signal to the third comparison module 1051, and the third comparison module 1051 may generate third ideal data under the control of the third control signal. The third comparing module 1051 compares the received third actual data with the third ideal data, and if the difference between the third actual data and the third ideal data exceeds the third threshold range, indicates that the display controller 105 and/or a transmission path from the second comparing module 1041 to the display controller 105 is faulty, the third comparing module 1051 sends the third ideal data to the display 102; in contrast, the transmission paths of the display controller 105 and the second comparing module 1041 to the display controller 105 are normal, and the third comparing module 1051 transmits the third ideal data or the third actual data to the display 102.

Here, the first actual data, the second actual data, and the third actual data are actual signals generated by the target processor 101, the bridge chip 104, and the display controller 105, respectively, for instructing the display 102 to display a screen. The first ideal data, the second ideal data, and the third ideal data are ideal signals generated by the target processor 101, the bridge chip 104, and the display controller 105, respectively, for instructing the display 102 to display a picture. The first threshold range, the second threshold range, and the third threshold range may be set to reasonable ranges adaptively based on the needs of the manufacturer or the customer, which is not limited in the embodiment of the present application.

Of course, as shown in fig. 1, the target processor 101 may also directly control the display 102 to display a screen. For convenience of description, the following description will be given by taking the example in which the target processor 101 shown in fig. 3 controls the display 102 to display a screen through the bridge chip 104 and the display controller 105, except for the other descriptions.

The foregoing describes that any one of the target processor 101, the display 102, the bridge chip 104, and the display controller 105 fails, which may cause the display 102 to fail to properly display the running information. Also, a method of detecting whether or not the target processor 101, the bridge chip 104, and the display controller 105 have failed is described. On the other hand, for the display 102, on the one hand, the parameters of the display 102 provided by each provider are different, and cannot be detected at the digital end in a unified manner like the target processor 101, the bridge chip 104 and the display controller 105; on the other hand, the inventors found that no device for extracting display light and no circuit for detecting display light are deployed in the design of the current display detection system. Thus, the detection of the display 102 in the display detection system is still in a state of technical blank.

Based on this, as shown in fig. 5, the embodiment of the present application provides a display detection device, which adds the light collector 106 and the detection circuit 107 on the basis of the existing HUD, so as to avoid adding an additional separate detection device, and save the detection cost.

The display 102 includes a plurality of display segments, and at least one display segment of the display 102 emits display light (the broken-line arrow portion in the figure indicates display light).

The light collector 106, the light collector 106 is disposed on an outgoing light path of the display light, and is configured to collect the display light outgoing from at least one display area, convert the collected display light into first display information in the form of an electrical signal, and send the first display information to the detection circuit 107.

The detection circuit 107, the light collector 106 is coupled to the detection circuit 107, and is configured to receive the first display information, and compare the first display information with the reference display information of the corresponding display partition, so as to indicate whether the display 102 displays an abnormality.

On the basis of the above, as shown in fig. 5, the display detection apparatus may further include a security processing module 108. The security processing module 108 is coupled to the detection circuit 107. The detection circuit 107 may send the comparison result of whether the display 102 is normally displayed to the security processing module 108. When the comparison indicates that the display 102 is displaying an anomaly, the security processing module 108 may take a series of actions with respect to the display 102 displaying the anomaly to alert the user.

For example, the security processing module 108 may be coupled to the display 102, receive a comparison of the display 102 display anomalies, and control the display 102 to reset. Alternatively, the security processing module 108 may be coupled to the target processor 101, receive the comparison of the display 102 display anomalies, and utilize the target processor 101 to control the display 102 reset.

Alternatively, the safety processing module 108 may be coupled with a control circuit of the automobile, which may be coupled with at least one of a horn, a seat, a steering wheel, etc. of the automobile. The safety processing module 108 receives the comparison result of the display 102 displaying the abnormality and controls the horn sounding alarm, or the seat vibration, or the steering wheel vibration, etc.

Of course, the display 102 may be reset in other ways, and other variations or alternatives are readily contemplated as falling within the scope of the present application.

In addition, any one of the foregoing display controller 105, the transmission path from the second comparing module 1041 to the display controller 105, the bridge chip 104, the transmission path from the first comparing module 1011 to the bridge chip 104, and the target processor 101 fails, and the above measures may be taken by the security processing module 108 to alert the user.

In some possible implementations, embodiments of the present application do not limit the manner in which the display partition 11 is divided. Alternatively, as shown in fig. 6a and 6b, each display section 11 may include at least one pixel region, each having one pixel unit. If the display 102 can display a full-color image, each pixel unit includes at least three sub-pixels that can form three primary colors, and the three sub-pixels that form the three primary colors can be respectively a red sub-pixel, a green sub-pixel, and a blue sub-pixel; alternatively, the three sub-pixels constituting the three primary colors may be a yellow sub-pixel, a cyan sub-pixel, and a magenta sub-pixel, respectively. Of course, the display 102 of the present application may also display a black-and-white screen, which is not limited in the embodiment of the present application.

As shown in fig. 6a, the number of sub-pixels included in each display section 11 is the same. For example, each display section 11 includes three pixel regions having 9 sub-pixels in total.

Alternatively, as shown in fig. 6b, the number of sub-pixels included in each display section 11 is at least partially different. For example, the partial display section 11 includes three pixel areas having 9 sub-pixels in total; the partial display section 11 includes four pixel areas having 12 sub-pixels in total; the partial display section 11 includes two pixel areas having 6 sub-pixels in total.

It should be noted that, each display area 11 of the display 102 may display a picture, based on which the light collector 106 may collect a part of the display light of the display area 11 for detection by the detection circuit 107; the light collector 106 may also collect the display light of all display areas 11 for detection by the detection circuit 107.

For the case where the light collector 106 collects the display light of a part of the display area 11 for detection by the detection circuit 107, the reason may be that when the display 102 displays a certain picture, only a part of the display area 11 displays a picture, and another part of the display area 11 is a black picture. Of course, it is also possible that the display detection means is used to detect whether or not a part of the display section 11 of the display 102 is displaying an abnormality, and it is not necessary to detect whether or not another part of the display section 11 of the display 102 is displaying an abnormality.

In some possible implementations, the manner in which the light collector 106 collects the display light is not limited in the embodiments of the present application, as long as the light collector 106 can receive the display light and convert the display light into the first display signal of the electrical signal, so that the first display signal is transmitted in the light collector 106 and the detection circuit 107 in the form of the electrical signal.

Specifically, in the first case, as shown in fig. 5, the display detection apparatus further includes a mirror 109. The optical path adjusting component 103 may include a lens group 1031 and a half mirror 1032, where the lens group 1031 is disposed on an optical path between the display 102 and the half mirror 1032, and the reflecting mirror 109 is disposed on an optical path between the half mirror 1032 and the light collector 106.

After the display light emitted from the display 102 is projected onto the lens group 1031, the display light is adjusted by the lens group 1031 and is projected onto the half mirror 1032. The part of the display light projected onto the half mirror 1032 is reflected by the half mirror 1032, projected onto the human eye, and directly ahead Cheng Xuxiang of the driver; another portion of the display light projected onto the half mirror 1032 is transmitted from the half mirror 1032 and projected onto the mirror 109, and the portion of the display light is reflected by the mirror 109 and then projected onto the light collector 106. The light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.

In this case, the light collector 106 can detect the display 102 without affecting the intensity of the display light projected to the human eye by collecting the display light that has passed through the half mirror 1032 and is wasted as the display light for detection. In addition, the display 102 may be provided on a driver seat, for example, and a front windshield of an automobile may be used as the half mirror 1032. Of course, the positions of the display 102 and the half mirror 1032 may be other, which is not limited by the embodiment of the present application.

In the second case, as shown in fig. 7, the display detection apparatus further includes a light guide fiber 110, and the light guide fiber 110 has a function of transmitting light. The present application transmits display light exiting from at least one display section 11 to the light collector 106 by disposing the light guide fiber 110 on the light exit side of the display 102. The light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.

It should be noted that, the specific installation position of the light guide fiber 110 is not limited in the embodiment of the present application, as long as the light guide fiber is disposed on the light emitting side of the display 102 and can transmit the display light to the light collector 106. Alternatively, as shown in fig. 7, the light collector 106 may be provided on the lens group 1031.

Of course, the light collector 106 may collect the display light in other manners, which is not limited by the embodiment of the present application.

In some possible implementations, the specific structure and model of the light collector 106 are not limited in the embodiments of the present application, as long as the light collector 106 has the functions of collecting display light and converting optical signals into electrical signals. For example, the light collector 106 may be an electro-optic camera (emitron camera).

In some possible implementations, the detecting circuit 107 compares the first display information with the reference display information of the corresponding display partition 11, specifically including: the detection circuit 107 receives the reference display information of at least one display section 11 and the first display information transmitted by the light collector 106, and compares the first display information of the same display section 11 with the reference display information. As shown in fig. 7, if the target processor 101 is directly coupled to the display 102 and directly controls the display 102 to display a picture, then in a case that the difference between the first display information and the reference display information exceeds the fourth threshold range, the display 102 is illustrated, and/or a transmission path from the target processor 101 to the display 102 fails, resulting in abnormal display of the display 102; in contrast, the transmission paths of the display 102 and the target processor 101 to the display 102 are normal. Alternatively, referring to fig. 4, if the target processor 101 is indirectly coupled to the display 102 and controls the display 102 to display a picture through the bridge chip 104 and/or the display controller 105, if the difference between the first display information and the reference display information exceeds the fourth threshold range, the display 102 is illustrated, and/or a transmission path from the display controller 105 (or the bridge chip) to the display 102 fails, resulting in abnormal display of the display 102; conversely, the transmission paths of the display 102 and the display controller 105 (or bridge chip) to the display 102 are normal.

Here, the first detection circuit 107 may compare the first display information and the reference display information of the same display area 11 while receiving the first display information and the reference display information; alternatively, after receiving the first display information and the reference display information, the detection circuit 107 may undergo a delay, and compare the first display information and the reference display information of the same display partition 11, which is not limited in the embodiment of the present application. In consideration of timely prompting the driver of abnormal display and avoiding occurrence of unnecessary or otherwise, the detection circuit 107 of the embodiment of the present application may compare the first display information and the reference display information of the same display section 11 while receiving the first display information and the reference display information.

Second, the process of comparing the first display information with the reference display information may be implemented by a hardware circuit or may be implemented by a software code, which is not limited in the embodiment of the present application. The display detection apparatus may further include a memory, and if the comparison process of the first display information and the reference display information is implemented by a software code, the software code may be stored in the memory.

Third, the first display information is an actual signal corresponding to the screen displayed on the display 102. The reference display information is an ideal signal generated by the target processor 101, the bridge chip 104, or the display controller 105 for instructing the display 102 to display a picture. The fourth threshold range may be a reasonable range set adaptively based on the requirements of the manufacturer or the customer, which is not limited in the embodiment of the present application.

In some possible implementations, the target processor 101 may directly or indirectly control the display 102 to display a picture, whether the target processor 101 is directly coupled to the display 102 or not. Those skilled in the art will appreciate that the target processor 101 can control the display 102 to display the correct picture if it is predetermined what kind of picture the display 102 should display. Thus, the target processor 101 may prestore information corresponding to a screen that the display 102 should display, i.e., reference display information of the display 102. Also, the target processor 101 may transmit the reference display information of the same frame of picture to the detection circuit 107. In this case, the detection circuit 107 may be integrated in the target processor 101 to shorten the path between the target processor 101 and the detection circuit 107.

Specifically, when the target processor 101 sends out the first ideal data or the first actual data, the reference display information may be sent to the detection circuit 107, and stored in the detection circuit 107. The detection circuit 107 receives the first display information sent by the light collector 106, and can directly call the pre-stored reference display information.

Alternatively, the target processor 101 may send the reference display information to the detection circuit 107 after sending the first ideal data or the first actual data, before the detection circuit 107 receives the first display information.

Alternatively, the detection circuit 107 receives the first display information sent by the light collector 106, that is, the reference display information may be acquired from the target processor 101. Compared with the two modes, the method can save the layout area occupied by the detection circuit 107 by eliminating the need of integrating a storage circuit in the detection circuit 107 for storing the reference display information.

In some possible implementations, the first display information and the reference display information may indicate display data of the display 102, which may be, for example, luminance information, bright point information, gray scale information, and the like.

Taking the first display information indicating the actual luminance of the picture displayed by the display 102 and the reference display information indicating the ideal luminance of the picture displayed by the display 102 as examples. Based on this, the specific process of comparing the first display information with the reference display information may include: the actual brightness of the plurality of sub-pixels in one display section 11 is accumulated, the ideal brightness of the plurality of sub-pixels in one display section 11 is accumulated, and the accumulated values of the two are compared.

Taking the first display information and the reference display information as examples, the first display information indicates the bright point information of the picture displayed by the display 102, the first display information indicates the actual bright point when the display 102 displays one frame picture, and the reference display information indicates the ideal bright point when the display 102 displays the same frame picture. Based on this, the specific process of comparing the first display information with the reference display information may include: the standard deviation of the actual bright spots and the ideal bright spots in each display section 11 is calculated row by row.

Of course, the embodiment of the present application may also compare the first display information with the reference display information in other manners, for example, performing hash calculation, cyclic redundancy check (cyclic redundancy code, CRC) and the like based on the first display information and the reference display information. Other variations and alternatives are readily contemplated as falling within the scope of the present application.

In some embodiments, as shown in fig. 8, the detection circuit 107 may further include a first image processing module 1071, where the first image processing module 1071 is configured to convert the first display information into the second display information, and an amount of pixel data of the second display information in each pixel area is smaller than an amount of pixel data of the first display information in the pixel area. That is, the first display information is subjected to the dimension reduction processing by the first image processing module 1071 to obtain the dimension reduced second display information. Thus, by reducing the pixel data amount of the second display information, the calculation amount in the comparison process by the detection circuit 107 can be reduced.

In some possible implementations, in a case where the number of sub-pixels corresponding to the first display information is not changed or reduced compared to the actual data of the sub-pixels in the display 102, the first display information is converted into the second display information with a smaller pixel data size, specifically, the data bit width of each sub-pixel (for example, the red sub-pixel, the green sub-pixel, and the blue sub-pixel) may be reduced.

By way of example, the data bit width of the red subpixel indicated by the first display information is 8 bits, and 255 different red colors may be displayed from 0 to 255, except for 0. And the data bit width of the red sub-pixel indicated by the second display information with smaller pixel data amount is 4 bits, and 15 different red colors can be displayed from 0 to 15 except 0.

For example, the first display information indicates a display frame having a gray scale bit width of 8 bits, from 0 to 255, i.e., the display 102 may display a frame having 256 different gray scales. While the gray scale bit width of the display screen indicated by the second display information with smaller pixel data amount is 2 bits, from 0 to 3, that is, the screen displayed by the display 102 can have 4 different gray scales.

In some embodiments, some ambient light may be captured by the light collector 106 at the same time that the light collector 106 captures the display light, thereby affecting the comparison result of the detection circuit 107. Based on this, as shown in fig. 9a and 9b, the detection circuit 107 may further include a second image processing module 1072. As shown in fig. 10, the second image processing module 1072 performs filtering processing on the first display information or the second display information to obtain third display information. The third display information after the filtering process filters out the ambient light other than the display light, improving the detection accuracy of the detection circuit 107.

Specifically, the second image processing module 1072 is configured to obtain a first feature value of the first display information or the second display information, where the first feature value is used to indicate display data of the display 102; the second image processing module 1072 is further configured to perform filtering processing on the first display information or the second display information according to the first feature value and the reference display information, so as to obtain third display information.

Taking the display data as gray scale information as an example, the second image processing module 1072 can determine the ideal gray scale for each sub-pixel and the outline of the frame displayed by the display 102 according to the reference display information. Based on the above, the gray level threshold range of each sub-pixel can be set according to the reference display information, and the sub-pixels with gray levels exceeding the gray level threshold range are subjected to filtering processing; the sub-pixels with gray scales in the gray scale threshold range retain the original gray scales.

For example, the second image processing module 1072 determines that the gray-scale threshold range of the sub-pixel with coordinates (8, 200) is [15, 20] according to the reference display information, and the actual gray-scale of the sub-pixel indicated by the first display information is 25, which exceeds the gray-scale threshold range, thus filtering out the display information of the sub-pixel.

For another example, the second image processing module 1072 determines that the gray-scale threshold range of the sub-pixel with coordinates (1, 3) is [0,3] according to the reference display information, and the actual gray-scale of the sub-pixel indicated by the second display information is 2 within the gray-scale threshold range, so that the display information of the sub-pixel is preserved.

In addition, in the first embodiment, when the detection circuit 107 includes both the first image processing module 1071 and the second image processing module 1072, the above description shows that the first display information is subjected to the dimension reduction process to obtain the second display information, and then the second display information is subjected to the filter process to obtain the third display information. Of course, in the case where the detection circuit 107 includes both the first image processing module 1071 and the second image processing module 1072, the first display information may be filtered and then subjected to the dimension reduction processing, which is not limited in the embodiment of the present application.

Second, the dimension reduction processing and the filtering processing may be implemented by a hardware circuit or by a software code. The first image processing module 1071 and the second image processing module 1072 may be hardware circuits or software codes. The display detection apparatus may further include a memory, and if the dimension reduction process and the filtering process are implemented by software codes, the software codes may be stored in the memory.

Furthermore, in some embodiments, some of the color sub-pixels may be color shifted, e.g., red sub-pixels, before the display light is projected onto the light collector 106, thereby affecting the comparison result. In this way, if the display 102 displays a full-color screen, the detection circuit 107 may perform gray-scale conversion on the first display information (or the second display information and the third display information), and the gray-scale converted first display information (or the second display information and the third display information) may indicate a black-and-white screen, thereby improving the accuracy of the comparison result.

In addition, in some embodiments, as shown in fig. 11, the detection circuit 107 may also include a processing circuit 1073. The processing circuit 1073 is configured to receive the second display information sent by the first image processing module 1071 or the third display information sent by the second image processing module 1072. In the case where the process of comparing the second display information (or the third display information) with the reference display information is implemented by software code, the processing circuit 1073 is further configured to execute the software code to compare the second display information (or the third display information) of the corresponding display partition 11 with the reference display information to indicate whether the display 102 displays an abnormality.

In other embodiments, as shown in fig. 9a and 9b, the detection circuit 107 may include a comparison circuit 1074 in addition to the processing circuit 1073 described above. The processing circuit 1073 is configured to receive the second display information sent by the first image processing module 1071 or the third display information sent by the second image processing module 1072, generate a control signal, and send the control signal to the comparing circuit 1074. The comparison circuit 1074 is configured to compare the second display information (or the third display information) of the corresponding display section 11 with the reference display information in response to the control signal to indicate whether the display 102 displays an abnormality.

It should be noted that, the method for comparing the second display information (or the third display information) of the corresponding display partition 11 with the reference display information is the same as the method for comparing the first display information of the corresponding display partition 11 with the reference display information, and will not be described again.

The embodiment of the application also provides a display detection method which is applied to a display detection device, wherein the display detection device comprises a display 102, a light collector 106 and a detection circuit 107. The display 102 comprises a plurality of display partitions 11, a light collector 106 is positioned on an outgoing light path of display light, and the light collector 106 is coupled with a detection circuit 107; as shown in fig. 12, the display detection method may be implemented by:

S110, as shown in fig. 5, display light is emitted through at least one display area 11 of the display 102 (the broken line arrow part in the figure indicates display light).

S120, the light collector 106 collects the display light emitted from the at least one display area 11, converts the collected display light into the first display information in the form of an electrical signal, and sends the first display information to the detection circuit 107.

Each display partition 11 of the display 102 can display a picture, and based on this, the light collector 106 can collect the display light of part of the display partition 11 for detection by the detection circuit 107; the display light of all display areas 11 can also be collected by the light collector 106 for detection by the detection circuit 107.

For the case where the light collector 106 collects the display light of a part of the display section 11 for detection by the detection circuit 107, the reason may be that the display 102 displays only a part of the display section 11 when displaying a certain screen, and another part of the display section 11 is a black screen. Of course, it is also possible that the display detection means is used to detect whether or not a part of the display section 11 of the display 102 is displaying an abnormality, and it is not necessary to detect whether or not another part of the display section 11 of the display 102 is displaying an abnormality.

In some possible implementations, the manner in which the display light is collected by the light collector 106 is not limited, so long as the light collector 106 can receive the display light and convert the display light into the first display signal of the electrical signal, so that the first display signal is transmitted in the light collector 106 and the detection circuit 107 in the form of the electrical signal.

In this case, the display light transmitted through the half mirror 1032 and wasted is collected by the light collector 106, and the display 102 can be detected as the display light for detection without affecting the intensity of the display light projected to the human eye. In addition, the display 102 may be provided on a driver seat, for example, and a front windshield of an automobile may be used as the half mirror 1032. Of course, the positions of the display 102 and the half mirror 1032 may be other, which is not limited by the embodiment of the present application.

In the second case, as shown in fig. 7, the display detection apparatus further includes a light guide fiber 110, and the light guide fiber 110 has a function of transmitting light. In the application, the light guide fiber 110 is arranged on the light emitting side of the display 102, so that the display light emitted from at least one display area 11 is transmitted to the light collector 106 by the light guide fiber 110. The light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.

It should be noted that, the specific installation position of the light guide fiber 110 is not limited in the embodiment of the present application, as long as the light guide fiber is disposed on the light emitting side of the display 102, and the display light can be transmitted to the light collector 106 through the light guide fiber 110. Alternatively, as shown in fig. 7, the light collector 106 may be provided on the lens group 1031.

Of course, other ways of collecting the display light by the light collector 106 may be used, which is not limited by the embodiment of the present application.

In some possible implementations, the specific structure and model of the light collector 106 are not limited in the embodiments of the present application, as long as the light collector 106 has the functions of collecting display light and converting optical signals into electrical signals. For example, the light collector 106 may be a photo camera.

S130, the detection circuit 107 receives the first display information, and compares the first display information with the reference display information of the corresponding display partition 11 to indicate whether the display 102 is abnormal.

As shown in fig. 5, the display detection apparatus may further include a security processing module 108. The security processing module 108 is coupled to the detection circuit 107. The comparison result of whether the display 102 is normally displayed may be sent to the security processing module 108 through the detection circuit 107. When the comparison result is indicative of an abnormality in the display 102, a series of actions may be taken with respect to the abnormality in the display 102 by the security processing module 108 to alert the user.

For example, the security processing module 108 may be coupled to the display 102 to receive a comparison of the display 102 display anomalies. When the comparison result is indicative of display abnormality of the display 102, the display 102 may be controlled to be reset by the security processing module 108.

Alternatively, the security processing module 108 may be coupled to the target processor 101 to receive the comparison of the display 102 display anomalies. When the comparison result is an indication that the display 102 is abnormal, the security processing module 108 may control the display 102 to be reset by using the target processor 101.

Alternatively, the safety processing module 108 may be coupled with a control circuit of the automobile, which may be coupled with at least one of a horn, a seat, a steering wheel, etc. of the automobile. The safety processing module 108 receives the comparison result of the display 102 displaying the abnormality, and when the comparison result indicates that the display 102 displaying the abnormality, the safety processing module 108 can control the horn sounding alarm, the seat vibration, the steering wheel vibration and the like.

In some possible implementations, comparing, by the detection circuit 107, the first display information with the reference display information of the corresponding display partition 11 specifically includes: the reference display information of at least one display partition 11 and the first display information transmitted by the light collector 106 are received by the detection circuit 107, and the first display information of the same display partition 11 is compared with the reference display information. As shown in fig. 7, if the target processor 101 is directly coupled to the display 102 and directly controls the display 102 to display a picture, then in a case that the difference between the first display information and the reference display information exceeds the fourth threshold range, the display 102 is illustrated, and/or a transmission path from the target processor 101 to the display 102 fails, resulting in abnormal display of the display 102; in contrast, the transmission paths of the display 102 and the target processor 101 to the display 102 are normal. Alternatively, referring to fig. 4, if the target processor 101 is indirectly coupled to the display 102 and controls the display 102 to display a picture through the bridge chip 104 and/or the display controller 105, if the difference between the first display information and the reference display information exceeds the fourth threshold range, the display 102 is illustrated, and/or a transmission path from the display controller 105 (or the bridge chip) to the display 102 fails, resulting in abnormal display of the display 102; conversely, the transmission paths of the display 102 and the display controller 105 (or bridge chip) to the display 102 are normal.

It should be noted that, first, the detection circuit 107 may receive the first display information and the reference display information, and at the same time, compare the first display information and the reference display information in the same display area 11; alternatively, after receiving the first display information and the reference display information through the detection circuit 107, a delay may be experienced, and the first display information and the reference display information of the same display partition 11 may be compared. In view of timely prompting the driver for display abnormality, avoiding occurrence other than unnecessary, the first display information and the reference display information of the same display section 11 may be compared while being received by the detection circuit 107.

Third, the first display information is an actual signal corresponding to the screen displayed on the display 102. The reference display information is a desired signal generated by the target processor 101, or the bridge chip 104, or the display controller 105, for instructing the display 102 to display a picture. The fourth threshold range may be a reasonable range set adaptively based on the requirements of the manufacturer or the customer, which is not limited in the embodiment of the present application.

In some possible implementations, the display 102 may be controlled directly or indirectly by the target processor 101 to display a picture, whether the target processor 101 is directly coupled to the display 102 or not. Those skilled in the art will appreciate that the display 102 can be controlled by the target processor 101 to display the correct picture if it is predetermined what kind of picture the display 102 should display. Accordingly, information corresponding to a picture that the display 102 should display, that is, reference display information of the display 102, can be prestored by the target processor 101. Also, the reference display information of the same frame picture may be transmitted to the detection circuit 107 by the target processor 101. In this case, the detection circuit 107 may be integrated in the target processor 101 to shorten the path between the target processor 101 and the detection circuit 107.

Specifically, when the target processor 101 sends the first ideal data or the first actual data, the target processor 101 sends the reference display information to the detection circuit 107, and the reference display information is stored in the detection circuit 107. When the detection circuit 107 receives the first display information sent by the light collector 106, the reference display information stored in advance can be directly called.

Alternatively, the reference display information may be transmitted to the detection circuit 107 by the target processor 101 before the detection circuit 107 receives the first display information after the first ideal data or the first actual data is transmitted by the target processor 101.

Alternatively, when the detection circuit 107 receives the first display information sent by the light collector 106, the reference display information may be acquired from the target processor 101. Compared with the two modes, the method can save the layout area occupied by the detection circuit 107 by eliminating the need of integrating a storage circuit in the detection circuit 107 for storing the reference display information.

Of course, the embodiment of the application can also compare the first display information with the reference display information in other manners, for example, hash calculation, cyclic redundancy check, etc. are performed based on the first display information and the reference display information. Other variations and alternatives are readily contemplated as falling within the scope of the present application.

In some embodiments, receiving the first display information by the detection circuit 107 and comparing the first display information with the reference display information of the corresponding display partition 11 to indicate whether the display 102 is displaying an anomaly may include:

s131, the first display information is received by the detection circuit 107, and image processing is performed on the first display information.

Specifically, referring to fig. 8, in some possible implementations, the detection circuit 107 may also convert the first display information into the second display information, where the amount of pixel data of the second display information in each pixel area is smaller than the amount of pixel data of the first display information in the pixel area. That is, the first display information is subjected to the dimension reduction processing by the detection circuit 107 to obtain the second display information after the dimension reduction. Thus, by reducing the pixel data amount of the second display information, the calculation amount in the comparison process by the detection circuit 107 can be reduced.

In a possible implementation manner, in a case where the number of sub-pixels corresponding to the first display information is not changed or reduced compared to the actual data of the sub-pixels in the display 102, the first display information is converted into the second display information with smaller pixel data size, specifically, the data bit width of each sub-pixel (for example, red sub-pixel, green sub-pixel, and blue sub-pixel) may be reduced.

In another possible implementation manner, in the case that the number of sub-pixels corresponding to the first display information is not changed or reduced compared to the actual data of the sub-pixels in the display 102, the first display information is converted into the second display information with smaller pixel data size, specifically, the gray scale bit width of each sub-pixel (for example, the red sub-pixel, the green sub-pixel, and the blue sub-pixel) may be reduced.

In some possible implementations, while the display light is collected by the light collector 106, some ambient light may be collected by the light collector 106, thereby affecting the comparison result of the detection circuit 107. Based on this, referring to fig. 9a and 9b, the first display information or the second display information may also be subjected to a filtering process by the detection circuit 107 to obtain third display information. The third display information after the filtering process filters out the ambient light other than the display light, improving the detection accuracy of the detection circuit 107.

Specifically, the detection circuit 107 may obtain a first feature value of the first display information or the second display information, where the first feature value is used to indicate display data of the display 102; the detection circuit 107 may also perform filtering processing on the first display information or the second display information according to the first feature value and the reference display information to obtain third display information.

Taking the display data as gray-scale information as an example, the ideal display gray-scale of each sub-pixel and the outline of the picture displayed by the display 102 can be determined by the detection circuit 107 based on the reference display information. Based on the above, the gray level threshold range of each sub-pixel can be set according to the reference display information, and the sub-pixels with gray levels exceeding the gray level threshold range are subjected to filtering processing; the sub-pixels with gray scales in the gray scale threshold range retain the original gray scales.

For example, by the detection circuit 107, the gray-scale threshold range of the sub-pixel whose coordinates are (8, 200) is determined to be [15, 20] based on the reference display information, and the actual gray-scale of the sub-pixel indicated by the first display information is 25, beyond the gray-scale threshold range, and thus the display information of the sub-pixel is filtered out.

For another example, the detection circuit 107 determines that the gray-scale threshold range of the sub-pixel with coordinates (1, 3) is [0,3] based on the reference display information, and the actual gray-scale of the sub-pixel indicated by the second display information is 2 within the gray-scale threshold range, and therefore, the display information of the sub-pixel is retained.

In addition, in the first embodiment, when the dimension reduction processing and the filtering processing are performed, the above description shows that the dimension reduction processing is performed on the first display information to obtain the second display information, and then the filtering processing is performed on the second display information to obtain the third display information. Of course, the first display information may be filtered and then subjected to the dimension reduction process, which is not limited in the embodiment of the present application.

Second, the dimension reduction processing and the filtering processing may be implemented by a hardware circuit or by a software code. The display detection apparatus may further include a memory, and if the dimension reduction process and the filtering process are implemented by software codes, the software codes may be stored in the memory.

Furthermore, in some embodiments, some of the color sub-pixels may be color shifted, e.g., red sub-pixels, before the display light is projected onto the light collector 106, thereby affecting the comparison result. In this way, if the display 102 displays a full-color screen, the detection circuit 107 may perform gray-scale conversion on the first display information (or the second display information and the third display information), and the gray-scale converted first display information (or the second display information and the third display information) may indicate a black-and-white screen, thereby improving accuracy of the comparison result.

S132, the display 102 is instructed by the detection circuit 107 whether to display normally or not according to the reference display information.

Specifically, in one possible implementation, referring to fig. 10, the foregoing second display information or third display information may also be received by the detection circuit 107. In the case where the process of comparing the second display information (or the third display information) with the reference display information is implemented by a software code, the second display information (or the third display information) of the corresponding display section 11 may also be compared with the reference display information by the detection circuit 107 to indicate whether the display 102 displays an abnormality.

In another possible implementation, as shown in fig. 9a and 9b, the detection circuit 107 may include a processing circuit 1073 and a comparison circuit 1074. The processing circuit 1073 may receive the second display information or the third display information, generate a control signal, and send the control signal to the comparing circuit 1074. The second display information (or the third display information) of the corresponding display section 11 is compared with the reference display information by the comparison circuit 1074 in response to the control signal to indicate whether the display 102 displays an abnormality.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. The display detection device is characterized by comprising a display, a light collector and a detection circuit;

the display comprises a plurality of display subareas, and at least one of the display subareas of the display emits display light;

the light ray collector is arranged on an emergent light path of the display light, and is used for collecting the display light emergent from at least one display partition, converting the collected display light into first display information in the form of an electric signal and sending the first display information to the detection circuit;

The detection circuit is coupled with the light collector and is used for receiving the first display information and comparing the first display information with the reference display information of the corresponding display partition so as to indicate whether the display is abnormal.

2. The display detection apparatus according to claim 1, further comprising an optical path adjustment assembly and a mirror;

the light path adjusting component is arranged on an emergent light path of the display light and is used for adjusting the light path of the display light; the light path adjusting component comprises a half-mirror, and the mirror is arranged on a light path between the half-mirror and the light collector;

the reflecting mirror is used for reflecting the display light transmitted through at least one display area of the half-mirror to the light collector.

3. The display detection apparatus according to claim 1, wherein the display detection apparatus further comprises a light guide fiber;

the optical fiber is arranged on the light emitting side of the display and is used for transmitting the display light of at least one display area to the light collector.

4. A display detection apparatus according to any one of claims 1 to 3 wherein the detection circuit further comprises a first image processing module; each display partition comprises at least one pixel area;

the first image processing module is configured to convert the first display information into second display information, where a pixel data size of the second display information in each pixel area is smaller than a pixel data size of the first display information in the pixel area.

5. The display detection apparatus according to any one of claims 1 to 4, wherein the detection circuit further comprises a second image processing module;

and the second image processing module is used for carrying out filtering processing on the first display information or the second display information so as to obtain third display information.

6. The display detection apparatus according to claim 5, wherein the second image processing module performs filtering processing on the first display information or the second display information to obtain third display information, and specifically includes:

the second image processing module is used for acquiring a first characteristic value of the first display information or the second display information; the first characteristic value is used for indicating display data of the display;

The second image processing module is further configured to perform filtering processing on the first display information or the second display information according to the first feature value and the reference display information, so as to obtain third display information.

7. The display detection apparatus according to any one of claims 4 to 6, wherein the display detection apparatus further comprises a target processor;

the target processor is used for controlling the display picture of the display and sending the reference display information to the detection circuit.

8. The display detection apparatus according to claim 7, wherein the detection circuit includes a processing circuit;

the processing circuit is used for receiving the second display information or the third display information;

the processing circuit is further configured to compare the second display information or the third display information corresponding to the display partition with the reference display information to indicate whether the display is abnormal.

9. The display detection apparatus according to claim 7, wherein the detection circuit includes a processing circuit and a comparison circuit;

The processing circuit is further used for responding to the second display information or the third display information and sending a control signal to the comparison circuit;

the comparison circuit is used for responding to the control signal, comparing the second display information or the third display information of the corresponding display partition with the reference display information to indicate whether the display is abnormal.

10. The display detection apparatus according to claim 8 or 9, wherein the detection circuit is integrated in the target processor.

11. A display detection system comprising a terminal and the display detection apparatus according to any one of claims 1 to 10;

the display light emitted by the display of the display detection device forms a virtual image at the target position of the terminal;

the display detection device comprises a detection circuit for indicating whether the display is abnormal.

12. The display detection system of claim 11, wherein the terminal is at least one of an automobile, an airplane, and a head-mounted device.

13. The display detection method is applied to a display detection device and is characterized in that the display detection device comprises a display, a light collector and a detection circuit; the display comprises a plurality of display partitions, the light collector is positioned on an outgoing light path of the display light, and the light collector is coupled with the detection circuit; the display detection method comprises the following steps:

Emitting display light through at least one of the display sections of the display;

collecting display light emitted from at least one display partition through the light collector, converting the collected display light into first display information in the form of an electric signal, and sending the first display information to the detection circuit;

and receiving the first display information through the detection circuit, and comparing the first display information with the reference display information of the corresponding display partition to indicate whether the display is abnormal.

14. The display detection method according to claim 13, wherein the display detection apparatus further comprises a reflecting mirror and an optical path adjusting component that adjusts the display light, the optical path adjusting component comprising a half mirror;

the collecting, by the light collector, display light emitted from at least one of the display partitions includes:

and reflecting the display light transmitted through at least one display area of the half-mirror to the light collector by using the reflecting mirror.

15. The display detection method according to claim 13, wherein the display detection device further comprises a light guide fiber; the collecting, by the light collector, display light emitted from at least one of the display partitions includes:

And transmitting the display light of at least one display partition to the light collector by utilizing the optical guide fiber.

16. The display detection method according to any one of claims 13 to 15, wherein the receiving, by the detection circuit, the first display information and comparing the first display information with reference display information of the corresponding display section to indicate whether the display is abnormal, includes:

receiving the first display information through the detection circuit, and performing image processing on the first display information;

and indicating whether the display normally displays or not according to the reference display information through the detection circuit.

17. The display detection method according to claim 16, wherein each of the display areas includes at least one pixel area;

the receiving, by the detection circuit, the first display information, and performing image processing on the first display information, including:

converting the first display information into second display information through the detection circuit; the pixel data amount of the second display information of each pixel area is smaller than the pixel data amount of the first display information of the pixel area.

18. The display detection method according to claim 16 or 17, wherein the receiving the first display information by the detection circuit and performing image processing on the first display information includes:

and filtering the first display information or the second display information through the detection circuit to obtain third display information.

19. The display detection method according to claim 18, wherein the filtering of the first display information or the second display information by the detection circuit to obtain third display information includes:

acquiring a first characteristic value of the first display information or the second display information through the detection circuit; the first characteristic value is used for indicating display data of the display;

and filtering the first display information or the second display information according to the first characteristic value and the reference display information by the detection circuit to obtain the third display information.

20. The display detection method according to any one of claims 17 to 19, wherein the display detection apparatus further comprises a target processor;

Said emitting display light through at least one of said display sections of said display comprises:

controlling at least one display partition of the display to emit display light through the target processor;

the display detection method further includes, before comparing, by the detection circuit, the first display information with reference display information of the corresponding display partition to indicate whether the display is abnormal, the display detection method including:

and sending the reference display information to the detection circuit through the target processor.

21. The display detection method according to claim 20, wherein comparing, by the detection circuit, the first display information with reference display information of the corresponding display section to indicate whether the display is displaying an abnormality, comprises:

receiving the second display information or the third display information through the detection circuit;

and calling the reference display information through the detection circuit, and comparing the second display information or the third display information corresponding to the display partition with the reference display information to indicate whether the display is abnormal.

22. The display detection method according to claim 20, wherein the detection circuit includes a processing circuit and a comparison circuit; the comparing, by the detection circuit, the first display information with reference display information of the corresponding display partition to indicate whether the display is abnormal, including:

receiving, by the processing circuit, the second display information or the third display information;

transmitting, by the processing circuit, a control signal to the comparing circuit in response to the second display information or the third display information;

and comparing, by the comparison circuit, the second display information or the third display information corresponding to the display partition with the reference display information in response to the control signal to indicate whether the display is abnormal.