WO2023160117A1 - 显示检测装置、显示检测系统和显示检测方法 - Google Patents

显示检测装置、显示检测系统和显示检测方法 Download PDF

Info

Publication number
WO2023160117A1
WO2023160117A1 PCT/CN2022/137947 CN2022137947W WO2023160117A1 WO 2023160117 A1 WO2023160117 A1 WO 2023160117A1 CN 2022137947 W CN2022137947 W CN 2022137947W WO 2023160117 A1 WO2023160117 A1 WO 2023160117A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display information
information
light
detection circuit
Prior art date
Application number
PCT/CN2022/137947
Other languages
English (en)
French (fr)
Inventor
李华
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023160117A1 publication Critical patent/WO2023160117A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/006Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M11/00Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
    • G01M11/02Testing optical properties
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M11/00Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
    • G01M11/02Testing optical properties
    • G01M11/04Optical benches therefor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals

Definitions

  • the present application relates to the field of display technology, and in particular to a display detection device, a display detection system and a display detection method.
  • Head up display head up display, hereinafter referred to as HUD
  • HUD head up display
  • driving information such as speed, navigation, fuel level, etc. You can see the above-mentioned driving information without turning your head down, which improves the driving safety of the vehicle.
  • the HUD includes a display. If the display fails, the virtual image projected by the HUD will not be able to display driving information correctly.
  • the present application provides a display detection device, a display detection system and a display detection method, which can determine whether the display is abnormal according to the comparison result between the first display information and the reference display information.
  • the present application provides a display detection device.
  • the display detection device includes an existing HUD, and the HUD may include an object processor, a display, and an optical path adjustment component.
  • the target processor is coupled with the display to control the display screen of the display; under the control of the target processor, the display emits display light to display important information related to the terminal; the optical path adjustment component is arranged on the outgoing light path of the display light to project the display light After reaching the optical path adjustment component, it is adjusted by the optical path adjustment component to form a virtual image at the target position of the terminal, so that the virtual image can be seen by the user when the user uses the terminal.
  • the HUD may also include a bridge chip and a display controller that support security functions.
  • the bridge chip can be integrated between the target processor and the signal transmission path of the display, and is used to make the display detection system enter a safe state when the safety warning information cannot be displayed correctly.
  • the safe state is as follows: the driver can be informed that the current display There is an abnormality in the detection system.
  • the bridge chip can send a signal to the display to control the display to display a power-on icon or other special icons (such as an exclamation point) to enter a safe state.
  • a power-on icon or other special icons such as an exclamation point
  • the above-mentioned safety status may also be reflected in other ways, such as a voice reminder inside the car, vibrating the steering wheel or seat, lighting up lights inside the car, and the like.
  • the display controller can be integrated between the bridge chip and the signal transmission path of the display, and is used to control the display screen of the display under the control of the target processor.
  • the display can also be controlled to display a power-on icon or other special icons under the control of the bridge chip.
  • the display detection system can also detect whether the target processor, display, and bridge chip are faulty.
  • the first comparison module can be integrated in the target processor
  • the second comparison module can be integrated in the bridge chip
  • the third comparison module can be integrated in the display controller. Test the target processor, bridge chip, and display controller for failure.
  • the target processor may send the first actual data and the first control signal to the first comparison module, and under the control of the first control signal, the first comparison module may generate the first ideal data.
  • the first comparison module compares the received first actual data with the first ideal data, and if the difference between the first actual data and the first ideal data exceeds the first threshold range, it indicates that the target processor is faulty, and the second A comparator sends first ideal data to the bridge chip; otherwise, if the target processor is normal, the first comparator sends first ideal data or first actual data to the bridge chip.
  • the bridge chip After receiving the first ideal data or the first actual data, the bridge chip generates second actual data and sends the second actual data to the second comparing module.
  • the target processor can also send a second control signal to the second comparison module, and under the control of the second control signal, the second comparison module can generate the second ideal data.
  • the second comparison module compares the received second actual data with the second ideal data, and if the difference between the second actual data and the second ideal data exceeds the second threshold range, it indicates the bridge chip, and/or,
  • the transmission path from the first comparison module to the bridge chip fails, and the second comparison module sends the second ideal data to the display controller; otherwise, the bridge chip and the transmission path from the first comparison module to the bridge chip are normal, and the second comparison module sends to the display controller
  • the controller sends second ideal data or second actual data.
  • the display controller After receiving the second ideal data or the second actual data, the display controller generates third actual data and sends the third actual data to the third comparison module.
  • the target processor can also send a third control signal to the third comparison module, and under the control of the third control signal, the third comparison module can generate third ideal data.
  • the third comparison module compares the received third actual data with the third ideal data, if the difference between the third actual data and the third ideal data exceeds the third threshold range, then the display controller, and/or , the transmission path from the second comparison module to the display controller fails, and the third comparison module sends the third ideal data to the display; otherwise, the transmission path from the display controller and the second comparison module to the display controller is normal, and the third comparison module Send the third ideal data or the third actual data to the display.
  • the previous article introduced that if any one of the target processor, display, bridge chip and display controller fails, the display cannot display driving information correctly. Also, methods for detecting failure of the target processor, bridge chip, and display controller are described.
  • the display on the one hand, the parameters of the displays provided by various suppliers are different, and it is impossible to uniformly detect the display at the digital end like the aforementioned target processor, bridge chip and display controller; on the other hand, the inventor found that the current display In the design of the detection system, there is no device for recovering display light and a circuit for detecting display light. Therefore, for the detection of the display in the display detection system, it is still in a technical blank state.
  • the above-mentioned display detection device may also include a light collector and a detection circuit.
  • the display includes a plurality of display segments, at least one of the display segments of the display emits display light.
  • a light collector the light collector is arranged on the outgoing light path of the display light, and is used to collect the display light emitted from at least one of the display partitions, and convert the collected display light into the first display light in the form of an electrical signal.
  • One display information sending the first display information to the detection circuit.
  • a detection circuit the light collector is coupled to the detection circuit, and is used to receive the first display information and compare the first display information with the corresponding reference display information of the display partition to indicate the Check whether the display above is abnormal.
  • the detection circuit receives the reference display information of at least one display partition and the first display information sent by the light collector, and compares the first display information of the same display partition with the reference display information. If the target processor is directly coupled to the display and directly controls the display to display images, then when the difference between the first display information and the reference display information exceeds the fourth threshold range, the display, and/or the target processor The transmission path to the display is faulty, causing the display to display abnormally; conversely, the transmission path from the display and the target processor to the display is normal.
  • the target processor is indirectly coupled to the display and controls the display to display images through a bridge chip and/or a display controller, when the difference between the first display information and the reference display information exceeds the fourth threshold range, It means that the display, and/or, the transmission path from the display controller (or bridge chip) to the display is faulty, causing the display to display abnormally; otherwise, the transmission path from the display and the display controller (or bridge chip) to the display is normal.
  • the display detection device may further include a security processing module.
  • the security processing module is coupled with the detection circuit.
  • the detection circuit can send the comparison result of whether the display is displayed normally to the security processing module.
  • the security processing module may take a series of measures against the abnormal display to remind the user.
  • any one of the above-mentioned display controller, the transmission path from the second comparison module to the display controller, the bridge chip, the transmission path from the first comparison module to the bridge chip, and the target processor fails, it can also be taken by the security processing module. The above measures to alert the user.
  • the above-mentioned display detection device further includes an optical path adjustment component and a reflection mirror.
  • the light path adjustment component is arranged on the outgoing light path of the display light, and is used for adjusting the light path of the display light;
  • the light path adjustment component includes a half-mirror, and the reflector is set on the light path between the half-mirror and the light collector.
  • the reflector is used to reflect the display light transmitted through at least one display partition of the half mirror to the light collector.
  • the display light emitted by the display is projected onto the lens group, adjusted by the lens group, and then projected onto the half-transparent mirror.
  • the part projected on the half-mirror shows that the light is reflected by the half-mirror, projects to the human eye, and forms a virtual image directly in front of the driver;
  • the half-mirror is transmitted and projected onto the reflector, and this part of the display light is reflected by the reflector and projected to the light collector.
  • the half-transparent and half-reflecting mirror may be a front windshield of an automobile.
  • the light collector can detect the display without affecting the intensity of the display light projected to human eyes by collecting the display light that passes through the half-mirror and is wasted as display light for detection.
  • the above-mentioned display detection device further includes an optical fiber.
  • the light guide fiber is arranged on the light output side of the display, and is used for transmitting the display light of at least one display partition to the light collector.
  • the light-guiding fiber can be used to transmit the display light emitted from at least one display partition to the light collector.
  • the above detection circuit further includes a first image processing module; each display partition includes at least one pixel area; the first image processing module is configured to convert the first display information into the second display information, each The pixel data amount of the second display information in a pixel area is smaller than the pixel data amount of the first display information in the pixel area.
  • the first image processing module may be used to perform dimensionality reduction processing on the first display information to obtain the dimensionality-reduced second display information. In this way, by reducing the amount of pixel data in the second display information, the amount of computation in the comparison process of the detection circuit can be reduced.
  • the second display information may be to reduce the data bit width of each sub-pixel (for example, a red sub-pixel, a green sub-pixel, and a blue sub-pixel).
  • the first display information is converted into the amount of pixel data
  • the grayscale bit width of each sub-pixel for example, red sub-pixel, green sub-pixel and blue sub-pixel
  • the detection circuit when the light collector collects display light, some ambient light may also be collected by the light collector, thereby affecting the comparison result of the detection circuit.
  • the detection circuit further includes a second image processing module.
  • the second image processing module is configured to filter the first display information or the second display information to obtain third display information.
  • the filtered third display information filters out ambient light other than the display light, thereby improving the detection accuracy of the detection circuit.
  • the above-mentioned second image processing module performs filtering processing on the first display information or the second display information to obtain the third display information, which specifically includes: a second image processing module configured to obtain the first display information or the second display information 2.
  • the first characteristic value of the display information is used to indicate the display data of the display; the second image processing module is also used to process the first display information or the second display information according to the first characteristic value and the reference display information Filtering is performed to obtain the third display information.
  • color shift may occur in some color sub-pixels, for example, color shift occurs in the red sub-pixel, thereby affecting the comparison result.
  • the detection circuit can also perform grayscale conversion on the first display information (or second display, third display information), and the grayscale converted first display information (or second display, third display information)
  • the third display information can indicate a black and white picture, thereby improving the accuracy of the comparison result.
  • the above-mentioned target processor is further configured to send reference display information to the detection circuit.
  • the target processor when it sends out the first ideal data or the first actual data, it can send the reference display information to the detection circuit for storage.
  • the detection circuit can directly call the pre-stored reference display information after receiving the first display information sent by the light collector.
  • the target processor may also send the reference display information to the detection circuit after sending the first ideal data or the first actual data and before the detection circuit receives the first display information.
  • the detection circuit receives the first display information sent by the light collector, and can obtain reference display information from the target processor.
  • the detection circuit includes a processing circuit.
  • the processing circuit is used for receiving the second display information or the third display information.
  • the processing circuit is also used to execute the software codes, and compare the second display information (or third display information) of the corresponding display partition.
  • the third display information) is compared with the reference display information to indicate whether the display is abnormal.
  • the detection circuit includes a processing circuit and a comparison circuit.
  • the processing circuit is used to receive the second display information or the third display information; the processing circuit is also used to send a control signal to the comparison circuit in response to the second display information or the third display information; the comparison circuit is used to respond to the control signal , comparing the second display information or the third display information of the corresponding display partition with the reference display information to indicate whether the display is abnormal.
  • the detection circuit is integrated into the target processor, so as to shorten the path between the target processor and the detection circuit.
  • the display detection device may also include a memory.
  • the first image processing module, the second image processing module, and the comparison module exists in the form of software code, it can also be said that in the first image processing module, the comparison module,
  • the computer program or software code can also be stored in the memory, and when the computer program or software code is executed, the display detection device can be executed steps to achieve the aforementioned functions.
  • the present application provides a display detection system, the display detection system includes a terminal and the display detection device described in the first aspect; the display light emitted by the display of the display detection device forms a virtual image at the target position of the terminal; the display detection The detection circuit of the device is used to indicate whether the display is abnormal.
  • the detection circuit of the above-mentioned display detection device receives the reference display information of at least one display partition and the first display information sent by the light collector, and compares the first display information of the same display partition with the reference display information. If the target processor is directly coupled to the display and directly controls the display to display images, then when the difference between the first display information and the reference display information exceeds the fourth threshold range, the display, and/or the target processor The transmission path to the display is faulty, causing the display to display abnormally; conversely, the transmission path from the display and the target processor to the display is normal.
  • the target processor is indirectly coupled to the display and controls the display to display images through a bridge chip and/or a display controller, when the difference between the first display information and the reference display information exceeds the fourth threshold range, It means that the display, and/or, the transmission path from the display controller (or bridge chip) to the display is faulty, causing the display to display abnormally; otherwise, the transmission path from the display and the display controller (or bridge chip) to the display is normal.
  • the terminal is at least one of a car, an airplane, and a head-mounted display device.
  • a virtual image can be formed directly in front of the cockpit of the car or airplane, and the display content of the virtual image can include driving information such as the current speed per hour and fuel level of the car or airplane.
  • a virtual image may be formed directly in front of the eyes of a user wearing the head-mounted display device, and the display content of the virtual image may be a movie, a game, or the like.
  • the present application provides a display detection method, which is applied to a display detection device.
  • the display detection device includes a display, a light collector and a detection circuit; the display includes a plurality of display partitions, and the light collector is located on the outgoing light path of the display light. , the light collector is coupled with the detection circuit; the above display detection method includes: emitting display light through at least one display partition of the display; collecting the display light emitted from at least one display partition through the light collector, and converting the collected display light into electrical
  • the first display information in the form of a signal is sent to the detection circuit; the first display information is received by the detection circuit, and the first display information is compared with the reference display information of the corresponding display partition to indicate whether the display is abnormal .
  • the detection circuit receives the reference display information of at least one display partition and the first display information sent by the light collector, and compares the first display information of the same display partition with the reference display information. If the target processor is directly coupled to the display and directly controls the display to display images, then when the difference between the first display information and the reference display information exceeds the fourth threshold range, the display, and/or the target processor The transmission path to the display is faulty, causing the display to display abnormally; conversely, the transmission path from the display and the target processor to the display is normal.
  • the target processor is indirectly coupled to the display and controls the display to display images through a bridge chip and/or a display controller, when the difference between the first display information and the reference display information exceeds the fourth threshold range, It means that the display, and/or, the transmission path from the display controller (or bridge chip) to the display is faulty, causing the display to display abnormally; otherwise, the transmission path from the display and the display controller (or bridge chip) to the display is normal.
  • the display detection device further includes a reflector and an optical path adjustment component for adjusting the display light
  • the optical path adjustment component includes a half mirror
  • the light collector collects the display light emitted from at least one display partition, including: The display light passing through at least one display partition of the half mirror is reflected to the light collector by using the reflector.
  • the display light emitted by the display is projected onto the lens group, adjusted by the lens group, and then projected onto the half-transparent mirror.
  • the part projected on the half-mirror shows that the light is reflected by the half-mirror, projects to the human eye, and forms a virtual image directly in front of the driver;
  • the half-mirror is transmitted and projected onto the reflector, and this part of the display light is reflected by the reflector and projected to the light collector.
  • the half-transparent and half-reflecting mirror may be a front windshield of an automobile.
  • the light collector can detect the display without affecting the intensity of the display light projected to human eyes by collecting the display light that passes through the half-mirror and is wasted as display light for detection.
  • the display detection device further includes a light guide fiber; the light collector collects the display light emitted from at least one display partition, including: using the light guide fiber to transmit the display light of at least one display partition to the light collector .
  • the light-guiding fiber can be used to transmit the display light emitted from at least one display partition to the light collector.
  • the first display information is received by the detection circuit, and the first display information is compared with the reference display information of the corresponding display partition to indicate whether the display is abnormal, including: receiving the first display information by the detection circuit Display information, and perform image processing on the first display information; through the detection circuit, according to the reference display information, indicate whether the display is normally displayed.
  • each display area includes at least one pixel area; receiving the first display information through the detection circuit, and performing image processing on the first display information, including: converting the first display information into the second display information through the detection circuit ; The amount of pixel data of the second display information of each pixel area is smaller than the amount of pixel data of the first display information of the pixel area.
  • the first image processing module may be used to perform dimensionality reduction processing on the first display information to obtain the dimensionality-reduced second display information. In this way, by reducing the amount of pixel data in the second display information, the amount of computation in the comparison process of the detection circuit can be reduced.
  • the second display information may be to reduce the data bit width of each sub-pixel (for example, a red sub-pixel, a green sub-pixel, and a blue sub-pixel).
  • the amount of pixel data converted from the first display information is larger.
  • the small second display information may also be to reduce the grayscale bit width of each sub-pixel (for example, a red sub-pixel, a green sub-pixel, and a blue sub-pixel).
  • the first display information or the second display information may also be filtered through the detection circuit to obtain the third display information.
  • the filtered third display information filters out ambient light other than the display light, thereby improving the detection accuracy of the detection circuit.
  • the process of filtering the first display information or the second display information through the above detection circuit to obtain the third display information specifically includes: obtaining the first characteristic value of the first display information or the second display information through detection
  • the first characteristic value is used to indicate the display data of the display; through the detection circuit, according to the first characteristic value and the reference display information, the first display information or the second display information is filtered to obtain the third display information.
  • the first display information (or the second display, the third display information) can also be grayscale converted through the detection circuit, and the first display information (or the second display information) after the grayscale conversion , third display information) can indicate a black and white picture, thereby improving the accuracy of the comparison result.
  • the display detection device further includes a target processor.
  • Emitting display light through at least one display subregion of the display includes: controlling at least one display subregion of the display to emit display light through a target processor.
  • the display detection method further includes: sending the reference display information to the detection circuit by the target processor.
  • the reference display information can be sent to the detection circuit through the target processor, and stored by the detection circuit.
  • the pre-stored reference display information can be directly called upon receiving the first display information sent by the light collector through the detection circuit.
  • the target processor sends the first ideal data or the first actual data, and before the detection circuit receives the first display information, the target processor sends the reference display information to the detection circuit.
  • the detection circuit when the detection circuit receives the first display information sent by the light collector, the reference display information can be obtained from the target processor.
  • the detection circuit is used to compare the second display information of the corresponding display partition with the reference display information to indicate whether the display is displayed normally, including: receiving the second display information or the third display information through the detection circuit;
  • the processing circuit is also used to execute The software code compares the second display information (or third display information) of the corresponding display partition with the reference display information to indicate whether the display is abnormal.
  • the detection circuit includes a processing circuit and a comparison circuit; the detection circuit compares the second display information of the corresponding display partition with the reference display information to indicate whether the display is normally displayed, including: receiving through the processing circuit The second display information or the third display information; through the processing circuit in response to the second display information or the third display information, send a control signal to the comparison circuit; through the comparison circuit in response to the control signal, the second display information or the corresponding display partition The third display information is compared with the reference display information to indicate whether the display is abnormal.
  • the present application provides a computer-readable storage medium, including a computer program or software code.
  • the display detection device performs the first steps described in the aspect.
  • the present application provides a computer program, where the computer program includes instructions for executing the steps in any possible implementation manner of the first aspect.
  • Fig. 1 is a relationship diagram of each structure in a display detection device and an optical path diagram of display light provided by an embodiment of the present application;
  • FIG. 2 is a display effect diagram of the HUD provided by the embodiment of the present application.
  • Fig. 3 is another relationship diagram of the structures in the display detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • FIG. 4 is another diagram showing the relationship between the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • Fig. 5 is another diagram showing the relationship between the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • Fig. 6a is a division diagram of multiple display partitions of the display provided by the embodiment of the present application.
  • FIG. 6b is another division diagram of multiple display partitions of the display provided by the embodiment of the present application.
  • Fig. 7 is another diagram showing the relationship between the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • Fig. 8 is another diagram showing the relationship between the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • Fig. 9a is another diagram showing the relationship between the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • Fig. 9b is another relationship diagram showing the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application.
  • FIG. 10 is an image processing effect diagram provided by the embodiment of the present application.
  • Fig. 11 is another diagram showing the relationship between the structures in the detection device and the optical path diagram of the display light provided by the embodiment of the present application;
  • FIG. 12 is a schematic flowchart of a display detection method provided by an embodiment of the present application.
  • 101-target processor 1011-first comparison module; 102-display; 103-optical path adjustment component; 1031-lens group; 1032-half mirror; 104-bridge chip; Display controller; 1051-third comparison module; 106-light collector; 107-detection circuit; 1071-first image processing module; 1072-second image processing module; 1073-processing circuit; 1074-comparison circuit; 108- Safety processing module; 109-mirror; 11-display partition.
  • connection should be understood in a broad sense, for example, it can be fixed connection, detachable connection, or integral connection; it can be direct connection, indirect connection through an intermediary, or is the connection between two components.
  • the terms “comprising” and “having”, as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, of a sequence of steps or elements.
  • a method, system, product or device is not necessarily limited to those steps or elements explicitly listed, but may include other steps or elements not explicitly listed or inherent to the process, method, product or device.
  • "Up”, “Down”, “Left”, “Right”, etc. are only used relative to the orientation of the components in the drawings. These directional terms are relative concepts, and they are used for description and clarification relative to , which may change accordingly according to changes in the orientation in which components are placed in the drawings.
  • An embodiment of the present application provides a display detection system, and the display detection system includes a terminal and a display detection device.
  • the display detection device may include an existing HUD.
  • the HUD may include an object processor 101 , a display 102 and an optical path adjustment component 103 .
  • the target processor 101 is coupled with the display 102, and is used to control the display 102 to display a picture; the display 102 emits display light under the control of the target processor 101, and displays important information related to the terminal; On the light emitting path, after the display light is projected to the optical path adjustment component 103, it is adjusted by the optical path adjustment component 103 to form a virtual image at the target position of the terminal, so that the virtual image can be seen by the user when using the terminal.
  • the optical path adjustment component 103 is arranged on the outgoing light path of the display light, that is, based on the installation positions of the display 102 and the optical path adjustment component 103, and the outgoing direction of the display light, the display light emitted from the display 102 At least part of the light can be projected to the light path adjustment component 103 .
  • An object that appears below is set on the outgoing light path of the display light, or an object is set on the light path between two other objects, can be explained in this way, and will not be described in detail below.
  • the aforementioned target location may be any location relative to the terminal.
  • the target position may be fixed, that is, the position of the virtual image relative to the terminal is fixed.
  • the virtual image may present alarm icons, status icons, numbers, etc. related to the terminal.
  • the target position may also be changed. For example, if the position of the display 102 changes randomly, the target position relative to the terminal also changes accordingly, and the position of the virtual image relative to the terminal is variable.
  • the virtual image may present icons, linear icons, numbers, etc. that are related to the terminal and whose size and shape can be changed.
  • the above-mentioned terminal may be a device suitable for HUD, such as a car, an airplane, a head-mounted display device, or the like.
  • the above-mentioned virtual image can be formed directly in front of the cab of the car or airplane, and the display content of the virtual image can include driving information such as the current speed per hour and fuel level of the car or airplane.
  • a virtual image may be formed directly in front of the eyes of a user wearing the head-mounted display device, and the display content of the virtual image may be a movie, a game, or the like.
  • the terminal may also be other devices, which is not limited in this embodiment of the present application.
  • the terminal may also be other devices, which is not limited in this embodiment of the present application.
  • the following uses a car as an example for illustration.
  • the HUD may also include a bridge chip 104 and a display controller 105 supporting security functions.
  • the above-mentioned bridge chip 104 can be integrated between the target processor 101 and the signal transmission path of the display 102, and is used to make the display detection system enter a safe state when the safety warning information cannot be displayed correctly. , the current display detection system is abnormal.
  • the bridge chip 104 can send a signal to the display 102 to control the display 102 to display a power-on icon or other special icons (such as an exclamation point) to enter the safety zone. state.
  • a power-on icon or other special icons such as an exclamation point
  • the above-mentioned safety status may also be reflected in other ways, such as a voice reminder inside the car, vibrating the steering wheel or seat, lighting up lights inside the car, and the like.
  • the above-mentioned display controller 105 can be integrated between the bridge chip 104 and the signal transmission path of the display 102 , and is used to control the display 102 to display images under the control of the target processor 101 .
  • the display 102 can also be controlled to display a power-on icon or other special icons under the control of the bridge chip 104 .
  • the display detection system can also detect whether the target processor 101 , display 102 and bridge chip 104 are faulty.
  • the first comparison module 1011 integrated in the target processor 101, the second comparison module 1041 integrated in the bridge chip 104, and the display controller 105 can be used.
  • the third comparison module 1051 is integrated in the controller 105 to respectively detect whether the target processor 101 , the bridge chip 104 and the display controller 105 are faulty.
  • the target processor 101 may send the first actual data and the first control signal to the first comparison module 1011, and under the control of the first control signal, the first comparison module 1011 may generate the first ideal data.
  • the first comparison module 1011 compares the received first actual data with the first ideal data, and if the difference between the first actual data and the first ideal data exceeds the first threshold range, it indicates that the target processor 101 is faulty , the first comparator 1011 sends the first ideal data to the bridge chip 104 ; otherwise, the target processor 101 is normal, and the first comparator 1011 sends the first ideal data or the first actual data to the bridge chip 104 .
  • the bridge chip 104 After receiving the first ideal data or the first actual data, the bridge chip 104 generates second actual data and sends the second actual data to the second comparison module 1041 .
  • the target processor 101 can also send a second control signal to the second comparison module 1041, and under the control of the second control signal, the second comparison module 1041 can generate the second ideal data.
  • the second comparison module 1041 compares the received second actual data with the second ideal data, and if the difference between the second actual data and the second ideal data exceeds the second threshold range, it indicates the bridge chip 104, and/or Or, the transmission path from the first comparison module 1011 to the bridge chip 104 fails, and the second comparison module 1041 sends the second ideal data to the display controller 105; If the path is normal, the second comparison module 1041 sends the second ideal data or the second actual data to the display controller 105 .
  • the display controller 105 After receiving the second ideal data or the second actual data, the display controller 105 generates third actual data and sends the third actual data to the third comparison module 1051 .
  • the target processor 101 may also send a third control signal to the third comparison module 1051, and under the control of the third control signal, the third comparison module 1051 may generate third ideal data.
  • the third comparison module 1051 compares the received third actual data with the third ideal data, if the difference between the third actual data and the third ideal data exceeds the third threshold range, then the display controller 105 is indicated, and /or, the transmission path from the second comparison module 1041 to the display controller 105 fails, and the third comparison module 1051 sends the third ideal data to the display 102; otherwise, the display controller 105 and the second comparison module 1041 to the display controller 105 If the transmission path is normal, the third comparison module 1051 sends the third ideal data or the third actual data to the display 102 .
  • first actual data, second actual data, and third actual data are respectively generated by the target processor 101, the bridge chip 104, and the display controller 105, and are used to instruct the display 102 to display the actual image.
  • the above-mentioned first ideal data, second ideal data and third ideal data are ideal signals generated by the target processor 101 , the bridge chip 104 and the display controller 105 respectively, and are used to instruct the display 102 to display images.
  • the first threshold range, the second threshold range, and the third threshold range can be adaptively set to reasonable ranges based on the requirements of manufacturers or customers, which is not limited in this embodiment of the present application.
  • the target processor 101 may also directly control the display 102 to display images.
  • the target processor 101 shown in FIG. 3 controls the display 102 to display images through the bridge chip 104 and the display controller 105 as an example for illustration.
  • any failure of any one of the target processor 101 , the display 102 , the bridge chip 104 and the display controller 105 may cause the display 102 to fail to display driving information correctly.
  • a method of detecting whether the target processor 101, the bridge chip 104, and the display controller 105 are faulty is introduced.
  • the display 102 on the one hand, the parameters of the display 102 provided by various suppliers are different, and it is impossible to uniformly detect the display 102 at the digital end like the aforementioned target processor 101, bridge chip 104 and display controller 105; on the other hand, The inventors found that the current design of the display detection system does not deploy devices for collecting display light and circuits for detecting display light. Therefore, the detection of the display 102 in the display detection system is still in a technical blank state.
  • the embodiment of the present application provides a display detection device.
  • the display detection device adds a light collector 106 and a detection circuit 107 on the basis of the existing HUD, avoiding the addition of a separate detection device. , which can save the detection cost.
  • the display 102 includes a plurality of display partitions, and at least one display partition of the display 102 emits display light (the dotted arrow in the figure represents the display light).
  • the light collector 106 is arranged on the outgoing light path of the display light, and is used to collect the display light emitted from at least one display partition, and convert the collected display light into the first display information in the form of an electrical signal, which is sent to the detection
  • the circuit 107 sends the first display information.
  • the detection circuit 107 the light collector 106 is coupled to the detection circuit 107 , is used to receive the first display information, and compare the first display information with the reference display information of the corresponding display partition to indicate whether the display 102 displays abnormally.
  • the display detection device may further include a security processing module 108 .
  • the security processing module 108 is coupled with the detection circuit 107 .
  • the detection circuit 107 can send the comparison result of whether the display 102 displays normally to the security processing module 108 .
  • the security processing module 108 may take a series of measures against the abnormal display on the display 102 to remind the user.
  • the security processing module 108 may be coupled with the display 102, receive the comparison result that the display 102 displays abnormality, and control the display 102 to reset.
  • the security processing module 108 may also be coupled with the target processor 101, receive the comparison result that the display 102 shows abnormality, and use the target processor 101 to control the display 102 to reset.
  • the safety processing module 108 may be coupled with the control circuit of the car, and the control circuit of the car may be coupled with at least one of the horn, seat, steering wheel, etc. of the car.
  • the safety processing module 108 receives the abnormal comparison result displayed on the display 102, and controls the horn to sound an alarm, or the seat vibrates, or the steering wheel vibrates.
  • any one of the aforementioned display controller 105, the transmission path from the second comparison module 1041 to the display controller 105, the bridge chip 104, the transmission path from the first comparison module 1011 to the bridge chip 104, and the target processor 101 fails,
  • the above measures may also be taken by the security processing module 108 to remind the user.
  • each display subregion 11 may include at least one pixel area, and each pixel area has one pixel unit.
  • each pixel unit includes at least three sub-pixels that can constitute three primary colors, and the three sub-pixels that constitute three primary colors can be red sub-pixels, green sub-pixels, and blue sub-pixels; or, The three sub-pixels constituting the three primary colors may also be yellow sub-pixels, cyan sub-pixels, and magenta sub-pixels respectively.
  • the display 102 of the present application may also display a black and white picture, which is not limited in this embodiment of the present application.
  • each display section 11 includes three pixel areas, and the three sub-pixel areas have 9 sub-pixels in total.
  • the number of sub-pixels included in each display area 11 is at least partly different.
  • part of the display area 11 includes three pixel areas, and the three sub-pixel areas have 9 sub-pixels in total; part of the display area 11 includes four pixel areas, and the four sub-pixel areas have 12 sub-pixels in total; and part of the display area 11 includes two pixels. area, the two sub-pixel areas have 6 sub-pixels in total.
  • each display partition 11 of the display 102 can display images, based on this, the light collector 106 can collect part of the display light of the display partition 11 for detection by the detection circuit 107; the light collector 106 can also collect The display lights of all the display partitions 11 are used for detection by the detection circuit 107 .
  • the reason may be that when the display 102 displays a certain picture, only part of the display subregion 11 displays the picture, and the other part of the display subregion 11 is Black screen.
  • the display detection device is used to detect whether a part of the display subregion 11 of the display 102 displays abnormally, and there is no need to detect whether another part of the display subregion 11 of the display 102 displays abnormally.
  • the embodiment of the present application does not limit the way the light collector 106 collects the display light, as long as the light collector 106 can receive the display light and convert the display light into the first display signal of an electrical signal. , so that the first display signal is transmitted in the light collector 106 and the detection circuit 107 in the form of an electrical signal.
  • the display detection device further includes a mirror 109 .
  • the optical path adjustment assembly 103 can include a lens group 1031 and a half mirror 1032, the lens group 1031 is arranged on the optical path between the display 102 and the half mirror 1032, and the reflector 109 is arranged on the half mirror 1032 and the light The optical path between collectors 106.
  • the display light emitted by the display 102 is projected onto the lens group 1031 , adjusted by the lens group 1031 , and projected onto the half mirror 1032 .
  • Part of the display light projected onto the half-mirror 1032 is reflected by the half-mirror 1032, projected to the human eye, and becomes a virtual image directly in front of the driver; another part of the display light projected onto the half-mirror 1032 Transmitted from the half-mirror 1032 and projected onto the reflector 109 , this part of the display light is reflected by the reflector 109 and projected to the light collector 106 .
  • the light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.
  • the light collector 106 collects the display light transmitted through the half-mirror 1032 and wasted as the display light for detection, without affecting the intensity of the display light projected to the human eye,
  • the display 102 is detected.
  • the display 102 can be installed on the driver's seat, for example, and the front windshield of the car can be used as the half mirror 1032 .
  • other positions of the display 102 and the half mirror 1032 may also be used, which is not limited in this embodiment of the present application.
  • the display detection device further includes a light guide fiber 110 , and the light guide fiber 110 has the function of transmitting light.
  • the light guide fiber 110 is disposed on the light emitting side of the display 102 to transmit the display light emitted from at least one display area 11 to the light collector 106 .
  • the light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.
  • the embodiment of the present application does not limit the specific location of the light guide fiber 110 , as long as the light guide fiber is placed on the light output side of the display 102 and can transmit the display light to the light collector 106 .
  • the light collector 106 may be disposed on the lens group 1031 .
  • the light collector 106 may also collect display light in other ways, which is not limited in this embodiment of the present application.
  • the embodiment of the present application does not limit the specific structure and model of the light collector 106, as long as the light collector 106 has the functions of collecting display light and converting optical signals into electrical signals.
  • the light collector 106 may be an emitron camera.
  • the detection circuit 107 compares the first display information with the reference display information of the corresponding display partition 11, which specifically includes: the detection circuit 107 receives the reference display information of at least one display partition 11 and the light collector 106 The transmitted first display information, and compares the first display information of the same display zone 11 with the reference display information. As shown in FIG.
  • the target processor 101 is indirectly coupled to the display 102 and controls the display 102 to display images through the bridge chip 104 and/or the display controller 105, the difference between the first display information and the reference display information In the case of exceeding the fourth threshold range, it indicates that the display 102, and/or, the transmission path from the display controller 105 (or bridge chip) to the display 102 fails, causing the display 102 to display abnormally; otherwise, the display 102 and the display controller 105 (or bridge chip) transmission path to the display 102 is normal.
  • the detection circuit 107 when the detection circuit 107 receives the first display information and the reference display information, it can compare the first display information and the reference display information of the same display area 11; or, the detection circuit 107 receives After the first display information and the reference display information, there may be a delay before comparing the first display information and the reference display information of the same display zone 11, which is not limited in this embodiment of the present application. Considering prompting the driver to display abnormalities in time to avoid unnecessary accidents, optionally, the detection circuit 107 in the embodiment of the present application detects the first display information of the same display partition 11 while receiving the first display information and the reference display information. The displayed information is compared with the reference displayed information.
  • the process of comparing the first display information with the reference display information may be implemented by hardware circuits or software codes, which is not limited in this embodiment of the present application.
  • the display detection device may further include a memory, and if the comparison process between the first display information and the reference display information is implemented through software codes, the above software codes may be stored in the memory.
  • the above-mentioned first display information is an actual signal corresponding to the picture displayed on the display 102 .
  • the above-mentioned reference display information is an ideal signal generated by the target processor 101 , or the bridge chip 104 , or the display controller 105 and used to instruct the display 102 to display a picture.
  • the fourth threshold range can be adaptively set to a reasonable range based on the requirements of manufacturers or customers, which is not limited in this embodiment of the present application.
  • the target processor 101 can directly or indirectly control the display 102 to display images.
  • the target processor 101 can control the display 102 to display the correct image only when the target processor 101 predetermines what image should be displayed on the display 102 . Therefore, the target processor 101 may pre-store the information corresponding to the picture that the display 102 should display, that is, the reference display information of the display 102 . Furthermore, the target processor 101 may also send the reference display information of the same frame to the detection circuit 107 . In this case, the detection circuit 107 can be integrated into the target processor 101 to shorten the path between the target processor 101 and the detection circuit 107 .
  • the target processor 101 when it sends out the first ideal data or the first actual data, it can send the reference display information to the detection circuit 107 for storage by the detection circuit 107 .
  • the detection circuit 107 can directly invoke the pre-stored reference display information after receiving the first display information sent by the light collector 106 .
  • the target processor 101 may also send reference display information to the detection circuit 107 after sending the first ideal data or the first actual data and before the detection circuit 107 receives the first display information.
  • the detection circuit 107 receives the first display information sent by the light collector 106 , that is, obtains reference display information from the target processor 101 . Compared with the above two methods, this method does not need to integrate a storage circuit in the detection circuit 107 for storing reference display information, thereby saving the layout area occupied by the detection circuit 107 .
  • the first display information and the reference display information may indicate display data of the display 102, and the display data may be, for example, brightness information, bright spot information, grayscale information, and the like.
  • the first display information indicates the actual brightness of the picture displayed on the display 102
  • the reference display information indicates the ideal brightness of the picture displayed on the display 102
  • the specific process of comparing the first display information with the reference display information may include: accumulating the actual luminance of a plurality of sub-pixels in a display sub-region 11, and accumulating the ideal luminance of a plurality of sub-pixels in a display sub-region 11 , and compare the accumulated values of the two.
  • the first display information indicates the actual bright spot when the display 102 displays a frame of picture
  • the reference display information indicates the ideal bright spot when the display 102 displays the same frame of picture. highlights.
  • the specific process of comparing the first display information with the reference display information may include: calculating the standard deviation of the actual bright spots and the ideal bright spots in each display area 11 line by line.
  • the embodiment of the present application can also use other methods to compare the first display information with the reference display information, such as performing hash calculation and cyclic redundancy code check (cyclic redundancy code, CRC) based on the first display information and the reference display information. )wait.
  • CRC cyclic redundancy code
  • the detection circuit 107 may further include a first image processing module 1071, the first image processing module 1071 is used to convert the first display information into the second display information, and each pixel region The amount of pixel data of the second display information is smaller than the amount of pixel data of the first display information of the pixel region. That is, the first image processing module 1071 is used to perform dimension reduction processing on the first display information to obtain the second display information after dimension reduction. In this way, by reducing the amount of pixel data in the second display information, the amount of computation in the comparison process of the detection circuit 107 can be reduced.
  • the amount of pixel data converted into the first display information is larger.
  • the small second display information may specifically reduce the data bit width of each sub-pixel (for example, a red sub-pixel, a green sub-pixel, and a blue sub-pixel).
  • the data bit width of the red sub-pixel indicated by the first display information is 8 bits, ranging from 0 to 255, except 0, which can display 255 different red colors.
  • the data bit width of the red sub-pixel indicated by the second display information with a smaller amount of pixel data is 4 bits, ranging from 0 to 15, except for 0, which can display 15 different red colors.
  • the first display information is converted into the amount of pixel data
  • the grayscale bit width of each sub-pixel for example, red sub-pixel, green sub-pixel and blue sub-pixel
  • the grayscale bit width of the display picture indicated by the first display information is 8 bits, ranging from 0 to 255, that is, the picture displayed on the display 102 may have 256 different grayscales.
  • the grayscale bit width of the display picture indicated by the second display information with a smaller amount of pixel data is 2 bits, ranging from 0 to 3, that is, the picture displayed on the display 102 can have 4 different grayscales.
  • the detection circuit 107 may further include a second image processing module 1072 .
  • the second image processing module 1072 performs filtering processing on the first display information or the second display information to obtain third display information.
  • the filtered third display information filters out the ambient light except the display light, so as to improve the detection accuracy of the detection circuit 107 .
  • the second image processing module 1072 is used to obtain the first feature value of the first display information or the second display information, and the first feature value is used to indicate the display data of the display 102; the second image processing module 1072 is also used to The first feature value and the reference display information are used to filter the first display information or the second display information to obtain third display information.
  • the second image processing module 1072 can determine the ideal display grayscale of each sub-pixel and the outline of the picture displayed on the display 102 according to the reference display information. Based on this, the gray scale threshold range of each sub-pixel can be set according to the reference display information, and the sub-pixels whose gray scale exceeds the gray scale threshold range are filtered; the sub-pixels whose gray scale is within the gray scale threshold range retain their original grayscale.
  • the second image processing module 1072 determines that the gray scale threshold range of the sub-pixel with coordinates (8, 200) is [15, 20], while the actual gray scale of the sub-pixel indicated by the first display information is is 25, which is beyond the gray scale threshold range, therefore, the display information of this sub-pixel is filtered out.
  • the second image processing module 1072 determines that the gray scale threshold range of the sub-pixel with coordinates (1, 3) is [0, 3], and the actual gray scale of the sub-pixel indicated by the second display information is The level is 2, which is within the gray scale threshold range, therefore, the display information of the sub-pixel is reserved.
  • the detection circuit 107 includes both the first image processing module 1071 and the second image processing module 1072
  • the above description shows that the first display information is subjected to dimensionality reduction processing to obtain second display information, and then perform filtering processing on the second display information to obtain third display information.
  • the first display information can also be filtered first, and then the dimensionality reduction processing is performed, which is not discussed in the embodiment of the present application. limited.
  • the above-mentioned dimensionality reduction processing and filtering processing can be implemented through hardware circuits, or can be implemented through software codes. It can also be said that the first image processing module 1071 and the second image processing module 1072 may be hardware circuits or software codes.
  • the display detection device may further include a memory, and if the dimensionality reduction processing and the filtering processing are implemented through software codes, the above software codes may be stored in the memory.
  • the detection circuit 107 can also perform grayscale conversion on the first display information (or second display, third display information), and the first display information (or second display information) after grayscale conversion display, the third display information) can indicate black and white images, thereby improving the accuracy of the comparison result.
  • the detection circuit 107 may further include a processing circuit 1073 .
  • the processing circuit 1073 is configured to receive the second display information sent by the first image processing module 1071 or the third display information sent by the second image processing module 1072 .
  • the processing circuit 1073 is also used to execute the software code, and compare the second display information of the corresponding display partition 11 (or the third display information) is compared with the reference display information to indicate whether the display 102 is abnormal.
  • the detection circuit 107 may further include a comparison circuit 1074 .
  • the processing circuit 1073 is used to receive the second display information sent by the first image processing module 1071 or the third display information sent by the second image processing module 1072 , generate a control signal, and send the control signal to the comparison circuit 1074 .
  • the comparison circuit 1074 is configured to compare the second display information (or third display information) of the corresponding display area 11 with the reference display information in response to the control signal, so as to indicate whether the display 102 is abnormal.
  • the above method of comparing the second display information (or third display information) of the corresponding display area 11 with the reference display information is the same as the method of comparing the first display information of the corresponding display area 11 with the reference display information. The method is the same and will not be repeated here.
  • the embodiment of the present application also provides a display detection method, which is applied to a display detection device, and the display detection device includes a display 102 , a light collector 106 and a detection circuit 107 .
  • the display 102 includes a plurality of display partitions 11, the light collector 106 is located on the outgoing optical path of the display light, and the light collector 106 is coupled with the detection circuit 107; as shown in Figure 12, the display detection method can be realized through the following steps:
  • each display subregion 11 may include at least one pixel area, and each pixel area has one pixel unit.
  • each pixel unit includes at least three sub-pixels that can constitute three primary colors, and the three sub-pixels that constitute three primary colors can be red sub-pixels, green sub-pixels, and blue sub-pixels; or, The three sub-pixels constituting the three primary colors may also be yellow sub-pixels, cyan sub-pixels, and magenta sub-pixels respectively.
  • the display 102 of the present application may also display a black and white picture, which is not limited in this embodiment of the present application.
  • each display section 11 includes three pixel areas, and the three sub-pixel areas have 9 sub-pixels in total.
  • the number of sub-pixels included in each display area 11 is at least partly different.
  • part of the display area 11 includes three pixel areas, and the three sub-pixel areas have 9 sub-pixels in total; part of the display area 11 includes four pixel areas, and the four sub-pixel areas have 12 sub-pixels in total; and part of the display area 11 includes two pixels. area, the two sub-pixel areas have 6 sub-pixels in total.
  • Each display subregion 11 of the display 102 can display a picture. Based on this, the display light of a part of the display subregion 11 can be collected by the light collector 106 for detection by the detection circuit 107; The display light is used for detection by the detection circuit 107 .
  • the reason may be that when the display 102 displays a certain picture, only part of the display area 11 displays the picture, and the other part displays the area 11. is a black screen.
  • the display detection device is used to detect whether a part of the display area 11 of the display 102 displays abnormally, and there is no need to detect whether another part of the display area 11 of the display 102 displays abnormally.
  • the embodiment of the present application does not limit the way of collecting display light through the light collector 106, as long as the light collector 106 can receive the display light and convert the display light into the first display signal of an electrical signal, that is, Yes, so that the first display signal is transmitted in the light collector 106 and the detection circuit 107 in the form of an electrical signal.
  • the display detection device further includes a mirror 109 .
  • the optical path adjustment assembly 103 can include a lens group 1031 and a half mirror 1032, the lens group 1031 is arranged on the optical path between the display 102 and the half mirror 1032, and the reflector 109 is arranged on the half mirror 1032 and the light The optical path between collectors 106.
  • the display light emitted by the display 102 is projected onto the lens group 1031 , adjusted by the lens group 1031 , and projected onto the half mirror 1032 .
  • Part of the display light projected onto the half-mirror 1032 is reflected by the half-mirror 1032, projected to the human eye, and becomes a virtual image directly in front of the driver; another part of the display light projected onto the half-mirror 1032 Transmitted from the half-mirror 1032 and projected onto the reflector 109 , this part of the display light is reflected by the reflector 109 and projected to the light collector 106 .
  • the light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.
  • the display light transmitted through the half mirror 1032 and wasted is collected by the light collector 106 as the display light for detection, without affecting the intensity of the display light projected to the human eye,
  • the display 102 is detected.
  • the display 102 can be installed on the driver's seat, for example, and the front windshield of the car can be used as the half mirror 1032 .
  • other positions of the display 102 and the half mirror 1032 may also be used, which is not limited in this embodiment of the present application.
  • the display detection device further includes a light guide fiber 110 , and the light guide fiber 110 has the function of transmitting light.
  • the light guide fiber 110 by disposing the light guide fiber 110 on the light emitting side of the display 102 , the display light emitted from at least one display area 11 is transmitted to the light collector 106 by the light guide fiber 110 .
  • the light collector 106 receives the display light and converts the display light into a first display signal in the form of an electrical signal.
  • the embodiment of the present application does not limit the specific location of the light guide fiber 110, as long as the light guide fiber is set on the light exit side of the display 102, and the display light can be transmitted to the light collector through the light guide fiber 110 106 is enough.
  • the light collector 106 may be disposed on the lens group 1031 .
  • the embodiment of the present application does not limit the specific structure and model of the light collector 106, as long as the light collector 106 has the functions of collecting display light and converting optical signals into electrical signals.
  • the light collector 106 may be a photoelectric camera.
  • the display detection device may further include a security processing module 108 .
  • the security processing module 108 is coupled with the detection circuit 107 .
  • the comparison result of whether the display 102 displays normally can be sent to the security processing module 108 through the detection circuit 107 .
  • a series of measures may be taken by the security processing module 108 to remind the user of the abnormal display 102 .
  • the security processing module 108 may be coupled with the display 102, and receive the comparison result that the display 102 shows abnormality. When the comparison result indicates that the display 102 is abnormal, the security processing module 108 may control the display 102 to reset.
  • the security processing module 108 may also be coupled with the target processor 101 to receive the abnormal comparison result displayed on the display 102 .
  • the target processor 101 may be used to control the display 102 to reset through the security processing module 108 .
  • the safety processing module 108 may be coupled with the control circuit of the car, and the control circuit of the car may be coupled with at least one of the horn, seat, steering wheel, etc. of the car.
  • the safety processing module 108 receives the comparison result that the display 102 displays abnormality.
  • the safety processing module 108 can control the horn to sound an alarm, or the seat vibrates, or the steering wheel vibrates.
  • the detection circuit 107 is used to compare the first display information with the reference display information of the corresponding display partition 11, specifically including: receiving the reference display information of at least one display partition 11 through the detection circuit 107 and collecting light The first display information sent by the controller 106, and compare the first display information of the same display zone 11 with the reference display information. As shown in FIG.
  • the target processor 101 is indirectly coupled to the display 102 and controls the display 102 to display images through the bridge chip 104 and/or the display controller 105, the difference between the first display information and the reference display information In the case of exceeding the fourth threshold range, it indicates that the display 102, and/or, the transmission path from the display controller 105 (or bridge chip) to the display 102 fails, causing the display 102 to display abnormally; otherwise, the display 102 and the display controller 105 (or bridge chip) transmission path to the display 102 is normal.
  • the first display information and the reference display information of the same display area 11 can be compared; 107 may experience a delay after receiving the first display information and the reference display information, and then compare the first display information and the reference display information in the same display area 11, which is not limited in this embodiment of the present application.
  • the first display information and the reference display information of the same display partition 11 are information to compare.
  • the process of comparing the first display information with the reference display information may be implemented by hardware circuits or software codes, which is not limited in this embodiment of the present application.
  • the display detection device may further include a memory, and if the comparison process between the first display information and the reference display information is implemented through software codes, the above software codes may be stored in the memory.
  • the above-mentioned first display information is an actual signal corresponding to the picture displayed on the display 102 .
  • the above reference display information is generated by the target processor 101 , or the bridge chip 104 , or the display controller 105 , and is used to instruct the display 102 to display an ideal signal of the picture.
  • the fourth threshold range can be adaptively set to a reasonable range based on the requirements of manufacturers or customers, which is not limited in this embodiment of the present application.
  • the target processor 101 can directly or indirectly control the display 102 to display images.
  • the display 102 can be controlled by the target processor 101 to display the correct picture only when it is determined in advance what kind of picture the display 102 should display. Therefore, information corresponding to the screen to be displayed on the display 102 may be pre-stored by the target processor 101 , that is, reference display information of the display 102 .
  • the target processor 101 can also send the reference display information of the same frame to the detection circuit 107. In this case, the detection circuit 107 can be integrated into the target processor 101 to shorten the path between the target processor 101 and the detection circuit 107 .
  • the target processor 101 when the target processor 101 sends out the first ideal data or the first actual data, the target processor 101 can send the reference display information to the detection circuit 107 for storage by the detection circuit 107 .
  • the detection circuit 107 receives the first display information sent by the light collector 106, the pre-stored reference display information can be called directly.
  • the target processor 101 may send the reference display information to the detection circuit 107 .
  • the detection circuit 107 when the detection circuit 107 receives the first display information sent by the light collector 106 , the reference display information can be obtained from the target processor 101 . Compared with the above two methods, this method does not need to integrate a storage circuit in the detection circuit 107 for storing reference display information, thereby saving the layout area occupied by the detection circuit 107 .
  • the first display information and the reference display information may indicate display data of the display 102, and the display data may be, for example, brightness information, bright spot information, grayscale information, and the like.
  • the first display information indicates the actual brightness of the picture displayed on the display 102
  • the reference display information indicates the ideal brightness of the picture displayed on the display 102
  • the specific process of comparing the first display information with the reference display information may include: accumulating the actual luminance of a plurality of sub-pixels in a display sub-region 11, and accumulating the ideal luminance of a plurality of sub-pixels in a display sub-region 11 , and compare the accumulated values of the two.
  • the first display information indicates the actual bright spot when the display 102 displays a frame of picture
  • the reference display information indicates the ideal bright spot when the display 102 displays the same frame of picture. highlights.
  • the specific process of comparing the first display information with the reference display information may include: calculating the standard deviation of the actual bright spots and the ideal bright spots in each display area 11 line by line.
  • the embodiment of the present application may also use other methods to compare the first display information with the reference display information, for example, performing hash calculation and cyclic redundancy check based on the first display information and the reference display information.
  • Other easily conceivable changes or substitutions shall fall within the protection scope of the present application.
  • the detection circuit 107 receives the first display information, and compares the first display information with the reference display information of the corresponding display partition 11 to indicate whether the display 102 displays abnormally, which may include:
  • the detection circuit 107 can also convert the first display information into the second display information, and the pixel data amount of the second display information in each pixel area is less than that of the pixel.
  • the pixel data amount of the first display information of the area is used to perform dimensionality reduction processing on the first display information, so as to obtain the dimensionality-reduced second display information. In this way, by reducing the amount of pixel data in the second display information, the amount of computation in the comparison process of the detection circuit 107 can be reduced.
  • the first display information is converted into the amount of pixel data
  • the smaller second display information may specifically reduce the data bit width of each sub-pixel (eg red sub-pixel, green sub-pixel and blue sub-pixel).
  • the data bit width of the red sub-pixel indicated by the first display information is 8 bits, ranging from 0 to 255, except 0, which can display 255 different red colors.
  • the data bit width of the red sub-pixel indicated by the second display information with a smaller amount of pixel data is 4 bits, ranging from 0 to 15, except for 0, which can display 15 different red colors.
  • the first display information is converted into pixel data
  • the gray scale bit width of each sub-pixel (such as a red sub-pixel, a green sub-pixel and a blue sub-pixel) may also be reduced.
  • the grayscale bit width of the display picture indicated by the first display information is 8 bits, ranging from 0 to 255, that is, the picture displayed on the display 102 may have 256 different grayscales.
  • the grayscale bit width of the display picture indicated by the second display information with a smaller amount of pixel data is 2 bits, ranging from 0 to 3, that is, the picture displayed on the display 102 can have 4 different grayscales.
  • the detection circuit 107 may also perform filtering processing on the first display information or the second display information to obtain third display information.
  • the filtered third display information filters out the ambient light except the display light, so as to improve the detection accuracy of the detection circuit 107 .
  • the first characteristic value of the first display information or the second display information can be obtained through the detection circuit 107, and the first characteristic value is used to indicate the display data of the display 102; Displaying information, performing filtering processing on the first display information or the second display information to obtain third display information.
  • the ideal display grayscale of each sub-pixel and the outline of the picture displayed by the display 102 can be determined by the detection circuit 107 according to the reference display information. Based on this, the gray scale threshold range of each sub-pixel can be set according to the reference display information, and the sub-pixels whose gray scale exceeds the gray scale threshold range are filtered; the sub-pixels whose gray scale is within the gray scale threshold range retain their original grayscale.
  • the detection circuit 107 determines that the gray scale threshold range of the sub-pixel whose coordinates are (8, 200) is [15, 20], while the actual gray scale of the sub-pixel indicated by the first display information is 25, beyond the gray scale threshold range, therefore, the display information of the sub-pixel is filtered out.
  • the detection circuit 107 determines that the gray scale threshold range of the sub-pixel whose coordinates are (1, 3) is [0, 3], and the actual gray scale of the sub-pixel indicated by the second display information is is 2, within the range of the gray scale threshold, therefore, the display information of the sub-pixel is reserved.
  • dimensionality reduction processing is first performed on the first display information to obtain the second display information, and then the second display information Filtering is performed to obtain the third display information.
  • filtering processing may also be performed on the first display information first, and then dimensionality reduction processing is performed, which is not limited in this embodiment of the present application.
  • the above-mentioned dimensionality reduction processing and filtering processing can be implemented through hardware circuits, or can be implemented through software codes.
  • the display detection device may further include a memory, and if the dimensionality reduction processing and the filtering processing are implemented through software codes, the above software codes may be stored in the memory.
  • the first display information (or the second display, the third display information) can also be grayscale converted by the detection circuit 107, and the first display information (or the second display information) after the grayscale conversion Second display, third display information) can indicate black and white images, thereby improving the accuracy of comparison results.
  • the detection circuit 107 indicates whether the display 102 displays normally according to the reference display information.
  • the detection circuit 107 may also receive the foregoing second display information or third display information.
  • the process of comparing the second display information (or the third display information) with the reference display information is realized by software code
  • the software code can also be executed by the detection circuit 107, and the second display information of the corresponding display partition 11 (or the third display information) is compared with the reference display information to indicate whether the display 102 is abnormal.
  • the detection circuit 107 may include a processing circuit 1073 and a comparison circuit 1074 .
  • the aforementioned second display information or third display information may be received by the processing circuit 1073 to generate a control signal and send the control signal to the comparison circuit 1074 .
  • the comparison circuit 1074 compares the second display information (or third display information) of the corresponding display area 11 with the reference display information to indicate whether the display 102 displays abnormally.
  • the above method of comparing the second display information (or third display information) of the corresponding display area 11 with the reference display information is the same as the method of comparing the first display information of the corresponding display area 11 with the reference display information. The method is the same and will not be repeated here.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

本申请提供一种显示检测装置、显示检测系统和显示检测方法,涉及显示技术领域,可以根据第一显示信息与参考显示信息的比较结果,确定显示器是否显示异常。该显示检测装置包括显示器、光线采集器和检测电路;显示器包括多个显示分区,显示器的至少一个显示分区出射显示光;光线采集器,光线采集器设置于显示光的出射光路上,用于采集从至少一个显示分区出射的显示光,并将采集的显示光转换为电信号形式的第一显示信息,向检测电路发送第一显示信息;检测电路,光线采集器与检测电路耦合,用于接收第一显示信息,并将第一显示信息与相应的显示分区的参考显示信息进行比较,以指示显示器是否显示异常。

Description

显示检测装置、显示检测系统和显示检测方法
本申请要求于2022年2月25日提交中国专利局、申请号为202210181496.1、申请名称为“显示检测装置、显示检测系统和显示检测方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示技术领域,尤其涉及一种显示检测装置、显示检测系统和显示检测方法。
背景技术
近年来,随着经济的不断发展,各地的汽车保有量也在逐年攀高,汽车已经成为最受青睐的现代化交通工具。
抬头显示(head up display,以下简称为HUD)作为一种驾驶辅助工具,其可以将时速、导航、油量等行驶信息,以虚像形式投射至驾驶员的正前方,让驾驶员尽量做到不低头、不转头,就能看到上述行驶信息,提高车辆驾驶安全性。
HUD包括显示器,若显示器出现故障,则HUD投射的虚像将不能正确显示行驶信息。
发明内容
本申请提供一种显示检测装置、显示检测系统和显示检测方法,可以根据第一显示信息与参考显示信息的比较结果,确定显示器是否显示异常。
第一方面,本申请提供一种显示检测装置,显示检测装置包括既有的HUD,HUD可以包括目标处理器、显示器和光路调节组件。目标处理器与显示器耦合,用于控制显示器显示画面;显示器在目标处理器的控制下,出射显示光,显示与终端相关的重要信息;光路调节组件设置于显示光的出射光路上,显示光投射至光路调节组件后,经光路调节组件调节,在终端的目标位置成虚像,以在用户使用终端时,被用户看到该虚像。
在一些可能实现的方式中,上述HUD除了包括目标处理器、显示器和光路调节组件以外,还可以包括支持安全功能的桥接芯片和显示控制器。
桥接芯片可以集成在目标处理器与显示器的信号传输路径之间,用于在安全告警信息等不能正确显示时,使显示检测系统进入安全状态,安全状态表现为:能够告知驾驶员,当前的显示检测系统出现异常。
示例的,驾驶员未系安全带告警、刹车系统故障等相关图标不能正常显示时,桥接芯片可以向显示器发送信号,控制显示器显示显示开机图标或其他特殊图标(例如叹号),以进入安全状态。当然,也可以以其他方式体现上述安全状态,例如汽车内部声音提醒、震动方向盘或座椅、点亮汽车内灯光等。
显示控制器可以集成在桥接芯片与显示器的信号传输路径之间,用于在目标处理器的控制下,控制显示器显示画面。在显示检测系统处于安全状态时,还可以在桥接芯片 的控制下,控制显示器显示开机图标或其他特殊图标。
在HUD中,若目标处理器、显示器和桥接芯片中的任意一个出现故障,将导致显示器不能正确显示上述行驶信息,驾驶员看到的虚像内容有误,可能发生不必要的安全事故。因此,应及时检测目标处理器、显示器和桥接芯片是否出现故障。在本申请实施例中,显示检测系统除了在终端的目标位置成虚像以外,还还可以检测目标处理器、显示器和桥接芯片是否出现故障。
对于目标处理器、桥接芯片和显示控制器,可以采用在目标处理器中集成第一比较模块、在桥接芯片中集成第二比较模块、在显示控制器中集成第三比较模块的方式,来分别检测目标处理器、桥接芯片和显示控制器是否出现故障。
具体的,目标处理器可以向第一比较模块发送第一实际数据和第一控制信号,在第一控制信号的控制下,第一比较模块可以产生第一理想数据。第一比较模块对接收到的第一实际数据与第一理想数据进行比较,若第一实际数据与第一理想数据之间的差值超出第一阈值范围,则说明目标处理器出现故障,第一比较器向桥接芯片发送第一理想数据;反之,目标处理器正常,第一比较器向桥接芯片发送第一理想数据或者第一实际数据。
桥接芯片接收到第一理想数据或第一实际数据后,产生第二实际数据,并将第二实际数据发送至第二比较模块。目标处理器还可以向第二比较模块发送第二控制信号,在第二控制信号的控制下,第二比较模块可以产生第二理想数据。第二比较模块对接收到的第二实际数据与第二理想数据进行比较,若第二实际数据与第二理想数据之间的差值超出第二阈值范围,则说明桥接芯片,和/或,第一比较模块到桥接芯片的传输路径出现故障,第二比较模块向显示控制器发送第二理想数据;反之,桥接芯片和第一比较模块到桥接芯片的传输路径正常,第二比较模块向显示控制器发送第二理想数据或者第二实际数据。
显示控制器接收到第二理想数据或第二实际数据后,产生第三实际数据,并将第三实际数据发送至第三比较模块。目标处理器还可以向第三比较模块发送第三控制信号,在第三控制信号的控制下,第三比较模块可以产生第三理想数据。第三比较模块对接收到的第三实际数据与第三理想数据进行比较,若第三实际数据与第三理想数据之间的差值超出第三阈值范围,则说明显示控制器,和/或,第二比较模块到显示控制器的传输路径出现故障,第三比较模块向显示器发送第三理想数据;反之,显示控制器和第二比较模块到显示控制器的传输路径正常,第三比较模块向显示器发送第三理想数据或者第三实际数据。
前文介绍了目标处理器、显示器、桥接芯片和显示控制器中的任意一个出现故障,即可导致显示器不能正确显示行驶信息。并且,介绍了检测目标处理器、桥接芯片和显示控制器是否出现故障的方法。而对于显示器,一方面,各个供应商提供的显示器的参数不同,无法如前述目标处理器、桥接芯片和显示控制器,统一在数字端对显示器进行检测;另一方面,发明人发现,当前显示检测系统的设计,均未部署回采显示光的器件及检测显示光的电路。因此,对于显示检测系统中显示器的检测,仍处于技术空白状态。
基于此,在既有HUD的基础上,上述显示检测装置还可以包括光线采集器和检测电 路。显示器包括多个显示分区,所述显示器的至少一个所述显示分区出射显示光。光线采集器,所述光线采集器设置于所述显示光的出射光路上,用于采集从至少一个所述显示分区出射的显示光,并将采集的所述显示光转换为电信号形式的第一显示信息,向所述检测电路发送所述第一显示信息。检测电路,所述光线采集器与所述检测电路耦合,用于接收所述第一显示信息,并将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常。
本申请中,检测电路接收至少一个显示分区的参考显示信息以及光线采集器发送的第一显示信息,并对同一显示分区的第一显示信息与参考显示信息进行比较。若目标处理器直接与显示器耦合,并直接控制显示器显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器,和/或,目标处理器到显示器的传输路径出现故障,导致显示器显示异常;反之,显示器和目标处理器到显示器的传输路径正常。或者,若目标处理器间接与显示器耦合,并通过桥接芯片和/或显示控制器控制显示器显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器,和/或,显示控制器(或者桥接芯片)到显示器的传输路径出现故障,导致显示器显示异常;反之,显示器和显示控制器(或者桥接芯片)到显示器的传输路径正常。
在一些可能实现的方式中,显示检测装置还可以包括安全处理模块。安全处理模块与检测电路耦合。检测电路可以将显示器是否正常显示的比较结果发送至安全处理模块。当比较结果为指示显示器显示异常时,安全处理模块可以针对显示器显示异常采取一系列措施,以提醒用户。另外,前述显示控制器、第二比较模块到显示控制器的传输路径、桥接芯片、第一比较模块到桥接芯片的传输路径、目标处理器中的任意一个出现故障,也可以通过安全处理模块采取上述措施,以提醒用户。
在一些可能实现的方式中,上述显示检测装置还包括光路调节组件和反射镜。光路调节组件设置于显示光的出射光路上,用于调节显示光的光路;光路调节组件包括半透半反镜,反射镜设置于半透半反镜与光线采集器之间的光路上。反射镜用于将透过半透半反镜的至少一个显示分区的显示光,反射至光线采集器。
显示器出射的显示光投射到透镜组后,经透镜组调节,投射到半透半反镜上。投射到半透半反镜上的部分显示光经半透半反镜反射,投射到人眼,在驾驶员的正前方成虚像;投射到半透半反镜上的另一部分显示光从半透半反镜透射、并投射到反射镜上,该部分显示光经反射镜反射后,投射至光线采集器。其中,半透半反镜可以是汽车的前挡风玻璃。
光线采集器通过采集透过半透半反镜且被浪费掉的显示光,作为用于检测的显示光,可以在不影响投射至人眼的显示光的强度的情况下,对显示器进行检测。
在一些可能实现的方式中,上述显示检测装置还包括导光纤维。导光纤维设置于显示器的出光侧,用于将至少一个显示分区的显示光传输至光线采集器。本申请通过将导光纤维设置于显示器的出光侧,可以利用导光纤维将从至少一个显示分区出射的显示光传输至光线采集器。
在一些可能实现的方式中,上述检测电路还包括第一图像处理模块;每一显示分区 包括至少一个像素区;第一图像处理模块,用于将第一显示信息转换为第二显示信息,每一像素区的第二显示信息的像素数据量,小于该像素区的第一显示信息的像素数据量。
可以利用第一图像处理模块对第一显示信息进行降维处理,以得到降维后的第二显示信息。这样一来,通过减小第二显示信息的像素数据量,可以降低检测电路比较过程中的计算量。
一些可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的数据位宽。
另一些可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器102中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,也可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的灰阶位宽。
在一些可能实现的方式中,光线采集器采集显示光的同时,可能会有部分环境光也被光线采集器采集到,从而影响检测电路的比较结果。基于此,上述检测电路还包括第二图像处理模块。第二图像处理模块,用于对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。经过滤波处理后的第三显示信息,滤除了除显示光以外的环境光,提高检测电路的检测精确度。
具体的,上述第二图像处理模块对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息的过程,具体包括:第二图像处理模块,用于获取第一显示信息或第二显示信息的第一特征值;第一特征值用于指示显示器的显示数据;第二图像处理模块,还用于根据第一特征值和参考显示信息,对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。
此外,在一些可能实现的方式中,显示光在投射至光线采集器之前,部分颜色子像素可能会发生色偏,例如红色子像素发生色偏,从而影响比较结果。基于此,若显示器显示全彩画面,检测电路还可以对第一显示信息(或者第二显示、第三显示信息)进行灰度转换,灰度转换后的第一显示信息(或者第二显示、第三显示信息)可以指示黑白画面,从而提高比较结果的准确性。
在一些可能实现的方式中,上述目标处理器还用于向检测电路发送参考显示信息。
第一种情况,目标处理器发出第一理想数据或第一实际数据时,即可将参考显示信息发送至检测电路,由检测电路存储。检测电路接收到光线采集器发送的第一显示信息,便可直接调用预先存储的参考显示信息。
第二种情况,目标处理器也可以在发出第一理想数据或第一实际数据之后,在检测电路接收第一显示信息之前,向检测电路发送参考显示信息。
第三种情况,检测电路接收光线采集器发送的第一显示信息,即可从目标处理器获取参考显示信息。
在一些可能实现的方式中,上述检测电路包括处理电路。处理电路,用于接收第二显示信息或第三显示信息。在对第二显示信息(或者第三显示信息)与参考显示信息进 行比较的过程通过软件代码实现的情况下,处理电路还用于执行该软件代码,对相应显示分区的第二显示信息(或者第三显示信息)与参考显示信息进行比较,以指示显示器是否显示异常。
在一些可能实现的方式中,上述检测电路包括处理电路和比较电路。处理电路,用于接收第二显示信息或第三显示信息;处理电路,还用于响应于第二显示信息或第三显示信息,向比较电路发送控制信号;比较电路,用于响应于控制信号,对相应显示分区的第二显示信息或第三显示信息,与参考显示信息进行比较,以指示显示器是否显示异常。
在一些可能实现的方式中,检测电路集成于目标处理器中,以缩短目标处理器与检测电路之间的路径。
此外,显示检测装置还可以包括存储器,在前述第一图像处理模块、第二图像处理模块、比较模块中的任意一个,以软件代码形式存在时,也可以说,在前述第一图像处理模块、第二图像处理模块、比较模块中的任意一个,以计算机程序形式存在时,计算机程序或者说软件代码还可以存储在存储器上,当计算机程序或者说软件代码被执行时,使得显示检测装置执行各自的步骤,以实现前述功能。
第二方面,本申请提供一种显示检测系统,该显示检测系统包括终端和第一方面所述的显示检测装置;显示检测装置的显示器出射的显示光,在终端的目标位置成虚像;显示检测装置的检测电路,用于指示显示器是否显示异常。
本申请中,上述显示检测装置的检测电路接收至少一个显示分区的参考显示信息以及光线采集器发送的第一显示信息,并对同一显示分区的第一显示信息与参考显示信息进行比较。若目标处理器直接与显示器耦合,并直接控制显示器显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器,和/或,目标处理器到显示器的传输路径出现故障,导致显示器显示异常;反之,显示器和目标处理器到显示器的传输路径正常。或者,若目标处理器间接与显示器耦合,并通过桥接芯片和/或显示控制器控制显示器显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器,和/或,显示控制器(或者桥接芯片)到显示器的传输路径出现故障,导致显示器显示异常;反之,显示器和显示控制器(或者桥接芯片)到显示器的传输路径正常。
在一些可能实现的方式中,终端为汽车、飞机和头显设备中的至少一种。
以终端为汽车或飞机为例,虚像可以成在汽车或飞机驾驶室的正前方,虚像的显示内容可以包括汽车或飞机当前的时速、油量等行驶信息。
以终端为头显设备为例,虚像可以成在佩戴头显设备的用户的眼睛正前方,虚像的显示内容可以是电影、游戏等。
第三方面,本申请提供一种显示检测方法,应用于显示检测装置,显示检测装置包括显示器、光线采集器和检测电路;显示器包括多个显示分区,光线采集器位于显示光的传出射光路上,光线采集器与检测电路耦合;上述显示检测方法包括:通过显示器的至少一个显示分区出射显示光;通过光线采集器采集从至少一个显示分区出射的显示光,并将采集的显示光转换为电信号形式的第一显示信息,向检测电路发送第一显示信息; 通过检测电路接收第一显示信息,并将第一显示信息与相应的显示分区的参考显示信息进行比较,以指示显示器是否显示异常。
本申请中,检测电路接收至少一个显示分区的参考显示信息以及光线采集器发送的第一显示信息,并对同一显示分区的第一显示信息与参考显示信息进行比较。若目标处理器直接与显示器耦合,并直接控制显示器显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器,和/或,目标处理器到显示器的传输路径出现故障,导致显示器显示异常;反之,显示器和目标处理器到显示器的传输路径正常。或者,若目标处理器间接与显示器耦合,并通过桥接芯片和/或显示控制器控制显示器显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器,和/或,显示控制器(或者桥接芯片)到显示器的传输路径出现故障,导致显示器显示异常;反之,显示器和显示控制器(或者桥接芯片)到显示器的传输路径正常。
在一些可能实现的方式中,显示检测装置还包括反射镜和调节显示光的光路调节组件,光路调节组件包括半透半反镜;光线采集器采集从至少一个显示分区出射的显示光,包括:利用反射镜将透过半透半反镜的至少一个显示分区的显示光,反射至光线采集器。
显示器出射的显示光投射到透镜组后,经透镜组调节,投射到半透半反镜上。投射到半透半反镜上的部分显示光经半透半反镜反射,投射到人眼,在驾驶员的正前方成虚像;投射到半透半反镜上的另一部分显示光从半透半反镜透射、并投射到反射镜上,该部分显示光经反射镜反射后,投射至光线采集器。其中,半透半反镜可以是汽车的前挡风玻璃。
光线采集器通过采集透过半透半反镜且被浪费掉的显示光,作为用于检测的显示光,可以在不影响投射至人眼的显示光的强度的情况下,对显示器进行检测。
在一些可能实现的方式中,显示检测装置还包括导光纤维;光线采集器采集从至少一个显示分区出射的显示光,包括:利用导光纤维将至少一个显示分区的显示光传输至光线采集器。本申请通过将导光纤维设置于显示器的出光侧,可以利用导光纤维将从至少一个显示分区出射的显示光传输至光线采集器。
在一些可能实现的方式中,通过检测电路接收第一显示信息,并将第一显示信息与相应的显示分区的参考显示信息进行比较,以指示显示器是否显示异常,包括:通过检测电路接收第一显示信息,并对第一显示信息进行图像处理;通过检测电路,根据参考显示信息,指示显示器是否正常显示。
第一种情况,每一显示区分包括至少一个像素区;通过检测电路接收第一显示信息,并对第一显示信息进行图像处理,包括:通过检测电路将第一显示信息转换为第二显示信息;每一像素区的第二显示信息的像素数据量,小于该像素区的第一显示信息的像素数据量。
可以利用第一图像处理模块对第一显示信息进行降维处理,以得到降维后的第二显示信息。这样一来,通过减小第二显示信息的像素数据量,可以降低检测电路比较过程中的计算量。
一些可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器中子 像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的数据位宽。
另一些可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,也可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的灰阶位宽。
第二种情况,光线采集器采集显示光的同时,可能会有部分环境光也被光线采集器采集到,从而影响检测电路的比较结果。基于此,还可以通过上述检测电路对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。经过滤波处理后的第三显示信息,滤除了除显示光以外的环境光,提高检测电路的检测精确度。
具体的,通过上述检测电路对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息的过程,具体包括:通过检测获取第一显示信息或第二显示信息的第一特征值;第一特征值用于指示显示器的显示数据;通过检测电路,根据第一特征值和参考显示信息,对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。
此外,在一些可能实现的方式中,显示光在投射至光线采集器之前,部分颜色子像素可能会发生色偏,例如红色子像素发生色偏,从而影响比较结果。基于此,若显示器显示全彩画面,还可以通过检测电路对第一显示信息(或者第二显示、第三显示信息)进行灰度转换,灰度转换后的第一显示信息(或者第二显示、第三显示信息)可以指示黑白画面,从而提高比较结果的准确性。
在一些可能实现的方式中,显示检测装置还包括目标处理器。
通过显示器的至少一个显示分区出射显示光,包括:通过目标处理器控制显示器的至少一个显示分区出射显示光。通过检测电路将第一显示信息与相应的显示分区的参考显示信息进行比较,以指示显示器是否显示异常之前,所述显示检测方法还包括:通过目标处理器向检测电路发送参考显示信息。
第一种情况,通过目标处理器发出第一理想数据或第一实际数据时,即可通过目标处理器将参考显示信息发送至检测电路,由检测电路存储。通过检测电路接收到光线采集器发送的第一显示信息,便可直接调用预先存储的参考显示信息。
第二种情况,也可以在通过目标处理器发出第一理想数据或第一实际数据之后,在通过检测电路接收第一显示信息之前,通过目标处理器向检测电路发送参考显示信息。
第三种情况,通过检测电路接收光线采集器发送的第一显示信息时,即可从目标处理器获取参考显示信息。
在一些可能实现的方式中,通过检测电路对相应显示分区的第二显示信息与参考显示信息进行比较,以指示显示器是否正常显示,包括:通过检测电路接收第二显示信息或第三显示信息;通过检测电路响应于第二显示信息或第三显示信息,在对第二显示信息(或者第三显示信息)与参考显示信息进行比较的过程通过软件代码实现的情况下,处理电路还用于执行该软件代码,对相应显示分区的第二显示信息(或者第三显示信息)与参考显示信息进行比较,以指示显示器是否显示异常。
在一些可能实现的方式中,上述检测电路包括处理电路和比较电路;通过检测电路对相应显示分区的第二显示信息与参考显示信息进行比较,以指示显示器是否正常显示,包括:通过处理电路接收第二显示信息或第三显示信息;通过处理电路响应于第二显示信息或第三显示信息,向比较电路发送控制信号;通过比较电路响应于控制信号,对相应显示分区的第二显示信息或第三显示信息,与参考显示信息进行比较,以指示显示器是否显示异常。
第四方面,本申请提供一种计算机可读存储介质,包括计算机程序或者说软件代码,当所述计算机程序或者说软件代码在显示检测装置上运行时,使得所述显示检测装置执行如第一方面所述的步骤。
第五方面,本申请提供一种计算机程序,该计算机程序包括用于执行第一方面的任意可能的实现方式中的步骤的指令。
附图说明
图1为本申请实施例提供的一种显示检测装置中各结构的关系图以及显示光的光路图;
图2为本申请实施例提供的HUD的显示效果图;
图3为本申请实施例提供的另一种显示检测装置中各结构的关系图以及显示光的光路图;
图4为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图5为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图6a为本申请实施例提供的显示器的多个显示分区的一种划分图;
图6b为本申请实施例提供的显示器的多个显示分区的另一种划分图;
图7为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图8为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图9a为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图9b为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图10为本申请实施例提供的一种图像处理效果图;
图11为本申请实施例提供的又一种显示检测装置中各结构的关系图以及显示光的光路图;
图12为本申请实施例提供的一种显示检测方法的流程示意图。
附图标记:
101-目标处理器;1011-第一比较模块;102-显示器;103-光路调节组件;1031-透镜 组;1032-半透半反镜;104-桥接芯片;1041-第二比较模块;105-显示控制器;1051-第三比较模块;106-光线采集器;107-检测电路;1071-第一图像处理模块;1072-第二图像处理模块;1073-处理电路;1074-比较电路;108-安全处理模块;109-反射镜;11-显示分区。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚,下面将结合本申请中的附图,对本申请中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书实施例和权利要求书及附图中的术语“第一”、“第二”等仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。“和/或”,用于描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:只存在A,只存在B以及同时存在A和B三种情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“安装”、“连接”、“相连”等应做广义理解,例如可以是固定连接,也可以是可拆卸连接,或者一体地连接;可以是直接连接,也可以是通过中间媒介间接,也可以是两个元件内部的连通。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元。方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。“上”、“下”、“左”、“右”等仅用于相对于附图中的部件的方位而言的,这些方向性术语是相对的概念,它们用于相对于的描述和澄清,其可以根据附图中的部件所放置的方位的变化而相应地发生变化。
本申请实施例提供一种显示检测系统,该显示检测系统包括终端和显示检测装置。该显示检测装置可以包括既有的HUD,如图1所示,HUD可以包括目标处理器101、显示器102和光路调节组件103。目标处理器101与显示器102耦合,用于控制显示器102显示画面;显示器102在目标处理器101的控制下,出射显示光,显示与终端相关的重要信息;光路调节组件103设置于显示光的出射光路上,显示光投射至光路调节组件103后,经光路调节组件103调节,在终端的目标位置成虚像,以在用户使用终端时,被用户看到该虚像。
此处需要说明的是,第一,光路调节组件103设置于显示光的出射光路上,即,基于显示器102和光路调节组件103的设置位置,以及显示光的出射方向,从显示器102出射的显示光中的至少部分可以投射至光路调节组件103。下文出现的一个物体设置在显示光的出射光路上,或者一个物体设置在另外两个物体之间的光路上,均可如此解释,下文不再赘述。
第二,根据终端的类型以及实际需求,上述目标位置可以是相对于终端的任意位置。一些可能实现的方式中,目标位置可以是固定的,即,虚像相对于终端的位置固定。此情况下,上述虚像可以呈现与终端相关的告警图标、状态图标和数字等。另一些可能实现的方式中,目标位置也可以是变化的,例如,显示器102的位置发生随机变化,相对 于终端的目标位置也随之变化,虚像相对于终端的位置可变。此情况下,虚像可以呈现与终端相关的大小和形状可变的图标、线形图标、数字等。
上述终端可以是汽车、飞机、头显设备等适用于HUD的设备。
以终端为汽车或飞机为例,如图2所示,上述虚像可以成在汽车或飞机驾驶室的正前方,虚像的显示内容可以包括汽车或飞机当前的时速、油量等行驶信息。
以终端为头显设备为例,虚像可以成在佩戴头显设备的用户的眼睛正前方,虚像的显示内容可以是电影、游戏等。
当然,终端还可以是其他设备,本申请实施例对此不作限定。为了方便说明,下文以终端为汽车进行举例说明。
如图3所示,上述HUD除了包括目标处理器101、显示器102和光路调节组件103以外,还可以包括支持安全功能的桥接芯片104和显示控制器105。
上述桥接芯片104可以集成在目标处理器101与显示器102的信号传输路径之间,用于在安全告警信息等不能正确显示时,使显示检测系统进入安全状态,安全状态表现为:能够告知驾驶员,当前的显示检测系统出现异常。
示例的,驾驶员未系安全带告警、刹车系统故障等相关图标不能正常显示时,桥接芯片104可以向显示器102发送信号,控制显示器102显示开机图标或其他特殊图标(例如叹号),以进入安全状态。当然,也可以以其他方式体现上述安全状态,例如汽车内部声音提醒、震动方向盘或座椅、点亮汽车内灯光等。
上述显示控制器105可以集成在桥接芯片104与显示器102的信号传输路径之间,用于在目标处理器101的控制下,控制显示器102显示画面。在显示检测系统处于安全状态时,还可以在桥接芯片104的控制下,控制显示器102显示开机图标或其他特殊图标。
在HUD中,若目标处理器101、显示器102和桥接芯片104中的任意一个出现故障,将导致显示器102不能正确显示上述行驶信息,驾驶员看到的虚像内容有误,可能发生不必要的安全事故。因此,应及时检测目标处理器101、显示器102和桥接芯片104是否出现故障。在本申请实施例中,显示检测系统除了在终端的目标位置成虚像以外,还还可以检测目标处理器101、显示器102和桥接芯片104是否出现故障。
如图4所示,对于目标处理器101、桥接芯片104和显示控制器105,可以采用在目标处理器101中集成第一比较模块1011、在桥接芯片104中集成第二比较模块1041、在显示控制器105中集成第三比较模块1051的方式,来分别检测目标处理器101、桥接芯片104和显示控制器105是否出现故障。
具体的,目标处理器101可以向第一比较模块1011发送第一实际数据和第一控制信号,在第一控制信号的控制下,第一比较模块1011可以产生第一理想数据。第一比较模块1011对接收到的第一实际数据与第一理想数据进行比较,若第一实际数据与第一理想数据之间的差值超出第一阈值范围,则说明目标处理器101出现故障,第一比较器1011向桥接芯片104发送第一理想数据;反之,目标处理器101正常,第一比较器1011向桥接芯片104发送第一理想数据或者第一实际数据。
桥接芯片104接收到第一理想数据或第一实际数据后,产生第二实际数据,并将第 二实际数据发送至第二比较模块1041。目标处理器101还可以向第二比较模块1041发送第二控制信号,在第二控制信号的控制下,第二比较模块1041可以产生第二理想数据。第二比较模块1041对接收到的第二实际数据与第二理想数据进行比较,若第二实际数据与第二理想数据之间的差值超出第二阈值范围,则说明桥接芯片104,和/或,第一比较模块1011到桥接芯片104的传输路径出现故障,第二比较模块1041向显示控制器105发送第二理想数据;反之,桥接芯片104和第一比较模块1011到桥接芯片104的传输路径正常,第二比较模块1041向显示控制器105发送第二理想数据或者第二实际数据。
显示控制器105接收到第二理想数据或第二实际数据后,产生第三实际数据,并将第三实际数据发送至第三比较模块1051。目标处理器101还可以向第三比较模块1051发送第三控制信号,在第三控制信号的控制下,第三比较模块1051可以产生第三理想数据。第三比较模块1051对接收到的第三实际数据与第三理想数据进行比较,若第三实际数据与第三理想数据之间的差值超出第三阈值范围,则说明显示控制器105,和/或,第二比较模块1041到显示控制器105的传输路径出现故障,第三比较模块1051向显示器102发送第三理想数据;反之,显示控制器105和第二比较模块1041到显示控制器105的传输路径正常,第三比较模块1051向显示器102发送第三理想数据或者第三实际数据。
此处需要说明的是,上述第一实际数据、第二实际数据和第三实际数据,分别为目标处理器101、桥接芯片104和显示控制器105产生的、用于指示显示器102显示画面的实际信号。上述第一理想数据、第二理想数据和第三理想数据,分别为目标处理器101、桥接芯片104和显示控制器105产生的,用于指示显示器102显示画面的理想信号。第一阈值范围、第二阈值范围和第三阈值范围,可以基于厂家或客户的需求,适应性的设置合理的范围,本申请实施例对此不作限定。
当然,如图1所示,目标处理器101也可以直接控制显示器102显示画面。为方便描述,下文除另外说明以外,均以图3示出的目标处理器101通过桥接芯片104和显示控制器105控制显示器102显示画面为例进行说明。
前文介绍了目标处理器101、显示器102、桥接芯片104和显示控制器105中的任意一个出现故障,即可导致显示器102不能正确显示行驶信息。并且,介绍了检测目标处理器101、桥接芯片104和显示控制器105是否出现故障的方法。而对于显示器102,一方面,各个供应商提供的显示器102的参数不同,无法如前述目标处理器101、桥接芯片104和显示控制器105,统一在数字端对显示器102进行检测;另一方面,发明人发现,当前显示检测系统的设计,均未部署回采显示光的器件及检测显示光的电路。因此,对于显示检测系统中显示器102的检测,仍处于技术空白状态。
基于此,如图5所示,本申请实施例提供一种显示检测装置,该显示检测装置在既有的HUD的基础上,增加光线采集器106和检测电路107,避免额外增加单独的检测装置,可以节约检测成本。
显示器102包括多个显示分区,显示器102的至少一个显示分区出射显示光(图中虚线箭头部分表示显示光)。
光线采集器106,光线采集器106设置于显示光的出射光路上,用于采集从至少一个显示分区出射的显示光,并将采集的显示光转换为电信号形式的第一显示信息,向检测 电路107发送第一显示信息。
检测电路107,光线采集器106与检测电路107耦合,用于接收第一显示信息,并将第一显示信息与相应的显示分区的参考显示信息进行比较,以指示显示器102是否显示异常。
在上述基础上,如图5所示,显示检测装置还可以包括安全处理模块108。安全处理模块108与检测电路107耦合。检测电路107可以将显示器102是否正常显示的比较结果发送至安全处理模块108。当比较结果为指示显示器102显示异常时,安全处理模块108可以针对显示器102显示异常采取一系列措施,以提醒用户。
例如,安全处理模块108可以与显示器102耦合,接收显示器102显示异常的比较结果,并控制显示器102复位。或者,安全处理模块108也可以与目标处理器101耦合,接收显示器102显示异常的比较结果,并利用目标处理器101来控制显示器102复位。
或者,安全处理模块108可以与汽车的控制电路耦合,汽车的控制电路可以与汽车的喇叭、座椅、方向盘等中的至少一个耦合。安全处理模块108接收显示器102显示异常的比较结果,并控制喇叭发声告警、或座椅振动、或方向盘振动等。
当然,还可以采用其他方式使显示器102复位,其他可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。
另外,前述显示控制器105、第二比较模块1041到显示控制器105的传输路径、桥接芯片104、第一比较模块1011到桥接芯片104的传输路径、目标处理器101中的任意一个出现故障,也可以通过安全处理模块108采取上述措施,以提醒用户。
在一些可能实现的方式中,本申请实施例不对显示分区11的划分方式进行限定。可选的,如图6a和图6b所示,每一显示分区11可以包括至少一个像素区,每一像素区具有一个像素单元。若显示器102可以显示全彩画面,则每一像素单元包括可以构成三基色的至少三个子像素,构成三基色的三个子像素可以分别为红色子像素、绿色子像素、蓝色子像素;或者,构成三基色的三个子像素也可以分别为黄色子像素、青色子像素、品红色子像素。当然,本申请的显示器102也可以显示黑白画面,本申请实施例对此不作限定。
如图6a所示,各个显示分区11中包含的子像素的个数均相同。例如,每一显示分区11均包括三个像素区,三个子像素区共计具有9个子像素。
或者,如图6b所示,各个显示分区11中包含的子像素的个数至少部分不相同。例如,部分显示分区11包括三个像素区,三个子像素区共计具有9个子像素;部分显示分区11包括四个像素区,四个子像素区共计具有12个子像素;部分显示分区11包括两个像素区,两个子像素区共计具有6个子像素。
此处需要说明的是,显示器102的各个显示分区11均可显示画面,基于此,光线采集器106可以采集部分显示分区11的显示光,用于检测电路107检测;光线采集器106也可以采集所有显示分区11的显示光,用于检测电路107检测。
对于光线采集器106采集部分显示分区11的显示光,用于检测电路107检测的情况,其原因可以是显示器102在显示某一画面时,只有部分显示分区11显示画面,另一部分显示分区11为黑画面。当然,也可以是因为显示检测装置用来检测显示器102的部分显 示分区11是否显示异常,无需检测显示器102的另一部分显示分区11是否显示异常。
在一些可能实现的方式中,本申请实施例不对光线采集器106采集显示光的方式进行限定,只要光线采集器106可以接收显示光,并将显示光转换为电信号的第一显示信号即可,以使得第一显示信号以电信号形式在光线采集器106和检测电路107中传输。
具体的,第一种情况,如图5所示,显示检测装置还包括反射镜109。光路调节组件103可以包括透镜组1031和半透半反镜1032,透镜组1031设置于显示器102与半透半反镜1032之间的光路上,反射镜109设置于半透半反镜1032与光线采集器106之间的光路上。
显示器102出射的显示光投射到透镜组1031后,经透镜组1031调节,投射到半透半反镜1032上。投射到半透半反镜1032上的部分显示光经半透半反镜1032反射,投射到人眼,在驾驶员的正前方成虚像;投射到半透半反镜1032上的另一部分显示光从半透半反镜1032透射、并投射到反射镜109上,该部分显示光经反射镜109反射后,投射至光线采集器106。光线采集器106接收显示光,并将显示光转换为电信号形式的第一显示信号。
此情况下,光线采集器106通过采集透过半透半反镜1032且被浪费掉的显示光,作为用于检测的显示光,可以在不影响投射至人眼的显示光的强度的情况下,对显示器102进行检测。此外,显示器102例如可以设置在驾驶座椅上,汽车的前挡风玻璃可以用作半透半反镜1032。当然,显示器102和半透半反镜1032的设置位置还可以是其他,本申请实施例对此不作限定。
第二种情况,如图7所示,显示检测装置还包括导光纤维110,导光纤维110具有传输光线的功能。本申请通过将导光纤维110设置于显示器102的出光侧,将从至少一个显示分区11出射的显示光传输至光线采集器106。光线采集器106接收显示光,并将显示光转换为电信号形式的第一显示信号。
此处需要说明的是,本申请实施例不对导光纤维110的具体设置位置进行限定,只要导光纤维设置于显示器102的出光侧,并可以将显示光传输至光线采集器106即可。可选的,如图7所示,光线采集器106可以设置在透镜组1031上。
当然,光线采集器106还可以通过其他方式采集显示光,本申请实施例对此不作限定。
在一些可能实现的方式中,本申请实施例不对光线采集器106的具体结构和型号进行限定,只要光线采集器106兼具采集显示光,以及将光信号转换为电信号的功能即可。例如,光线采集器106可以是光电摄像机(emitron camera)。
在一些可能实现的方式中,检测电路107将第一显示信息与相应的显示分区11的参考显示信息进行比较,具体包括:检测电路107接收至少一个显示分区11的参考显示信息以及光线采集器106发送的第一显示信息,并对同一显示分区11的第一显示信息与参考显示信息进行比较。如图7所示,若目标处理器101直接与显示器102耦合,并直接控制显示器102显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器102,和/或,目标处理器101到显示器102的传输路径出现故障,导致显示器102显示异常;反之,显示器102和目标处理器101到显示器102的 传输路径正常。或者,参考图4,若目标处理器101间接与显示器102耦合,并通过桥接芯片104和/或显示控制器105控制显示器102显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器102,和/或,显示控制器105(或者桥接芯片)到显示器102的传输路径出现故障,导致显示器102显示异常;反之,显示器102和显示控制器105(或者桥接芯片)到显示器102的传输路径正常。
此处需要说明的是,第一,检测电路107接收第一显示信息和参考显示信息的同时,即可对同一显示分区11的第一显示信息和参考显示信息进行比较;或者,检测电路107接收第一显示信息和参考显示信息后,可以经历一段延时,再对同一显示分区11的第一显示信息和参考显示信息进行比较,本申请实施例对此不作限定。考虑到及时提示驾驶员显示异常,避免不必要的以外发生,可选的,本申请实施例的检测电路107在接收第一显示信息和参考显示信息的同时,便对同一显示分区11的第一显示信息和参考显示信息进行比较。
第二,对第一显示信息与参考显示信息进行比较的过程,可以通过硬件电路实现,也可以通过软件代码实现,本申请实施例对此不作限定。其中,显示检测装置还可以包括存储器,若通过软件代码实现第一显示信息与参考显示信息的比较过程,则上述软件代码可以存储在存储器中。
第三,上述第一显示信息为显示器102显示的画面对应的实际信号。上述参考显示信息为目标处理器101、或者桥接芯片104、或者显示控制器105产生的、用于指示显示器102显示画面的理想信号。第四阈值范围可以基于厂家或客户的需求,适应性的设置合理的范围,本申请实施例对此不作限定。
在一些可能实现的方式中,不论目标处理器101直接与显示器102耦合与否,目标处理器101都可以直接或间接的控制显示器102显示画面。本领域的技术人员应该知道,目标处理器101在预先确定显示器102应该显示何种画面的情况下,才能控制显示器102显示正确的画面。因此,目标处理器101可以预存储显示器102应该显示的画面对应的信息,即,显示器102的参考显示信息。并且,还可以由目标处理器101将同一帧画面的参考显示信息发送至检测电路107。此情况下,检测电路107可以集成于目标处理器101中,以缩短目标处理器101与检测电路107之间的路径。
具体的,目标处理器101发出第一理想数据或第一实际数据时,即可将参考显示信息发送至检测电路107,由检测电路107存储。检测电路107接收到光线采集器106发送的第一显示信息,便可直接调用预先存储的参考显示信息。
或者,目标处理器101也可以在发出第一理想数据或第一实际数据之后,在检测电路107接收第一显示信息之前,向检测电路107发送参考显示信息。
或者,检测电路107接收光线采集器106发送的第一显示信息,即可从目标处理器101获取参考显示信息。相较于前述两种方式,本方式可以无需在检测电路107中集成存储电路,用于存储参考显示信息,从而可以节省检测电路107所占的版图面积。
在一些可能实现的方式中,第一显示信息和参考显示信息可以指示显示器102的显示数据,显示数据例如可以是亮度信息、亮点信息、灰阶信息等。
以第一显示信息和参考显示信息指示显示器102显示的画面的亮度信息为例,第一 显示信息指示显示器102显示的画面的实际亮度,参考显示信息指示显示器102显示的画面的理想亮度。基于此,对第一显示信息与参考显示信息进行比较的具体过程可以包括:对一个显示分区11内的多个子像素实际亮度进行累加,对一个显示分区11内的多个子像素的理想亮度进行累加,并对二者的累加值进行比较。
以第一显示信息和参考显示信息指示显示器102显示的画面的亮点信息为例,第一显示信息指示显示器102显示一帧画面时的实际亮点,参考显示信息指示显示器102显示同一帧画面时的理想亮点。基于此,对第一显示信息与参考显示信息进行比较的具体过程可以包括:逐行计算各个显示分区11中实际亮点和理想亮点的标准差。
当然,本申请实施例还可以采用其他方式对第一显示信息与参考显示信息进行比较,例如基于第一显示信息和参考显示信息进行哈希计算、循环冗余码校验(cyclic redundancy code,CRC)等。其他可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。
在一些实施例中,如图8所示,检测电路107还可以包括第一图像处理模块1071,第一图像处理模块1071用于将第一显示信息转换为第二显示信息,每一像素区的第二显示信息的像素数据量,小于该像素区的第一显示信息的像素数据量。即,利用第一图像处理模块1071对第一显示信息进行降维处理,以得到降维后的第二显示信息。这样一来,通过减小第二显示信息的像素数据量,可以降低检测电路107比较过程中的计算量。
一些可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器102中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的数据位宽。
示例的,第一显示信息指示的红色子像素的数据位宽为8位,从0~255,除0以外,可以显示255种不同的红色。而像素数据量更小的第二显示信息指示的红色子像素的数据位宽为4位,从0~15,除0以外,可以显示15种不同的红色。
另一些可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器102中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,也可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的灰阶位宽。
示例的,第一显示信息指示的显示画面的灰阶位宽为8位,从0~255,即,显示器102显示的画面可以有256种不同的灰阶。而像素数据量更小的第二显示信息指示的显示画面的灰阶位宽为2位,从0~3,即,显示器102显示的画面可以有4种不同的灰阶。
在一些实施例中,光线采集器106采集显示光的同时,可能会有部分环境光也被光线采集器106采集到,从而影响检测电路107的比较结果。基于此,如图9a和图9b所示,检测电路107还可以包括第二图像处理模块1072。如图10所示,第二图像处理模块1072对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。经过滤波处理后的第三显示信息,滤除了除显示光以外的环境光,提高检测电路107的检测精确度。
具体的,第二图像处理模块1072用于获取第一显示信息或第二显示信息的第一特征值,第一特征值用于指示显示器102的显示数据;第二图像处理模块1072还用于根据第 一特征值和参考显示信息,对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。
以显示数据为灰阶信息为例,第二图像处理模块1072根据参考显示信息,可以确定各个子像素的理想显示灰阶,以及显示器102显示的画面的轮廓。基于此,可以根据参考显示信息,设定各个子像素的灰阶阈值范围,对灰阶超出灰阶阈值范围的子像素进行滤波处理;灰阶在灰阶阈值范围的子像素,保留其原有灰阶。
例如,第二图像处理模块1072根据参考显示信息,确定坐标为(8,200)的子像素的灰阶阈值范围为[15,20],而第一显示信息指示的该子像素的实际灰阶为25,超出了灰阶阈值范围,因此,滤除该子像素的显示信息。
又例如,第二图像处理模块1072根据参考显示信息,确定坐标为(1,3)的子像素的灰阶阈值范围为[0,3],而第二显示信息指示的该子像素的实际灰阶为2,在灰阶阈值范围内,因此,保留该子像素的显示信息。
此外,需要说明的是,第一,在检测电路107同时包括第一图像处理模块1071和第二图像处理模块1072的情况下,上述说明示出了先对第一显示信息进行降维处理,得到第二显示信息,再对第二显示信息进行滤波处理,得到第三显示信息。当然,在检测电路107同时包括第一图像处理模块1071和第二图像处理模块1072的情况下,还可以先对第一显示信息进行滤波处理,再进行降维处理,本申请实施例对此不作限定。
第二,上述降维处理和滤波处理,可以通过硬件电路实现,也可以通过软件代码实现。也可以说,上述第一图像处理模块1071和第二图像处理模块1072可以是硬件电路,也可以是软件代码。其中,显示检测装置还可以包括存储器,若通过软件代码实现降维处理和滤波处理,则上述软件代码可以存储在存储器中。
此外,在一些实施例中,显示光在投射至光线采集器106之前,部分颜色子像素可能会发生色偏,例如红色子像素发生色偏,从而影响比较结果。基于此,若显示器102显示全彩画面,检测电路107还可以对第一显示信息(或者第二显示、第三显示信息)进行灰度转换,灰度转换后的第一显示信息(或者第二显示、第三显示信息)可以指示黑白画面,从而提高比较结果的准确性。
另外,在一些实施例中,如图11所示,检测电路107还可以包括处理电路1073。处理电路1073用于接收前述第一图像处理模块1071发送的第二显示信息,或者第二图像处理模块1072发送的第三显示信息。在对第二显示信息(或者第三显示信息)与参考显示信息进行比较的过程通过软件代码实现的情况下,处理电路1073还用于执行该软件代码,对相应显示分区11的第二显示信息(或者第三显示信息)与参考显示信息进行比较,以指示显示器102是否显示异常。
在另一些实施例中,如图9a和图9b所示,除上述处理电路1073以外,检测电路107还可以包括比较电路1074。处理电路1073用于接收前述第一图像处理模块1071发送的第二显示信息,或者第二图像处理模块1072发送的第三显示信息,产生控制信号,并将控制信号发送至比较电路1074。比较电路1074用于响应于该控制信号,对相应显示分区11的第二显示信息(或第三显示信息)与参考显示信息进行比较,以指示显示器102是否显示异常。
需要说明的是,上述对相应显示分区11的第二显示信息(或第三显示信息)与参考显示信息进行比较的方法,与对相应显示分区11的第一显示信息与参考显示信息进行比较的方法相同,对此不再赘述。
本申请实施例还提供一种显示检测方法,应用于显示检测装置,显示检测装置包括显示器102、光线采集器106和检测电路107。显示器102包括多个显示分区11,光线采集器106位于显示光的传出射光路上,光线采集器106与检测电路107耦合;如图12所示,该显示检测方法可以通过如下步骤实现:
S110,如图5所示,通过显示器102的至少一个显示分区11出射显示光(图中虚线箭头部分表示显示光)。
在一些可能实现的方式中,本申请实施例不对显示分区11的划分方式进行限定。可选的,如图6a和图6b所示,每一显示分区11可以包括至少一个像素区,每一像素区具有一个像素单元。若显示器102可以显示全彩画面,则每一像素单元包括可以构成三基色的至少三个子像素,构成三基色的三个子像素可以分别为红色子像素、绿色子像素、蓝色子像素;或者,构成三基色的三个子像素也可以分别为黄色子像素、青色子像素、品红色子像素。当然,本申请的显示器102也可以显示黑白画面,本申请实施例对此不作限定。
如图6a所示,各个显示分区11中包含的子像素的个数均相同。例如,每一显示分区11均包括三个像素区,三个子像素区共计具有9个子像素。
或者,如图6b所示,各个显示分区11中包含的子像素的个数至少部分不相同。例如,部分显示分区11包括三个像素区,三个子像素区共计具有9个子像素;部分显示分区11包括四个像素区,四个子像素区共计具有12个子像素;部分显示分区11包括两个像素区,两个子像素区共计具有6个子像素。
S120,通过光线采集器106采集从至少一个显示分区11出射的显示光,并将采集的显示光转换为电信号形式的第一显示信息,向检测电路107发送第一显示信息。
显示器102的各个显示分区11均可显示画面,基于此,可以通过光线采集器106采集部分显示分区11的显示光,用于检测电路107检测;也可以通过光线采集器106采集所有显示分区11的显示光,用于检测电路107检测。
对于通过光线采集器106采集部分显示分区11的显示光,用于检测电路107检测的情况,其原因可以是显示器102在显示某一画面时,只有部分显示分区11显示画面,另一部分显示分区11为黑画面。当然,也可以是因为显示检测装置用来检测显示器102的部分显示分区11是否显示异常,无需检测显示器102的另一部分显示分区11是否显示异常。
在一些可能实现的方式中,本申请实施例不对通过光线采集器106采集显示光的方式进行限定,只要光线采集器106可以接收显示光,并将显示光转换为电信号的第一显示信号即可,以使得第一显示信号以电信号形式在光线采集器106和检测电路107中传输。
具体的,第一种情况,如图5所示,显示检测装置还包括反射镜109。光路调节组件 103可以包括透镜组1031和半透半反镜1032,透镜组1031设置于显示器102与半透半反镜1032之间的光路上,反射镜109设置于半透半反镜1032与光线采集器106之间的光路上。
显示器102出射的显示光投射到透镜组1031后,经透镜组1031调节,投射到半透半反镜1032上。投射到半透半反镜1032上的部分显示光经半透半反镜1032反射,投射到人眼,在驾驶员的正前方成虚像;投射到半透半反镜1032上的另一部分显示光从半透半反镜1032透射、并投射到反射镜109上,该部分显示光经反射镜109反射后,投射至光线采集器106。光线采集器106接收显示光,并将显示光转换为电信号形式的第一显示信号。
此情况下,通过光线采集器106采集透过半透半反镜1032且被浪费掉的显示光,作为用于检测的显示光,可以在不影响投射至人眼的显示光的强度的情况下,对显示器102进行检测。此外,显示器102例如可以设置在驾驶座椅上,汽车的前挡风玻璃可以用作半透半反镜1032。当然,显示器102和半透半反镜1032的设置位置还可以是其他,本申请实施例对此不作限定。
第二种情况,如图7所示,显示检测装置还包括导光纤维110,导光纤维110具有传输光线的功能。本申请通过将导光纤维110设置于显示器102的出光侧,利用导光纤维110将从至少一个显示分区11出射的显示光传输至光线采集器106。光线采集器106接收显示光,并将显示光转换为电信号形式的第一显示信号。
此处需要说明的是,本申请实施例不对导光纤维110的具体设置位置进行限定,只要导光纤维设置于显示器102的出光侧,且可以通过导光纤维110将显示光传输至光线采集器106即可。可选的,如图7所示,光线采集器106可以设置在透镜组1031上。
当然,还可以利用其他方式,通过光线采集器106采集显示光,本申请实施例对此不作限定。
在一些可能实现的方式中,本申请实施例不对光线采集器106的具体结构和型号进行限定,只要光线采集器106兼具采集显示光,以及将光信号转换为电信号的功能即可。例如,光线采集器106可以是光电摄像机。
S130,通过检测电路107接收第一显示信息,并将第一显示信息与相应的显示分区11的参考显示信息进行比较,以指示显示器102是否显示异常。
如图5所示,显示检测装置还可以包括安全处理模块108。安全处理模块108与检测电路107耦合。可以通过检测电路107将显示器102是否正常显示的比较结果发送至安全处理模块108。当比较结果为指示显示器102显示异常时,可以通过安全处理模块108针对显示器102显示异常采取一系列措施,以提醒用户。
例如,安全处理模块108可以与显示器102耦合,接收显示器102显示异常的比较结果。当比较结果为指示显示器102显示异常时,可以通过安全处理模块108控制显示器102复位。
或者,安全处理模块108也可以与目标处理器101耦合,接收显示器102显示异常的比较结果。当比较结果为指示显示器102显示异常时,可以通过安全处理模块108利用目标处理器101来控制显示器102复位。
或者,安全处理模块108可以与汽车的控制电路耦合,汽车的控制电路可以与汽车的喇叭、座椅、方向盘等中的至少一个耦合。安全处理模块108接收显示器102显示异常的比较结果,当比较结果为指示显示器102显示异常时,可以通过安全处理模块108控制喇叭发声告警、或座椅振动、或方向盘振动等。
当然,还可以采用其他方式使显示器102复位,其他可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。
在一些可能实现的方式中,通过检测电路107将第一显示信息与相应的显示分区11的参考显示信息进行比较,具体包括:通过检测电路107接收至少一个显示分区11的参考显示信息以及光线采集器106发送的第一显示信息,并对同一显示分区11的第一显示信息与参考显示信息进行比较。如图7所示,若目标处理器101直接与显示器102耦合,并直接控制显示器102显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器102,和/或,目标处理器101到显示器102的传输路径出现故障,导致显示器102显示异常;反之,显示器102和目标处理器101到显示器102的传输路径正常。或者,参考图4,若目标处理器101间接与显示器102耦合,并通过桥接芯片104和/或显示控制器105控制显示器102显示画面,则在第一显示信息与参考显示信息之间的差值超出第四阈值范围的情况下,说明显示器102,和/或,显示控制器105(或者桥接芯片)到显示器102的传输路径出现故障,导致显示器102显示异常;反之,显示器102和显示控制器105(或者桥接芯片)到显示器102的传输路径正常。
此处需要说明的是,第一,通过检测电路107接收第一显示信息和参考显示信息的同时,即可对同一显示分区11的第一显示信息和参考显示信息进行比较;或者,通过检测电路107接收第一显示信息和参考显示信息后,可以经历一段延时,再对同一显示分区11的第一显示信息和参考显示信息进行比较,本申请实施例对此不作限定。考虑到及时提示驾驶员显示异常,避免不必要的以外发生,可选的,通过检测电路107接收第一显示信息和参考显示信息的同时,便对同一显示分区11的第一显示信息和参考显示信息进行比较。
第二,对第一显示信息与参考显示信息进行比较的过程,可以通过硬件电路实现,也可以通过软件代码实现,本申请实施例对此不作限定。其中,显示检测装置还可以包括存储器,若通过软件代码实现第一显示信息与参考显示信息的比较过程,则上述软件代码可以存储在存储器中。
第三,上述第一显示信息为显示器102显示的画面对应的实际信号。上述参考显示信息为通过目标处理器101、或者桥接芯片104、或者显示控制器105产生的,用于指示显示器102显示画面的理想信号。第四阈值范围可以基于厂家或客户的需求,适应性的设置合理的范围,本申请实施例对此不作限定。
在一些可能实现的方式中,不论目标处理器101直接与显示器102耦合与否,都可以直接或间接的通过目标处理器101控制显示器102显示画面。本领域的技术人员应该知道,在预先确定显示器102应该显示何种画面的情况下,才能通过目标处理器101控制显示器102显示正确的画面。因此,可以通过目标处理器101预存储显示器102应该显示的画面对应的信息,即,显示器102的参考显示信息。并且,还可以通过目标处理 器101将同一帧画面的参考显示信息发送至检测电路107。此情况下,检测电路107可以集成于目标处理器101中,以缩短目标处理器101与检测电路107之间的路径。
具体的,通过目标处理器101发出第一理想数据或第一实际数据时,即可通过目标处理器101将参考显示信息发送至检测电路107,由检测电路107存储。通过检测电路107接收到光线采集器106发送的第一显示信息时,便可直接调用预先存储的参考显示信息。
或者,也可以在通过目标处理器101发出第一理想数据或第一实际数据之后,在检测电路107接收第一显示信息之前,通过目标处理器101向检测电路107发送参考显示信息。
或者,通过检测电路107接收光线采集器106发送的第一显示信息时,即可从目标处理器101获取参考显示信息。相较于前述两种方式,本方式可以无需在检测电路107中集成存储电路,用于存储参考显示信息,从而可以节省检测电路107所占的版图面积。
在一些可能实现的方式中,第一显示信息和参考显示信息可以指示显示器102的显示数据,显示数据例如可以是亮度信息、亮点信息、灰阶信息等。
以第一显示信息和参考显示信息指示显示器102显示的画面的亮度信息为例,第一显示信息指示显示器102显示的画面的实际亮度,参考显示信息指示显示器102显示的画面的理想亮度。基于此,对第一显示信息与参考显示信息进行比较的具体过程可以包括:对一个显示分区11内的多个子像素实际亮度进行累加,对一个显示分区11内的多个子像素的理想亮度进行累加,并对二者的累加值进行比较。
以第一显示信息和参考显示信息指示显示器102显示的画面的亮点信息为例,第一显示信息指示显示器102显示一帧画面时的实际亮点,参考显示信息指示显示器102显示同一帧画面时的理想亮点。基于此,对第一显示信息与参考显示信息进行比较的具体过程可以包括:逐行计算各个显示分区11中实际亮点和理想亮点的标准差。
当然,本申请实施例还可以采用其他方式对第一显示信息与参考显示信息进行比较,例如基于第一显示信息和参考显示信息进行哈希计算、循环冗余码校验等。其他可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。
在一些实施例中,通过检测电路107接收第一显示信息,并将第一显示信息与相应的显示分区11的参考显示信息进行比较,以指示显示器102是否显示异常,可以包括:
S131,通过检测电路107接收第一显示信息,并对第一显示信息进行图像处理。
具体的,参考图8,在一些可能实现的方式中,还可以通过检测电路107将第一显示信息转换为第二显示信息,每一像素区的第二显示信息的像素数据量,小于该像素区的第一显示信息的像素数据量。即,利用检测电路107对第一显示信息进行降维处理,以得到降维后的第二显示信息。这样一来,通过减小第二显示信息的像素数据量,可以降低检测电路107比较过程中的计算量。
一种可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器102中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的数据位宽。
示例的,第一显示信息指示的红色子像素的数据位宽为8位,从0~255,除0以外,可以显示255种不同的红色。而像素数据量更小的第二显示信息指示的红色子像素的数据位宽为4位,从0~15,除0以外,可以显示15种不同的红色。
另一种可能实现的方式中,在第一显示信息对应的子像素的数量,相较于显示器102中子像素的实际数据不变或减小的情况下,将第一显示信息转换为像素数据量更小的第二显示信息,具体的,也可以是降低每一子像素(例如红色子像素、绿色子像素和蓝色子像素)的灰阶位宽。
示例的,第一显示信息指示的显示画面的灰阶位宽为8位,从0~255,即,显示器102显示的画面可以有256种不同的灰阶。而像素数据量更小的第二显示信息指示的显示画面的灰阶位宽为2位,从0~3,即,显示器102显示的画面可以有4种不同的灰阶。
在一些可能实现的方式中,通过光线采集器106采集显示光的同时,可能会有部分环境光也被光线采集器106采集到,从而影响检测电路107的比较结果。基于此,参考图9a和图9b,还可以通过检测电路107对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。经过滤波处理后的第三显示信息,滤除了除显示光以外的环境光,提高检测电路107的检测精确度。
具体的,可以通过检测电路107获取第一显示信息或第二显示信息的第一特征值,第一特征值用于指示显示器102的显示数据;还可以通过检测电路107根据第一特征值和参考显示信息,对第一显示信息或第二显示信息进行滤波处理,以得到第三显示信息。
以显示数据为灰阶信息为例,通过检测电路107根据参考显示信息,可以确定各个子像素的理想显示灰阶,以及显示器102显示的画面的轮廓。基于此,可以根据参考显示信息,设定各个子像素的灰阶阈值范围,对灰阶超出灰阶阈值范围的子像素进行滤波处理;灰阶在灰阶阈值范围的子像素,保留其原有灰阶。
例如,通过检测电路107,根据参考显示信息,确定坐标为(8,200)的子像素的灰阶阈值范围为[15,20],而第一显示信息指示的该子像素的实际灰阶为25,超出了灰阶阈值范围,因此,滤除该子像素的显示信息。
又例如,通过检测电路107,根据参考显示信息,确定坐标为(1,3)的子像素的灰阶阈值范围为[0,3],而第二显示信息指示的该子像素的实际灰阶为2,在灰阶阈值范围内,因此,保留该子像素的显示信息。
此外,需要说明的是,第一,在进行降维处理和滤波处理的情况下,上述说明示出了先对第一显示信息进行降维处理,得到第二显示信息,再对第二显示信息进行滤波处理,得到第三显示信息。当然,也可以先对第一显示信息进行滤波处理,再进行降维处理,本申请实施例对此不作限定。
第二,上述降维处理和滤波处理,可以通过硬件电路实现,也可以通过软件代码实现。其中,显示检测装置还可以包括存储器,若通过软件代码实现降维处理和滤波处理,则上述软件代码可以存储在存储器中。
此外,在一些实施例中,显示光在投射至光线采集器106之前,部分颜色子像素可能会发生色偏,例如红色子像素发生色偏,从而影响比较结果。基于此,若显示器102显示全彩画面,还可以通过检测电路107对第一显示信息(或者第二显示、第三显示信 息)进行灰度转换,灰度转换后的第一显示信息(或者第二显示、第三显示信息)可以指示黑白画面,从而提高比较结果的准确性。
S132,通过检测电路107根据参考显示信息,指示显示器102是否正常显示。
具体的,一种可能实现的方式中,参考图10所示,还可以通过检测电路107接收前述第二显示信息或者第三显示信息。在对第二显示信息(或者第三显示信息)与参考显示信息进行比较的过程通过软件代码实现的情况下,还可以通过检测电路107执行该软件代码,对相应显示分区11的第二显示信息(或第三显示信息)与参考显示信息进行比较,以指示显示器102是否显示异常。
另一种可能实现的方式中,如图9a和图9b所示,检测电路107可以包括处理电路1073和比较电路1074。可以通过处理电路1073接收前述第二显示信息或者第三显示信息,产生控制信号,并将控制信号发送至比较电路1074。通过比较电路1074响应于该控制信号,对相应显示分区11的第二显示信息(或第三显示信息)与参考显示信息进行比较,以指示显示器102是否显示异常。
需要说明的是,上述对相应显示分区11的第二显示信息(或第三显示信息)与参考显示信息进行比较的方法,与对相应显示分区11的第一显示信息与参考显示信息进行比较的方法相同,对此不再赘述。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (22)

  1. 一种显示检测装置,其特征在于,包括显示器、光线采集器和检测电路;
    所述显示器包括多个显示分区,所述显示器的至少一个所述显示分区出射显示光;
    所述光线采集器,所述光线采集器设置于所述显示光的出射光路上,用于采集从至少一个所述显示分区出射的显示光,并将采集的所述显示光转换为电信号形式的第一显示信息,向所述检测电路发送所述第一显示信息;
    所述检测电路,所述光线采集器与所述检测电路耦合,用于接收所述第一显示信息,并将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常。
  2. 根据权利要求1所述的显示检测装置,其特征在于,所述显示检测装置还包括光路调节组件和反射镜;
    所述光路调节组件设置于所述显示光的出射光路上,用于调节所述显示光的光路;所述光路调节组件包括半透半反镜,所述反射镜设置于所述半透半反镜与所述光线采集器之间的光路上;
    所述反射镜用于将透过所述半透半反镜的至少一个所述显示分区的所述显示光,反射至所述光线采集器。
  3. 根据权利要求1所述的显示检测装置,其特征在于,所述显示检测装置还包括导光纤维;
    所述导光纤维设置于所述显示器的出光侧,用于将至少一个所述显示分区的所述显示光传输至所述光线采集器。
  4. 根据权利要求1-3任一项所述的显示检测装置,其特征在于,所述检测电路还包括第一图像处理模块;每一所述显示分区包括至少一个像素区;
    所述第一图像处理模块,用于将所述第一显示信息转换为第二显示信息,每一所述像素区的所述第二显示信息的像素数据量,小于该像素区的所述第一显示信息的像素数据量。
  5. 根据权利要求1-4任一项所述的显示检测装置,其特征在于,所述检测电路还包括第二图像处理模块;
    所述第二图像处理模块,用于对所述第一显示信息或所述第二显示信息进行滤波处理,以得到第三显示信息。
  6. 根据权利要求5所述的显示检测装置,其特征在于,所述第二图像处理模块对所述第一显示信息或所述第二显示信息进行滤波处理,以得到第三显示信息,具体包括:
    所述第二图像处理模块,用于获取所述第一显示信息或第二显示信息的第一特征值;所述第一特征值用于指示所述显示器的显示数据;
    所述第二图像处理模块,还用于根据所述第一特征值和所述参考显示信息,对所述第一显示信息或所述第二显示信息进行滤波处理,以得到第三显示信息。
  7. 根据权利要求4-6任一项所述的显示检测装置,其特征在于,所述显示检测装置还包括目标处理器;
    所述目标处理器,用于控制所述显示器显示画面,并向所述检测电路发送所述参考显示信息。
  8. 根据权利要求7所述的显示检测装置,其特征在于,所述检测电路包括处理电路;
    所述处理电路,用于接收所述第二显示信息或所述第三显示信息;
    所述处理电路,还用于对相应所述显示分区的所述第二显示信息或所述第三显示信息,与所述参考显示信息进行比较,以指示所述显示器是否显示异常。
  9. 根据权利要求7所述的显示检测装置,其特征在于,所述检测电路包括处理电路和比较电路;
    所述处理电路,用于接收所述第二显示信息或所述第三显示信息;
    所述处理电路,还用于响应于所述第二显示信息或所述第三显示信息,向所述比较电路发送控制信号;
    所述比较电路,用于响应于所述控制信号,对相应所述显示分区的所述第二显示信息或所述第三显示信息,与所述参考显示信息进行比较,以指示所述显示器是否显示异常。
  10. 根据权利要求8或9所述的显示检测装置,其特征在于,所述检测电路集成于所述目标处理器中。
  11. 一种显示检测系统,其特征在于,包括终端和权利要求1-10任一项所述的显示检测装置;
    所述显示检测装置的显示器出射的显示光,在所述终端的目标位置成虚像;
    所述显示检测装置的检测电路,用于指示所述显示器是否显示异常。
  12. 根据权利要求11所述的显示检测系统,其特征在于,所述终端为汽车、飞机和头显设备中的至少一种。
  13. 一种显示检测方法,应用于显示检测装置,其特征在于,所述显示检测装置包括显示器、光线采集器和检测电路;所述显示器包括多个显示分区,所述光线采集器位于所述显示光的传出射光路上,所述光线采集器与所述检测电路耦合;所述显示检测方法包括:
    通过所述显示器的至少一个所述显示分区出射显示光;
    通过所述光线采集器采集从至少一个所述显示分区出射的显示光,并将采集的所述显示光转换为电信号形式的第一显示信息,向所述检测电路发送所述第一显示信息;
    通过所述检测电路接收所述第一显示信息,并将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常。
  14. 根据权利要求13所述的显示检测方法,其特征在于,所述显示检测装置还包括反射镜和调节所述显示光的光路调节组件,所述光路调节组件包括半透半反镜;
    所述通过所述光线采集器采集从至少一个所述显示分区出射的显示光,包括:
    利用所述反射镜将透过所述半透半反镜的至少一个所述显示分区的所述显示光,反射至所述光线采集器。
  15. 根据权利要求13所述的显示检测方法,其特征在于,所述显示检测装置还包括导光纤维;所述通过所述光线采集器采集从至少一个所述显示分区出射的显示光,包括:
    利用所述导光纤维将至少一个所述显示分区的所述显示光传输至所述光线采集器。
  16. 根据权利要求13-15任一项所述的显示检测方法,其特征在于,所述通过检测电路接收所述第一显示信息,并将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常,包括:
    通过所述检测电路接收所述第一显示信息,并对所述第一显示信息进行图像处理;
    通过所述检测电路,根据所述参考显示信息,指示所述显示器是否正常显示。
  17. 根据权利要求16所述的显示检测方法,其特征在于,每一所述显示区分包括至少一个像素区;
    所述通过所述检测电路接收所述第一显示信息,并对所述第一显示信息进行图像处理,包括:
    通过所述检测电路将所述第一显示信息转换为第二显示信息;每一所述像素区的所述第二显示信息的像素数据量,小于该像素区的所述第一显示信息的像素数据量。
  18. 根据权利要求16或17所述的显示检测方法,其特征在于,所述通过所述检测电路接收所述第一显示信息,并对所述第一显示信息进行图像处理,包括:
    通过所述检测电路对所述第一显示信息或所述第二显示信息进行滤波处理,以得到第三显示信息。
  19. 根据权利要求18所述的显示检测方法,其特征在于,所述通过所述检测电路对所述第一显示信息或所述第二显示信息进行滤波处理,以得到第三显示信息,包括:
    通过所述检测电路获取所述第一显示信息或第二显示信息的第一特征值;所述第一特征值用于指示所述显示器的显示数据;
    通过所述检测电路,根据所述第一特征值和所述参考显示信息,对所述第一显示信息或所述第二显示信息进行滤波处理,以得到所述第三显示信息。
  20. 根据权利要求17-19任一项所述的显示检测方法,其特征在于,所述显示检测装置还包括目标处理器;
    所述通过所述显示器的至少一个所述显示分区出射显示光,包括:
    通过所述目标处理器控制所述显示器的至少一个所述显示分区出射显示光;
    所述通过所述检测电路将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常之前,所述显示检测方法还包括:
    通过所述目标处理器向所述检测电路发送所述参考显示信息。
  21. 根据权利要求20所述的显示检测方法,其特征在于,所述通过所述检测电路将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常,包括:
    通过所述检测电路接收所述第二显示信息或所述第三显示信息;
    通过所述检测电路调用所述参考显示信息,并对相应所述显示分区的所述第二显示信息或所述第三显示信息,与所述参考显示信息进行比较,以指示所述显示器是否显示异常。
  22. 根据权利要求20所述的显示检测方法,其特征在于,所述检测电路包括处理电路和比较电路;所述通过所述检测电路将所述第一显示信息与相应的所述显示分区的参考显示信息进行比较,以指示所述显示器是否显示异常,包括:
    通过所述处理电路接收所述第二显示信息或所述第三显示信息;
    通过所述处理电路响应于所述第二显示信息或所述第三显示信息,向所述比较电路发送控制信号;
    通过所述比较电路响应于所述控制信号,对相应所述显示分区的所述第二显示信息或所述第三显示信息,与所述参考显示信息进行比较,以指示所述显示器是否显示异常。
PCT/CN2022/137947 2022-02-25 2022-12-09 显示检测装置、显示检测系统和显示检测方法 WO2023160117A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210181496.1 2022-02-25
CN202210181496.1A CN116704918A (zh) 2022-02-25 2022-02-25 显示检测装置、显示检测系统和显示检测方法

Publications (1)

Publication Number Publication Date
WO2023160117A1 true WO2023160117A1 (zh) 2023-08-31

Family

ID=87764609

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/137947 WO2023160117A1 (zh) 2022-02-25 2022-12-09 显示检测装置、显示检测系统和显示检测方法

Country Status (2)

Country Link
CN (1) CN116704918A (zh)
WO (1) WO2023160117A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102934091A (zh) * 2010-06-11 2013-02-13 西门子公司 用于识别显示单元上图像数据的错误显示的方法和装置
JP2015018099A (ja) * 2013-07-11 2015-01-29 株式会社デンソー ヘッドアップディスプレイ装置、および画像投影装置
CN110099836A (zh) * 2017-01-17 2019-08-06 Lg 电子株式会社 车辆及控制其中的显示器的方法
CN110189667A (zh) * 2019-06-04 2019-08-30 深圳市华星光电技术有限公司 一种显示器验证方法
CN111316247A (zh) * 2017-09-07 2020-06-19 Lg电子株式会社 车辆av系统的错误检测ic
CN112349256A (zh) * 2019-08-09 2021-02-09 本田技研工业株式会社 显示控制装置、显示控制方法及存储介质
CN113496661A (zh) * 2020-03-18 2021-10-12 西安诺瓦星云科技股份有限公司 Led显示控制系统检测方法、装置及系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102934091A (zh) * 2010-06-11 2013-02-13 西门子公司 用于识别显示单元上图像数据的错误显示的方法和装置
JP2015018099A (ja) * 2013-07-11 2015-01-29 株式会社デンソー ヘッドアップディスプレイ装置、および画像投影装置
CN110099836A (zh) * 2017-01-17 2019-08-06 Lg 电子株式会社 车辆及控制其中的显示器的方法
CN111316247A (zh) * 2017-09-07 2020-06-19 Lg电子株式会社 车辆av系统的错误检测ic
CN110189667A (zh) * 2019-06-04 2019-08-30 深圳市华星光电技术有限公司 一种显示器验证方法
CN112349256A (zh) * 2019-08-09 2021-02-09 本田技研工业株式会社 显示控制装置、显示控制方法及存储介质
CN113496661A (zh) * 2020-03-18 2021-10-12 西安诺瓦星云科技股份有限公司 Led显示控制系统检测方法、装置及系统

Also Published As

Publication number Publication date
CN116704918A (zh) 2023-09-05

Similar Documents

Publication Publication Date Title
US10336192B2 (en) Projection type display device and operation assistance method
US10528825B2 (en) Information processing device, approaching object notification method, and program
JP5197349B2 (ja) ヘッドアップディスプレイ装置
US8593373B2 (en) Headup display device and method for indicating virtual image
US10578865B2 (en) Head-up display apparatus, controlling method therer, and vehicle
US10996471B2 (en) Vehicle display device
JP2014116756A (ja) 周辺監視システム
WO2018092709A1 (ja) 撮像装置状態監視装置、撮像装置状態監視方法、およびプログラム
US20200201035A1 (en) Circuit device, electronic apparatus, and mobile body
US20140293433A1 (en) Head-up display device and display method of head-up display device
US11009703B2 (en) Vehicle display device
WO2023160117A1 (zh) 显示检测装置、显示检测系统和显示检测方法
JP3731303B2 (ja) 車両周辺監視装置
US11007874B2 (en) Vehicle display device
US20070177815A1 (en) Method, video display system and automobile video display system
KR20140079903A (ko) 차량의 헤드업 디스플레이 장치 및 그 동작 방법
JP2020194117A (ja) 虚像表示装置
US11345364B2 (en) Attention calling device and attention calling method
US20150042541A1 (en) Head-up display device and display method of head-up display device
JP2004243891A (ja) ヘッドアップディスプレイ
US11731513B2 (en) Display control device, display system, display method, and program
JP2019114118A (ja) 警告装置、自動車、警告方法、及びプログラム
WO2023100598A1 (ja) 異常判定装置、異常判定方法、及び異常判定プログラム
WO2022196256A1 (ja) 車両用表示装置
JPH04267289A (ja) 車両用ヘッドアップディスプレイ装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22928376

Country of ref document: EP

Kind code of ref document: A1