JP7229646B2 - image display device - Google Patents

Description

The present invention relates to an image display device that displays a specific image overlaid on a display image.

Conventionally, an on-screen display OSD (On Screen Display) has been known as a function of displaying a vehicle speedometer or the like using a cluster display and displaying warning light icons using a part of the display screen. there is The warning lights displayed in this way are important for the running of the vehicle, and it is necessary to confirm their validity (whether the contents of the icon display are correct or not). 2. Description of the Related Art Conventionally, there is known an image display system (see, for example, Japanese Unexamined Patent Application Publication No. 2002-100001) that detects occurrence of a freeze in which image information does not change.

JP 2008-252307 A

By the way, in the image display system disclosed in the above-mentioned Patent Document 1, by setting a specific area in the captured image and synthesizing the detection image in this specific area, the presence or absence of freezing of the captured image is detected. Therefore, it cannot be applied to the validation of icons displayed on part of the screen by the OSD function. Therefore, when a specific image (icon or the like) is synthesized and displayed on a display image, there is a demand for a method capable of reliably verifying the validity of this specific image.

SUMMARY OF THE INVENTION The present invention has been created in view of such a point, and its object is to provide an image display device capable of reliably verifying the validity of a specific image superimposed and displayed on a display image. That's what it is.

In order to solve the above-described problems, an image display device of the present invention is an image display device for displaying a display image in which a specific image is synthesized in a partial first region of a display screen, the image display device comprising: partial image extracting means for extracting a first partial image as a display image corresponding to and a second partial image as a display image corresponding to a second region not including the specific image; a partial image computing means for performing a predetermined computation on each of the two partial images; Operation of at least one of the partial image extraction means and the partial image calculation means by comparing the calculation results corresponding to the first and second partial images obtained by the validity verification means to be verified and the partial image calculation means. and operation stop determination means for determining whether or not there is a stop.

In particular, the validity verification means compares the calculation result with the expected value as the calculation result obtained by the partial image calculation means for the first partial image when the specific image is correctly combined with the first region. It is desirable to verify validity by Further, it is desirable that the above-described operation stop determination means determines that the operation has stopped when the calculation results corresponding to the first and second partial images are the same.

Predetermined computation is performed using the synthesized partial image corresponding to the first region synthesized with the specific image, and different calculation results are obtained depending on whether there is an abnormality in the operation of synthesizing the specific image. Based on this calculation result, it is possible to reliably verify the validity of the specific image included in the first area. Further, by performing the same calculation for the first region and the second region where different calculation results are likely to be obtained, and comparing the results, it is possible to determine whether or not the calculation operation has stopped. It becomes possible to confirm that the validity verification is not functioning effectively.

Further, the above-described validity verification means verifies the validity of the display content of the second area based on the calculation result corresponding to the second partial image by the partial image calculation means. It is desirable to further include calculation correct/wrong judgment means for judging the correctness/wrongness of the calculation content by the validity verification means based on the result of the corresponding validity verification. As a result, it is possible to distinguish whether a correct verification result cannot be obtained due to an abnormality in the content of the specific image to be synthesized, or whether a correct verification result cannot be obtained due to an abnormality in the operation contents of the partial image. A more accurate verification result can be obtained.

Moreover, it is desirable that the first area and the second area described above are set at different positions within the display screen. This makes it possible to easily and reliably verify the validity of the specific image.

A common area within the display screen is used for the above-described first area and second area. It is desirable that the common area is set as the second area in the display state. As a result, even if the display screen is narrow and it is difficult to secure an area that is not the object of image synthesis, the validity of the specific image can be verified reliably.

It is a figure which shows the structure of the image display apparatus of this embodiment. FIG. 4 is a diagram showing the relationship between the display screen of the LCD and the icon area; It is a flowchart which shows the operation|movement procedure which performs validity verification of a warning light icon, and effectiveness confirmation of this verification function.

An image display device according to an embodiment to which the present invention is applied will be described below with reference to the drawings.

FIG. 1 is a diagram showing the configuration of an image display device according to this embodiment. The image display device 100 shown in FIG. 1 includes an image synthesis unit 110, a display image storage unit 112, an LCD (liquid crystal display device) 114, an icon area extraction unit 120, an icon area calculation unit 122, an icon verification unit 124, and a processing stop determination unit. 126 and an arithmetic correct/wrong determination unit 128 .

This image display device 100 is mounted on a vehicle, and superimposes a warning light icon on a partial area of a cluster display that displays a speedometer, an engine tachometer, etc., by synthesizing an image using an OSD function. The adequacy of the displayed warning light icon is verified, and it is determined whether or not this verification function is operating effectively.

The image synthesizing unit 110 combines display image data (display image data) corresponding to the display screen of the LCD 114 serving as a cluster display, and icon image data corresponding to the warning light icon displayed in the icon area that is part of the display screen. (icon image data) are input, and these display images and icon images are synthesized and output.

FIG. 2 is a diagram showing the relationship between the display screen of LCD 114 and icon areas. As shown in FIG. 2, an icon area A is set substantially at the bottom center of the display screen D of the LCD 114 . Further, on the right side of the icon area A, a failure determination area B having approximately the same size as the icon area A is set. The failure determination area B will be described later.

The display image storage unit 112 is a frame buffer (video RAM) corresponding to the display screen of the LCD 114, and stores, for example, display image data in RGB format, which is synthesized with icon image data, for each display pixel constituting the display screen. do. This display image data is read out at a predetermined frame rate and input to LCD 114, and a warning light icon is displayed on the display screen of LCD 114 along with a speedometer, an engine speed meter, and the like.

The icon area extraction unit 120 extracts partial image data corresponding to the icon area A from the display image data stored in the display image storage unit 112 . This partial image data includes the original icon data and part of the background display image data.

The icon area calculation unit 122 receives the partial image data extracted by the icon area extraction unit 120 and performs a predetermined operation (comparison operation) to compare the partial image data with the original icon image data input to the image synthesis unit 110 . , and outputs the operation result A by holding it in an internal register. The contents of this comparison calculation are set so that a predetermined calculation result (expected value) is obtained when the expected warning light icon is correctly displayed in the icon area A. FIG. For example, it is conceivable that the partial image data and the original icon image data are correlated with each other. Note that it is not always necessary to use the original icon data in this comparison calculation, and it is sufficient that a specific value corresponding to the warning light icon is obtained by performing a predetermined calculation on the partial image data.

The icon verification unit 124 determines that the value (calculation result A) obtained by the comparison calculation by the icon region calculation unit 122 matches the expected value corresponding to the warning light icon to be displayed (not only when the values match completely). , the difference may be within a certain range), the validity of the warning light icon displayed in the icon area A (the assumed warning light icon is whether it was displayed correctly). If they match, it is determined that the warning light icon displayed in the icon area A is valid, and if they do not match, it is determined that it is not valid.

In the description of the icon area extraction unit 120, the icon area calculation unit 122, and the icon verification unit 124 described above, various processes are performed on the icon area A, but the same process is performed on the failure determination area B as well. This failure determination area B has the same size as the icon area A, but unlike the icon area A, it does not include an image of a specific icon such as a warning light icon, but includes part of the display image data as a background. is The icon region calculation unit 122 uses the display image data included in the failure determination region B to perform calculation using the same calculation formula as the calculation performed for the icon region A, and holds the calculation result B in an internal register. Output. The icon verification unit 124 determines whether or not this calculation result B matches an expected value (preliminarily calculated fixed value) that is expected to be obtained corresponding to the failure determination region B. FIG.

The processing stop determination unit 126 determines if the calculation results A and B obtained by the icon region calculation unit 122 corresponding to the icon region A and the failure determination region B are the same (the internal register of the icon region calculation unit 122 (indicating that updating has stopped), a failure determination is made to the effect that each process by the icon area calculation unit 122 and the icon area extraction unit 120 has stopped.

If the verification result obtained by the icon verification unit 124 corresponding to the failure determination region B is not valid, the calculation correct/wrong determination unit 128 indicates that some abnormality has occurred in the calculation processing by the icon region calculation unit 122. failure determination.

The icon area extraction unit 120 described above serves as partial image extraction means, the icon area calculation unit 122 serves as partial image calculation means, the icon verification unit 124 serves as validity verification means, and the processing stop determination unit 126 serves as operation stop determination means. The correct/wrong judging section 128 corresponds to the calculation correct/wrong judging means.

The image display apparatus 100 of this embodiment has such a configuration, and the operation thereof will be described next.

FIG. 3 is a flow chart showing an operation procedure for verifying the validity of the warning light icon and confirming the validity of this verification function.

First, the icon area extraction unit 120 extracts partial image data corresponding to the icon area A from the display image data stored in the display image storage unit 112 (step 100). Next, the icon area calculator 122 performs a predetermined calculation corresponding to the icon area A using the extracted partial image data to obtain a calculation result A (step 102).

Similarly, the icon area extraction unit 120 extracts partial image data corresponding to the failure determination area B from the display image data stored in the display image storage unit 112 (step 104). Next, the icon region calculator 122 performs a predetermined calculation corresponding to the failure determination region B using the extracted partial image data to obtain a calculation result B (step 106).

Next, the processing stop determination unit 126 determines whether or not the calculation result A and the calculation result B match (step 108). When the processing of the icon area extraction unit 120 and the icon area calculation unit 122 is stopped, the operations of steps 104 and 106 are not performed, and the calculation result A held in the internal register of the icon area calculation unit 122 is updated. never As a result, the value of the calculation result A and the value of the calculation result B become the same, and the determination at step 108 is affirmative. In this case, the process stop determination unit 126 issues a process stop failure notification (step 110). For example, when a predetermined display indicating this notification is performed using a partial area of the LCD 114, when the LCD 114 is turned off, when a predetermined notification sound is output using a buzzer or the like. Note that the processing stop is not limited to occurring between steps 102 and 104 and may occur before step 100 . Even in such a case, the result of calculation by the icon area calculation unit 122 is not updated and maintains the same value, so the determination in step 108 is affirmative.

On the other hand, when the calculation result A and the calculation result B do not match, a negative decision is made in the decision of step 108 . Next, the icon verification unit 124 determines whether or not the calculation result B coincides with the expected value expected to be obtained corresponding to the failure determination region B (step 112). Since the failure determination area B does not include an icon, if there is no abnormality in the calculation process performed by the icon area calculation unit 122, the calculation result B should always match the expected value. In other words, when they do not match, there is some kind of abnormality in the calculation process performed by the icon area calculation unit 122 . In this case, a negative determination is made in the determination at step 112, and the calculation correct/wrong determination unit 128 notifies the calculation abnormality (step 114). For example, in the same manner as the processing stop failure notification described above, when a predetermined display indicating this notification is performed using a partial area of the LCD 114, when the LCD 114 is turned off, a predetermined notification sound is output using a buzzer or the like. Such cases can be considered.

Further, when the calculation result B matches the expected value, affirmative determination is made in the determination of step 112 . Next, the icon verification unit 124 determines whether or not the calculation result A matches the expected value that would be obtained corresponding to the icon area A (step 116). When the warning light icons displayed in the icon area A are correctly displayed, they match each other, so an affirmative determination is made. In this case, the process returns to step 100 and the process is repeated from the beginning.

Further, if the warning light icons displayed in the icon area A are not correctly displayed, they do not match. Next, the icon verification unit 124 notifies that the warning light icon displayed in the icon area A is not valid (is not displayed correctly) (step 118). For example, similar to the above-described processing stop failure notification and operation abnormality notification, when a predetermined display indicating this notification is performed using a partial area of the LCD 114, when the LCD 114 is turned off, a predetermined notification using a buzzer or the like A case of outputting sound can be considered. When the processing stop failure notification (step 110), the calculation abnormality notification (step 114), and the icon abnormality notification (step 118) are performed in this way, the series of operations shown in FIG. 3 ends.

As described above, in the image display device 100 of the present embodiment, a predetermined calculation is performed using a synthesized partial image corresponding to the icon area where the image of the warning light icon is synthesized. Since different calculation results can be obtained depending on whether there is an abnormality in the operation to be combined, it is possible to reliably verify the validity of the warning light icon included in the icon area based on this calculation result. In addition, by performing the same calculation for the icon area and the failure determination area, where different calculation results are likely to be obtained, it is possible to determine whether the calculation operation has stopped or not, and it is effective to verify the validity of the displayed warning light icon. It is possible to confirm that it is not functioning.

In addition, by performing the same validity verification for the failure judgment area that does not include the partial image to be synthesized such as the warning light icon, regardless of the content of the warning light icon, etc., the correctness judgment of the calculation contents in the verification operation can be performed. Is going. This makes it possible to distinguish whether correct verification results cannot be obtained due to an abnormality in the content of the warning light icon, etc. to be synthesized, or whether correct verification results cannot be obtained due to an abnormality in the calculation content itself for the warning light icon, etc. It is possible to obtain more accurate validation results.

Also, as shown in FIG. 2, by setting the icon area A and the failure determination area B at different positions in the display screen D, the process of extracting partial images from the separate areas A and B is simplified. Therefore, it is possible to easily and reliably verify the validity of the icon image.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the present invention. For example, in the above-described embodiment, the icon area A and the failure determination area B are adjacent to each other as shown in FIG. 2, but they may be separated from each other.

A common area in the display screen D is used as the icon area A and the failure determination area B. When the icon image is displayed, the common area is set as the icon area A. When the icon image is not displayed, the common area is set as the icon area A. A common area may be set as the failure determination area B. FIG. As a result, even if the display screen is narrow and it is difficult to secure a failure determination area that is not a target for image synthesis, it is possible to reliably verify the validity of the icon image. In the case of a blinking icon image such as an arrow image of a blinker, since there are a display state and a non-display state, it is easy to set the icon area and the failure determination area. Also, when the display state of the icon image continues or when the non-display state continues, when the non-display state or the display state is forcibly interrupted (for example, when the screen display of 30 frames per second is performed and switching the display state/non-display state for one frame in 30 frames).

Also, in the above-described embodiment, the case of displaying one warning light icon has been described, but the present invention can also be applied to the case of displaying two or more icon images. In this case, a failure determination area may be set separately from the two or more icon areas displaying the two or more icon images.

As described above, according to the present invention, a predetermined calculation is performed using a synthesized partial image corresponding to a first area synthesized with a specific image, and whether or not there is an abnormality in the operation of synthesizing the specific image is determined. Since different calculation results can be obtained depending on , it is possible to reliably verify the validity of the specific image included in the first region based on the calculation results. Further, by performing the same calculation for the first region and the second region where different calculation results are likely to be obtained, it is possible to determine whether or not the calculation operation has been stopped, thus effectively verifying the validity of the specific image. It is possible to confirm that it is not functioning.

REFERENCE SIGNS LIST 100 image display device 110 image synthesizing unit 112 display image storage unit 114 LCD
120 icon area extraction unit 122 icon area calculation unit 124 icon verification unit 126 processing stop determination unit 128 calculation correct/wrong determination unit

Claims (6)

An image display device for displaying a display image obtained by synthesizing a specific image on a partial first region of a display screen,
A partial image for extracting a first partial image as the display image corresponding to the first area and a second partial image as the display image corresponding to the second area not including the specific image. extraction means;
partial image calculation means for performing a predetermined calculation on each of the first and second partial images;
Validity verification means for verifying the validity of the display content of the first area based on the calculation result corresponding to the first partial image by the partial image calculation means;
By comparing calculation results corresponding to the first and second partial images obtained by the partial image calculation means, it is possible to determine whether or not at least one of the partial image extraction means and the partial image calculation means has stopped operating. Operation stop determination means for determining,
An image display device comprising: The validity verification means compares the calculation result with an expected value as a calculation result obtained by the partial image calculation means for the first partial image when the specific image is correctly combined with the first region. 2. The image display device according to claim 1, wherein the validity verification is performed by comparing . 3. The operation stop determination means according to claim 1, wherein the operation stop determination means determines that the operation has stopped when computation results corresponding to the first and second partial images are the same. Image display device. The validity verification means verifies the validity of the display content of the second region based on the calculation result corresponding to the second partial image by the partial image calculation means,
4. The method according to any one of claims 1 to 3, further comprising calculation correct/wrong judgment means for judging the correctness/wrongness of the content of calculation by said validity verification means based on the result of validity verification corresponding to said second region. 1. The image display device according to item 1. 5. The image display device according to claim 1, wherein the first area and the second area are set at different positions within the display screen. A common area within the display screen is used for the first area and the second area,
setting the common area as the first area when the specific image is displayed;
5. The image display device according to claim 1, wherein the common area is set as the second area when the specific image is in a non-display state.

Images