JP6337864B2 - Display control apparatus and display control program - Google Patents

Description

  The present invention relates to a display control device and a display control program for controlling display of information provided to a passenger such as a vehicle.

  In recent years, when an object (for example, a vehicle, a pedestrian, a white line, a road sign, etc.) existing around the vehicle is detected using a sensor mounted on the vehicle, it is determined that there is a high possibility of a collision with the object. The development of driving support systems that present information to vehicle occupants is thriving.

  However, the accuracy with which the sensor detects an object around the vehicle (hereinafter referred to as sensing accuracy) may vary depending on the environment in which the vehicle travels. As a method for changing the presentation of information to an occupant according to sensing accuracy, for example, there is a technique disclosed in Patent Document 1 (hereinafter referred to as a conventional technique).

  In the related art, when an image taken by a camera mounted on a vehicle is displayed, the object is highlighted according to the reliability of the object included in the image. As a result, it is possible to avoid giving the passenger an uncomfortable feeling that information being displayed is suddenly not displayed when the sensing accuracy is lowered.

JP 2009-117978 A

  However, the conventional technology highlights the object according to the sensing accuracy, but the sensing accuracy is not taken into consideration.

  The objective of this invention is providing the display control apparatus and display control program which the passenger | crew of a mobile body can grasp | ascertain sensing accuracy.

  A display control device according to an aspect of the present invention divides a figure having a predetermined shape when displayed on a display medium based on an input unit that receives detection accuracy of an object existing around a moving body and the detection accuracy A control unit that controls the image generation unit so as to generate a predetermined image representing the presented image, and the detection accuracy of the first direction out of the periphery of the moving body is other than the first direction When the accuracy is lower than the direction detection accuracy, the sizes of the plurality of regions obtained by dividing the figure of the predetermined shape are not uniform in the presented image.

  According to the present invention, an occupant of a moving body can grasp sensing accuracy.

The block diagram which shows the structural example of the display system which concerns on Embodiment 1 of this invention. The block diagram which shows the structural example of the display system which concerns on Embodiment 1 of this invention. The flowchart which shows the operation example of the display system which concerns on Embodiment 1 of this invention. The figure which shows the example of a display of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example which concerns on Embodiment 1 of this invention, and an emphasis display The figure which shows the example which concerns on Embodiment 1 of this invention, and an emphasis display The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The block diagram which shows the structural example of the display system which concerns on Embodiment 2 of this invention. The block diagram which shows the structural example of the display system which concerns on Embodiment 3 of this invention. The flowchart which shows the operation example of the display system which concerns on Embodiment 3 of this invention. The figure which shows the example of the setting pattern of the brightness | luminance which concerns on Embodiment 3 of this invention, and an image transition The block diagram which shows the hardware structural example of the display control system which concerns on Embodiment 1-3 of this invention, and a display control apparatus. The block diagram which shows another structural example of the display system which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows an example of the combiner which concerns on Embodiment 1 of this invention The flowchart which shows the operation example of the display control apparatus of the display system of FIG. The flowchart which shows another operation example of the display control apparatus of the display system of FIG. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention. The figure which shows the example of a division | segmentation of the image which concerns on Embodiment 1 of this invention.

  In a conventional driving support system, for example, when a camera is used as a sensor, there is a risk that the sensing accuracy may deteriorate in a driving environment such as nighttime, backlight, or rainy weather. Further, in the conventional driving support system, for example, when a millimeter wave radar is used as a sensor, there is a risk that the sensing accuracy may decrease in a traveling environment where an obstacle that reflects the radar exists. In spite of the situation in which the sensing accuracy is reduced in this way, if the same information is presented to the occupant as usual, there is a risk of causing false or missing information. Therefore, it is important for the occupant to grasp the decrease in sensing accuracy. Accordingly, an object of the embodiment of the present invention is to enable an occupant to grasp sensing accuracy.

(Embodiment 1)
Embodiment 1 of the present invention will be described with reference to the drawings.

  First, a configuration example of the display system 10 according to the present embodiment will be described. FIG. 1 is a block diagram illustrating a configuration example of a display system 10 according to the present embodiment.

  The display system 10 is used in a moving body such as a vehicle, for example. That is, the display system 10 may be an in-vehicle device or a device brought into a vehicle. In the present embodiment, the display system 10 is described as being applied to a vehicle. However, the moving body is not limited to a vehicle, and may be a ship, an aircraft, or the like. In this embodiment, an example in which the user is a vehicle occupant, particularly a vehicle driver, is described, but the present invention is not limited thereto. Furthermore, the display system 10 may be used in a wearable computer (for example, an HMD described later) that can be worn by the user.

  1, the display system 10 includes a sensor 100, a recognition unit 200, a calculation unit 300, a display control device 400, an image generation unit 500, and a display unit 600. In addition, the display control device 400 includes a determination unit 401 and a display control unit 402.

  Here, the sensor 100 may be included in a detection device (see FIG. 17). The recognition unit 200 may be included in the detection device (see FIG. 17) together with the sensor 100. In addition, the display control device 400 may include an acquisition unit (see FIG. 17) that is an input terminal such as a connector or a signal input unit. Further, the determination unit 401 and the display control unit 402 may be combined to form a control unit (see FIG. 17).

  FIG. 17 shows another configuration example of the display system 10. The display system 10 includes a detection device 700, a calculation unit 300, a display control device 400, an image generation unit 500, and a display unit 600. The display control apparatus 400 includes an acquisition unit 404 and a control unit 405. The display device 20 includes a display control device 400, an image generation unit 500, and a display unit 600. Details of the display system 10 shown in FIG. 17 will be described later.

  Hereinafter, each component of the display system 10 will be described with reference to FIG.

  The sensor 100 senses the foreground of the driver of the vehicle every predetermined time. The sensor 100 is a sensing camera, for example. The sensing camera is mounted inside or outside the vehicle and captures the foreground of the vehicle. Furthermore, the sensing camera may capture not only the foreground but also the side view. Alternatively, the sensor 100 may be a radar, for example. The radar is mounted inside or outside the vehicle and senses the foreground of the vehicle. Hereinafter, the foreground and the like of the vehicle may be referred to as the vicinity of the vehicle.

  Then, the sensor 100 outputs peripheral information indicating the peripheral sensing result to the recognition unit 200. This output is performed at predetermined time intervals, for example.

  The recognition unit 200 recognizes a predetermined object existing around the vehicle based on the peripheral information from the sensor 100. The target object is, for example, a moving body (for example, a vehicle, a person, a bicycle, a two-wheeled vehicle, etc.), a white line on a road, a sign, a road marking, a curb, a guardrail, a traffic light, a power pole, and a building. For example, when the sensor 100 is a sensing camera, the recognition unit 200 recognizes an object by performing pattern matching on the peripheral information (peripheral image). For example, when the sensor 100 is a radar, the recognition unit 200 extracts and recognizes an object from surrounding information by clustering or machine learning. In addition, since the target object recognition technique in the recognition part 200 is a well-known technique, the detailed description is abbreviate | omitted.

  Then, the recognition unit 200 outputs recognition result information indicating the recognition result of the object to the calculation unit 300 and the display control unit 402 of the display control device 400. The recognition result information includes, for example, the presence position (X, Y) of the object, the relative angle of the object with respect to the traveling direction of the vehicle (hereinafter simply referred to as the relative angle), the relative speed between the object and the vehicle, and the type of the object. , Information obtained by pattern matching, information obtained by tracking processing of an object, and the like. The position (X, Y) of the object is a coordinate in the camera coordinate system in which the horizontal direction is X and the forward direction is Y with respect to the point where the sensing camera of the vehicle is installed. Y at the position (X, Y) of the object indicates the distance between the vehicle and the object in the traveling direction of the vehicle (hereinafter simply referred to as distance).

  The calculation unit 300 calculates sensor recognition accuracy (also referred to as sensing accuracy, hereinafter simply referred to as recognition accuracy). The calculation unit 300 may calculate the sensing accuracy based on the recognition result from the recognition unit 200, or may calculate the sensing accuracy without using the recognition result by the recognition unit 200. Details will be described below.

  For example, the calculation unit 300 calculates the sensing accuracy based on the recognition result from the recognition unit 200. Specifically, the calculation unit 300 calculates the recognition accuracy based on the difference between the peripheral image and the template obtained at the time of pattern matching. In this case, for example, the calculation unit 300 calculates the recognition accuracy to be a high value when the difference between the image of the object photographed by the camera and the template stored in advance is small. Alternatively, for example, the calculation unit 300 calculates the recognition accuracy based on the number of frames obtained when tracking an object (for example, a moving object) between different image frames. In this case, for example, the calculation unit 300 calculates such that the greater the number of frames, the higher the recognition accuracy. Even if the tracking process is successful, the recognition accuracy may be low if the detection result of the object changes greatly between frames. For this reason, for example, the larger the amount of change in the detection result (distance, relative speed, etc.) between frames, the lower the recognition accuracy. When a sensor other than the camera is used, a feature amount corresponding to the sensor type corresponding to the difference between the peripheral image and the template described above may be used for recognition accuracy calculation.

  Further, the calculation unit 300 may calculate the recognition accuracy based on, for example, a recognition result of the traveling environment of the vehicle. For example, when the sensor 100 is a sensing camera, the recognition unit 200 performs predetermined image processing on a surrounding image of the vehicle photographed by the sensing camera, and is the traveling environment in which the recognition accuracy is likely to decrease (for example, The vehicle is running in bad weather such as rain, fog, sleet, hail, snow, etc., the illumination around the vehicle has increased due to backlight or headlights of oncoming vehicles, etc. Recognize whether the illuminance has decreased. The calculation unit 300 calculates the recognition accuracy to a low value when the recognition unit 200 recognizes that the driving environment is likely to have a low recognition accuracy.

  Moreover, you may make it the calculation part 300 perform, for example, without using the recognition result by the recognition part 200. FIG. An example of this case will be described with reference to FIG. 2, the same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted here. 2 is different from FIG. 1 in that the display system 10 does not include the recognition unit 200. In FIG. 2, for example, when the sensor 100 is a sensing camera, the calculation unit 300 receives a surrounding image of the vehicle from the sensor 100. Then, the calculation unit 300 determines whether or not the surrounding image of the vehicle has a driving environment in which the recognition accuracy is likely to decrease (for example, whether the vehicle is traveling in bad weather such as rain, fog, sleet, hail, snow) If the information indicating whether the illuminance around the vehicle has increased due to the headlight of an oncoming vehicle, or whether the illuminance around the vehicle has decreased due to traveling in the night or in the tunnel) is included, the recognition accuracy is calculated to a low value.

  In FIG. 2, another sensor (for example, the same sensor as the sensor 101 described later in Embodiment 2) may be provided instead of the sensor 100. This sensor is used in a driving environment where the recognition accuracy is likely to deteriorate (for example, whether the vehicle is traveling in bad weather such as rain, fog, sleet, hail, snow, etc.) For example, a raindrop sensor or illuminance sensor. The calculation unit 300 receives information indicating a detection result from the sensor. Then, the calculation unit 300 calculates the recognition accuracy to a low value when the detection result is a traveling environment in which the recognition accuracy is likely to decrease.

  Then, the calculation unit 300 outputs recognition accuracy information indicating the recognition accuracy value to the determination unit 401 of the display control device 400.

  The determination unit 401 determines the recognition accuracy input from the calculation unit 300. Specifically, the level of recognition accuracy is determined based on the recognition accuracy information from the calculation unit 300 and a predetermined threshold value. For example, when the recognition accuracy value indicated by the recognition accuracy information is greater than or equal to a threshold (or greater than the threshold), the determination unit 401 determines that the accuracy is high. On the other hand, for example, when the recognition accuracy value indicated by the recognition result information is smaller than the threshold (or less than or equal to the threshold), the determination unit 401 determines that the accuracy is low. The above-described recognition accuracy determination method in the determination unit 401 is an example, and other methods will be described later.

  Then, the determination unit 401 outputs determination result information indicating the determination result to the display control unit 402.

  When the determination unit 401 determines that the first recognition accuracy is obtained, the display control unit 402 represents a figure with a predetermined shape divided into n (an integer of 2 or more) when displayed on the display medium. The image generation unit 500 is controlled to generate a predetermined image. Further, when the determination unit 401 determines that the second recognition accuracy is lower than the first recognition accuracy, the display control unit 402 is not divided when displayed on the display medium, or m The image generation unit 500 is controlled so as to generate a predetermined image representing a figure having a predetermined shape divided into (an integer of 2 or more smaller than n). This will be specifically described below.

  The display control unit 402 determines a predetermined figure division number (number of figures after division) based on the determination result information from the determination unit 401. The figure is image information of a predetermined shape stored in advance by the display control unit 402 (or a storage unit (not shown)), and details thereof will be described later with reference to FIG. For example, when the determination result information indicates high accuracy, the display control unit 402 determines the division number to be n (n is an integer of 2 or more). On the other hand, for example, when the determination result information indicates low accuracy, the display control unit 402 determines not to divide the figure, or determines the division number to be m (m is an integer of 2 or more smaller than n).

  Further, the display control unit 402 determines how to divide the figure (hereinafter referred to as a division method) based on the determined number of divisions. The determination of the division method is different depending on which of the relative angle and the distance is used in the determination of the highlight area to be described later.

  A specific example of the process of determining the number of divisions and the division method will be described later with reference to FIGS.

  Further, the display control unit 402 determines the highlighted display area based on the recognition result information from the recognition unit 200. The highlight display area is an area that is displayed with emphasis in the divided figure, and is, for example, an area indicating a direction (relative angle) in which the object exists or a distance (distance) between the object and the vehicle. The highlighted display area may be displayed constantly or may be displayed at any time. For example, the display control unit 402 determines the highlighted display area from among the divided areas based on the relative angle indicated by the recognition result information and a table stored in advance (see FIGS. 7A and 7C). Alternatively, for example, the display control unit 402 determines the highlighted display region from the regions to be divided based on the distance indicated by the recognition result information and a prestored table (see FIGS. 8A and 8C). . A specific example of the highlight area determination process will be described later with reference to FIGS.

  Then, the display control unit 402 outputs control information to the image generation unit 500. The control information is information for controlling the image generation unit 500, and includes, for example, information on the shape of the figure, the number of divisions, the division method, and the highlighted display area.

  The image generation unit 500 generates a predetermined image based on the control information from the display control unit 402. The predetermined image is displayed on the display medium by the display unit 600 described later, and represents a figure having a predetermined shape.

  The predetermined figure may be a fan-like figure shown in FIGS. 4 to 6 or a linear figure shown in FIG. FIG. 18 will be described later. When the figure of the predetermined shape is divided and displayed on the display medium, the front, the right front and the left front, or the right direction and the left direction can be distinguished from the position of the driver of the moving body. The shape of the present invention is not limited by the shape of the figure. However, as shown in FIGS. 4 to 6, 18, and 19, it is desirable that the figure having a predetermined shape is a figure in which the component substantially horizontal with respect to the horizontal axis is larger than the vertical component. A display example of a figure having a predetermined shape will be described later with reference to FIGS.

  The predetermined image may be an image or image data. When the display unit 600 described later has a projector function, the image generation unit 500 generates an image, and the image is projected by the display unit 600. On the other hand, when the display unit 600 described later does not have a projector function, the image generation unit 500 generates image data, and the image data is output by the display unit 600.

  The display unit 600 outputs a predetermined image generated by the image generation unit 500 to a display (an example of a display medium) (not shown) to display a graphic with a predetermined shape on the display medium. The display unit 600 has, for example, a projector function and projects directly onto the display. The display is, for example, a front windshield of a moving body or a transparent combiner provided separately from the windshield. That is, the display unit 600 projects a predetermined image on the windshield, thereby displaying a figure with a predetermined shape on the windshield. The displayed figure of a predetermined shape is visually recognized as a virtual image by a passenger of the moving body. The transparent combiner is, for example, a combiner 801 shown in FIG.

  Note that the display unit 600 may display on a display, for example, instead of using the projector function. In this case, the display is a transmissive display, and the predetermined image generated by the image generation unit 500 is image data. In other words, the display unit 600 outputs image data to the transmissive display to display a figure with a predetermined shape on the transmissive display. Since the principle that the image data input to the transmissive display is displayed as a figure with a predetermined shape is a known technique, description thereof is omitted.

  The display medium may be a hologram. When a hologram is used, a part of the parallel light flux group that is guided by total internal reflection of the light guide plate by using the light guide plate that totally reflects and guides the parallel light flux group that satisfies the total internal reflection condition of the light guide plate. It is also possible to make the occupant visually recognize the virtual image by injecting. In the method using the light guide plate, the image data is not directly projected as in the projector, but for the sake of convenience of explanation, it will be described by the definition of projection as in the projector method.

  Examples of displays include LCD (Liquid Crystal Display), HUD (Head-Up Display), HMD (Head-Mounted Display or Helmet-Mounted Display), glasses-type display (Smart Glasses), navigation display, meter display, etc. Applicable display etc. are applied. For example, the HUD may be a windshield of a vehicle, or may be a separately provided glass surface, plastic surface, or the like. The windshield may be, for example, a windshield, a vehicle side glass or a back glass. Further, as described above, the display medium may be a transmissive display. The transmissive display is, for example, a transmissive organic EL display or a transparent display using glass that emits light when irradiated with light of a specific wavelength. You can see the display above. The transmissive display is a display medium that transmits light.

  When the display medium is a moving body windshield, the display unit 600 projects a predetermined image on the windshield to display a figure with a predetermined shape on the windshield. On the other hand, when the display medium is a transmissive display, the predetermined image is image data, and the display unit 600 outputs the image data to the transmissive display so that a figure with a predetermined shape is displayed on the transmissive display. Here, for convenience of explanation, the output is defined as a superordinate concept of projection in the explanation of the present embodiment.

  Note that the display system 10 may include the above-described display.

  Further, the graphic described above may be generated not by the image generation unit 500 but by the display control device 400 or other components not shown.

  For example, when a predetermined image is projected onto a display medium, the graphic generated in the display system 10 is visually recognized as a virtual image by a passenger of a moving body. At this time, the figure may be projected on the display so as to be superimposed on the field of view of the passenger. In addition, since the principle by which the driver | operator visually recognizes the figure projected on the display as a virtual image is a well-known technique, description is abbreviate | omitted.

  Next, an operation example of the display system 10 according to the present embodiment will be described. FIG. 3 is a flowchart showing an operation example of the display system 10 according to the present embodiment. The flow in FIG. 3 is performed at predetermined operation intervals such as 30 milliseconds and 100 milliseconds, for example. For example, when the sensor 100 is a sensing camera and peripheral information is output to the recognition unit 200 at a frame rate such as 15 fps or 30 fps, the flow of FIG. 3 may be performed in accordance with the output interval.

  In step S001, the recognition unit 200 recognizes an object present around the vehicle based on the peripheral information from the sensor 100.

  In step S002, the calculation unit 300 calculates recognition accuracy based on the recognition result information from the recognition unit 200.

  In step S003, the determination unit 401 determines the level of recognition accuracy based on the recognition result information from the calculation unit 300 and a predetermined threshold value. That is, when the recognition accuracy value indicated by the recognition result information is greater than or equal to the threshold, the determination unit 401 determines that the accuracy is high (step S003: YES). In this case, the flow proceeds to step S004. On the other hand, when the recognition accuracy value indicated by the recognition result information is smaller than the threshold, the determination unit 401 determines that the accuracy is low (step S003: NO). In this case, the flow proceeds to step S005.

  In step S004, when the determination result information from the determination unit 401 indicates high accuracy, the display control unit 402 determines the number of divisions to be n (n is an integer of 2 or more).

  In step S005, when the determination result information from the determination unit 401 indicates low accuracy, the display control unit 402 does not divide the figure or sets the number of divisions to m (m is an integer of 2 or more smaller than n). decide.

  Here, a specific example of the process of determining the number of divisions and the division method in steps S004 and S005 will be described with reference to FIGS.

  First, an example of a graphic generated by the display system 10 will be described with reference to FIG. In FIG. 4, a graphic 301 indicates a vehicle, and a graphic 302 indicates the vicinity of the vehicle (positional relationship between the vehicle and the object). The graphic 301 (an example of the first graphic) is not an object of division, but is used as a reference position when determining the division method. A figure 302 (an example of a second figure) is an object of division, and FIG. 4 shows a state before division. The figure 301 and the figure 302 shown in FIG. 4 are default shapes, and are stored in advance in the display control unit 402 (or a storage unit (not shown)) in this shape. The graphic 302 is always displayed on the display in the shape before division shown in FIG. 4 or the shape after division shown in FIGS.

  Next, determination of the number of divisions will be described. For example, the number of divisions and the level of accuracy are associated in advance, such as “the number of divisions in the case of low accuracy is 3” and “the number of divisions in the case of high accuracy is 5”. I remember it. Therefore, the display control unit 402 determines the number of divisions to 3 when the determination result information indicates low accuracy, and determines the number of divisions to 5 when the determination result information indicates high accuracy.

  After determining the number of divisions as described above, the display control unit 402 reads the figures 301 and 302 shown in FIG. 4 and determines the division method.

  Next, determination of the division method will be described with reference to FIGS.

  First, an example of determining the first division method will be described. The first division method is a division method in the case where a relative angle is used in determining the highlight area. For example, when the number of divisions is determined to be 3 (m = 3) in the case of low accuracy, the display control unit 402 uses a dividing line 303 that extends radially around the figure 301 as shown in FIG. 5A. Is divided into three. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 5B or FIG. 5C. Further, for example, when the number of divisions is determined to be 5 (n = 5) in the case of high accuracy, the display control unit 402 uses a dividing line 303 that spreads radially around the figure 301 as shown in FIG. 5D. A division method for dividing the figure 302 into five is determined. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 5E or FIG. 5F.

  Next, an example of determining the second division method will be described. The second division method is a division method in the case where a distance is used in determining the highlight area. For example, when the number of divisions is determined to be 2 (m = 2) in the case of low accuracy, the display control unit 402, as shown in FIG. 6A, the division curve extending in the circumferential direction of a semicircle centered on the graphic 301. A division method for dividing the figure 302 into two is determined using 304. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 6B or 6C. For example, when the number of divisions is determined to be 3 (n = 3) in the case of high accuracy, the display control unit 402 has a semicircular division curve 304 (centered on a graphic 301 as shown in FIG. 6D. In this case, a division method for dividing the figure 302 into three parts using a plurality of division curves having different radii is determined. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 6E or FIG. 6F.

  In the above description, it has been described that the figure is equally divided, but the present invention is not limited to this. If a division method is defined in advance for each division number, division can be performed by an arbitrary division method.

  The specific example of the determination process of the number of divisions and the division method has been described above. Hereinafter, the flow returns to the flow of FIG.

  In step S006, the display control unit 402 determines the highlighted display area based on the recognition result information from the recognition unit 200.

  Here, a specific example of the highlight area determination process in step S006 will be described with reference to FIGS. As described above, the highlighted area is determined using either the relative angle or the distance included in the recognition result information from the recognition unit 200.

  First, the process of determining the highlight area when the relative angle is used (when the first division method is determined) will be described with reference to FIG.

  FIG. 7A shows an example of a first table used when the recognition accuracy is low and the highlight area is determined using the relative angle. The first table is stored in advance in the display control unit 402 (or a storage unit (not shown)). In the first table, a relative angle as a condition and a highlight display area are associated with each other. In the first table, the angle A is a horizontal angle with respect to the front of the vehicle (or the position of the sensor, the position of the driver), and the right is positive. For example, when the relative angle included in the recognition result information indicates 40 degrees on the right side (A = 40), the display control unit 402 determines the highlighted display area as the area 603. When the display processing of the highlighted display area is executed by the image generation unit 500, the area 603 is highlighted on the display in a color different from the colors of the areas 601 and 602, for example, as shown in FIG. 7B. Is done.

  FIG. 7C shows an example of a second table that is used when the recognition accuracy is high and the highlight region is determined using the relative angle. Similar to the first table, the second table is stored in advance in the display control unit 402 (or a storage unit (not shown)), and the relative angle as a condition and the highlighted display area are associated with each other. For example, when the relative angle included in the recognition result information indicates 40 degrees on the right side (A = 40), the display control unit 402 determines the highlighted display area as the area 607. When the display processing of the highlighted display area is executed by the image generation unit 500, the area 607 is highlighted on the display in a color different from the colors of the areas 604 to 606 and 608, for example, as shown in FIG. 7D. Displayed.

  Next, the highlight display area determination process when distance is used (when the second division method is determined) will be described with reference to FIG.

  FIG. 8A shows an example of a third table used when the recognition accuracy is low and the highlight region is determined using the distance. The third table is stored in advance in the display control unit 402 (or a storage unit (not shown)). In the third table, the distance (for example, the unit is m) as a condition and the highlighted display area are associated with each other. For example, when the distance included in the recognition result information indicates 55 m (D = 55), the display control unit 402 determines the highlighted display area as the area 702. When the display processing of the highlight display area is executed by the image generation unit 500, the area 702 is displayed on the display with a color different from the color of the area 701, for example, as shown in FIG. 8B. .

  FIG. 8C shows an example of a fourth table used when the recognition accuracy is high and the highlight region is determined using the distance. Similar to the third table, the fourth table is stored in advance in the display control unit 402 (or a storage unit (not shown)), and the distance as the condition and the highlighted display area are associated with each other. For example, when the distance included in the recognition result information indicates 55 m (D = 55), the display control unit 402 determines the highlighted display area as the area 704. When the display process of the highlight area is executed by the image generation unit 500, the area 704 is highlighted on the display in a color different from the colors of the areas 703 and 705, for example, as shown in FIG. 8D. Is done.

  The specific example of the highlight area determination process has been described above.

  Then, the display control unit 402 outputs to the image generation unit 500 control information that controls to generate a graphic based on the determined number of divisions, division method, and highlighted display area and display the figure on the display. Hereinafter, the flow returns to the flow of FIG.

  In step S007, the image generation unit 500 generates a graphic based on the control information from the display control unit 402, and the display unit 600 displays the graphic on the display. As a result, for example, the display shown in FIG. 7B, FIG. 7D, FIG. 8B, or FIG. 8D is performed.

  Next, another configuration example of the display system 10 illustrated in FIG. 17 will be described. As described above, the display system 10 includes the detection device 700, the calculation unit 300, the display control device 400, the image generation unit 500, and the display unit 600. The display control apparatus 400 includes an acquisition unit 404 and a control unit 405. Note that the functions of the control unit 405 are the same as the functions of the determination unit 401 and the display control unit 402. Hereinafter, each component of the display system 10 will be described with reference to FIG.

  The detection device 700 detects a predetermined object existing around the moving body. The detection device 700 has at least a sensor. The detection device 700 may include the recognition unit 200. Therefore, the detection result of the detection apparatus 700 includes at least a sensing result. The detection device 700 senses the surroundings of the vehicle every predetermined time. Whether or not to recognize a predetermined target object is determined based on the specifications of the apparatus based on the peripheral information of the moving body that is the sensing result. When the detection device 700 recognizes a predetermined object, the detection device 700 recognizes the predetermined object based on the peripheral information. The method for recognizing the object is as described above.

  The calculation unit 300 calculates the detection accuracy of the detection device of the detection device 700. Here, the detection accuracy is the same as the recognition accuracy. The calculation unit 300 outputs detection accuracy information indicating the detection accuracy value to the display control device 400. Since the detection accuracy calculation method is as described above, a description thereof will be omitted.

  The display control device 400 includes an acquisition unit 404 that receives detection accuracy from the calculation unit 300 and a control unit 405. When the display control apparatus 400 is configured by hardware, the acquisition unit 404 is a connector, an input terminal, or the like, and is an input unit that does not have a substantial function.

  The control unit 405 includes a determination unit 401 and a display control unit 402. In other words, the control unit 405 controls the image generation unit 500 to generate a predetermined image representing a figure with a predetermined shape when displayed on the display medium based on the detection accuracy.

  The image generation unit 500 generates a predetermined image based on the control information from the display control unit 402. The predetermined image is displayed on the display medium by the display unit 600 described later, and represents a figure having a predetermined shape. A display example of a figure having a predetermined shape will be described later with reference to FIGS. The predetermined image may be an image or image data. When the display unit 600 described later has a projector function, the image generation unit 500 generates an image, and the image is projected by the display unit 600. On the other hand, when the display unit 600 described later does not have a projector function, the image generation unit 500 generates image data, and the image data is output by the display unit 600.

  The display unit 600 outputs a predetermined image generated by the image generation unit 500 to a display (an example of a display medium) (not shown) to display a graphic with a predetermined shape on the display medium. The display unit 600 has, for example, a projector function and projects directly onto the display. The display is, for example, a front windshield of a moving body or a transparent combiner (for example, a combiner 801 shown in FIG. 20) provided separately from the windshield. That is, the display unit 600 projects a predetermined image on the windshield, thereby displaying a figure with a predetermined shape on the windshield. The displayed figure of a predetermined shape is visually recognized as a virtual image by a passenger of the moving body.

  FIG. 21 is a flowchart illustrating an operation example of the display control apparatus 400 included in the display system 10 illustrated in FIG. Hereinafter, an operation example of the control unit 405 will be described with reference to FIGS. 17 and 21.

  In step 101, when the acquisition unit 404 receives the detection accuracy (step S101: YES), in step S102, the control unit 405 determines whether the recognition accuracy is high or low based on the detection accuracy and a predetermined threshold value. To do. In step 101, when the acquisition unit 404 has not received the detection accuracy (step S101: NO), the flow ends.

  In step S10, when the detection accuracy is equal to or higher than the threshold value, the control unit 405 determines that the detection accuracy is high (step S102: YES). In this case, the flow proceeds to step S103. On the other hand, when the detection information is smaller than the threshold value in step S102, the control unit 405 determines that the accuracy is low (step S102: NO). In this case, the flow proceeds to step S104.

  In step S103, the control unit 405 determines the division number to be n (n is an integer of 2 or more).

  In step S104, the control unit 405 determines not to divide the figure, or determines the number of divisions to be m (m is an integer of 2 or more smaller than n).

  Here, the specific example of the process of determining the number of divisions and the division method in steps S103 and S104 is as described above with reference to FIGS.

  Next, in step S105, the control unit 405 controls the image generation unit 500 so as to generate a predetermined image. Here, the predetermined image is an image representing a figure having a predetermined shape when displayed on the display medium. The figure having a predetermined shape is the figure described with reference to FIGS.

  For example, when the number of divisions is determined to be n in step S <b> 103, the control unit 405 controls the image generation unit 500 to generate a predetermined image divided into n using the determined division method. On the other hand, when the division is not performed or the number of divisions is determined to be m in step S103, the control unit 405 generates a predetermined image that is not divided, or is divided into m using the determined division method. The image generation unit 500 is controlled so as to generate the predetermined image.

  Next, in step S106, the image generation unit 500 generates a predetermined image under the control of the control unit 405.

  Next, in step S <b> 107, the display unit 600 outputs a predetermined image generated by the image generation unit 500 to the display medium, thereby displaying a graphic with a predetermined shape on the display medium. Then, the flow returns to step S101.

  As described above, the detection device 700 detects a predetermined object existing around the moving body, and the calculation unit 300 calculates the detection accuracy of the detection device 700. The image generation unit 500 generates a predetermined image, and the display unit 600 outputs a predetermined image to the display medium, thereby displaying a graphic with a predetermined shape on the display medium. The display control device 400 controls the image generation unit 500 so as to generate a predetermined image representing a figure having a predetermined shape when displayed on the display medium based on the detection accuracy and the acquisition unit 404 that receives the detection accuracy. Unit 405. When the acquisition unit 404 receives the first detection accuracy (high accuracy), the control unit 405 displays the first predetermined shape graphic divided into n pieces when displayed on the display medium. The image generation unit 500 is controlled to generate a predetermined image. After that, when the acquisition unit 404 receives the second detection accuracy (low accuracy) lower than the first detection accuracy (high accuracy), when the acquisition unit 404 is displayed on the display medium, it is divided into m pieces, or The image generation unit 500 is controlled so as to generate a second predetermined image representing a graphic having a second predetermined shape that is not divided. Here, n is an integer of 2 or more, and m is an integer of 2 or more smaller than n.

  Note that the predetermined image and the figure with the predetermined shape are ideally the same. Although it differs somewhat depending on conditions such as the degree of curvature of the display medium, it is substantially the same. The predetermined image is generated by the image generation unit 500, and a graphic having a predetermined shape is displayed on the display medium. Moreover, the determination of the highlight area described with reference to FIG. 7 may be performed only when an attention object exists around the vehicle. That is, in the display system 10 according to the present embodiment, it is not an essential element to determine the highlight area and display it on the display medium. The object is achieved only by displaying a figure of a predetermined shape on the display medium based on the detection accuracy.

  FIG. 22 shows the processing of the display system 10 when the display system 10 shown in FIG. 17 displays a figure of a predetermined shape on the display medium in response to the recognition of a predetermined object existing around the moving body. It is a flow. This processing flow will be described below.

  In step S111, when the detection apparatus 700 recognizes a predetermined object existing around the moving body (step S111: YES), the process proceeds to step S112. If the detection device 700 does not recognize the predetermined object (step S111: NO), the flow ends.

  In step S112, after the calculation unit 300 calculates the detection accuracy, the flow proceeds to step S102. Subsequent processing is the same as that shown in FIG.

  The divided figure with a predetermined shape does not need to be divided equally. For example, as shown in FIG. For example, when the detection device 700 is a camera, depending on the sunlight conditions such as shade, it is conceivable that the recognition accuracy partially decreases, such as the left side ahead of the host vehicle and the right side ahead of the host vehicle. The detection device 700 may change the number of divisions of the figure of a predetermined shape partially instead of uniformly according to the recognition accuracy that varies from place to place. FIG. 23A shows a display example in which only the right front display resolution is reduced when the right front recognition accuracy is reduced as viewed from the host vehicle. On the other hand, FIG. 23B shows a display example in which only the left front display resolution is reduced when the left front recognition accuracy is low as viewed from the host vehicle.

  Moreover, the division | segmentation of the figure of a predetermined shape may just be divided with the broken line, as shown to FIG. 24A-FIG. 24D and FIG. 25A-FIG. 25D. Furthermore, not only a broken line but a solid line, a dashed-dotted line, and a dotted line may be sufficient.

  Further, as shown in FIG. 18, the figure having a predetermined shape is not limited to a fan shape, and may be a linear shape substantially parallel to the horizontal axis. This is because the direction of a predetermined object existing around the moving body can be grasped even with the linear shape. FIG. 18A shows a state where it is not divided, and FIGS. 18B and 18C show a state where it is not divided.

  In the above description, the display device 20 has been described as including the display control device 400, the image generation unit 500, and the display unit 600. However, when the display medium is a combiner, the display device 20 includes the display medium. Also good. FIG. 20 shows a configuration example of the display device 20 when the display medium is a combiner. The display device 20 includes a combiner 801 as a display medium.

  As described above, the present embodiment is characterized in that a graphic representing recognition accuracy is always displayed on the display, and the number of divisions of the graphic is changed according to the recognition accuracy. Thereby, the driver | operator of a vehicle can grasp | ascertain recognition accuracy always and intuitively. As a result, the driver can perform the driving operation without depending on the display system excessively.

  In the present embodiment, even if the recognition result (for example, relative angle or distance) of the object by the recognition unit is the same, the number of divisions of the figure and the position of the highlight area are changed according to the recognition accuracy. It is characterized by that. Thereby, the presence direction of the object or the distance between the object and the vehicle can be displayed with a low resolution when the recognition accuracy is low, or with a high resolution when the recognition accuracy is high.

  As mentioned above, although Embodiment 1 of this invention was demonstrated, this invention is not limited to the said Embodiment 1, and various deformation | transformation are possible. Hereinafter, modified examples will be described.

(Modification 1)
In the above embodiment, the second figure to be divided is a semicircle (see, for example, the figure 302 in FIG. 4), but the shape of the first figure is not limited to this. For example, by using a sensor capable of sensing the side and rear of the vehicle in addition to the front of the vehicle as the sensor 100, it is possible to detect objects in all directions around the vehicle. In this case, for example, as shown in FIGS. 9A and 9B, an annular figure 802 (an example of a second figure) indicating the periphery of the vehicle and all its directions may be used. For example, when the relative angle is used in determining the highlight region and the recognition accuracy is low, the display control unit 402 determines the number of divisions to 4 (m = 4), and then selects FIG. 9A. As shown in FIG. 5, a division method for dividing the figure 802 into four parts using a division line 803 passing through the figure 301 is determined. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 9B or FIG. 9C. Further, for example, when the relative angle is used in determining the highlight display area and the recognition accuracy is high, the display control unit 402 determines the number of divisions to 6 (n = 6), As shown in FIG. 9D, a division method for dividing the figure 802 into six parts is determined using a dividing line 803 passing through the figure 301. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 9E or FIG. 9F.

(Modification 2)
When the distance is used in determining the highlight display area, for example, as shown in FIGS. 10A and 10B, a polygonal figure 902 may be used as the second figure to be divided. For example, when the recognition accuracy is low accuracy, the display control unit 402 determines the number of divisions to 2 (m = 2), and then, as shown in FIG. 10A, the traveling direction of the vehicle (the tip of the graphic 301 indicates A division method for dividing the figure 902 into two parts is determined using a division line 903 extending in a direction perpendicular to (direction). When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 10B or FIG. 10C. For example, when the recognition accuracy is high, the display control unit 402 determines the division number to be 3 (n = 3), and then, as shown in FIG. 10D, the division straight line perpendicular to the traveling direction of the vehicle. 903 is used to determine a division method for dividing the figure 902 into three. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 10E or FIG. 10F.

(Modification 3)
In the above-described embodiment, the first division method is performed when the relative angle is used when determining the highlight region, while the second division method is used when the distance is used when determining the highlight region. Although the example which performs is demonstrated, it is not limited to this. For example, both the relative angle and the distance may be used when determining the highlight area. In this case, the first division method and the second division method may be combined. For example, when the recognition accuracy is low accuracy, the display control unit 402 performs a dividing method in which the figure 302 is divided into three by the dividing line 303 and the figure 302 is divided into two by the dividing curve 304 as shown in FIG. 11A. decide. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 11B or FIG. 11C. For example, when the recognition accuracy is high, the display control unit 402 divides the figure 302 into five by the dividing line 303 and divides the figure 302 into three by the dividing curve 304 as shown in FIG. 11D. Decide how. When this division method is executed by the image generation unit 500, it is displayed on the display as shown in FIG. 11E or FIG. 11F. In FIG. 11, the highlighted display area is not shown, but this may be performed as follows. For example, when both the relative angle and the distance are highly accurate, one area divided by the dividing line 303 and the dividing curve 304 shown in FIG. 11D may be displayed as the highlighted area. For example, when the distance is low accuracy and the relative angle is high accuracy, the distance is divided into three in the circumferential direction as shown in FIG. 11A, and the relative angle is a straight line passing through the graphic 301 as shown in FIG. 11D. Then, one of the divided areas may be set as an emphasis area.

(Modification 4)
In order to further improve the recognition accuracy, the sensor 100 may include a plurality of types of sensors such as a millimeter wave sensor, a camera, and a laser radar. In this case, the calculation unit 300 may calculate the recognition accuracy higher as the number of operating sensors increases. Further, the calculation unit 300 may calculate the recognition accuracy based on the number of normally operating sensors or the number of malfunctioning sensors among the plurality of sensors.

(Modification 5)
When the number of divisions of the second graphic is changed according to the recognition accuracy, the display area of the highlight area changes. The area of the highlighted area does not indicate the degree of danger (the possibility that the vehicle will collide with the object, also called the degree of urgency). For example, if the area of the highlighted area increases, the degree of danger increases. There is a risk of giving the passenger a false impression. Therefore, when the area of the highlighted display area transitions from small to large, the display control unit 402 may lower the brightness of the highlighted display area after the transition than the brightness of the highlighted display area before the transition. For example, when the recognition accuracy is lowered during display of the graphic shown in FIG. 7D and the display is switched to the graphic display shown in FIG. 7B, the display control unit 402 controls the luminance of the region 603 to be lower than the luminance of the region 607. On the other hand, when the area of the highlight display region transitions from large to small, the display control unit 402 may increase the brightness of the highlight display region before the transition after the transition. For example, when the recognition accuracy increases during the display of the graphic shown in FIG. 7B and the display is switched to the graphic display shown in FIG. 7D, the display control unit 402 controls the luminance of the region 607 to be higher than the luminance of the region 603. By such control, it is possible to avoid giving the above-mentioned erroneous impression to the occupant.

(Modification 6)
In the above-described embodiment, when the highlighted area is determined, the position of the highlighted area is determined according to the relative angle. However, the highlighted area may be determined by a different method. This example will be described using the figure shown in FIG. 7B. For example, when the vehicle is traveling in the center lane of three parallel lanes, and there is a preceding vehicle traveling in the same lane as the object to be recognized, the display control unit 402 displays the region 602. Decide on the highlight area. Further, when there is a preceding vehicle traveling in the right lane, the display control unit 402 determines the region 603 as a highlighted display region. Further, when there is a preceding vehicle traveling in the left lane, the display control unit 402 determines the region 601 as the highlighted display region.

(Modification 7)
In the above embodiment, the determination unit 401 compares the recognition accuracy with a threshold value to perform a binary determination as to whether the recognition accuracy is high or low. However, the present invention is not limited to this. . For example, the recognition accuracy may be determined based on three or more values by providing a plurality of threshold values. Thereby, the pattern of the division | segmentation number of a figure can be increased, and a more detailed recognition accuracy can be conveyed to a driver | operator. In addition, the location of the object and / or the distance to the object can be transmitted to the driver in more detail.

(Modification 8)
In the above embodiment, the determination unit 401 determines whether the accuracy is high and the display control unit 402 determines the number of divisions based on the determination. However, the present invention is not limited to this. For example, the determination unit 401 may determine the number of divisions. For example, the determination unit 401 determines the number of divisions based on a table in which the recognition accuracy value and the number of divisions are associated with each other and the recognition accuracy value from the calculation unit 300, and uses the determination result information as the determination result information. May be output. Alternatively, for example, the determination unit 401 calculates the number of divisions using a predetermined mathematical formula for calculating the number of divisions from the recognition accuracy value calculated by the calculation unit 300, and outputs the calculated number to the display control unit 402 as determination result information. May be. Note that the processing of this modification may be performed by the display control unit 402 by configuring the display control unit 402 to directly receive the recognition accuracy value from the calculation unit 300 (in this case, the determination unit 401 is configured). Can be omitted).

(Modification 9)
The first graphic or the second graphic may be one in which the entire graphic is filled with a predetermined color, or only the outline of the graphic is colored with a predetermined color.

(Modification 10)
Depending on whether the object is detected by the sensor 100, the color of the first graphic and / or the second graphic may be changed. For example, when an object is not detected, the display control unit 402 displays a figure using a color (for example, blue or green) that gives a low impression to the driver. On the other hand, when an object is detected, the display control unit 402 displays a figure using a color (for example, yellow or red) that gives a high impression to the driver.

(Modification 11)
The color of the highlight area may be changed according to the distance. For example, the display control unit 402 performs control so that yellow is used when the distance is greater than or equal to a predetermined value, and red is used when the distance is less than the predetermined value.

(Modification 12)
Even if the sensor 100 is of the same type, the sensing range is different. For example, in the case of a camera, the detection range is narrow (for example, 10 degrees in the horizontal direction around the front) depending on the lens used, or the detection range is wide (for example, 30 in the horizontal direction around the front, respectively). There is a thing). Therefore, the sensing range may be indicated by changing the overall shape of the second graphic. This example will be described using a graphic 302 shown in FIG. For example, when the sensing range is narrow, the angle of the figure 302 is narrowed and changed to a sharper sector. As a result, the driver can intuitively grasp that the sensing range is narrow.

(Modification 13)
In the above embodiment, the display control unit 402 determines the division method using the division line or the division curve according to the determined number of divisions. However, the present invention is not limited to this. For example, the display control unit 402 (or a storage unit (not shown)) may hold the second graphic divided by a predetermined number of divisions as a template. In this case, the display control unit 402 appropriately selects a template corresponding to the determination result of the determination unit 401.

(Modification 14)
For example, when a plurality of objects are recognized by the recognition unit 200, the calculation unit 300 and the determination unit 401 may perform calculation and determination of recognition accuracy for each of the plurality of objects. Then, for example, the display control unit 402 determines the number of divisions and the division method of the second graphic, and determines the highlight region in accordance with the calculation of the recognition accuracy and the determination of the recognition accuracy for the object with the lower recognition accuracy. May be performed.

(Modification 15)
Only the second graphic (for example, graphic 302) may be displayed without displaying the first graphic (for example, graphic 301).

(Embodiment 2)
A second embodiment of the present invention will be described with reference to FIG. FIG. 12 is a block diagram illustrating a configuration example of the display system 10 according to the present embodiment. 12 is different from FIG. 1 in that the sensor 101 is added in the display system 10 and the recognition unit 200 and the calculation unit 300 are not provided. 12 has been described with reference to FIG. 1, and detailed description thereof will be omitted below.

  The sensor 100 is a sensing camera, for example. The sensor 100 detects the vicinity of the vehicle and outputs the detection result to the determination unit 401.

  In addition, the sensor 101 detects whether the vehicle is traveling in a bad environment such as rain, fog, sleet, hail, snow, etc., or the surroundings of the vehicle due to backlight or oncoming headlights. The sensor can detect whether the illuminance of the vehicle has increased, or the illuminance around the vehicle has decreased at night or due to traveling in the tunnel, for example, a raindrop sensor or an illuminance sensor. The sensor 101 detects bad weather due to rain, fog, snow, or backlight, illumination light from other vehicles, nighttime travel, illuminance change due to travel in a tunnel, and outputs the detection result to the determination unit 401.

  The determination unit 401 determines that the recognition accuracy of the sensor 100 is the first recognition accuracy when bad weather or illuminance change is not detected in the sensor 101. Further, when bad weather or illuminance change is detected in the sensor 101, the determination unit 401 determines that the recognition accuracy of the sensor 100 is the second recognition accuracy lower than the first recognition accuracy.

  When the determination unit 401 determines that the recognition accuracy of the sensor 100 is the first recognition accuracy, the display control unit 402 indicates the positional relationship between the predetermined object and the vehicle when displayed on the display medium. , N (integer greater than or equal to 2), the image generation unit 500 is controlled to generate a predetermined image representing a figure of a predetermined shape. Further, when it is determined that the recognition accuracy of the sensor 100 is the second recognition accuracy, the display control unit 402 is not divided when displayed on the display medium, or m (two or more smaller than n). The image generation unit 500 is controlled so as to generate a predetermined image representing a figure of a predetermined shape divided into an integer).

  As described above, the present embodiment can obtain the same effects as those of the first embodiment. Note that each modification described in Embodiment 1 may be applied to this embodiment as appropriate.

(Embodiment 3)
Embodiment 3 of the present invention will be described with reference to the drawings.

  When the number of graphic divisions is changed according to the recognition accuracy, if the second graphic being displayed and the second graphic displayed next are simultaneously displayed, the image will change greatly instantaneously. , It will be annoying to the driver. Therefore, in the present embodiment, when the number of divisions of the graphic is changed according to the recognition accuracy, the deletion of the second graphic being displayed and the display of the second graphic to be displayed next are changed in time series. Make control.

  First, a configuration example of the display system 10 according to the present embodiment will be described. FIG. 13 is a block diagram illustrating a configuration example of the display system 10 according to the present embodiment. FIG. 13 is different from FIG. 1 in that a display correction unit 403 is added to the display control device 400. In FIG. 13, the same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

  The display correction unit 403 changes the number of divisions between the deletion of the second graphic being displayed (hereinafter referred to as the graphic being displayed) and the second graphic (hereinafter referred to as the latest graphic) to be displayed next. In this case, the control information from the display control unit 402 is corrected and output to the image generation unit 500. The control information after correction is content that causes the image generation unit 500 to execute control to change the erasure of the displayed graphic and the display of the latest graphic in time series. The detailed operation of the display correction unit 403 will be described later with reference to FIG.

  Next, an operation example of the display system 10 according to the present embodiment will be described. FIG. 14 is a flowchart showing an operation example of the display system 10 according to the present embodiment.

  In step S011, the display correction unit 403 acquires the latest control information from the display control unit 402. This control information includes, for example, the shape of the latest graphic, the number of divisions, the division method, and the highlight area.

  In step S012, the display correction unit 403 compares the number of divisions included in the control information related to the graphic being displayed (hereinafter referred to as control information being displayed) with the number of divisions included in the latest control information. It is determined whether there is a change in the number of divisions between them. It is assumed that the display correction unit 403 stores the control information being displayed before acquiring the latest control information.

  As a result of the determination process in step S012, when it is determined that there is no change in the number of divisions (step S012: NO), the display correction unit 403 does not correct the latest control information, and displays the latest control information as an image generation unit. 500, and the latest control information is newly stored. Thereafter, the flow proceeds to step S016.

  On the other hand, if it is determined that there is a change in the number of divisions as a result of the determination process in step S012 (step S012: YES), the flow proceeds to step S013.

  In step S013, the display correction unit 403 calculates an elapsed time from the time when the latest control information is acquired (hereinafter simply referred to as elapsed time).

  In step S014, the display correction unit 403 sets the luminance of the graphic being displayed according to the elapsed time. A specific example of this setting is shown in FIG. 15A. As shown in FIG. 15A, the display correction unit 403 sets the luminance (relative value) of the graphic being displayed to gradually decrease according to the elapsed time.

  In step S015, the display correction unit 403 sets the brightness of the latest graphic in accordance with the elapsed time. A specific example of this setting is shown in FIG. 15B. As shown in FIG. 15B, the display correction unit 403 sets the luminance (relative value) of the latest graphic to gradually increase according to the elapsed time.

  Then, the display correction unit 403 outputs the control information being displayed, the latest control information, the luminance setting in step S014, and the information including the luminance setting in step S015 to the image generation unit 500 as corrected control information. Further, the display correction unit 403 newly stores the latest control information.

  In step S016, the image generation unit 500 generates a figure based on the control information from the display correction unit 403, and the display unit 600 displays the figure on the display. For example, when it is determined that there is no change in the number of divisions as a result of the determination process in step S012, a graphic is generated and displayed based on the latest control information that has not been corrected. On the other hand, if it is determined that the number of divisions has changed as a result of the determination process in step S012, a graphic is generated and displayed based on the corrected control information. A specific example is shown in FIG. 15C. For example, when the recognition accuracy decreases during display of the graphic (example of displayed graphic) shown in FIG. 7D and the display is switched to display of the graphic (example of latest graphic) shown in FIG. 7B, the elapsed time as shown in FIG. 15C Accordingly, the brightness of the graphic in FIG. 7D is gradually decreased and the brightness of the graphic in FIG. 7B is gradually increased.

  As described above, the present embodiment is characterized in that when the number of divisions of a graphic is changed according to the recognition accuracy, control is performed to change the erasure of the displayed graphic and the display of the latest graphic in time series. To do. As a result, the graphic being displayed gradually disappears and the latest graphic appears to appear gradually, so that the troublesomeness given to the driver can be reduced.

  As mentioned above, although Embodiment 3 of this invention was demonstrated, this invention is not limited to the said Embodiment 3, and a various deformation | transformation is possible. For example, each modification and / or second embodiment described in the first embodiment may be applied to the third embodiment as appropriate.

  In addition, the function of each part of the display system 10 in each embodiment mentioned above and the display control apparatus 400 may be implement | achieved by the computer program.

  FIG. 16 is a diagram illustrating a hardware configuration of a computer that realizes the functions of the respective units by a program. The computer 1000 includes an input device 1001 such as an input button and a touch pad, an output device 1002 such as a display and a speaker, a CPU (Central Processing Unit) 1003, a ROM (Read Only Memory) 1004, a RAM (Random Access Memory) 1005, and a hard disk. A storage device 1006 such as a device or SSD (Solid State Drive), a reading device 1007 that reads information from a recording medium such as a DVD-ROM (Digital Versatile Disk Read Only Memory) or a USB (Universal Serial Bus) memory, and communication via a network A transmission / reception device 1008 is provided, and each unit is connected by a bus 1009.

  Then, the reading device 1007 reads the program from a recording medium on which a program for realizing the functions of the above-described units is recorded, and stores the program in the storage device 1006. Alternatively, the transmission / reception device 1008 communicates with a server device connected to the network, and causes the storage device 1006 to store a program for realizing the function of each unit downloaded from the server device.

  Then, the CPU 1003 copies the program stored in the storage device 1006 to the RAM 1005, and sequentially reads and executes the instructions included in the program from the RAM 1005, thereby realizing the functions of the above-described units. Further, when executing the program, the RAM 1005 or the storage device 1006 stores information obtained by various processes described in each embodiment, and is used as appropriate.

  The present invention is useful for a display control apparatus and a display control program that control display of information provided to a user (for example, an occupant such as a vehicle or a user wearing a display device).

  Each functional block used in the description of the above embodiment may be realized as an LSI (Large Scale Integration) that is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them. The name used here is LSI, but it may also be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

  Further, the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI, or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

  Furthermore, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. Biotechnology can be applied.

DESCRIPTION OF SYMBOLS 10 Display system 20 Display apparatus 100, 101 Sensor 200 Recognition part 300 Calculation part 301,302,802,902 Graphic 303,803,903 Divided straight line 304 Divided curve 400 Display control device 401 Judgment part 402 Display control part 403 Display correction part 404 Acquisition unit 405 Control unit 500 Image generation unit 600 Display unit 601 to 608, 701 to 705 Region 700 Detection device 801 Combiner 1000 Computer 1001 Input device 1002 Output device 1003 CPU
1004 ROM
1005 RAM
1006 Storage device 1007 Reading device 1008 Transmission / reception device 1009 Bus

Claims (3)

An input unit for receiving detection accuracy of an object existing around the moving body;
A control unit that controls the image generation unit to generate a predetermined image representing a presentation image obtained by dividing a figure of a predetermined shape when displayed on a display medium based on the detection accuracy;
When the detection accuracy is lower than the detection accuracy in the direction other than the first direction in the vicinity of the moving body,
In the presented image, the size of the plurality of regions formed by dividing the figure of the predetermined shape is not uniform.
Display control device. Of the plurality of regions, the size of the first region corresponding to the first direction is larger than the size of one or more second regions corresponding to directions other than the first direction.
The display control apparatus according to claim 1. A display that includes an input unit that receives detection accuracy of an object existing around a moving body, and an image generation unit that generates a predetermined image representing a presentation image obtained by dividing a figure of a predetermined shape when displayed on a display medium A display control program executed in a display control device in a system,
For the computer of the display control device,
A first predetermined image representing a first presentation image in which the sizes of a plurality of regions obtained by dividing the figure of the predetermined shape are equal when the detection accuracy around the moving body is equal to the first detection accuracy. Processing to generate the image generation unit,
The size of the plurality of regions when the detection accuracy in the first direction of the periphery of the moving body changes from the first detection accuracy to a second detection accuracy lower than the detection accuracy in a direction other than the first direction. Causing the image generation unit to generate a second predetermined image representing a second presentation image that is not equal,
Display control program.

Images