JP6424434B2 - Image data generation apparatus and image data generation program - Google Patents

Description

  The present invention relates to an image data generation apparatus and an image data generation program for generating image data for displaying an image on a display device.

  As the above-described image data generation apparatus, one that makes one drawing unit (GPU: Graphics Processing Unit) shared by a plurality of applications is known (for example, see Patent Document 1).

JP, 2010-026297, A

  However, in the above-described image data generation apparatus, when a malfunction occurs in the operation of the drawing unit at the time of drawing by a certain application, there is a possibility that drawing by another application can not be performed.

  Therefore, in view of such problems, in an image data generating apparatus for generating image data for displaying an image on a display device, drawing can be performed even if a malfunction occurs in the operation of the drawing unit. It is an object of the present invention to do so.

  In the image data generation apparatus of the present invention, the data acquisition unit acquires application data acquired by executing an application, and the specific drawing generation unit generates a plurality of drawing units that generate image data according to the input data. One of the preset specific drawing units generates image data based on the application data. Then, the abnormality acquisition unit acquires that the specific drawing unit is in the abnormal state, and the other drawing generation unit is changed to the specific drawing unit when the abnormal state is acquired, and among the plurality of drawing units The image data based on the application data is generated by the other drawing units except the specific drawing unit.

According to such an image data generation apparatus, even if a malfunction occurs in the operation of the specific drawing unit, another drawing unit can be used, so drawing can be continued.
Note that the present invention may be an image data generation program for realizing a computer as each unit constituting an image data generation apparatus. Moreover, the description of each claim can be arbitrarily combined as much as possible. Under the present circumstances, you may exclude a one part structure in the range which can achieve the objective of invention.

FIG. 1 is a block diagram showing a schematic configuration of a drawing apparatus 1 of a first embodiment to which the present invention is applied. It is a flowchart which shows the drawing process of 1st Embodiment by application [A] or [B] which application control part 10 (CPU11) performs. FIG. 6 is an explanatory view showing an example of data recorded in a VRAM 54 a in the SDRAM 54. It is an explanatory view showing an example of a superposing method of pictures. 5 is a ladder chart showing an example of the operation of the drawing device 1; It is a block diagram which shows schematic structure of the drawing apparatus 2 of 2nd Embodiment. It is a flowchart which shows the drawing process of 2nd Embodiment by application [C] or [D] which the application control part 10 (CPU11) performs. It is a flowchart which shows the drawing process of the modification which the application control part 10 (CPU11) performs.

Embodiments of the present invention will be described below with reference to the drawings.
First Embodiment
[Configuration of this embodiment]
The drawing device 1 to which the present invention is applied is a device mounted on a vehicle such as a passenger car, for example, and generating image data for displaying an image on a display device (display). The drawing apparatus 1 has a function capable of continuing the drawing satisfactorily even when an abnormality occurs in a drawing processor (GPU) used normally.

  Specifically, as shown in FIG. 1, the drawing apparatus 1 includes an application control unit 10, a shared GPU 51, a sub GPU 52, a synchronous dynamic random access memory (SDRAM) controller 53, an SDRAM 54, an image output unit [A] 55, a display [ A] 56 is provided. These components are communicably connected to each other by a bus 15.

  The shared GPU 51 and the sub GPU 52 are configured as known GPUs. However, the shared GPU 51 has a higher image processing capability than the sub GPU 52, and in the normal state where there is no abnormality in the shared GPU 51, the shared GPU 51 is mainly used.

  The shared GPU 51 and the sub GPU 52 generate image data in accordance with the data input through the bus 15, and instructs the predetermined VRAM 54a in the SDRAM 54 to write the image data.

The SDRAM 54 includes an area as the VRAM 54 a for recording image data, and an area (GPU state 54 b) for recording the state of each of the GPUs 51 and 52.
When receiving an access request to the SDRAM 54 via the bus 15, the SDRAM controller 53 controls reading and writing of data in the SDRAM 54 in response to the request.

  The image output unit [A] 55 generates a composite image by combining a plurality of image data generated by the shared GPU 51 and the sub GPU 52, converts the composite image into a video signal, and outputs the video signal to the display [A] 56. The image output unit [A] 55 receives a command on the hierarchical order from the application control unit 10, and generates a composite image in which the plurality of image data in the VRAM 54a are rearranged according to the hierarchical order and synthesized.

The display [A] 56 is configured as a known display for displaying an image based on the video signal from the image output unit [A] 55.
The application control unit 10 is configured as a computer including a CPU 11 and a memory 12 such as a ROM and a RAM, and the CPU 11 executes a program stored in the memory 12 to generate an image in the drawing device 1. Take control. The application control unit 10 has a drawing function [A] 20 as this program.

  The drawing function [A] 20 includes a plurality of applications such as an application [A] 21a and an application [B] 21b, and the respective applications 21a and 21b include drawing applications (fail) 22a and 22b, and drawing applications (usually ) 23a and 23b, and control applications 24a and 24b.

The drawing function [A] 20 is provided with a library [A] 26 a, a library [B] 26 b, and operation software (OS) 27.
The application [A] 21a and the application [B] 21b have, for example, a function of acquiring information of instruments in a vehicle and generating an image corresponding to the acquired information. However, the application [A] 21a and the application [B] 21b are set to perform processing on different information.

  For example, in this case, when processing by the application [A] 21a is exemplified, the CPU 11 uses the control application 24a to acquire information on the traveling state such as the vehicle speed and water temperature of the vehicle, and the drawing application (normal) 23a or the drawing application (Fail) 22a is used to generate data for drawing. Here, the drawing application (normal) 23a is an application for generating drawing data for the shared GPU 51, and the drawing application (fail) 22a is an application for generating drawing data for the sub GPU 52.

  The library [A] 26 a stores image data for the drawing application (fail) 22 a and an instruction set including a plurality of instruction contents for the sub GPU 52. The drawing application (fail) 22a extracts a combination of a plurality of images in the library [A] 26a according to the information of instruments while using the function of the OS 27, and instructs the sub-GPU 52 to generate an image based thereon .

  The library [B] 26 b stores image data for the drawing application (normal) 23 a and an instruction set including a plurality of instruction contents for the shared GPU 51. The drawing application (normally) 23a extracts a combination of a plurality of images in the library [B] 26b according to the information of instruments while using the function of the OS 27, and instructs the shared GPU 51 to generate an image based on these .

  In addition, in the image in the library [A] 26a, an image simpler than the image in the library [B] 26b is taken into consideration (the processing load at the time of drawing is taken into consideration, in consideration of the capacity difference between the sub GPU 52 and the shared GPU 51. Small images are being recorded.

[Process of this embodiment]
In the drawing apparatus 1 configured as described above, the application control unit 10 performs the drawing process shown in FIG. The drawing process is, for example, a process that is started when the power of the vehicle is turned on, and is a process that is repeatedly performed after every predetermined period (for example, every 50 ms).

  In this process, as shown in FIG. 2, first, it is determined whether the shared GPU 51 is in the normal state (S110). In this process, information indicating whether the shared GPU 51 is in the normal state (“drawable” or “during drawing”) or in the abnormal state (“abnormal”) is acquired from the area of the GPU state 54b of the SDRAM 54.

  If the shared GPU 51 is in the normal state (S110: YES), normal drawing data is created (S120). In this process, as described above, data for generating an image based on the image in the library [B] 26 b is created using the drawing application (normal) 23 a.

  Subsequently, it is determined whether the shared GPU 51 is in a drawable state (S130). Whether or not the shared GPU 51 is in the drawable state is determined by referring to the GPU state 54b and whether or not the state of the shared GPU 51 is “drawable”.

  If the shared GPU 51 is not in the drawable state (S130: NO), it is determined whether the drawing process by the shared GPU 51 has timed out (S140). That is, after the determination as to whether or not the drawing is possible is started, it is determined whether or not the shared GPU 51 is not returned to the drawing possible state beyond the preset time.

  If the drawing process by the shared GPU 51 has not timed out (S140: NO), the process returns to the process of S130. If the drawing process by the shared GPU 51 has timed out (S140: YES), the process proceeds to the process of S230 described later.

  If the shared GPU 51 is in the drawable state in the process of S130 (S130: YES), the state of the shared GPU 51 is changed from "drawable" to "during drawing" in the GPU state 54b of the SDRAM 54 (S160). In the case of “during drawing”, the image generated by another application can not be accepted and the image can not be drawn.

  Subsequently, drawing data is transmitted to the shared GPU 51, and drawing is requested (S170). The image generated by this processing is, for example, an image that three-dimensionally expresses various elements indicating the state of the vehicle as shown in FIG. 3A, and the user can feel a sense of luxury Are set to have complex movements. The shared GPU 51 records this image in the area of the VRAM 1 of the VRAM 54 a.

  Then, it is determined whether the shared GPU 51 has completed drawing (S180). Here, the shared GPU 51 is set to return a drawing completion signal to the application control unit 10 when drawing is completed, and the application control unit 10 recognizes that the sharing GPU 51 has completed drawing by receiving this drawing completion signal. Do.

  If the shared GPU 51 has completed the rendering (S180: YES), the status of the shared GPU 51 in the GPU status 54b of the SDRAM 54 is transitioned from "during rendering" to "renderable" (S220), and the rendering processing is ended.

  In addition, if the sharing GPU 51 has not completed drawing (S180: NO), it is determined whether the sharing GPU 51 has returned an error (S190). If the shared GPU 51 returns an error (S190: YES), the state of the shared GPU 51 is changed from "during drawing" to "abnormal" (S230), and the drawing process is ended.

  When the state of the shared GPU 51 becomes "abnormal", the shared GPU 51 restarts, and when the restart of the shared GPU 51 is completed, the shared GPU 51 restores the state of the shared GPU 51 to "drawable" in the GPU state 54b of the SDRAM 54. .

  If the shared GPU 51 does not return an error (S190: NO), it is determined whether the drawing process by the shared GPU 51 has timed out (S200). That is, after sending data to the shared GPU 51, it is determined whether or not a response from the shared GPU 51 can not be received for a time set in advance for a predetermined time.

  If the drawing process by the shared GPU 51 has not timed out (S200: NO), the process returns to S180. If the drawing process by the shared GPU 51 has timed out (S200), the process of S230 described above is performed, and then the drawing process is ended.

  By the way, if the shared GPU 51 is in an abnormal state in the process of S110 (S110: NO), fail drawing data is generated (S310). In this process, as described above, the drawing application (fail) 23a is used to create data for generating an image based on an image in the library [A] 26a.

  Subsequently, it is determined whether the sub GPU 52 is in a drawable state (S320). Whether or not the sub GPU 52 is in the drawable state is determined by referring to the GPU state 54b and whether or not the state of the sub GPU 52 is “drawable”.

  If the sub GPU 52 is not in the drawable state (S320: NO), the process of S320 is repeated. If the sub GPU 52 is in the drawable state (S320: YES), the state of the sub GPU 52 is transitioned from “drawable” to “during drawing” (S330), and drawing data is transmitted to the sub GPU 52 to draw (S340).

  An image based on drawing data required in this process is, for example, an image simpler than the image by the shared GPU 51, as shown in FIG. 3 (b). That is, while the image by the shared GPU 51 is an image that three-dimensionally represents various elements indicating the state of the vehicle, the image by the sub GPU 52 is the minimum necessary to drive the elements to be displayed It is a simpler display method, such as squeezing into the elements of the image and making it a secondary image.

  Also, this image is an image having a region that only covers the entire image by the shared GPU 51. The sub GPU 52 records this image in the area of the VRAM 2 of the VRAM 54 a.

  Subsequently, an instruction is sent to the image output unit [A] 55 to change the layer order (S350). That is, as shown in FIG. 4A, it is instructed to generate a composite image in which the image of the image (VRAM 2) by the sub GPU 52 is superimposed on the upper hierarchy of the image (VRAM 1) by the shared GPU 51 . By doing this, the image by the shared GPU 51 is covered with the image by the sub GPU 52 in all areas.

  If the shared GPU 51 is normal, the image of the image (VRAM 2) by the sub GPU 52 is set to a lower hierarchy of the image (VRAM 1) by the shared GPU 51, or the image by the sub GPU 52 is set to be invalid. Be done.

  Subsequently, it is determined whether the sub GPU 52 has completed drawing (S360). Here, similarly to the shared GPU 51, the sub GPU 52 is set to return a drawing completion signal to the application control unit 10 when drawing is completed, and the application control unit 10 receives the drawing completion signal and the sub GPU 52 Recognize that drawing is complete.

  If the sub GPU 52 has completed drawing (S360: YES), the state of the sub GPU 52 is transitioned from "during drawing" to "durable" in the GPU state 54b of the SDRAM 54 (S370), and the drawing processing is ended.

  Next, an example of the operation of the drawing apparatus 1 will be described with reference to FIG. When drawing is performed by the application [A] 21a, if there is no abnormality in the shared GPU 51, a drawing completion notification is returned from the shared GPU 51 after the drawing request (see FIG. 5A).

  Further, when drawing is performed by the application [B] 21b, if there is no abnormality in the shared GPU 51, a drawing completion notification is returned from the sharing GPU 51 after the drawing request as in the case of the application [A] 21a (FIG. B) see). Here, when drawing with the application [B] 21 b, if there is an abnormality in the data to be transmitted, etc., the common GPU 51 can not execute the normal processing.

  Then, the image output from the shared GPU 51 may be in a non-changing state (in a fixed state), and in this case, an error or timeout occurs (see (C) in FIG. 5). At this time, the state of the shared GPU 51 transitions to "abnormal".

  In such a case, the application [A] 21a recognizes an abnormality and performs drawing using the drawing application (fail) 23a (see (D) in FIG. 5). At this time, the image of the image (VRAM 2) by the sub GPU 52 is set to a higher hierarchy than the image (VRAM 1) by the shared GPU 51 so that the image (VRAM 2) by the sub GPU 52 is displayed effectively.

[Effect by this embodiment]
In the drawing apparatus 1 described in detail above, the application control unit 10 acquires application data obtained by executing an application, and generates a plurality of drawing units (GPU) that generate image data according to the input data, Image data based on the application data is generated by the shared GPU 51 set in advance. Then, the application control unit 10 acquires that the shared GPU 51 is in the abnormal state, and when it is acquired that it is in the abnormal state, replaces the shared GPU 51 and causes the sub GPU 52 to generate image data based on the application data.

According to such a drawing device 1, even when a malfunction occurs in the operation of the shared GPU 51, the sub GPU 52 can be used, so drawing can be continued.
Further, in the drawing apparatus 1, the application control unit 10 generates the image data generated by the sub GPU 52 with respect to the image output unit [A] 55 that combines the plurality of image data generated by the plurality of drawing units, It is instructed to arrange in a higher hierarchy than the image data generated by the shared GPU 51.

  According to such a drawing apparatus 1, since the image data generated with the image generated by the sub GPU 52 as the upper hierarchy is generated, even if there is an abnormality in the image by the shared GPU 51 and this image is fixed, The normal image by the sub GPU 52 can be superimposed and displayed on the upper side. Thus, a normal image can be provided.

  Further, in the drawing apparatus 1, the application control unit 10 generates specific drawing data corresponding to the shared GPU 51, generates other drawing data corresponding to the sub GPU 52, and acquires the specific drawing data and the other drawing data as application data. Do. Then, the application control unit 10 generates, as other drawing data, data for generating an image having an area that only covers the entire image based on the specific drawing data.

  According to such a drawing device 1, it is possible to generate appropriate application data corresponding to the drawing unit. Then, since the image generated by the sub GPU 52 covers the image generated by the shared GPU 51 and replaces the entire image, the image generated by the sub GPU 52 is generated without considering the layout of the image generated by the shared GPU 51. be able to.

  Further, in the drawing device 1, image data to be provided to a display device mounted on a vehicle and performing display indicating at least one of a vehicle state and a vehicle environment as an instrument of the vehicle is generated.

  Here, when the display of the vehicle causes a delay, it may display a state different from the current state, which may cause a problem in the operation of the vehicle. However, if the configuration of the present invention is provided, the sub GPU 52 functions Therefore, display delay can be effectively suppressed.

Second Embodiment
Next, another drawing apparatus 2 will be described. In the present embodiment (the second embodiment), only portions different from the drawing device 1 of the first embodiment are described in detail, and portions similar to those of the drawing device 1 of the first embodiment are denoted by the same reference numerals. I omit explanation.

  The drawing device 2 of the present embodiment, as shown in FIG. 6, includes a drawing function [B] 30 in addition to the drawing function [A] 20. As the drawing function [B] 30, the application [C] 31a and the application [D] 31b are executed using the functions of the library [C] and the OS 33.

  In the application [C] 31 a and the application [D] 31 b, only drawing using the shared GPU 51 is set to be executable, and in the library [C], image data corresponding to the shared GPU 51 and an instruction to the shared GPU 51 An instruction set having a plurality of contents is recorded.

  The drawing device 2 also includes an image output unit [B] 57 and a display [B] 58 for displaying an image corresponding to the drawing function [B] 30. The image output unit [B] 57 and the display [B] 58 have the same configuration and function as the image output unit [A] 55 and the display [A] 56 described above.

  When such a drawing function [B] 30 (application [C] 31a or application [D] 31b) is to be executed, drawing processing as shown in FIG. 7 may be performed. That is, the processing of S310 to S370 in the drawing processing shown in FIG. 2 may be omitted.

  Here, in the drawing function [B] 30, for example, as shown in FIG. 3C, an image such as a log of the state of the vehicle is generated, and this image is displayed via the image output unit [B] 57 [B] Output to 58.

  As described above, it is not necessary for all the applications to perform the processing corresponding to the sub GPU 52, and whether or not the application corresponding to the sub GPU 52 can be arbitrarily set according to the importance of display.

Other Embodiments
The present invention is not interpreted in any way as limited by the embodiments described above. Moreover, the aspect which abbreviate | omitted a part of structure of said embodiment as long as a subject is solvable is also embodiment of this invention. In addition, an aspect configured by appropriately combining the plurality of embodiments described above is also an embodiment of the present invention. In addition, any aspect that can be considered without departing from the essence of the invention specified by only the language described in the claims is also an embodiment of the present invention. Moreover, although the code | symbol used by description of said embodiment is suitably used also in a claim, it is used in order to make an understanding of the invention which concerns on each claim easy, and it is an invention which concerns on each claim It is not intended to limit the technical scope of

  For example, in the drawing apparatuses 1 and 2 according to the above embodiment, the application control unit 10 causes the shared GPU 51 to generate image data based on the application data even when the abnormal state is acquired, and the abnormal state is Even when not acquired, the sub GPU 52 may generate image data based on application data. In such a case, when it is acquired that the abnormal state is obtained, the image data generated by the sub GPU 52 is placed in a higher hierarchy than the image data generated by the shared GPU 51 or invalidated. In this case, when the abnormal state is not obtained, the image data generated by the sub GPU 52 may be instructed to be arranged in a lower hierarchy than the image data generated by the shared GPU 51.

  Specifically, in the drawing process shown in FIG. 8, the process of S110 may be omitted from the drawing process shown in FIG. 2, and the processes of S310 to S370 may be performed after the processes of S220 and S230. However, in the process of S350, it is necessary to change whether the image by the shared GPU 51 is set as the upper layer or the lower layer according to whether the shared GPU 51 is normal.

According to such a drawing device, it is possible to maintain the image in a normal state only by switching the hierarchy of the image.
Furthermore, in the drawing apparatus, the application control unit 10 may cause the image by the sub GPU 52 to be a narrower area than the image by the shared GPU 51. That is, as shown in FIG. 4B, when the image by the sub GPU 52 is superimposed on the top of the image by the shared GPU 51, a part of the image by the shared GPU 51 is made visible. However, in the image by the sub GPU 52, the image by the shared GPU 51 is set to be concealed with respect to factors such as the vehicle speed and the engine rotation speed that should be updated frequently in the vehicle state.

  According to such a drawing device 1, the sub GPU 52 generates an image that covers a part of the image generated by the shared GPU 51 and replaces a part of the image, so the area to be drawn by the sub GPU 52 can be narrowed. The processing load by the sub GPU 52 can be reduced. As a result, when the image by the shared GPU 51 is fixed, a part of the fixed image can be used as it is.

[Correspondence between configuration of embodiment and means of the present invention]
The application control unit 10 in the above embodiment corresponds to the image data generation device in the present invention, and the shared GPU 51 in the above embodiment corresponds to the specific drawing unit in the present invention. The sub GPU 52 in the above embodiment corresponds to the other drawing unit in the present invention, and the image output unit 55 in the above embodiment corresponds to the image combining unit in the present invention.

  Furthermore, the process of S110 among the processes executed by the application control unit 10 in the above embodiment corresponds to the abnormality acquisition means in the present invention, and the process of S120 in the above embodiment is the specific drawing data generation in the present invention It corresponds to the means. Further, the processing of S120 and S310 in the above embodiment corresponds to the data acquisition means in the present invention, and the processing of S170 in the above embodiment corresponds to the specific drawing generation means in the present invention.

  Furthermore, the process of S310 in the above embodiment corresponds to the other drawing data generation means in the present invention, and the process of S340 in the above embodiment corresponds to the other drawing generation means in the present invention. Further, the process of S350 in the above embodiment corresponds to the hierarchy instruction means in the present invention.

  1, 2 ... drawing device, 10 ... application control unit, 11 ... CPU, 12 ... memory, 15 ... bus, 21 a ... application, 24 a ... control application, 51 ... shared GPU, 52 ... sub GPU, 53 ... SDRAM controller, 54 ... SDRAM, 54a ... VRAM, 54b ... GPU state, 55 ... Image output unit [A], 56 ... Display [A], 57 ... Image output unit [B], 58 ... Display [B].

Claims (5)

An image data generating device (10) for generating image data for displaying an image on a display device, comprising:
Data acquisition means (S120, S310) for acquiring application data obtained by executing the application;
Specific drawing generation means (S170) for generating image data based on the application data in a preset specific drawing unit (51) among a plurality of drawing units for generating image data according to the input data;
Abnormality acquisition means (S110) for acquiring that the specific drawing unit is in an abnormal state;
When it is acquired that the abnormal state is obtained, image data based on the application data is transferred to the other drawing unit (52) excluding the specific drawing unit among the plurality of drawing units in place of the specific drawing unit. And other drawing generation means (S340) for generating image data which becomes an area narrower than the image data generated by the specific drawing unit ;
Image data generated by the specific drawing unit, the image data generated by the other drawing unit with respect to the image synthesizing unit (55) that synthesizes the plurality of image data generated by the plurality of drawing units Hierarchy instructing means (S350) instructing to arrange in a higher hierarchy than the above;
An image data generating apparatus comprising: An image data generating device (10) for generating image data for displaying an image on a display device, comprising:
Data acquisition means (S120, S310) for acquiring application data obtained by executing the application;
Specific drawing generation means (S170) for generating image data based on the application data in a preset specific drawing unit (51) among a plurality of drawing units for generating image data according to the input data;
An image data based on the application data in another drawing unit (52) excluding the specific drawing unit among the plurality of drawing units, which is an area narrower than the image data generated by the specific drawing unit Other drawing generation means (S340) for generating data ;
When it is acquired that the specific drawing unit is in an abnormal state with respect to an image combining unit (55) that combines a plurality of image data generated by a plurality of drawing units, the other drawing unit generates The other image data is arranged in a higher hierarchy than the image data generated by the specific drawing unit, or instructed to invalidate the image data, and the other state is not acquired, Hierarchical instruction means (S350) for instructing to arrange the image data generated by the drawing unit in a hierarchy lower than the image data generated by the specific drawing unit;
An image data generating apparatus comprising: In the image data generation apparatus according to claim 1 or 2 ,
Specific drawing data generation means (S120) for generating specific drawing data corresponding to the specific drawing unit;
Other drawing data generation means (S310) for generating other drawing data corresponding to the other drawing unit;
Equipped with
The image data generation device, wherein the data acquisition unit acquires the specific drawing data and the other drawing data as the application data. The image data generation apparatus according to any one of claims 1 to 3 .
The image data generation device is mounted on a vehicle and generates image data to be provided to a display device that displays at least one of a vehicle state and a vehicle environment as an instrument of the vehicle. Generator. The image data generation program for functioning a computer as each means which the process execution part in any one of Claims 1-4 has.