JP4866059B2 - Method for synthesizing image data for on-screen display, on-screen display device, and digital camera - Google Patents

Description

  The present invention relates to a method for synthesizing image data for on-screen display, an on-screen display device, and a digital camera.

  A digital camera has a function of displaying an actual image such as an image obtained by photographing on a display unit such as a TFT liquid crystal provided in the digital camera or an external display device such as a television receiver. There are a lot of things. When such an image is displayed, an image indicating information such as menus, mode settings, and shooting information may be superimposed on the actual image, and such an image may be displayed as an on-screen display image (On Screen Display (hereinafter abbreviated as OSD image). Since this OSD image has many monotonous images, generally, a color palette of a plurality of colors is prepared, and bitmapped with color palette numbers corresponding to the color palette.

  In recent years, the number of characters to be displayed as an OSD image at a time has increased, and it has become necessary to superimpose a plurality of OSD images on an actual image. As an example of the countermeasure, an example in which the technique of Patent Document 1 is applied will be described with reference to FIG.

  As shown in FIG. 6, the memory 101 includes actual image data composed of color data (for example, YCbCr data and RGB data), and a plurality of OSD data (OSD1 data and OSD2 data) to be superimposed on the actual image data. Stored. A system bus 102 is a data transfer path connected to the memory 101 and the arbiter 103. The arbiter 103 is connected to the color palette conversion units 104a and 104b and the superimposition processing unit 105, and receives an OSD1 data acquisition request from the color palette conversion unit 104a, an OSD2 data acquisition request from the color palette conversion unit 104b, and an overlay process. In response to the real image data acquisition request from the unit 105, the color palette conversion units 104a and 104b and the superimposition processing unit 105 acquire data according to a predetermined priority order.

  The color palette conversion unit 104a converts the OSD1 data configured by the color palette number into color data corresponding to the actual image and outputs the color data to the superimposition processing unit 105. The color palette conversion unit 104b converts the OSD2 data configured by the color palette number into color data corresponding to the actual image and outputs the color data to the superimposition processing unit 108.

  The superimposition processing unit 105 superimposes the OSD1 data converted into color data on the actual image data, and outputs the superimposed image data obtained by the superimposition to the superimposition processing unit 108. The superimposition processing unit 108 superimposes the OSD 2 converted into color data on the superimposed image data, and outputs the superimposed image data obtained by the superimposition to the display output processing unit 109. The display output processing unit 109 converts the superimposed image data into a predetermined video signal such as the NTSC format and causes the display unit 110 to display it. In this way, the display unit 110 displays an image in which the OSD image 110b and the OSD image 110c are superimposed on the actual image 110a.

That is, the method as described in Patent Document 1 is a method of sequentially superimposing a plurality of OSD images on an actual image.
JP-A-10-150609

  Here, in the technique as described in Patent Document 1 described above, it is necessary to superimpose a plurality of OSD images in accordance with the display timing of an actual image, and a plurality of OSD data is read from the memory 101 at the time of this superimposition. Therefore, in some cases, the OSD data to be superimposed cannot be prepared by the display timing, which may cause data corruption.

  The present invention has been made in view of the above circumstances, and a method for synthesizing an image for on-screen display capable of appropriately synthesizing a plurality of OSD data so as not to cause data corruption. An object is to provide an applied on-screen display device and a digital camera.

In order to achieve the above object, a method for synthesizing image data for on-screen display according to the first aspect of the present invention comprises a plurality of table numbers configured corresponding to table data in which color information is tabulated. the method of synthesizing the on-screen display image data to create a single on-screen display image synthesis data, the on-screen display image data to be stored one on-screen display image synthesis data the created data synthesizer The plurality of on-screen display image data is data composed of table numbers of different tables, and prior to the synthesis, the largest color among the plurality of on-screen display image data The data format of the image data for on-screen display composed of the table numbers of tables that do not have the maximum color It is converted into the data format of the on-screen display image data composed of a table number of the table with the conversion, configured on-screen display image data in the table number of the table without a number of colors the maximum The table number is calculated based on a conversion table that converts the table number corresponding to the color information that is equal to the color information corresponding to the table number of the table having the maximum number of colors .

  According to the first aspect, prior to superimposing a plurality of on-screen display images on an actual image, a plurality of on-screen display images can be synthesized in advance. There will be no bankruptcy.

In order to achieve the above object, an on-screen display device according to the second aspect of the present invention provides a plurality of on-screen display devices having table numbers set in correspondence with table data in which color information is tabulated. a data combining unit that creates a single on-screen display image synthesis data by synthesizing the image data, a storage unit for storing a single on-screen display image synthesis data generated by the data synthesizer, in the storage unit A display unit that reads the stored image synthesis data for on-screen display and displays the superimposed image on the actual image, wherein the data synthesis unit has a maximum number of colors among the plurality of on-screen display image data Te having a color number of the maximum corresponding to the table number of the table that does not have a phase equal color information to the color information corresponding to respective table numbers A data conversion section for converting the table of the table number, the bit width of the table number of the no maximum color number table, so as not to change the value of the table number, the table with the largest number of colors the table A data expansion unit that expands to the bit width of the number, and selects either the output of the data conversion unit or the output of the data expansion unit, and includes the selected output and the table number of the table having the maximum number of colors. And a synthesis processing unit for performing the synthesis with the on-screen display image data.

  According to the second aspect, when one on-screen display image data is created by combining a plurality of on-screen display image data, the data format between the on-screen display image data is made equal. Therefore, appropriate synthesis can be performed.

  In order to achieve the above object, a digital camera according to a third aspect of the present invention is a digital camera equipped with the on-screen display device according to the second aspect, wherein the color information is YCbCr data. Alternatively, it is RGB data, and the on-screen display image data is data for displaying information including at least one of menu information display and shooting information display, and the actual image is an image pickup that the digital camera has It includes at least one of a captured image obtained by an element and a reproduced image read from a recording medium included in the digital camera.

  According to the third aspect, the on-screen display device of the second aspect can be applied to a digital camera.

  According to the present invention, an on-screen display image synthesis method capable of appropriately synthesizing a plurality of OSD data without causing data corruption, an on-screen display device to which such a synthesis method is applied, and a digital A camera can be provided.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a diagram showing a configuration of an on-screen display device to which a method for synthesizing image data for on-screen display according to the first embodiment of the present invention is applied. The on-screen display device shown in FIG. 1 includes a memory 1, a system bus 2, an arbiter 3, a conversion table 4, a superimposition processing unit 5, an arbiter 6, a color palette conversion unit 7, and a superimposition processing unit 8. The display output processing unit 9 and the display unit 10 are configured.

  The memory 1 as a storage unit includes an actual image composed of color data (for example, YCbCr data and RGB data) and a plurality of OSD data (here, OSD1 data and OSD2 data) to be superimposed on the actual image. A plurality of configured OSD images are stored. Hereinafter, as an example, the description will be continued assuming that the OSD1 data is 8-color palette number data and the OSD2 data is 4-color palette number data. In this case, the OSD1 data is composed of 3-bit color palette number data, and the OSD2 data is composed of 2-bit color palette number data.

  The system bus 2 is a data transfer path connected to the memory 1 and the arbiter 3 and arbiter 6. The arbiter 3 is connected to the conversion table 4 and the superimposition processing unit 5 in addition to the system bus 2, and in response to an OSD2 data acquisition request from the conversion table 4 and an OSD1 data acquisition request from the superimposition processing unit 5. Data is acquired by either the conversion table 4 or the superimposition processing unit 5 in accordance with a predetermined priority order.

  The conversion table 4 as a data conversion unit converts the data format of the OSD2 data into the data format of the OSD1 data so that the OSD2 data can be superimposed on the OSD1 data. The superimposition processing unit 5 as a synthesis processing unit combines the OSD2 data and the OSD1 data whose data formats are converted by the conversion table 4, and stores the OSD3 data obtained thereby in the memory 1 via the arbiter 3. The conversion table 4 and the superimposition processing unit 5 will be described in detail later.

  In addition to the system bus 2, the arbiter 6 is connected to the color palette conversion unit 7 and the superimposition processing unit 8. The arbiter 6 receives the OSD3 data acquisition request from the color palette conversion unit 7 and the actual image data from the superimposition processing unit 8. In response to the acquisition request, either the color palette conversion unit 7 or the superimposition processing unit 8 acquires data according to a predetermined priority order.

  The color palette conversion unit 7 has a table for converting the color palette number into color data set corresponding to the color palette number, and corresponds to the OSD3 data composed of the color palette number for the actual image. Is converted into color data to be output to the superimposition processing unit 8. The superimposition processing unit 8 reads out and superimposes the OSD3 data in synchronization with the actual image data, and outputs the superimposed image data obtained by the superimposition to the display output processing unit 9. The display output processing unit 9 converts the superimposed image data input from the superimposition processing unit 8 into a predetermined video signal such as the NTSC format and causes the display unit 10 to display it.

  Next, the conversion table 4 and the superimposition processing unit 5 will be described in more detail with reference to FIGS. FIG. 2 is a diagram showing the configuration of the conversion table 4. As shown in FIG. 2, the conversion table 4 has a conversion table composed of 3 bits × 4 words in order to equalize the bit widths of the OSD1 data and the OSD2 data.

  Here, as the simplest method for equalizing the bit width, it is conceivable to add “0” to the most significant bit of the 2-bit OSD2 data to make it 3 bits. However, in this method, the color palette arrangement of the four colors included in the OSD image 2 and the color palette arrangement of the OSD image 1 corresponding to these four colors are the same, that is, the color palettes of the same color in the OSD image 2 and the OSD image 1. Can only be used when the number values are equal.

  For example, the arrangement of the eight color palettes of the OSD image 1 is as shown by reference numeral 1a in FIG. 3, and the arrangement of the four color palettes of the OSD image 2 is shown by reference numeral 1b in FIG. In such a case, the method of adding “0” to the most significant bit as described above cannot be used. For example, in FIG. 3, the color palette number representing “white” in the OSD image 2 is “00”. However, “000” obtained by adding “0” to the most significant bit is a color palette number indicating “yellow” in the OSD image 1. Therefore, if superimposing is performed as it is, the OSD image 2 which was originally white is regarded as yellow and synthesized.

  Therefore, in the first embodiment, the table data of the conversion table 4 is set as indicated by reference numeral 4a in FIG. 3 in order to prevent such an OSD image having an incorrect color from being synthesized. To. The table data of the conversion table 4a is set so that the data (color palette number) of each color of the OSD image 2 is converted to the data of each corresponding color of the OSD image 1. For example, in the above-described example of “white”, 2-bit data “00” representing “white” in the OSD image 2 is converted into 3-bit data “010” representing “white” in the OSD image 1.

  According to the first embodiment as described above, when superimposing a plurality of OSD images on an actual image, a plurality of OSD images 1 and 2 are synthesized in advance, and an OSD image 3 obtained thereby is obtained. By storing in the memory 1 before superimposition, it is possible to superimpose and display a plurality of OSD images in synchronism with the display timing of the actual image without causing data corruption.

  Further, since the data formats such as the bit width and the color palette arrangement are made equal among a plurality of OSD images, the OSD data composed of the color palette numbers can be combined without returning to the color data. In other words, the amount of processing data can be reduced, and erroneous color data is not combined at the time of combining.

  Here, in the first embodiment, the synthesis of two OSD data of OSD1 data and OSD2 data has been described. However, the basic idea in the synthesis of three or more OSD data is the same as in the case of two. Instead, a table for converting the bit width of “OSD data other than the OSD image having the maximum number of colors” into “OSD data of the same color in the OSD image having the maximum number of colors” may be provided. For example, 3 bits of OSD data (4-color palette data), 3 bits of OSD data (8 colors of palette data), and 4 bits of OSD data (16 colors of palette data) are combined. In this case, a table may be provided to convert the data of each color of 2-bit OSD data and 3-bit OSD data into data of each color corresponding to the 4-bit OSD data. That is, such a conversion table includes a 4 bit × 4 Word table for converting 2-bit OSD data into OSD data of a corresponding color in 4 bits, and a 4 bit × of converting 3 bit OSD data into OSD data of a corresponding color in 4 bits. It is composed of an 8-word table. Using such a conversion table, 2-bit OSD data and 4-bit OSD data are first synthesized, and the obtained 4-bit OSD data and 3-bit OSD data are synthesized.

  Alternatively, the 2-bit OSD data and the 3-bit OSD data may be synthesized first, and then the 3-bit OSD data and the 4-bit OSD data obtained by the synthesis may be synthesized.

  Further, the conversion table 4 may store a conversion table corresponding to all combinations of the OSD data, or the conversion table corresponding to the OSD image to be superimposed is selected when the OSD image to be superimposed is selected. You may make it produce | generate.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. FIG. 4 is a diagram when the on-screen display device according to the second embodiment of the present invention is applied to a digital camera. In FIG. 4, the same components as those in FIG. 1 are denoted by the same reference numerals as those in FIG.

  In FIG. 4, the image sensor 11 captures a subject and acquires real images for a captured image and a through image. Here, the photographed image is an actual image acquired for recording a still image or a moving image, and the through image is an actual image displayed on the display unit 10 for the purpose of subject observation. Hereinafter, these are referred to as real images without any particular distinction.

  The pre-processing unit 12 performs analog processing such as waveform conversion, noise removal, and amplification on the actual image obtained by the image sensor 11, and converts the analog-processed actual image into a digital signal to generate digital actual image data. To get. Actual image data obtained by the preprocessing unit 12 is stored in the memory 1 via the system bus 2.

  The image processing unit 13 reads the actual image data stored in the memory 1, and performs image processing for recording or image processing for display on the read actual image data. Here, the image processing for recording includes white balance correction, γ correction, color correction, compression, and the like. On the other hand, image processing for display includes white balance correction, resizing processing, and the like. For these processes, a well-known image processing method may be used, and the description thereof is omitted here. The actual image data processed by the image processing unit 13 is written back to the memory 1 via the system bus 2.

  Here, in the case of through image display, the actual image data after image processing stored in the memory 1 is read out by the superimposition processing unit 8 via the system bus 2 and the arbiter 6. At this time, when it is necessary to superimpose a plurality of OSD images on the real image, the OSD data stored in the memory 1 is read via the arbiter 3 before the superimposition processing unit 8 reads the real image data.

  Here, the on-screen display device of the second embodiment is different from the on-screen display device of the first embodiment in that the second embodiment is provided with a bit extension unit 14 as a data extension unit. This is the point. In the second embodiment, the color palette array included in the OSD image 2 and the color palette array of the OSD image 1 corresponding to each color of the color palette included in the OSD image 2 are equal, that is, the OSD image 2 and the OSD image 1. If the color palette number values of the same color are equal, the bit extension unit 14 issues an OSD2 data acquisition request to the arbiter 3, and if they are not equal, the conversion table 4 issues an OSD2 data acquisition request to the arbiter 3. The The arbiter 3 causes the conversion table 4 or the bit extension unit 14 to acquire data in accordance with these acquisition requests.

  The conversion table 4 performs the same processing as in the first embodiment described above, and outputs the OSD2 data converted by the conversion table to the selector 15. On the other hand, the bit extension unit 14 adds “0” corresponding to the difference between the bit width of the OSD1 data and the bit width of the OSD2 data to the most significant bit of the OSD2 data to change the data format of the OSD2 data to that of the OSD1 data. Perform processing equivalent to the data format. That is, the bit extension unit 14 makes the bit width of the OSD2 data equal to the bit width of the OSD1 data.

  The selector 15 selects one of the output of the conversion table 4 and the output of the bit extension unit 14 and outputs the selected output to the superimposition processing unit 5. Subsequent operations of the on-screen display device are the same as those in the first embodiment.

  In FIG. 4, when recording a captured image, the recording control unit 16 records actual image data subjected to image processing for recording stored in the memory 1 in a memory card 17 as a recording medium. To do. Note that the recording medium is not limited to a memory card.

  As described above, in the second embodiment, in addition to the effects of the first embodiment described above, the OSD data is synthesized by using an appropriate output of the conversion table 4 or the bit extension unit 14. It can be carried out. In general, the bit extension unit 14 can perform processing faster than the conversion table 4, and therefore, if there is no problem even if the output of the bit extension unit 14 is used, the output of the bit extension unit 14 is selected. As a result, it is possible to speed up the entire superimposed display process.

  In the second embodiment, the superimposed display at the time of through image display is described as an example. However, the method of the second embodiment is used for the superimposed display at the time of reproducing an image recorded on the memory card 17. It goes without saying that may be applied.

  Although the present invention has been described based on the above embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, the problem described in the column of the problem to be solved by the invention can be solved, and the effect described in the column of the effect of the invention Can be extracted as an invention.

It is a figure shown about the structure of the on-screen display apparatus to which the synthetic | combination method of the image data for on-screen display which concerns on the 1st Embodiment of this invention is applied. It is a figure which shows the structure of a conversion table. It is a figure for demonstrating the specific example of a conversion table. It is a figure at the time of applying the on-screen display apparatus which concerns on the 2nd Embodiment of this invention to a digital camera. It is a figure which shows the example of the OSD image which can utilize a bit expansion part. It is a figure shown about a prior art example.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1,101 ... Memory, 2,102 ... System bus, 3, 6, 103 ... Arbiter, 4 ... Conversion table, 5, 8, 105, 108 ... Superimposition processing part, 7, 104a, 104b ... Color palette conversion part, 9 , 109: Display output processing unit, 10, 110: Display unit, 11: Image sensor, 12 ... Pre-processing unit, 13 ... Image processing unit, 14 ... Bit expansion unit, 15 ... Selector, 16 ... Recording control unit, 17 ... Memory card

Claims (7)

A plurality of on-screen display image data composed of table numbers set corresponding to the table data in which color information is tabulated are combined to create one on-screen display image combined data. One of the on-screen display image synthesis data a synthetic method of the on-screen display image data to be stored in memory,
The plurality of on-screen display image data is data composed of table numbers of different tables,
Prior to the composition, the data format of the on-screen display image data constituted by the table number of the table having no maximum number of colors among the plurality of on-screen display image data is set to the maximum number of colors. Convert to the data format of on-screen display image data composed of table numbers
In the conversion, the table number in the on-screen display image data configured with the table number of the table having no maximum number of colors is compared with the color information corresponding to the table number of the table having the maximum number of colors. A method for synthesizing image data for on-screen display, which is performed based on a conversion table for converting into table numbers corresponding to equal color information . In the conversion, the bit width of the table number of the table not having the maximum number of colors is expanded to the bit width of the table number of the table having the maximum number of colors so as not to change the value of the table number. The method for synthesizing image data for on-screen display according to claim 1, wherein: 2. The on-screen display device according to claim 1, wherein the color information is YCbCr data or RGB data, and the one on-screen display image composition data has a data format equivalent to the color information. Image data composition method. The on-screen display image according to claim 1 or 3, wherein the on-screen display image data is data for displaying information including at least one of menu information display and photographing information display. How to synthesize data. A data composition unit for composing a plurality of on-screen display image data composed of table numbers set corresponding to the table data in which color information is tabulated to create one on-screen display image composition data;
A storage unit for storing one on-screen display image synthesis data created by the data synthesis unit;
A display unit that reads the image synthesis data for on-screen display stored in the storage unit and displays the combined image on the actual image, and
The data synthesis unit
A table having the maximum number of colors corresponding to color information equal to the color information corresponding to each table number, which is the table number having no maximum number of colors among the plurality of on-screen display image data. A data conversion unit for converting the table number into
A data extension unit that extends the bit width of the table number of the table having no maximum number of colors to the bit width of the table number of the table having the maximum number of colors so as not to change the value of the table number;
Select one of the output of the data conversion unit and the output of the data expansion unit, and combine the selected output and the on-screen display image data composed of the table number of the table having the maximum number of colors. A synthesis processing unit to perform;
An on-screen display device comprising: The composition processing unit is configured such that the table number of the table having the maximum number of colors corresponding to the color information corresponding to the color information corresponding to each table number is the table number value of the table not having the maximum number of colors. 6. The output of the data conversion unit is selected when the values do not match, and the synthesis is performed. If the values match, the output of the data extension unit is selected and the synthesis is performed. On-screen display device. A digital camera equipped with the on-screen display device according to claim 5 or 6,
The color information is YCbCr data or RGB data,
The on-screen display image data is data for displaying information including at least one of menu information display and shooting information display,
2. The digital camera according to claim 1, wherein the real image includes at least one of a captured image obtained by an imaging element included in the digital camera and a reproduced image read from a recording medium included in the digital camera.

Images