JP2001008064A - Electronic camera and superimpostion display information layout method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize an electronic camera that can display superimposition display information such as photographing information displayed with a picture in an easy-to-see state and to provide a superimposition display method. SOLUTION: After photographing in a process P1, photographing information such as photographing date and time is acquired (P2), a part satisfying a prescribed condition nearly in the same color of a prescribed area or over within a search range is used for a display position of the photographing information (P3-P5). Furthermore, in the case that nearly the same color is the same as the display color of the photographing information, the display color of the photographing information is made different (P6), a display size of the displayed photographing information is decided depending on the size of nearly the same color (P7), the photographing information obtained by the P2-P5, the display position of the photographing information, the display color and the display size are recorded on a photographing information recording file of a storage memory such as a memory card (P8).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing technique, and more particularly, to a technique for arranging superimposed display information such as imaging information to be displayed together with an image.

[0002]

2. Description of the Related Art Conventionally, there is a silver halide camera in which a date and a photographing time are projected below a latent image on a film at the time of photographing and reproduced below a developed image.

There is also an electronic camera device such as a digital camera equipped with an image display device, which can display character data such as a date and a photographing time when a reproduced image is displayed on a screen. In such an electronic camera device, when an image is stored and recorded on a recording medium such as a flash memory when capturing an image, character data such as a date and a photographing time are recorded on the recording medium separately from the image. In this case, the character data is displayed at a fixed position on the screen.

[0004]

In the above-mentioned conventional electronic camera device, character data such as the date and time of image capture is projected at a fixed position on the image. Therefore, depending on the composition of the image, the projected character data itself becomes an obstacle. There was a problem. In addition, since the display color of the character data to be projected is fixed, there is a problem that it may be difficult to see the character data even if the character data is displayed depending on the background color of the character data.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and provides an electronic camera device and a superimposed display information arranging method capable of displaying superimposed display information such as imaging information displayed together with an image in an easily viewable state. Aim.

[0006]

According to a first aspect of the present invention, there is provided an electronic camera apparatus for capturing an image of a subject and recording the captured image. It is characterized by comprising a substantially same-color-part identifying means for determining whether or not there is an image, and imaging information arranging means for arranging imaging information on an image in the substantially same-color part when that part exists.

According to a second aspect of the present invention, there is provided the electronic camera device of the first aspect, further comprising a search range determining means for determining a search range of the image, wherein the same-color portion determining means is the search determined by the search range determining means. It is characterized in that it is determined whether or not substantially the same color portion exists in the range.

According to a third aspect of the present invention, in the electronic camera device according to the second aspect, the search range determining means includes a search range designating means for designating a search range.

According to a fourth aspect of the present invention, in the electronic camera device of the second aspect, the search range determining means includes an outline detecting means for detecting an outline of a subject portion in the image. The outside of the contour is set as a search range.

According to a fifth aspect of the present invention, in the electronic camera device according to the second aspect, the search range determining means determines the search range based on a focus state in the image.

According to a sixth aspect of the present invention, in the electronic camera device according to the second aspect, the search range determining means sets a peripheral portion excluding a central portion of the image as the search range.

According to a seventh aspect of the present invention, in the electronic camera device according to the first aspect, the imaging information arranging means includes size determining means for determining a size of the imaging information according to an area of the substantially same color portion. The electronic camera device according to claim 1, wherein:

According to an eighth aspect of the present invention, in the electronic camera device according to any one of the first to seventh aspects, the imaging information arranging means includes a predetermined priority among the substantially same-color portions determined by the same-color portion determining means. It is characterized by including arrangement position determining means for preferentially arranging imaging information in a portion corresponding to the order.

According to a ninth aspect, in the electronic camera device according to the first aspect, the imaging information arranging means determines a display color of the imaging information such that a color of a substantially same color portion and a display color of the imaging information are different. And a display color determining unit that performs the display color determination.

According to a tenth aspect, in the electronic camera device according to any one of the first to eighth aspects, the same-color portion determining means determines a portion having a color different from the standard display color of the imaging information. Features.

An electronic camera device according to an eleventh aspect of the present invention comprises:
In an electronic camera device that captures an image of a subject and records a captured image, a subject determination unit that determines a subject portion in an image, and the subject portion determined by the subject determination unit and imaging information about an image overlap when displayed. Size determining means for determining a display size of the imaging information so that the imaging information can be superimposed and displayed outside the subject portion with a size not to be exceeded.

The twelfth electronic camera device is an electronic camera device for capturing an image of a subject and recording a captured image, wherein: an imaging information arranging means for arranging imaging information relating to the image in the captured image; Display color determining means for determining the display color such that the color of the image portion where the imaging information is arranged by the arrangement means and the display color of the imaging information of the image are different.

The thirteenth electronic camera device is an electronic camera device that captures an image of a subject and records the captured image. If the captured image includes an image portion other than the standard display color of the imaging information related to the image, Color component determining means for determining whether or not the image portion is present when the presence of the image portion is determined by the color component determining means. And

In a fourteenth aspect of the present invention, the superimposed display information arranging method determines whether or not substantially the same color portion exists in an image displayed on the display device, and superimposes the substantially same color portion when the same exists. Display information is arranged.

According to a fifteenth aspect of the present invention, in the method of arranging superimposed display information, a subject portion in an image displayed on the display device is determined, and the display size of the superimposed display information is changed according to the area of the portion determined to be other than the subject portion. It is characterized in that it is determined and arranged.

According to a sixteenth aspect of the present invention, when arranging the superimposed display information on an image to be displayed on the display device, the method determines the color of the image portion where the superimposed display information is arranged, Is different from the color of the image portion.

[0022] In a seventeenth aspect of the present invention, the superimposed display information arranging method determines whether or not an image displayed on the display device includes a substantially same color portion different from the standard display color of the superimposed display information. When there is a substantially same color portion different from the standard display color of information, the superimposed display information is arranged in that portion,
It is characterized by the following.

[0023]

DESCRIPTION OF THE PREFERRED EMBODIMENTS [Circuit Configuration Example] FIG. 1 is a block diagram showing a circuit configuration example of a digital camera to which the imaging information arrangement method of the present invention can be applied.
Represents an optical system 11, a signal conversion unit 12, a signal processing unit 13, and D
It includes a RAM 14, a control unit 20, an operation unit 30, a display unit 40, and a storage unit 50. Note that the optical system 11, the signal conversion unit 12, and the signal processing unit 13 constitute the imaging unit 10. Further, as shown in the figure, a data output unit 60 for outputting an image or image information stored in a recording medium (memory card 51) of the storage recording unit 50 to an external image processing device such as a personal computer (hereinafter, a personal computer) is provided. It may be provided.

In FIG. 1A, the optical system 11 includes an imaging lens, an automatic aperture mechanism, a focusing mechanism, and the like (not shown).
The luminous flux of the subject image condensed through the imaging lens is formed on a subsequent image sensor (CCD).

The signal conversion section 12 includes a CCD and a signal conversion circuit, converts an image formed on the CCD via the optical system 11 at the preceding stage into an electric signal, converts the image into digital data, and converts the image into a digital signal at a predetermined period. To output.

The signal processing unit 13 processes the output from the signal conversion unit 12 at the time of imaging to obtain signal components such as digital luminance and color difference multiplex signals (Y, Cb, Cr data). , Cb, Cr data (hereinafter, image data) are transferred to the DRAM 14 and temporarily stored therein. Further, in order to display a through image, the captured image data is thinned out and sent to the display unit 40. When a shutter operation is performed, the image data at that time is sent to the display unit 40 to display a still image. The signal processing unit 13 also reads out the image data written in the DRAM 14 at the time of storing and recording the image, performs JPEG compression processing, and stores the image data stored and recorded in the recording memory (memory card) 51 at the time of reproduction. Is subjected to decompression processing to reproduce image data.

The DRAM 14 is used as a work memory, and as shown in FIG. 2, an image buffer area 141 for temporarily storing captured images and reproduced images, a work area 142 for JPEG compression / expansion, and the like are secured. .

As shown in FIG. 1B, the control unit 20
PU 21, RAM 22, and ROM 23 for storing programs
And a microprocessor having peripheral circuits such as a timer. The CPU 21 is connected to each of the above-described circuits and a power switch (not shown) via a bus line, and is stored in a program storage ROM 23. The control program controls the entire digital camera 100. In addition, a program for each mode processing stored in the program storage ROM 23 and a photographing information arrangement program based on the present invention are stored in the program storage ROM 23 in accordance with the state signal from the operation unit 30. Take out and perform execution control of each function of the digital camera 100, for example, perform execution of a function of imaging and reproduction of a recorded image, and also perform processing such as a process of arranging imaging information in a captured image or a reproduced image at the time of imaging or reproduction. Performs execution control.

The operation section 30 includes keys and switches such as a processing mode switch, a function selection button, a cursor movement key 35, and a shutter button 36. When these keys or switches are operated, a status signal is generated. It is sent to the control unit 20.

The display unit 40 includes a video encoder, a VRA
M, a liquid crystal screen (LCD), and the like. Under the display control of the control unit 20, a through image at the time of imaging, a still image, a reproduction image at the time of reproduction, a selection menu (or icon) at the time of processing selection, In addition to displaying a message for operating instructions, etc., the imaging information is displayed together with the through image, the still image, and the reproduced image.

The storage and recording unit 50 is configured so that a memory card 51 can be detachably attached thereto.
1 stores and records a captured image, imaging information, and the like. Further, at the time of reproducing the image, the image and the imaging information stored in the memory card 51 are taken out. Note that the storage recording unit 50 may be configured to include a storage recording medium such as a flash memory.

[Imaging Information Arrangement Process] FIG. 3 is a process chart showing a process of arranging imaging information according to the present invention. FIGS. 3A and 3B show imaging information to be displayed on an image at the time of storage and recording of an image. And its position and display color (hereinafter,
This is an example of saving and recording arrangement data). FIG.
(C) is an example of arranging the imaging information on a captured image based on the arrangement data, synthesizing (projecting), storing and recording,
FIG. 3D is a detailed flowchart of the process 6.

FIG. 4 is an explanatory view of an imaging information recording file for storing imaging information and its arrangement data. FIG. 4A shows an example of a memory card provided with an imaging information recording file area. (B) is a figure showing an example of an imaging information record list.

(A-1) Example of Recording Imaging Information and Its Arrangement Data in Imaging Information List (1) (Example of Detecting Same-Color Portion) Process P1: (Imaging Operation) In FIG. When 100 is activated,
After the focusing operation, the subject image is
4 and is sent to the display unit 40 to be displayed as a through image. The operations of capturing the image and displaying the through image are repeated until the shutter button 36 is pressed. When the user presses the shutter button 36, an imaging instruction signal is sent to the control unit 20, and the process shifts to P2.

Process P2: (Acquisition of imaging information) The control unit 20 acquires the imaging information at the time of the imaging operation (when the shutter button 36 is pressed down) and temporarily stores it in the RAM 22 (may be temporarily stored in the DRAM 14). ).
In the present embodiment, only the shooting date and time is described as an example of the shooting information. However, the present invention is not limited to this. For example, as shown in FIG. 4A, the shooting date and time and the type of shooting mode (normal shooting, close-up shooting, panorama shooting) (E.g., shooting, etc.), whether or not a strobe is used, the distance to the subject, the focal length, the shutter speed, and the like. In addition, environmental conditions at the time of imaging, such as longitude, latitude, shooting location and angle of view, temperature, humidity, altitude, and the like can be used as imaging information, and the number and combination of imaging conditions reflected in a captured image are It may be fixedly set according to the type of digital camera at the time of design, may be set as standard at the time of design, and may be appropriately set by the user at the time of use.

Further, the imaging information can be obtained as a value calculated by a well-known calendar program on the basis of a timer value at the time of pressing down the shutter for the shooting date and time.
The type of the imaging mode, the use of the strobe, and the like can be acquired based on the values set when the user selects the processing. In addition, the distance to the subject, the focal length, the shutter speed, the angle of view, the environmental conditions, and the like can also be acquired as a value or the like that is detected or generated at the time of imaging and a code representing the determination result.

Process P3: (Determination of Search Range) When deciding the display position of the imaging information, it is necessary to improve the search efficiency of substantially the same color portion and to arrange the imaging information to be displayed in a well-balanced manner so as not to cover the subject. Requested. In order to satisfy such a condition, a same-color portion determination target area (hereinafter, a search range) for determining a substantially same-color portion is used.
It is desirable to determine

The control unit 20 determines a search range 219 as shown in FIG. 5B based on a program that implements one of the following methods (see the description of each embodiment for details). The subject (attention subject) in the image is automatically determined,
A method of setting an image area outside the subject as a search range. In this case, a method of detecting the contour of the subject (Example 1-1) as a method of determining the subject, and determining the subject based on whether or not the subject is in focus (Example 1
-2). Method of setting peripheral portion of image as same-color portion determination region (Example 1-3) Also, a plurality of points in the image are designated at the time of initial setting, and a region outside a line connecting those points is set as a search range. You may.

Process P4: (Determination of Same Color Portion) The control section 20 checks the search range determined in the process P3 and specifies a substantially same color portion. For example, among images stored in the DRAM 14 of the digital camera 100 (or a memory of an external image processing device such as a personal computer), a search range (FIG. 5B, FIG. 7C, FIG. 9D, FIG. 10), and the color distribution of R, R is determined as shown in FIG.
It is determined whether or not the difference r, g, b between the G and B ratios is within the threshold value δ. If the difference is within the threshold value δ (FIG. 11A), the portion is determined to be a substantially same color portion (FIG. 11B ) Is the distribution of parts that are not substantially the same color). The portions 262, 263,... Having a predetermined area or more among the portions determined to be substantially the same color in this manner.
(FIG. 1 (c) is discriminated as a substantially same color portion and extracted.

As described later (Embodiment 2), it is also possible to discriminate a substantially same color portion by comparing colors in a frame before and after movement of a frame of a predetermined size.

Process P5: (Determination of Display Position of Imaging Information) The control unit 20 determines a display position where the imaging information is displayed in the substantially same color portion specified in the process P4, and acquires its coordinates.

Process P6: (Determination of Display Color of Imaging Information) The control unit 20 determines that the display color of the substantially same color portion searched in the process P4 is the standard display color (default color) of characters, graphics, etc. representing the imaging information. It is determined whether they are the same (P6-1).
(FIG. 3B), in the same case, the display color (for example, the character color) of the imaging information is changed to a different color (a display color that is easy to see, for example, an opposite color or white outline) (P6-2 (FIG. 3D) This process is omitted when the substantially same color portion obtained in the process P4 is set to a color other than the standard display color of the imaging information as shown in FIG.

Process P7: (Determination of Display Size of Imaging Information) The control unit 20 determines the display size (character size or figure size) of the imaging information according to the size of the substantially same color portion obtained in the process P4. I do. This process is omitted when the method of moving the search frame is used to determine the same color portion in the process P4 (FIG. 12).

Process P8: (Recording of arrangement information of imaging information) The control unit 20 stores the imaging information obtained in the above-described processes to P7 and the display position of the imaging information in the imaging information recording file 70 (FIG. 4) provided in the memory card 51. , Display color and display size are recorded.

In the example of FIG. 4B, the image number of the recorded image is stored in the image number column 71 of the imaging information recording file 70, and the display color (color) of the imaging information of the image is stored in the display color column 72. Code), the size column 73 stores the display size (for example, a ratio when the standard display size is set to “1”) of the imaging information of the image, and the display position 1 column stores the imaging information (data The coordinates of the display frame (1) may be stored (the coordinates of the four corners of the display frame may be used, but the coordinates of a specific corner may be used). The data 1 column stores the shooting date and time data of the image. The column stores the coordinates of the display zone of the imaging information (data 6).

Process P9: (Image Recording Process) The controller 20 sets the DR when the shutter button 36 is depressed.
The image captured by the AM 14 is subjected to JPEG compression processing, and stored and recorded on the memory card 51.

According to the above process, when reproducing the recorded image, the image information (data) is extracted from the image information recording list 70, adjusted according to the stored display color code and the display size ratio, and arranged at the display position. It can be combined with an image and displayed (reflection display). The reproduced image projected and displayed in this manner is arranged so as not to disturb the subject and is displayed in a display color that is easy to see.

Further, since a plurality of pieces of imaging information and their arrangement information can be registered in the imaging information recording file, the user can select and set the imaging information to be displayed at the start of the reproduction mode.

The memory card 51 in which the imaging information and its arrangement data and the image are recorded is mounted on an external image processing device such as a personal computer, or the digital camera 100 is connected to the external image processing device via the data output unit 60 from the memory card. 5
By transmitting the image and the image information and the arrangement information recorded in the image information 1, the image information can be displayed on the external image processing apparatus side so as not to disturb the image and to be easily viewable.

(B-2) Example of Recording Imaging Information and Its Arrangement Data in Imaging Information List (2) (Example of Detecting Portion Different from Display Color of Imaging Information)
In the example of FIG. 3A, the same color portion in the search range is detected in the process P4, and the display position is determined in P5. However, as shown in FIG. 3B, the following processes P4 'and P
A part other than the standard display color of the imaging information in the search range may be detected at 5 ′ to determine the display position. In this case, the process of determining the display color of the imaging information in the process P6 becomes unnecessary (see the third embodiment).

Process P4 ': (Determination of Same Color Portion) In FIG. 3B, the control unit 20 checks the search range determined in the process P3 in the same manner as the process P4.
It is determined that the portions are substantially the same color.

Process P5 ': (Determination of Display Position of Imaging Information) The control unit 20 determines a display position for displaying imaging information in the portion specified in the process P4', obtains its coordinates, and obtains the coordinates shown in FIG. The process proceeds to the process P7 of (a).

(B) Example of describing imaging information, its position, display color, and the like in an HTML file In the above-described examples of FIGS. 3A and 3B, in process P8,
The image information and its arrangement data are stored in the image information recording file (FIG. 4) of the memory card 51. Instead, the image information and its arrangement information are stored in the memory card 51 in an HTML image list file. It may be described by.

(C) Example of combining and storing imaging information at the time of recording a captured image In the process P8 in the example of FIG. 3A described above, the imaging information and its arrangement data are stored in an imaging information recording file or HT.
Although it was stored in the ML file ((a-1),
(B)), as shown in FIG. 3C, the imaging information may be combined with the captured image in the process P8 ′. That is, after the process P7 in FIGS. 3A and 3B, the process P6 ′: (combination of image and imaging information) The control unit 20 converts the imaging information obtained in the process P2 into a process P2.
7 is converted to the display size obtained in process P5, and the image recorded in the DRAM 14 with the display color obtained in process P6 at the display position obtained in process P5
Image captured in the image).

Process P9 ': (Synthesized image and storage / recording) The control unit 20 controls the D in which the imaging information is synthesized in the process P6'.
The image on the RAM 14 is subjected to JPEG compression processing, and stored and recorded on the memory card 51.

According to the above-described process, the captured information 300 is displayed so as not to disturb the image at the time of reproducing the recorded image and to be easily viewed (FIGS. 8C and 8D).

Note that, in the process shown in FIG.
Is converted into the display size obtained in the process P7, and is arranged at the display position obtained in the process P5.
4 is synthesized with the image recorded. By doing so, a similar result can be obtained.

In the above process chart, an example in which imaging is performed in the process P1 is described. However, a recorded image is reproduced by an image processing apparatus such as a digital camera or a personal computer, and superimposed display information such as the imaging information is converted to a reproduced image. Also in the case of the superimposed display, the superimposed display information can be combined with the reproduced image and displayed by using the same process (that is, the process P1 is the reproduction process of the recorded image, and the process P2 is recorded together with the recorded image in the storage memory). Image information, or image information newly input by a key, is acquired.
The process of determining the character size in the process P7 from the determination of the search range in the process P3 is performed in the same manner as in the case of FIG.
Can be combined and displayed at the image position determined by. As a result, if the imaging information is also recorded for the conventional recording image, the imaging information can be displayed in the reproduced image without obstructing the image and in a legible manner.
Further, an imaging information recording file or an HTML file is created in the memory card 51 (or the image storage memory),
The imaging information and the arrangement data of the imaging information may be recorded in the process P8 of FIG.

<Embodiment 1> FIG. 5 is an explanatory diagram of image pickup information arranged in a search range, and is a closed space surrounded by a subject 210 and points 211, 212, 213 and 214 in the image shown in FIG. Considering 215 (FIG. 5B), the same color portion is determined using the image portion 219 other than the closed space 215 as a search range. The closed space 215 may be the contour of the subject, a focused portion, or a portion set outside the search range.

In the example of FIG. 3C, the search range 219
This is an example in which imaging information 300 (imaging date and time in the illustrated example) having a size proportional to the area is displayed in a portion determined to be substantially the same color portion in FIG.

[Method of Determining Same Color Part Discrimination Target Area (Search Range)] (1) A method of automatically discriminating a subject image (target subject image) in an image and setting an image area other than the subject image as a search range [ Embodiment 1-1 Method of Detecting Contour of Subject Image and Setting Outer Contour as Search Range FIG. 6 is a flowchart showing an embodiment of a method for automatically detecting a search area, and FIG. 7 is an explanatory diagram thereof. Step S1: (Contrast smoothing process) The control unit 20 controls the DRAM 14 of the digital camera 100
(Or a memory of an external image processing apparatus such as a personal computer) is subjected to a smoothing process on a distribution (contrast (brightness)) 220 of an image (FIG. 7A) to obtain a distribution as shown in FIG. 7B. .

Step S2: (Extraction of Contour) The control unit 20 extracts the rising portion 221 (or the falling portion 221 ') from the flat portions 225 and 225' toward the center of the smoothed contrast distribution. Extract as data.

Step S3: (Specification of Contour) The controller 20 processes the contour data extracted in the above step S2, and performs processing on the contour 222 of the subject as shown in FIG.
Is specified, and the outside of the outline 222 is set as the search area 229.

[Embodiment 1-2] Method of Determining Search Range Based on Whether Focus is Focused FIG. 8 is a flowchart showing an embodiment of a method for automatically detecting a search area, and FIG. FIG. Step T1: (Extraction of Horizontal Contrast) The control unit 20 controls the DRAM 14 of the digital camera 100
9 (or a memory of an external image processing device such as a personal computer), the contrast (luminance) distribution in the horizontal direction (X) of the image 231 (FIG. 9A) is smoothed, and FIG.
A distribution 235 as shown in FIG.

Step T2: (Extraction of Vertical Contrast) The control unit 20 similarly performs smoothing processing on the contrast distribution in the vertical direction (Y) of the image 231 (FIG. 9A),
A distribution 236 as shown in FIG. 9C is obtained.

Step T3: (Synthesis) The control unit 20 controls the sharp range 235 'to 235''of the horizontal luminance distribution 235 obtained in the above step T1.
And the sharp portions 236 ′ to 236 ″ of the vertical luminance distribution 236 obtained in step T2.

Step T4: (Detection of Focusing Range) The control section 20 determines the focusing range 23
2 is detected, and an image area other than the in-focus range is set as a search area. (3) Method of setting peripheral portion of image as same-color portion determination region [Embodiment 1-3] FIG. 10 is an explanatory diagram of a method of setting a search region.

In this method, as shown in FIG. 10A, a search range 2 is set within a range of distances R1, R2, R3, and R4 from image frame frames 251, 252, 253, and 254.
59 is set in advance. As a result, the search range can be easily determined, and the search for the same color portion becomes easier as described later.

Normally, the periphery of an image includes sky, ground, sea,
In many cases, it is a part different from the subject, such as a lake, a mountain, or a grass. Therefore, in most cases, the search position of the imaging information can be obtained only by searching the peripheral part of the image.
Even when there is no substantially same-color portion having a size enough to arrange the imaging information, the imaging information can be arranged by determining the display size of the imaging information in proportion to the size of the substantially same-color portion as described later. There is no practical problem.

<Embodiment 2> Before moving a frame of a predetermined size,
Example of Determining Same-Color Portion by Comparing Colors in Frame After Movement [Embodiment 2] FIG. 12 is a flowchart showing an embodiment of a method for automatically determining a same-color portion and a method for automatically determining a display position. FIG.

Step W1: (Holding the Color of the Image Part in the Current Search Frame) The control unit 20 extracts the color distribution of the image part in the current position frame occupied by the search frame, and stores the color distribution in the RAM together with the coordinates of the image part.
22.

Step W2: (Searching of Search Range by Search Frame) The control unit 20 sets the search frames 270-1, 270-2, 270-3,...
(A)) in FIG.
As shown in FIG. 7B, the image portion determined as the search range is moved in a predetermined direction at a predetermined pitch, and the color distribution of the image portion in the frame occupied by the search frame at the position after the movement is extracted. . When the search of the search range is completed (that is, when the same color portion is not found), the process transits to W5.

The search order of the search frame may be clockwise or counterclockwise, or may be sequentially searched in parallel from right (left) to left (right) or from top (bottom) to bottom (top). In view of the balance with the subject, the optimal display position of the imaging information is empirically determined (for example, at the lower right corner). Therefore, the optimal position (coordinate) for displaying the imaging information is determined in advance in a table (for example, , Priority display position table), and search may be performed in the order of registration according to the priority display. In the embodiment, when moving in the vertical direction, the moving pitch is 1 / the length of the search frame in the vertical direction.
5. When moving in the horizontal direction, 1/1 of the horizontal direction of the search frame
Although it was set to 10, it is not limited to this.

Step W3: (Comparison of colors in search frame before / after movement) The control unit 20 extracts the color distribution (the color distribution of the image portion before the movement) held in the RAM 22 and the above-mentioned step W2. The color distribution is compared with the color distribution, and when the difference between the color distribution before and after the movement is zero or within a predetermined threshold, the image portion occupied by the search frame (the image portion before the movement, the image portion after the movement, or the intermediate portion) (In the embodiment, the portion before movement) is determined to be the same color portion, and the process proceeds to Step W4.
In this case, the size of the search frame is set to be the same as the size of the image information display frame, and the search is performed sequentially from the maximum search frame. Therefore, even if the actual substantially same color portion is larger than the size of the area occupied by the search frame, the display of the imaging information is performed. Above does not cause inconvenience. If the difference between the color distributions before and after the movement is equal to or larger than a predetermined threshold, the color is regarded as not the same and the process returns to step W1.

Step W4: (Acquisition of Coordinates of Arrangement Position) The control unit 20 occupies the coordinate values of the portion determined to be substantially the same color in step W3 (that is, occupied by the search frame before the movement held in step W1). The coordinate value of the image part) is acquired as the arrangement position (display position) of the imaging information, and the process transits to P6.

Step W5: (display position = fixed position) When the search of the search range is completed in step W2, the preset fixed position is set as the arrangement position, the coordinates are set as the arrangement position of the imaging information, and the coordinate value is set. It is temporarily stored in the RAM 22.

Step W6: (display color = fixed color) Further, the control unit 20 sets the display color of the imaging information to a fixed color (for example, a standard display color), temporarily stores the color code in the RAM 22, and transits to P8. .

According to this method, a predetermined corner of the image (usually, as shown in FIG. 13B, the lower right corner 271 having the best display balance when displaying the imaging information) is arranged along the frame. Specific direction (counterclockwise or counterclockwise, or lower right corner 271 → upper right corner 272, lower right corner 271 → lower left corner 274, upper right corner 272 → upper left corner 273, upper left corner 273
→ The largest frame 27, such as the lower left corner 274)
The operation of discriminating the preceding and following colors is repeated while first moving 0-1. If the same color portion is not found, the same discriminating operation is performed using a search frame 270-2 of the next size. The same color portion can be used as the arrangement position of the imaging information and its coordinate value can be obtained.

When the same color portion is determined using the search frame in this way, the determination of the same color portion is simplified. In addition, since the image portion is searched with a priority and the same color portion found first can be determined as the arrangement position of the imaging information, the arrangement of the imaging information with a good balance with the subject can be realized.

In the above embodiment, the color in the search frame before the movement and the color in the search frame after the movement are compared. However, it may be simply determined sequentially whether or not the inside of the search frame is substantially the same color. Good.

<Embodiment 3> [Determination of a portion having a color different from the display color of imaging information and determination of display position] In the above-described method of determining the same color portion, the same color portion was determined. Alternatively, a color portion different from the color portion may be detected. In this case, the process P6 of FIG. 3 and the process of determining the display color of the imaging information are not required.

FIG. 14 is a flowchart showing one embodiment of a method for automatically determining an image portion different from the standard display color of the image pickup information and a method for automatically determining a display position, and FIG. 15 is an explanatory diagram thereof.

Step X1: (Contrast smoothing process) The control unit 20
(Or a memory of an external image processing device such as a personal computer) A smoothing process is performed on the distribution of contrast (brightness) of an image portion determined as a search range among images stored in the image processing device.

Step X2: (Extraction of Flat Contrast Portion) The control section 20 extracts, from the distribution obtained in the above step X1, a portion having a contrast difference within a threshold value as a flat contrast portion. If there is no flat portion having a predetermined area or more, the flow goes to X7.

Step X3: (Comparison of Color Distribution) The control unit 20 examines the color distribution (FIGS. 13A and 13B) of the portion where the contrast extracted in the above step X2 is flat, and It is determined whether or not the differences r, g, and b of the R, G, and B ratios are within a threshold δ, and when the differences are not less than a threshold γ (FIG. 13).
In (b)), the part is determined as a part of a different color, and X4
Transitions to. Otherwise (FIG. 13A), X2
To extract the next portion where the contrast is flat.

Step X4: (Extraction of Substantially the Same Color Portion of Different Color Portions) The control unit 20 extracts the substantially same color portion of the image portion determined as the different color portion in the above step X3.

Step X5: (Selection of Arrangement Position) The control unit 20 selects and extracts the part having the maximum area from the substantially same color parts extracted in step X4. If no image color portion of a different color is extracted in step X4, the process proceeds to X7.

Step X6: (Acquisition of Coordinates of Arrangement Position) The control unit 20 obtains a rectangular frame inscribed in the maximum area obtained in step X5, obtains the coordinate value of the maximum frame, and arranges the imaging information. RAM2 stores the coordinates as the position
Then, the process temporarily shifts to P7.

Step X7: (arrangement position = fixed position) If there is no image part of a different color larger than the predetermined area in step X2, or if there is no image part of a different color extracted in step X4, The coordinates are temporarily stored in the RAM 22 with the set fixed position as the arrangement position and the coordinates as the arrangement position of the imaging information.

Step X8: (display color = fixed color) Further, the control unit 20 sets the display color of the imaging information to a fixed color (for example, a standard display color) and temporarily stores the color code in the RAM 22.

Step X9: (display size = fixed size) Further, the control unit 20 sets the display size of the imaging information to a fixed size (standard display size) and sets the size (code) to RA.
It is temporarily stored in M22.

As in the case of the second embodiment, a search frame may be used to search for a substantially same color portion different from the standard display color of the imaging information.

<Fourth Embodiment> [Method of Determining Display Size] When the size of the display position of the image information determined in process P5 in FIG. 3 is smaller than the standard display size of the character or figure representing the imaging information, or the standard of the imaging information If the size is larger than the size, it is necessary to reduce or enlarge the display size of the character or figure so that it matches the size of the display position.

FIG. 16 is a flowchart showing one embodiment of a method for automatically determining a display color and a display size.
(A) Digital camera 10 in processes P6 and P7
11 is a flowchart illustrating an operation example of a zero.

Step Y1: (Comparison and Determination of Display Color of Background and Image Information) The control unit 20 determines the color of the substantially same color portion obtained by the same color portion determination process in the process P4 in FIG. The standard display colors are compared, and if the colors are the same, a transition is made to Y2; otherwise, a transition is made to Y3. The determination as to whether or not the color of the substantially same color portion is the same as the standard display color of the imaging information is performed, for example, by calculating the difference between the color distribution of the substantially same color portion and the color distribution of the standard color of the imaging information, and determining the difference within a predetermined value. If so, the determination can be made in the same manner.

Step Y2: (Comparison of Areas of Substantially Same Color Part) The control unit 20 sets the area of the above substantially same color part to a predetermined value (A>B>
C> D), when the area of the substantially same color portion> A, Y
4 if Y ≦ A <substantially the same color area <C
If C ≦ substantially the same color portion area <D, the process transitions to Y6, and if C ≦ substantially the same color portion area ≦, the process transits to Y7.

Y4: (enlargement of size) The control unit 20 enlarges the character or graphic data constituting the imaging information at the display position determined in the process P5 so as to enlarge the image and the graphic data according to the area of the substantially same color portion. The subsequent size (the ratio to the standard size) is obtained, temporarily stored in the RAM 22, and the process transits to P8. The enlargement size may be obtained, for example, by calculating the ratio of a portion having substantially the same color as the area C using the area C as a standard, and using the ratio as the enlargement ratio.

Y5: (Setting of standard display size) The control unit 20 sets the standard display size (ratio = ratio) such that characters and graphic data constituting the imaging information can be captured in the standard display size at the display position determined in the process P5. 1) RAM
22 and the process transits to P8.

Y6: (Reduction of Size) The control unit 20 enlarges the character or graphic data constituting the imaging information at the display position determined in the process P5 so that the character or graphic data can be reduced in size according to the area of the substantially same color portion. The subsequent size (the ratio to the standard size) is obtained, temporarily stored in the RAM 22, and the process transits to P8. As the reduced size, for example, a ratio of a portion having substantially the same color as the area C may be obtained by using the area C as a standard, and may be used as a reduction ratio.

Y7: (Setting of fixed display size) The control unit 20 controls the fixed display size (standard display size) so that the character or graphic data constituting the image pickup information can be displayed at the fixed display size at the display position determined in the process P5. (The ratio to the size) is temporarily stored in the RAM 22, and the process transits to P8. Note that the fixed display size may be equal to the standard display size.

In the example in which the search frame is moved to search for a substantially same color portion (Embodiment 2), the size of the standard size search frame and the size of the standard display frame of the imaging information are the same, and the size of the search frame is different from that of the other search frames. The size of the search frame is determined by the ratio of the size of the search frame to that of the standard search frame. , The enlargement (reduction) magnification of the imaging information is known. Therefore, this can be recorded in the imaging information recording file (or HTML file),
The display size can be easily determined.

Further, the arrangement of the superimposition information according to the present invention may be performed after displaying a moving image, reproducing a moving image, and displaying a through image. In this case, the arrangement position, size, color, and the like of the superimposition information such as the imaging information may be sequentially changed according to the change of the moving image that changes every moment.

The imaging information includes character information such as memos and titles input by the user, and character information. Further, the information is not limited to the imaging information, and may be, for example, status information such as help information, operation information, and icons that are not related to the captured image (not associated with the captured image).
Any information that can be superimposed and displayed on the display image may be used.

In this embodiment, the outline of the subject is extracted and the outside of the outline is set as a search range, or the out-of-focus portion in the image is determined as the search range, and the substantially same portion in the search range is set as the search range. Was extracted and the imaging information was arranged, but the outline of the subject was simply extracted,
Outside the contour, or in the in-focus portion of the image, where the focus is not obtained, that is, in a portion that is not the subject, the imaging information is resized and controlled so that it does not overlap the subject. Is also good. Although several embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and it goes without saying that various modifications can be made.

[0105]

As described above, according to the electronic camera apparatus of the first and second aspects and the electronic camera apparatus of the fourteenth aspect, substantially the same color portion as the background is automatically detected. Since the superimposed display information such as the imaging information is arranged in the portion, the imaging information and the like can be displayed easily in the image.

Further, since the electronic camera device according to the third aspect of the present invention can specify the search range, the user can determine the search range at the time of initial setting and can take an image.

In the electronic camera devices according to the fourth to sixth aspects of the present invention, the search range is automatically determined so as not to overlap with the subject, so that superimposed display information such as imaging information may be displayed over the subject. Therefore, both the subject and the superimposed display information are easy to see.

According to the electronic camera device of the seventh aspect and the superimposed display information arranging method of the fifteenth aspect, the size of the superimposed display information such as the imaging information is automatically changed according to the area of the substantially same color portion. As a result, the superimposed display information can be displayed in a well-balanced size in the same color portion of the carrier.

In the electronic camera device according to the eighth aspect,
Since superimposed display information such as imaging information is displayed in a portion corresponding to a predetermined priority in the substantially same color portion, a preferable display position of the intuitive display information is registered in advance, so that the superimposed display information is displayed in a well-balanced position. Display information can be displayed.

The electronic camera device according to the eleventh aspect of the present invention
According to the superposition information arranging method of the fifteenth aspect, the display size of the imaging information and the like is automatically determined so as not to overlap with the subject, so that the superimposed display information such as the imaging information is displayed over the subject. Therefore, both the subject and the superimposed display information can be easily viewed.

According to the electronic camera apparatus of the ninth or twelfth aspect, or the superimposed display information arranging method of the sixteenth aspect, the color of the portion where the superimposed display information is arranged is the same as the display color of the superimposed display information. In this case, the display color of the superimposed display information is changed and displayed, so that the superimposed display information is easy to see.

According to the electronic camera device of the tenth or thirteenth aspect, or the superimposed display information arranging method of the seventeenth aspect, the superimposed display information is displayed in an image portion different from the display color of the superimposed display information. The superimposed display information is easy to see.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a circuit configuration example of a digital camera to which an imaging information arrangement method according to the present invention can be applied.

FIG. 2 is a diagram illustrating a layout example of a DRAM.

FIG. 3 is a process chart showing a process of arranging imaging information according to the present invention.

FIG. 4 is an explanatory diagram of an imaging information recording file that stores imaging information and its arrangement data.

FIG. 5 is an explanatory diagram of a search range and arranged imaging information.

FIG. 6 is a flowchart illustrating an embodiment of a method for automatically detecting a search area.

FIG. 7 is an explanatory diagram of a method for automatically detecting a search area.

FIG. 8 is a flowchart illustrating an embodiment of a method for automatically detecting a search area.

FIG. 9 is an explanatory diagram of a method for automatically detecting a search area.

FIG. 10 is a flowchart illustrating an embodiment of a search area setting method.

FIG. 11 is an explanatory diagram of a method for automatically determining the same color portion and a method for automatically determining a display position.

FIG. 12 is a flowchart illustrating an embodiment of a method for automatically determining the same color portion and a method for automatically determining a display position.

FIG. 13 is an explanatory diagram of a method for automatically determining the same color portion and a method for automatically determining a display position.

FIG. 14 is a flowchart illustrating an embodiment of a method for automatically determining an image portion different from a standard display color of imaging information and a method for automatically determining a display position.

FIG. 15 is an explanatory diagram of a method for automatically determining an image portion different from a standard display color of imaging information.

FIG. 16 is a flowchart showing an embodiment of a method for automatically determining a display color and a display size.

[Explanation of symbols]

40 Display device 75-1,..., 75-6 Date and time 1,..., Shutter speed 1 (imaging information) 100 Digital camera (electronic camera device) 210 Subject 222 Subject contour 225, 225 'Substantially the same color portion 300 Imaging information

Claims (17)

[Claims] 1. An electronic camera device for capturing an image of a subject and recording a captured image, comprising: a substantially same color portion identifying means for determining whether or not a substantially same color portion having a predetermined area or more exists in the captured image; An electronic camera device comprising: an imaging information arranging unit for arranging imaging information relating to the image in a portion where the same color exists. 2. A search range determining means for determining a search range of the image, wherein the same color portion determining means determines whether or not substantially the same color portion exists in the search range determined by the search range determining means. The electronic camera device according to claim 1, wherein the determination is performed. 3. The electronic camera device according to claim 2, wherein said search range determining means includes a search range specifying means for specifying said search range. 4. The search range determining means includes contour detecting means for detecting a contour of a subject portion in the image, and sets a search range outside a contour detected by the contour detecting means. The electronic camera device according to claim 2. 5. The electronic camera device according to claim 2, wherein said search range determining means determines a search range based on a focus state in said image. 6. The electronic camera apparatus according to claim 2, wherein said search range determination means sets a peripheral portion excluding a central portion of said image as a search range. 7. The electronic camera apparatus according to claim 1, wherein said image information arranging means includes a size determining means for determining a size of said image information according to an area of said substantially same color portion. 8. An arrangement position determining means for preferentially arranging the imaging information in a portion corresponding to a predetermined priority among substantially the same color portions determined by the same color portion determining means. 2. The method according to claim 1, wherein
The electronic camera device according to any one of claims 1 to 7. 9. The image information arranging means includes a display color determining means for determining a display color of the image information such that a color of the substantially same color portion and a display color of the image information are different. Item 2. The electronic camera device according to Item 1. 10. The electronic camera device according to claim 1, wherein the same-color portion determining unit determines a portion having a color different from a standard display color of the imaging information. 11. An electronic camera device for capturing an image of a subject and recording a captured image, a subject determining means for determining a subject part in the image, and a subject part determined by the subject determining means and imaging information relating to the image. And a size determining means for determining a display size of the imaging information so that the imaging information can be superimposed and displayed outside the subject portion with a size that does not overlap when displayed. Camera device. 12. An electronic camera apparatus for capturing an image of a subject and recording a captured image, comprising: an imaging information arranging unit for arranging imaging information related to the image in the captured image; An electronic camera device comprising: a display color determining unit that determines a display color such that a color of an image portion of a portion to be arranged is different from a display color of imaging information of the image. 13. An electronic camera device for capturing an image of a subject and recording the captured image, wherein a color portion for determining whether or not an image portion other than a standard display color of imaging information related to the image exists in the captured image. An electronic camera apparatus comprising: a determination unit; and imaging information arranging unit that arranges the imaging information in the image portion when the presence of the image portion is determined by the color portion identification unit. 14. A superimposed display, wherein it is determined whether or not substantially the same color portion exists in an image displayed on the display device, and when the substantially same color portion exists, superimposed display information is arranged in the portion. Information placement method. 15. A superimposed display wherein a subject portion in an image displayed on the display device is determined, and a display size of the superimposed display information is determined and arranged according to an area of the portion determined to be other than the subject portion. Image placement method. 16. When arranging superimposed display information on an image to be displayed on a display device, a color of an image portion where the superimposed display information is arranged is determined, and a display color of the superimposed information is different from a color of the image portion. The superimposed display information is characterized by the position method. 17. It is determined whether or not a substantially same color portion different from the standard display color of the superimposed display information exists in an image displayed on the display device, and the substantially same color portion different from the standard display color of the superimposed display information is determined. A method of arranging superimposed display information, wherein the superimposed display information is arranged in a portion when the information is present.