JP2006254389A - Imaging apparatus, and image reproducing apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology capable of simply generating a multi-value image of a principal purpose and a binary image for attachment of a character memo. <P>SOLUTION: A CCD 3 images an object and outputs imaged data. A DSP section 5 converts the imaged data into multi-value gradation image data. Further, e.g. a character board on which collateral information is written is imaged in addition, and the DSP section 5 converts the imaged data into binary gradation image data. The multi-value gradation image data and the binary gradation image data are stored in a memory card 11 in association with each other. When the stored multi-value gradation image data are designated by a switch section 13, the binary gradation image data in response to this designation are stored in a corresponding file of the multi-value gradation image data, and the resulting file is stored in the memory card as a binary image attached file. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging device such as a digital still camera to which character information can be added, an image playback device for playing back a captured image, and a program used in these devices.

In some cases, additional information may be added to the main image data when the image is taken with a digital camera.
For example, an image of a construction site, date, explanation of construction contents, and the like. There are techniques for adding information to the main image in the past. Many digital cameras have a voice recording function, and photography with voice memos in which voice data is attached to an image is also possible (see, for example, Patent Document 1). In addition, there is a technique in which a camera has a memory for storing information associated with an image, and information is selected by adding an operation to a captured image (for example, see Patent Document 2). A means for inputting characters by operating a button on the camera is also conceivable.

On the other hand, some digital cameras can convert a captured image into binary image data instead of converting it into multi-valued image data. A binary image is particularly suitable for photographing characters. If the pixel data of the multi-valued image data is larger than the average of the peripheral pixel data, it can be converted to binary gradation image data by setting it to “1”, and if it is smaller than “0”.
Japanese Patent Laid-Open No. 11-136623 Japanese Patent Laid-Open No. 2001-157025

However, if the additional information of the main image is audio data as in Patent Document 1, it takes time to listen to the additional information one by one. Moreover, inputting the data to be added into the memory as in Patent Document 2 restricts the contents of the additional data. Also, the button input operation of the camera when inputting additional data is complicated and unusable.
An object of the present invention is to make it possible to easily create a multi-value image (main image) as a main object and a binary image (attached image) for attaching a character memo.

  An image pickup apparatus according to a first aspect of the present invention is an image pickup means for picking up an image of a subject and outputting image pickup data, a first image processing means for converting the image pickup data into multi-value gradation image data, and binarizing the image pickup data. Second image processing means for converting to gradation image data, storage means for storing the multi-value gradation image data and binary gradation image data in association with each other, and the stored multi-value gradation image data or Specification means for designating binary gradation image data, and the multi-value gradation image data and binary gradation image data corresponding to each other according to the designation are stored in the same file and recorded as a binary image attachment file. And a binary image attachment recording means.

  According to a second aspect of the present invention, there is provided an image pickup apparatus according to the first aspect of the invention, further comprising display means for displaying an image being picked up or image data in the storage means, wherein the binary attached recording means is the designated When the multi-value gradation image data in the storage means is displayed on the display means, the image being picked up is displayed on a part of the display screen of the display means. The image is converted into binary gradation image data by the second image processing means, and the binary gradation image data is stored in the same file as the multi-value gradation image data being displayed and attached to the binary image. It is recorded as a file.

The image pickup apparatus according to a third aspect of the present invention is the image pickup apparatus according to the second aspect, wherein when the image being picked up is displayed on a part of the display screen, the display position of the image being picked up on a part of the display screen And changing means for changing at least one of the sizes.
According to a fourth aspect of the present invention, there is provided an image pickup apparatus according to any one of the first to third aspects, wherein the binary gradation image data is stored separately in the same file as the multi-value gradation image data. It records in the data area of this.

An image pickup apparatus according to a fifth aspect of the present invention provides the imaging apparatus according to any one of the first to third aspects, wherein the binary gradation image data is stored in the same file as the multi-value gradation image data. It is recorded in a separate data area.
An image pickup apparatus according to a sixth aspect of the present invention provides the image pickup apparatus according to any one of the first to fifth aspects, wherein the binary gradation image data is stored in the same file as the multi-value gradation image data. Binary gradation image data is synthesized and recorded on a part of the multi-value gradation image data.

An image pickup apparatus according to a seventh aspect of the present invention is the image pickup apparatus according to any one of the first to sixth aspects, further comprising character code input means for inputting a character code, and the input character code data and multi-value image data. Is stored in the binary image attachment file.
According to an eighth aspect of the present invention, there is provided an imaging apparatus according to any one of the first to seventh aspects, wherein code data is converted into specific code data from binary gradation image data in the binary image attached recording file. The converted code data and the multi-value image data are stored in the same file.

  An imaging apparatus according to a ninth aspect of the present invention is the imaging device according to any one of the first to eighth aspects, wherein the binary gradation image data is temporarily stored after imaging, and the temporarily stored binary data is stored. Selecting means for selecting whether or not to store gradation image data as the binary image attachment file in the storage means.

  An image reproduction apparatus according to a tenth aspect of the present invention is a binary image attachment storage means for storing multi-value gradation image data and binary gradation image data as a binary image attachment file, and a display means for displaying an image. , Reproducing the multi-value gradation image data of the binary image attachment file and displaying it on the display means, and displaying the binary image attachment file at that time, and the binary And selecting means for selecting whether or not to reproduce and display the binary image data attached to the image attachment file.

An image reproduction apparatus according to an eleventh aspect of the present invention is the image reproduction apparatus according to the tenth aspect, further comprising character code input means for inputting a character code, wherein the input character code data and multi-valued image data are stored in the binary image attachment file. It is characterized by storing.
An image reproduction apparatus according to a twelfth aspect of the invention is the image reproduction apparatus according to the tenth or eleventh aspect of the invention, wherein the code data is converted into specific code data from the binary gradation image data in the binary image attached recording file. The code data and the multi-value image data are stored in the same file.
The image reproduction device according to a thirteenth aspect of the present invention is the image reproduction device according to any one of the tenth to twelfth aspects, wherein the binary image attachment storage means is detachable from the image reproduction device.

  According to a fourteenth aspect of the present invention, there is provided a program for imaging a subject and outputting imaging data, first image processing for converting the imaging data into multi-value gradation image data, and binary gradation for the imaging data. Second image processing for conversion to image data; storage processing for storing the multi-value gradation image data and binary gradation image data in association with each other; and the stored multi-value gradation image data or binary scale A binary image in which multi-tone image data and binary tone image data corresponding to each other according to the designation are stored in the same file and recorded as a binary image attachment file. A program for causing a computer to execute an attached recording process.

  According to the fifteenth aspect of the invention, the multi-value gradation image data and the binary gradation image data reproduce and display the multi-value gradation image data in the binary image attachment file. A program for causing a computer to execute a reproduction display process for displaying that the image is displayed and a selection process for selecting whether to reproduce and display the binary image data attached to the binary image attachment file at the time of the display. It is.

  According to the inventions of claims 1 and 14, when it is desired to add information such as comments by characters to a still image file, a simple operation of photographing a multi-value image and a binary image is sufficient. And a complicated operation such as inputting characters by operating a button on the camera is not necessary, and usability is improved.

According to the second aspect of the present invention, since a binary image can be taken while confirming a multi-value image of an attachment destination file, there is no mistake.
According to the third aspect of the present invention, it is possible to determine in advance the layout when the attached image (binary image) is combined with the main image (multi-valued image), and the post-work can be saved.

According to the invention of claim 4, the main image and the attached image can be completely retained, and can be reused in later processing.
According to the invention of claim 5, the main image and the attached image can be seen at a glance and are easy to understand.

According to the sixth, tenth, and fifteenth inventions, a binary image can be reproduced and displayed automatically or by the user operating the image reproducing device while reproducing and displaying the main image.
According to the seventh and eleventh aspects of the present invention, the attached image can be made a smaller character code, and the storage capacity can be reduced. In addition, it is convenient for post-processing on a PC or the like.
According to the eighth and twelfth aspects of the present invention, by adding a specific code to the main image, it becomes convenient for post-processing on a PC.

According to the ninth aspect of the present invention, even if shooting of an attached image fails, the data can be canceled and shooting can be performed again.
According to the thirteenth aspect of the invention, the binary image attachment file can be recorded on a memory card or the like, which is convenient.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a digital camera according to an embodiment of the present invention.
The present embodiment provides a camera that can store a multi-value image (main image) of a main purpose and a binary image (attached image) for attaching a character memo in the same file. In addition, the character information desired to be added to the main image is created from binary image shooting data of the same camera and stored in the same file as the multi-valued image so that it can be easily created. Further, the present invention provides a device that can efficiently handle additional character information even on a PC or the like by converting the added binary image into a character code and storing it in the same file.

In FIG. 1, 1 is a lens, 2 is a mechanical shutter, 3 is a CCD as an image sensor,
4 is a CDS / AD unit that performs correlated double sampling and A / D conversion on the image pickup signal of the CCD 3, and 5 is a digital signal obtained by A / D conversion, which is converted into a luminance signal Y and color difference signals U and V. A DSP unit (digital signal processing unit) 6 for JPEG compression and a driver unit for driving a mechanical unit perform focus driving for driving the lens 1 and opening / closing control of the shutter 2. 7 is a CCD drive unit, 8 is a CPU that controls the entire camera, 9 is imaged image data, memory that temporarily stores read data from a file, 10 is a communication driver unit for the outside of the camera, and 11 is detachable from the camera It is a memory card.

  Reference numeral 12 denotes a display controller that converts the image signal processed by the DSP unit 5 so that it can be displayed on an LCD, a display unit that includes an LCD that displays the converted signal, 13 a switch unit operated by a user such as a shutter button, and 14 a camera. For example, the external device A to be imaged includes a charging circuit for charging a battery in the camera body. If the external device A has a display device, the display unit 12 may not be provided. Reference numeral 15 denotes an external device B connected to the external device A, for example, a PC (personal computer). Reference numeral 16 denotes an audio CODEC, which converts an analog audio signal from an input analog unit 18 (for example, a microphone) from A / D to the DSP unit 5 or outputs a digital audio signal from the DSP unit 5 by D / A conversion. It outputs to the analog part 19 (for example, speaker). Reference numeral 17 denotes a non-volatile memory that stores captured image files, recorded audio files, and holds shooting mode information and the like even when the camera is turned off.

FIG. 2 is a flowchart showing the main processing during recording, and FIG. 3 is a block diagram showing the configuration of the main processing unit 20 and the parallel processing unit 30.
3, each processing unit 21 to 29 of the main processing unit block 20 is a processing unit that executes processing in each step of the flowchart of FIG. For example, the SW determination processing (S1) of FIG. 2 is executed by the SW determination processing portion 21 of FIG. 3, and the operation mode determination processing (S2) of FIG. 2 is executed by the operation mode determination processing portion 22 of FIG. The parallel processing unit 30 includes a periodic timer interrupt processing unit 31 that periodically executes interrupt processing.

Next, the operation will be described.
As shown in FIGS. 2 and 3, in the present embodiment, there are a still image shooting mode for recording a multi-valued image (main image) and a character shooting mode for recording a binary image (attached image).
In this system, for example, SW (switch) information input by the periodic timer interrupt processing unit 31 every 20 ms is determined by the SW determination processing unit 21 (S1 in FIG. 2), and the information is sent to the operation mode determination processing unit 22. hand over. If there is no particularly valid SW confirmation input, a loop for repeating the SW determination process as an invalid operation is obtained. If there is a valid SW confirmation input, the operation mode determination unit processing unit 22 distributes the information to the first SW on operation, the second SW on operation, the file reproduction operation, and the display composition operation based on the information (S2).

  In the still image shooting mode or the character shooting mode, the imaging unit is driven, the imaging data is subjected to image processing, and displayed on the display unit 12 (monitoring display). The switch unit 13 in FIG. 1 has a shutter button. In the still image shooting mode, when the first SW of the shutter button is turned on, an AE / AF (automatic exposure control / automatic focus control) processing unit 23 performs processing. (S3). The CPU 8 moves the lens 1 by the driver unit 6 to adjust the focus. Further, the imaging data is evaluated by the DSP unit 5 and the exposure time value of the CCD 3 set in the CCD driving unit 7 is determined.

  2 and 3, the SW determination processing unit 21 (S1) and the operation mode determination processing unit 22 (S2) determine the first SW on process, and the AE / AF processing unit 23 processes (S3), and the process ends. After that, the process returns to the SW determination process. If there is no valid SW information, the loop is returned to the SW determination process without doing anything again. Next, when the second SW is turned on (S4), photographing / recording processing is performed. The CCD image data is processed by the DSP unit 5 from image processing to compression and written in the memory 3. Image processing and compression processing are different in the still image shooting mode and the character shooting mode.

  When a multi-value image is shot in the still image shooting mode, a still image recording process (S5) is performed. At the time of image processing, multi-tone luminance data and color data at the image position are generated from the R, G, and B data at each imaging position. These data are subjected to still image compression conversion such as JPEG, and a header is added to write this as a still image compressed file to the memory card 11 (S6). As an example, FIG. 4A shows a photograph of a person having a handwritten dial 40.

  In the character photographing mode, character recording processing (S7) is performed. The average luminance around each imaging position is used as a threshold value, and the luminance data at that image position is binarized (“1” if greater than the threshold value, “0” if smaller). This binarized data is compressed into binary data such as MMR which is also used in facsimile, and a binary compressed file is attached with a header, and this is written in the memory card 11 in association with the multi-valued image (S6). . In the example of FIG. 4B, only the dial 40 is photographed as a binary image. A normal still picture luminance signal and color signal are 16 bits per pixel. Since a binary image can represent each pixel with 1 bit, it is simply 1/16 of a multi-valued image. Further, the number of data can be further reduced by assigning codes according to the appearance frequency of the bit string pattern.

  In addition, the camera selects a file to be played back in the memory card in the playback frame number determination process (S8), and reads it into the memory 9 in the camera in the still playback process (S9). Is expanded and displayed on the display unit 12.

Next, embodiments will be described.
First, a captured still image file is selected and reproduced by the reproduction operation, and the display unit 12 performs still reproduction display of the captured image. Next, display composite processing (S10) of the photographed image and the binary image corresponding thereto is performed. As a result, as shown in FIG. 4C, the reduced monitoring image is displayed in a part of the reproduction display screen. The photographer puts an object to be photographed within the angle of view of the monitoring display (related to claim 2). Here, what is desired to be photographed refers to what is desired to be photographed as a binary image in relation to the still image being reproduced. For example, when the still image is an image of a construction site, the binary image is a blackboard or the like on which the process is written down. In the example of FIG. 4C, a still image obtained by photographing a person and a case where only the dial 40 is photographed before or after the photographing is illustrated.

  When the second SW is turned on in this state (S4), the character-attached photographing mode is automatically set, and the character recording process (S11) is performed. The processed character data is stored together in the same file as the still image data file in the memory 9 (S12), and is recorded in the memory card 9 as a still image file with characters (character attached file). 1 and claim 4).

  The composite display position at the time of the display composition processing in FIG. 4C can be changed in size and position from the switch unit 13 by the camera operator (related to claim 3). The size and position information can also be stored in the file header information of the character-added still image file. The character-attached file can be reproduced and displayed on the display unit 12 as a still image with characters by a camera or a playback device such as a personal computer after shooting. These playback devices can determine that the still image has characters from the file header and display that the characters have been added.

  In the example of FIG. 5A, the fact that a character is attached is displayed as MEMO (related to claim 6). When the text is attached, the image of the binary image can be reproduced and displayed as shown in FIG. 5B by operating the reproduction device automatically or by the user. The display position of the binary image can also be displayed based on the size and position at the time of image composition display at the time of shooting in the file header. In addition, the user can also operate the playback device in that state to generate a new still image image file in which the still image and the binary image are combined on the image (related to claim 5). Concerning the composition on the image, when the still image file with characters is input to the printing device, it may be composed on the printing device side.

  As a function of the playback device, a binary image can be recognized and converted into a character code or a specific corresponding code. The code may be, for example, a bar code (related to claim 8). If the captured binary image is not handwritten but printed in advance as a type, it can be correctly converted into a desired code. It is also possible to store the code information in a file together with still image data in place of the binary image data to make a still image with code. As a result, the data can be made smaller than the still image with characters, and the still image attached with the code can be searched by the code attached to the file by the playback device.

  Furthermore, it is possible to describe the contents of post-processing on a still image by character code. You can also classify captured images and post-process images from the code in the file on your computer. Note that the conversion to the code is not automatic, but it is also possible to input characters using the keyboard of the personal computer together with the display of the binary image as shown in FIG. 5 (c). ). In addition, the user may be able to select from the switch unit 13 of the camera whether or not to record the binary image data temporarily stored in the memory 9 after imaging, as a binary image attachment file in the nonvolatile memory 17. Thus, even if the shooting of the attached binary image fails, the shooting can be canceled and the shooting can be performed again (related to claim 9).

  The program for the CPU 8 to execute the processing based on the operation of the above-described embodiment constitutes a program according to the present invention. As a recording medium for recording the program, a semiconductor storage device, an optical and magnetic storage device, or the like can be used. By using such a program and recording medium in a system or the like having a configuration different from that of the above-described embodiment and causing the CPU to execute the program, substantially the same effects as those of the present invention can be obtained.

It is a block diagram which shows the structure of the digital camera by embodiment of this invention. It is a flowchart which shows the main process at the time of recording. It is a block diagram which shows the structure of a main process part and a parallel process part. It is a block diagram which shows the example of a display of the multi-value image at the time of imaging | photography, and a binary image. It is a block diagram which shows the example of a display of the multi-value image and binary image at the time of reproduction | regeneration.

Explanation of symbols

3 CCD
5 DSP section 8 CPU
9 Memory 11 Memory Card 12 Display Unit 13 Switch Unit 14 External Device A
15 External device B
17 Non-volatile memory 21 SW determination processing unit 22 Operation mode determination processing unit 24 Still image recording processing unit 25 Character recording processing unit 26 Display composition processing unit 28 Still reproduction processing unit 29 Card recording processing unit

Claims (15)

Imaging means for imaging a subject and outputting imaging data;
First image processing means for converting the imaging data into multi-value gradation image data;
Second image processing means for converting the imaging data into binary gradation image data;
Storage means for storing the multi-value gradation image data and the binary gradation image data in association with each other;
Designating means for designating the stored multi-value gradation image data or binary gradation image data;
A binary image attachment recording means for storing the multi-value gradation image data and the binary gradation image data corresponding to each other according to the designation in a same file and recording the binary image attachment file as a binary image attachment file; An imaging device. Providing a display means for displaying an image being imaged or image data in the storage means;
The binary attachment recording means displays the multi-value gradation image data in the designated storage means on the display means, and displays the image being captured on a part of the display screen of the display means, When shooting is performed in this state, the captured image is converted into binary gradation image data by the second image processing means, and the binary gradation image data is converted into the multi-value gradation image data being displayed. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is stored in the same file and recorded as a binary image attachment file.   When the image being captured is displayed on a part of the display screen, the display unit includes a changing unit that changes at least one of a display position and a size of the image being captured on a part of the display screen. The imaging device according to claim 2.   The imaging according to any one of claims 1 to 3, wherein the binary gradation image data is recorded in a separate data area when stored in the same file as the multi-value gradation image data. apparatus.   When the binary gradation image data is stored in the same file as the multi-value gradation image data, the binary gradation image data is synthesized and recorded on a part of the multi-value gradation image data. The imaging device according to any one of claims 1 to 3. Reproduction means for reproducing the multi-value gradation image data of the binary image attachment file and displaying it on the display means, and displaying that it is a binary image attachment file.
6. The display apparatus according to claim 1, further comprising selection means for selecting whether or not to reproduce and display the binary image data attached to the binary image attachment file at the time of the display. The imaging device described in 1.   7. The apparatus according to claim 1, further comprising a character code input means for inputting a character code, wherein the input character code data and multi-value image data are stored in the binary image attachment file. The imaging device described.   The code data is converted into specific code data from binary gradation image data in the binary image attached recording file, and the converted code data and multi-value image data are stored in the same file. The imaging device according to any one of 1 to 7.   Temporary storage means for temporarily storing the binary gradation image data after imaging, and selection means for selecting whether or not to record the temporarily stored binary gradation image data as the binary image attachment file in the storage means The imaging apparatus according to claim 1, wherein the imaging apparatus includes: Binary image attachment storage means in which multi-value gradation image data and binary gradation image data are stored as a binary image attachment file;
Display means for displaying an image;
Reproduction means for reproducing the multi-value gradation image data of the binary image attachment file and displaying it on the display means, and displaying that it is a binary image attachment file.
An image reproducing apparatus comprising: selection means for selecting whether or not to reproduce and display the binary image data attached to the binary image attachment file during the display.   11. The image reproducing apparatus according to claim 10, further comprising character code input means for inputting a character code, wherein the input character code data and multi-value image data are stored in the binary image attachment file.   The code data is converted into specific code data from binary gradation image data in the binary image attached recording file, and the converted code data and multi-value image data are stored in the same file. The image reproducing device according to 10 or 11.   The image reproduction apparatus according to any one of claims 10 to 12, wherein the binary image attachment storage unit is detachable from the image reproduction apparatus. Imaging processing for imaging a subject and outputting imaging data;
First image processing for converting the imaging data into multi-value gradation image data;
Second image processing for converting the imaging data into binary gradation image data;
A storage process for storing the multi-value gradation image data and the binary gradation image data in association with each other;
A designation process for designating the stored multi-value gradation image data or binary gradation image data;
A program for causing a computer to execute a binary image attachment recording process in which the multi-value gradation image data and the binary gradation image data corresponding to each other according to the designation are stored in the same file and recorded as a binary image attachment file. . Reproduction display processing for displaying multi-value gradation image data and binary gradation image data by reproducing and displaying the multi-value gradation image data in the binary image attachment file, and in this case displaying the binary image attachment file. When,
A program for causing a computer to execute selection processing for selecting whether or not to reproduce and display binary image data attached to the binary image attachment file at the time of display.

Images